A multimodal agent for ceramic management via LLM-driven knowledge and visual synergy
Ceramic heritage digitization has produced heterogeneous textual, visual, and structured data, while existing frameworks remain limited in structured extraction, fine-grained visual grounding, and evidence-based reasoning. Therefore, a multimodal ceramic analysis agent (CeramicAgent) is proposed, which integrates schema-constrained information extraction, high-quality visual segmentation based on the High-Quality Segment Anything Model (HQ-SAM), and graph-guided reasoning that connects textual, visual, and historical evidence. Experiments on a Palace Museum ceramic dataset show improved attribute extraction, reliable localization of micro-features, and coherent answers grounded in retrieved knowledge paths. The results indicate that the coordinated use of language, vision, and structured knowledge can support expert-oriented analysis of ancient ceramics, particularly when interpretation depends on degraded surface evidence, specialized terminology, and uncertain historical relations.
Authors
- Jingyan Qin (ORCID: https://orcid.org/0000-0002-4101-4316)
- Yuexin Huang
- Bin Du
Institutions
- Northwestern Polytechnical University (CN)
- University of Science and Technology Beijing (CN)
Publication Details
- Journal
- npj Heritage Science
- Published
- 2026-09-04
- DOI
- https://doi.org/10.1038/s40494-026-02868-y
- Primary Topic
- Augmented Reality Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Fundamental Research Funds for the Central Universities