A multimodal agent for ceramic management via LLM-driven knowledge and visual synergy

Ceramic heritage digitization has produced heterogeneous textual, visual, and structured data, while existing frameworks remain limited in structured extraction, fine-grained visual grounding, and evidence-based reasoning. Therefore, a multimodal ceramic analysis agent (CeramicAgent) is proposed, which integrates schema-constrained information extraction, high-quality visual segmentation based on the High-Quality Segment Anything Model (HQ-SAM), and graph-guided reasoning that connects textual, visual, and historical evidence. Experiments on a Palace Museum ceramic dataset show improved attribute extraction, reliable localization of micro-features, and coherent answers grounded in retrieved knowledge paths. The results indicate that the coordinated use of language, vision, and structured knowledge can support expert-oriented analysis of ancient ceramics, particularly when interpretation depends on degraded surface evidence, specialized terminology, and uncertain historical relations.

Authors

Institutions

Publication Details

Journal
npj Heritage Science
Published
2026-09-04
DOI
https://doi.org/10.1038/s40494-026-02868-y
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multimodal agent for ceramic management via LLM-driven knowledge and visual synergy

Jingyan Qin, Yuexin Huang, Bin Du
npj Heritage Science
Augmented Reality Applications
article

A multimodal agent for ceramic management via LLM-driven knowledge and visual synergy

Jingyan Qin, Yuexin Huang, Bin Du
article en

Abstract

Ceramic heritage digitization has produced heterogeneous textual, visual, and structured data, while existing frameworks remain limited in structured extraction, fine-grained visual grounding, and evidence-based reasoning. Therefore, a multimodal ceramic analysis agent (CeramicAgent) is proposed, which integrates schema-constrained information extraction, high-quality visual segmentation based on the High-Quality Segment Anything Model (HQ-SAM), and graph-guided reasoning that connects textual, visual, and historical evidence. Experiments on a Palace Museum ceramic dataset show improved attribute extraction, reliable localization of micro-features, and coherent answers grounded in retrieved knowledge paths. The results indicate that the coordinated use of language, vision, and structured knowledge can support expert-oriented analysis of ancient ceramics, particularly when interpretation depends on degraded surface evidence, specialized terminology, and uncertain historical relations.

npj Heritage Science
Northwestern Polytechnical University (CN), University of Science and Technology Beijing (CN)
Fundamental Research Funds for the Central Universities
Industry, innovation and infrastructure
Openalex Percentile: Top 12%
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.