From Pixels to Preservation: The Power of Large Vision Models in Heritage Content Understanding
Preserving cultural heritage is essential for maintaining the legacy and history of human civilization, but it presents challenges in managing vast amounts of historical artifacts and documents. Recent advances in artificial intelligence, especially large vision models (LVMs), offer unprecedented capabilities for understanding and preserving heritage content. This keynote will explore how LVMs are revolutionizing image analysis, encompassing advancements in architecture design, multimodal learning, and image generation. We will delve into specific applications such as object detection for identifying artifacts, pose estimation for interpreting historical depictions, text detection and recognition for deciphering ancient scripts, and visual grounding for contextualizing objects within textual descriptions. By leveraging the power of LVMs, we can gain deeper insights into cultural heritage, enabling better preservation strategies and fostering a richer understanding of our past for future generations. The future holds immense promise for LVMs in this domain, with potential applications in automating restoration processes, identifying damage at an early stage, uncovering hidden stories from historical artifacts, and creating engaging, interactive experiences for wider audiences.
Authors
- Jing Zhang (ORCID: https://orcid.org/0000-0001-6595-7661)
Institutions
- The University of Sydney (AU)
Publication Details
- Published
- 2024-10-08
- DOI
- https://doi.org/10.1145/3689094.3689470
- Citations
- 1
- Primary Topic
- 3D Surveying and Cultural Heritage
- Type
- article
- Field-Weighted Citation Impact
- 0.83