Building Multimodal Knowledge Graphs: Automation for Enterprise Integration

As enterprises increasingly aim to incorporate artificial intelligence into their workflows to tackle complex, multimodal tasks, the demand for intelligent, robust, and trustworthy systems is paramount. While multimodal large language models offer initial capabilities for processing diverse data streams, their dependence on embedding-based representations limit their effectiveness in delivering semantically grounded explanations and reasoning, as well as qualities essential for enterprise-grade applications. Neurosymbolic approaches provide a promising alternative by enabling traceable, context-aware decision making. However, constructing enterprise-level multimodal knowledge graphs (MMKGs) that enable neurosymbolic approaches remains largely impractical. Although prior efforts have explored MMKG construction, they fall short in addressing the scalability, modularity, and integration that are necessary for any enterprise-grade application. We present a fully automated MMKG construction framework tailored to real-world enterprise environments. Our system features a modular, self-refining lifecycle with a support for human-in-the-loop feedback, enabling scalable, cost-effective, and task-aligned MMKG generation. We demonstrate the practical value of our framework through a real-world case study, showcasing its ability to transform unstructured multimodal data into actionable, semantically grounded knowledge assets for enterprise use.

Authors

Institutions

Publication Details

Journal
IEEE Internet Computing
Published
2025-05-01
DOI
https://doi.org/10.1109/mic.2025.3588546
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Building Multimodal Knowledge Graphs: Automation for Enterprise Integration

Revathy Venkataramanan, Hong Yung Yip, Ritvik Garimella
IEEE Internet Computing
Semantic Web and Ontologies
article

Building Multimodal Knowledge Graphs: Automation for Enterprise Integration

Revathy Venkataramanan, Hong Yung Yip, Ritvik Garimella
article en

Abstract

As enterprises increasingly aim to incorporate artificial intelligence into their workflows to tackle complex, multimodal tasks, the demand for intelligent, robust, and trustworthy systems is paramount. While multimodal large language models offer initial capabilities for processing diverse data streams, their dependence on embedding-based representations limit their effectiveness in delivering semantically grounded explanations and reasoning, as well as qualities essential for enterprise-grade applications. Neurosymbolic approaches provide a promising alternative by enabling traceable, context-aware decision making. However, constructing enterprise-level multimodal knowledge graphs (MMKGs) that enable neurosymbolic approaches remains largely impractical. Although prior efforts have explored MMKG construction, they fall short in addressing the scalability, modularity, and integration that are necessary for any enterprise-grade application. We present a fully automated MMKG construction framework tailored to real-world enterprise environments. Our system features a modular, self-refining lifecycle with a support for human-in-the-loop feedback, enabling scalable, cost-effective, and task-aligned MMKG generation. We demonstrate the practical value of our framework through a real-world case study, showcasing its ability to transform unstructured multimodal data into actionable, semantically grounded knowledge assets for enterprise use.

IEEE Internet ComputingVol. 29(3)
University of South Carolina (US)
National Science Foundation
Openalex Percentile: Top 88%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Building Multimodal Knowledge Graphs: Automation for Enterprise Integration — Revathy Venkataramanan, Hong Yung Yip, et al. · IEEE Internet Computing (2025) | TGRS Research Map | TGRS