Splatsearch: Real Time Semantic Digital Twin

To meet the demand for high-fidelity spatial awareness in robotics and augmented reality (AR), this project introduces a unified framework for generating real-time, linguistically-aware digital twins.Traditional Simultaneous Localization and Mapping (SLAM) systems typically suffer from "semantic blindness"-they capture 3D geometry but lack object context.Our system bridges the gap between spatial data and human language by integrating SplaTAM for dense Gaussian Splatting, LangSplat for open-vocabulary embedding, and Online LangSplat for high-speed encoding.The architecture leverages a robust client-server model where an iPhone streams synchronized RGB-D data directly to a GPU-accelerated backend.This setup enables real-time 3D reconstruction at over 45 frames per second.During this generation phase, the system dynamically assigns CLIP-based language features to millions of 3D Gaussians.The resulting digital twin is not only photorealistic but fully searchable via natural language queries.Users can seamlessly localize and identify specific objects within previously unknown environments with remarkable semantic accuracy.By eliminating the latency gap between mapping and understanding, this research delivers a scalable, highly efficient solution perfectly suited for advanced smart-home automation and assistive navigation technologies.

Authors

Institutions

Publication Details

Journal
IJARCCE
Published
2026-11-18
DOI
https://doi.org/10.17148/ijarcce.2026.1511150
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Splatsearch: Real Time Semantic Digital Twin

M Madhushree, N Chandana, H Tilak, Arfain Sultana et al.
2 links
IJARCCE
Robotics and Sensor-Based Localization
article

Splatsearch: Real Time Semantic Digital Twin

M Madhushree, N Chandana, H Tilak, Arfain Sultana, Kruthika S
article en

Abstract

To meet the demand for high-fidelity spatial awareness in robotics and augmented reality (AR), this project introduces a unified framework for generating real-time, linguistically-aware digital twins.Traditional Simultaneous Localization and Mapping (SLAM) systems typically suffer from "semantic blindness"-they capture 3D geometry but lack object context.Our system bridges the gap between spatial data and human language by integrating SplaTAM for dense Gaussian Splatting, LangSplat for open-vocabulary embedding, and Online LangSplat for high-speed encoding.The architecture leverages a robust client-server model where an iPhone streams synchronized RGB-D data directly to a GPU-accelerated backend.This setup enables real-time 3D reconstruction at over 45 frames per second.During this generation phase, the system dynamically assigns CLIP-based language features to millions of 3D Gaussians.The resulting digital twin is not only photorealistic but fully searchable via natural language queries.Users can seamlessly localize and identify specific objects within previously unknown environments with remarkable semantic accuracy.By eliminating the latency gap between mapping and understanding, this research delivers a scalable, highly efficient solution perfectly suited for advanced smart-home automation and assistive navigation technologies.

IJARCCEVol. 15(11)
East West Institute of Technology (IN)
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon