RT-Core Accelerated Semantic Memory Retrieval for Local AI Systems

We demonstrate 210x average speedup over linear semantic memory search by projecting high-dimensional embeddings into 3D geometric space and using BVH traversal — the algorithm executed by idle RT Cores in consumer GPUs. Tested on real sentence embeddings with 48% Recall@10, improving to near-100% with a re-ranking step. Results obtained on an RTX 3070 using CPU KDTree as RT Core proxy. Conservative hardware estimates suggest 1,000x-3,000x speedup with true RT Core traversal.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-18
DOI
https://doi.org/10.5281/zenodo.20263093
Primary Topic
Graph Theory and Algorithms
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

RT-Core Accelerated Semantic Memory Retrieval for Local AI Systems

Mohamed Mahmoud Ahmed Mohamed
Zenodo (CERN European Organization for Nuclear Research)
Graph Theory and Algorithms
preprint

RT-Core Accelerated Semantic Memory Retrieval for Local AI Systems

Mohamed Mahmoud Ahmed Mohamed
preprint en

Abstract

We demonstrate 210x average speedup over linear semantic memory search by projecting high-dimensional embeddings into 3D geometric space and using BVH traversal — the algorithm executed by idle RT Cores in consumer GPUs. Tested on real sentence embeddings with 48% Recall@10, improving to near-100% with a re-ranking step. Results obtained on an RTX 3070 using CPU KDTree as RT Core proxy. Conservative hardware estimates suggest 1,000x-3,000x speedup with true RT Core traversal.

Zenodo (CERN European Organization for Nuclear Research)
Graph Theory and Algorithms
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

RT-Core Accelerated Semantic Memory Retrieval for Local AI Systems — Mohamed Mahmoud Ahmed Mohamed · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS