Markdown-Native Agent Memory and Skill Retrieval with FAISS: Building Persistent AI Systems without a Traditional Database

This paper presents a practical architecture for persistent AI assistants in which long-term memory, skill metadata, and agent operating context are stored as ordinary Markdown files rather than rows in a relational, document, or vector database. In OctaMind, the canonical state for each assistant lives in human-readable files such as working_memory.md, episodic_memory.md, semantic_memory.md, personality.md, habits.md, self_reflection.md, skills.md, and skill_context.md. Semantic retrieval is provided by lightweight FAISS indexes built on demand from these files using SentenceTransformer embeddings, while the files themselves remain the sole source of truth. The implementation couples a six-layer memory system, periodic background consolidation, semantic episodic recall, and semantic tool selection without introducing a traditional database tier. This work argues that Markdown-native architectures offer strong advantages for small-to-medium AI systems, including inspectability, debuggability, versionability, portability, and low operational overhead.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-03-14
DOI
https://doi.org/10.5281/zenodo.19018414
Primary Topic
AI-based Problem Solving and Planning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Markdown-Native Agent Memory and Skill Retrieval with FAISS: Building Persistent AI Systems without a Traditional Database

Hrishikesh Maluskar
Zenodo (CERN European Organization for Nuclear Research)
AI-based Problem Solving and Planning
article

Markdown-Native Agent Memory and Skill Retrieval with FAISS: Building Persistent AI Systems without a Traditional Database

Hrishikesh Maluskar
article en

Abstract

This paper presents a practical architecture for persistent AI assistants in which long-term memory, skill metadata, and agent operating context are stored as ordinary Markdown files rather than rows in a relational, document, or vector database. In OctaMind, the canonical state for each assistant lives in human-readable files such as working_memory.md, episodic_memory.md, semantic_memory.md, personality.md, habits.md, self_reflection.md, skills.md, and skill_context.md. Semantic retrieval is provided by lightweight FAISS indexes built on demand from these files using SentenceTransformer embeddings, while the files themselves remain the sole source of truth. The implementation couples a six-layer memory system, periodic background consolidation, semantic episodic recall, and semantic tool selection without introducing a traditional database tier. This work argues that Markdown-native architectures offer strong advantages for small-to-medium AI systems, including inspectability, debuggability, versionability, portability, and low operational overhead.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 26%
AI-based Problem Solving and Planning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.