Open-Source Intelligence Analysis Method Based on Fine-Tuned Large Models and Knowledge Graphs

Open-Source Intelligence (OSINT) has become a pivotal component of national security and military intelligence, given that up to 80–90% of intel used by agencies is derived from public sources. However, the massive volume and heterogeneity of open-source data pose challenges for timely, accurate analysis. This paper proposes a concrete methodology for OSINT analysis that synergistically combines a fine-tuned large AI language model with a structured knowledge graph. The fine-tuned model (a transformer-based large language model) is specifically adapted to extract entities, relations, and events from unstructured data and populate a dynamic knowledge graph which enables structured reasoning and querying. We detail the system architecture, including the model’s training process, knowledge graph construction, and the integration framework that allows iterative refinement of intelligence through retrieval-augmented generation. To illustrate the approach, we present a case study in a national security context, where our method builds an intelligence knowledge graph from open sources and uses it to answer complex queries about a hypothetical conflict scenario. Experimental results demonstrate that our fine-tuned model achieves high accuracy on OSINT-specific extraction tasks and that the knowledge graph enhances analytical depth by revealing hidden connections. The proposed OSINT analysis method offers a scalable and actionable framework, improving both the precision and recall of intelligence insights while ensuring they are organized for efficient analyst review.

Authors

Institutions

Publication Details

Published
2025-08-08
DOI
https://doi.org/10.1109/iaeac65194.2025.11165922
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Open-Source Intelligence Analysis Method Based on Fine-Tuned Large Models and Knowledge Graphs

Yang Su
Advanced Computational Techniques and Applications
article

Open-Source Intelligence Analysis Method Based on Fine-Tuned Large Models and Knowledge Graphs

Yang Su
article en

Abstract

Open-Source Intelligence (OSINT) has become a pivotal component of national security and military intelligence, given that up to 80–90% of intel used by agencies is derived from public sources. However, the massive volume and heterogeneity of open-source data pose challenges for timely, accurate analysis. This paper proposes a concrete methodology for OSINT analysis that synergistically combines a fine-tuned large AI language model with a structured knowledge graph. The fine-tuned model (a transformer-based large language model) is specifically adapted to extract entities, relations, and events from unstructured data and populate a dynamic knowledge graph which enables structured reasoning and querying. We detail the system architecture, including the model’s training process, knowledge graph construction, and the integration framework that allows iterative refinement of intelligence through retrieval-augmented generation. To illustrate the approach, we present a case study in a national security context, where our method builds an intelligence knowledge graph from open sources and uses it to answer complex queries about a hypothetical conflict scenario. Experimental results demonstrate that our fine-tuned model achieves high accuracy on OSINT-specific extraction tasks and that the knowledge graph enhances analytical depth by revealing hidden connections. The proposed OSINT analysis method offers a scalable and actionable framework, improving both the precision and recall of intelligence insights while ensuring they are organized for efficient analyst review.

Chinese People's Armed Police Force Engineering University (CN)
Openalex Percentile: Top 86%
Advanced Computational Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.