Extracting infromation from text using an LLM model – first tests

This work investigates the use of Large Language Models (LLMs) to convert unstructured natural‑language instructions into structured JSON metadata suitable for scientific workflows. The system architecture combines a locally executed LLM via Ollama, a .NET Web API responsible for prompting and validation, and a lightweight console client. The processing pipeline operates in two stages: a linguistic normalization step that translates operator input into clear, unambiguous English, followed by schema‑guided extraction that enforces strict JSON structure. Through iterative prompt engineering, the approach achieves deterministic, schema‑compliant output while avoiding free text and hallucinated fields. Experiments show that smaller, instruction‑obedient models such as Phi‑3 provide the most reliable behavior under strong constraints. The resulting workflow is robust, offline‑capable, and well‑suited to institutional environments where reproducibility and metadata quality are essential. Future extensions may include schema expansion, ontology integration, and confidence scoring.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-03-23
DOI
https://doi.org/10.5281/zenodo.19184107
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Extracting infromation from text using an LLM model – first tests

Francesco Carraro
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
article

Extracting infromation from text using an LLM model – first tests

Francesco Carraro
article en

Abstract

This work investigates the use of Large Language Models (LLMs) to convert unstructured natural‑language instructions into structured JSON metadata suitable for scientific workflows. The system architecture combines a locally executed LLM via Ollama, a .NET Web API responsible for prompting and validation, and a lightweight console client. The processing pipeline operates in two stages: a linguistic normalization step that translates operator input into clear, unambiguous English, followed by schema‑guided extraction that enforces strict JSON structure. Through iterative prompt engineering, the approach achieves deterministic, schema‑compliant output while avoiding free text and hallucinated fields. Experiments show that smaller, instruction‑obedient models such as Phi‑3 provide the most reliable behavior under strong constraints. The resulting workflow is robust, offline‑capable, and well‑suited to institutional environments where reproducibility and metadata quality are essential. Future extensions may include schema expansion, ontology integration, and confidence scoring.

Zenodo (CERN European Organization for Nuclear Research)
National Institute for Astrophysics (IT)
Quality Education
Openalex Percentile: Top 13%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Extracting infromation from text using an LLM model – first tests — Francesco Carraro · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS