Re-extraction and analysis protocol: What the evaluations say, an LLM synthesis of Australian economic governance programs in Southeast Asia and the Pacific

Protocol for the second extraction of findings from DFAT's published evaluations of economic governance programs in Southeast Asia and the Pacific, and the analysis built on it. Version 1.2, dated 31 October 2026 (version 1, 27 October 2026). Timing of this deposit: deposited on 4 November 2026. The document is dated before the full extraction, but this deposit came after it. Extraction ran from 31 October to 1 November 2026, and model proposals for candidate claims, verification and family coding were also run on 1 November. The claim list has not been frozen and the counting step has not been run. Main departures logged so far: inventory run on Claude Sonnet rather than Claude Haiku; a third extraction pass on all 71 documents rather than only those failing the stopping rule. The decision log recording every departure will be deposited with the paper (Section 13).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23936688
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Re-extraction and analysis protocol: What the evaluations say, an LLM synthesis of Australian economic governance programs in Southeast Asia and the Pacific

Sam Porter
Zenodo (CERN European Organization for Nuclear Research)
Evaluation and Performance Assessment
article

Re-extraction and analysis protocol: What the evaluations say, an LLM synthesis of Australian economic governance programs in Southeast Asia and the Pacific

Sam Porter
article en

Abstract

Protocol for the second extraction of findings from DFAT's published evaluations of economic governance programs in Southeast Asia and the Pacific, and the analysis built on it. Version 1.2, dated 31 October 2026 (version 1, 27 October 2026). Timing of this deposit: deposited on 4 November 2026. The document is dated before the full extraction, but this deposit came after it. Extraction ran from 31 October to 1 November 2026, and model proposals for candidate claims, verification and family coding were also run on 1 November. The claim list has not been frozen and the counting step has not been run. Main departures logged so far: inventory run on Claude Sonnet rather than Claude Haiku; a third extraction pass on all 71 documents rather than only those failing the stopping rule. The decision log recording every departure will be deposited with the paper (Section 13).

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 13%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon