Re-extraction and analysis protocol: What the evaluations say, an LLM synthesis of Australian economic governance programs in Southeast Asia and the Pacific
Protocol for the second extraction of findings from DFAT's published evaluations of economic governance programs in Southeast Asia and the Pacific, and the analysis built on it. Version 1.2, dated 31 October 2026 (version 1, 27 October 2026). Timing of this deposit: deposited on 4 November 2026. The document is dated before the full extraction, but this deposit came after it. Extraction ran from 31 October to 1 November 2026, and model proposals for candidate claims, verification and family coding were also run on 1 November. The claim list has not been frozen and the counting step has not been run. Main departures logged so far: inventory run on Claude Sonnet rather than Claude Haiku; a third extraction pass on all 71 documents rather than only those failing the stopping rule. The decision log recording every departure will be deposited with the paper (Section 13).
Authors
- Sam Porter (ORCID: https://orcid.org/0000-0002-1815-4716)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-04
- DOI
- https://doi.org/10.5281/zenodo.23936688
- Primary Topic
- Evaluation and Performance Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00