AI-Native Development Frameworks: A Comparison by AI Assessors

This study examines how three independent model-generated assessments describe the documented coverage of different AI frameworks for software-engineering and delivery. One framework was noted as to be included in the Prompt (IntDEx v5) and the other frameworks were picked by the models on what they consider as more relevant and mature at time, according to the prompt instructions. In the prompt, the guideline to not favor any of the models and especially IntDEx (to the extent that IntDEx assessment may be considered stricter to the other frameworks) was provided. The selected models for the evaluation have been chosen based on what could be considered state-of-the-art at time, and are from three different model families to increase independency. The research material includes an evaluation prompt and three assessment records, retained unchanged in Annex A DATA. A descriptive secondary analysis extracted comparison selections, assessment criteria, scores on an ordered scale, evidence statements and stated limitations, and checked the arithmetic of the reported totals. IntDEx ranked first within all three assessments, with reported scores of 67/80 (83.75%), 53/80 (66.25%) and 63/75 (84%). The AI experts (assessors) selected different frameworks to compare and used different criteria and scoring standards. This is a design choice result. Their totals therefore do not form a common benchmark. The author deliberatively did not intervene in any phase of the AI expert’s assessment. The records match (for IntDEx) comparatively strong treatment of human accountability, the origin and traceability of evidence and delivery-engine governance, while identifying limited empirical validation. The broader delivery scoring additionally identifies weaker IntDEx product discovery, application architecture and application operations. These findings describe the AI expert judgments rather than independently verified framework capabilities or demonstrated effectiveness. The main contribution is a transparent account of agreement, differences in assessment methods and limits of the evidence in model-generated comparative assessment. A common more detailed evaluation framework registered in advance, versioned references and human review of each AI assessor’s results are proposed as requirements for a later validation study.

Authors

Publication Details

Journal
Figshare
Published
2026-11-07
DOI
https://doi.org/10.6084/m9.figshare.34946623
Primary Topic
Software Engineering Techniques and Practices
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

AI-Native Development Frameworks: A Comparison by AI Assessors

Spyridon Ktenas
2 links
Figshare
Software Engineering Techniques and Practices
preprint

AI-Native Development Frameworks: A Comparison by AI Assessors

Spyridon Ktenas
preprint en

Abstract

This study examines how three independent model-generated assessments describe the documented coverage of different AI frameworks for software-engineering and delivery. One framework was noted as to be included in the Prompt (IntDEx v5) and the other frameworks were picked by the models on what they consider as more relevant and mature at time, according to the prompt instructions. In the prompt, the guideline to not favor any of the models and especially IntDEx (to the extent that IntDEx assessment may be considered stricter to the other frameworks) was provided. The selected models for the evaluation have been chosen based on what could be considered state-of-the-art at time, and are from three different model families to increase independency. The research material includes an evaluation prompt and three assessment records, retained unchanged in Annex A DATA. A descriptive secondary analysis extracted comparison selections, assessment criteria, scores on an ordered scale, evidence statements and stated limitations, and checked the arithmetic of the reported totals. IntDEx ranked first within all three assessments, with reported scores of 67/80 (83.75%), 53/80 (66.25%) and 63/75 (84%). The AI experts (assessors) selected different frameworks to compare and used different criteria and scoring standards. This is a design choice result. Their totals therefore do not form a common benchmark. The author deliberatively did not intervene in any phase of the AI expert’s assessment. The records match (for IntDEx) comparatively strong treatment of human accountability, the origin and traceability of evidence and delivery-engine governance, while identifying limited empirical validation. The broader delivery scoring additionally identifies weaker IntDEx product discovery, application architecture and application operations. These findings describe the AI expert judgments rather than independently verified framework capabilities or demonstrated effectiveness. The main contribution is a transparent account of agreement, differences in assessment methods and limits of the evidence in model-generated comparative assessment. A common more detailed evaluation framework registered in advance, versioned references and human review of each AI assessor’s results are proposed as requirements for a later validation study.

Figshare
Software Engineering Techniques and Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon