From Execution to Discovery : Physical Verification as the Key Gap in AI Agents for Science

Why can AI agents operate reliably in digital environments such as software development yet still struggle to achieve autonomous scientific discovery? We argue that this gap reflects not only limitations in model capability but also differences in how agent capabilities are externalized and how reliably environments can verify the consequences of agent actions. In this survey, we trace the technical evolution of AI agents and propose a three-stage framework of capability externalization: reasoning externalization makes knowledge, memory, and intermediate inferences inspectable; execution externalization makes tool use and long-horizon workflows governable; and world-interaction externalization integrates environmental evidence into hypothesis revision and action selection. Materials discovery provides a demanding testbed for all three stages, spanning literature-grounded hypothesis generation, computational design, automated experimentation, and iterative knowledge updating. Although agents can increasingly complete predefined research workflows, workflow automation alone does not constitute scientific discovery. Sustained autonomy requires agents to assess whether new observations support or challenge a hypothesis and to select subsequent experiments accordingly. We therefore identify environmental verifiability as a central systems constraint on agent autonomy: the extent to which an environment can translate actions into timely, attributable, reproducible, and affordable evidence. This perspective positions physical verification capacity as a key scaling dimension for autonomous scientific discovery.

Authors

Institutions

Publication Details

Journal
ChemRxiv
Published
2026-11-03
DOI
https://doi.org/10.26434/chemrxiv.15011571/v1
Primary Topic
Machine Learning in Materials Science
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

From Execution to Discovery : Physical Verification as the Key Gap in AI Agents for Science

Bin Cao, Tongyi Zhang, Yixuan Zhang
ChemRxiv
Machine Learning in Materials Science
preprint

From Execution to Discovery : Physical Verification as the Key Gap in AI Agents for Science

Bin Cao, Tongyi Zhang, Yixuan Zhang
preprint en

Abstract

Why can AI agents operate reliably in digital environments such as software development yet still struggle to achieve autonomous scientific discovery? We argue that this gap reflects not only limitations in model capability but also differences in how agent capabilities are externalized and how reliably environments can verify the consequences of agent actions. In this survey, we trace the technical evolution of AI agents and propose a three-stage framework of capability externalization: reasoning externalization makes knowledge, memory, and intermediate inferences inspectable; execution externalization makes tool use and long-horizon workflows governable; and world-interaction externalization integrates environmental evidence into hypothesis revision and action selection. Materials discovery provides a demanding testbed for all three stages, spanning literature-grounded hypothesis generation, computational design, automated experimentation, and iterative knowledge updating. Although agents can increasingly complete predefined research workflows, workflow automation alone does not constitute scientific discovery. Sustained autonomy requires agents to assess whether new observations support or challenge a hypothesis and to select subsequent experiments accordingly. We therefore identify environmental verifiability as a central systems constraint on agent autonomy: the extent to which an environment can translate actions into timely, attributable, reproducible, and affordable evidence. This perspective positions physical verification capacity as a key scaling dimension for autonomous scientific discovery.

ChemRxiv
Shanghai University (CN)
Machine Learning in Materials Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
From Execution to Discovery : Physical Verification as the Key Gap in AI Agents for Science — Bin Cao, Tongyi Zhang, et al. · ChemRxiv (2026) | TGRS Research Map | TGRS