Collaborative Intelligence in Sequential Experiments: A Human-in-the-Loop Framework for Drug Discovery

Drug discovery is a complex process that involves sequentially screening and examining a vast array of molecules to identify those with the target properties. This process faces challenges because of the vast search space, the rarity of target molecules, and constraints imposed by limited data and experimental budgets. To overcome these challenges, we propose a human-centered human–algorithm collaboration framework. Notably, both the algorithm and humans have substantial knowledge gaps. The algorithm proposes, and human experts retain decision rights to approve, revise, or override. Our design artifact leverages dual-process theory for attention management, surfaces meta-knowledge as a shared state for coordination, and optimizes a joint team objective. In real-world drug discovery tasks, the human–AI team consistently outperforms all baselines, including human-only and AI-only methods. This demonstrates complementary performance. These findings illustrate that the optimal use of AI in complex decision-making environments is to augment, rather than replace, human expertise. Managers should balance AI integration with the cultivation of deep domain expertise, ensuring that technology enhances decisions without eroding uniquely human strengths. For practice and policy: preserve human agency with clear decision rights, make model uncertainty explicit, and use AI to route scarce expert attention to the most informative experiments.

Authors

Institutions

Publication Details

Journal
Information Systems Research
Published
2025-12-03
DOI
https://doi.org/10.1287/isre.2024.1154
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Collaborative Intelligence in Sequential Experiments: A Human-in-the-Loop Framework for Drug Discovery

Zeyu Zheng, Hua Cheng, Jinghai He, Yingfei Wang
Information Systems Research
Computational Drug Discovery Methods
article

Collaborative Intelligence in Sequential Experiments: A Human-in-the-Loop Framework for Drug Discovery

Zeyu Zheng, Hua Cheng, Jinghai He, Yingfei Wang
article en

Abstract

Drug discovery is a complex process that involves sequentially screening and examining a vast array of molecules to identify those with the target properties. This process faces challenges because of the vast search space, the rarity of target molecules, and constraints imposed by limited data and experimental budgets. To overcome these challenges, we propose a human-centered human–algorithm collaboration framework. Notably, both the algorithm and humans have substantial knowledge gaps. The algorithm proposes, and human experts retain decision rights to approve, revise, or override. Our design artifact leverages dual-process theory for attention management, surfaces meta-knowledge as a shared state for coordination, and optimizes a joint team objective. In real-world drug discovery tasks, the human–AI team consistently outperforms all baselines, including human-only and AI-only methods. This demonstrates complementary performance. These findings illustrate that the optimal use of AI in complex decision-making environments is to augment, rather than replace, human expertise. Managers should balance AI integration with the cultivation of deep domain expertise, ensuring that technology enhances decisions without eroding uniquely human strengths. For practice and policy: preserve human agency with clear decision rights, make model uncertainty explicit, and use AI to route scarce expert attention to the most informative experiments.

Information Systems Research
Shanghai Jiao Tong University (CN), University of Washington (US), University of California, Berkeley (US)
Openalex Percentile: Top 62%
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.