Autonomous artificial intelligence, scientific research, and human values

During the initial stage of AI's incorporation into scientific research, AI systems have functioned predominantly as tools under direct human supervision and control. However, AI incorporation into scientific research is now entering a stage in which AI Agents perform research tasks with partial autonomy while remaining under human supervision and control. In the not-too-distant future, a third stage may arise when autonomous AI systems conduct their own research and generate knowledge without human supervision or control. While the second and third stages of AI-augmented research may offer substantial benefits for science and society, they also create novel ethical issues, including (1) Conducting immoral research that may harm humans and other forms of life; (2) Increasing rate of biased, erroneous and deceptive research; (3) Confidentiality challenges; (4) Overreliance on AI; (5) Diffusion of responsibility and accountability; (6) Deskilling; (7) Job losses; (8) AI-generated research beyond human comprehension; and (9) Erosion of trust. We suggest specific solutions to minimize the negative consequences of these issues and offer proposals for ensuring that incorporation of AI into scientific research supports human values.

Authors

Institutions

Publication Details

Journal
AI and Ethics
Published
2026-02-01
DOI
https://doi.org/10.1007/s43681-025-00908-0
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
17.70

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Autonomous artificial intelligence, scientific research, and human values

David B. Resnik, Mohammad Hosseini, Rico Hauswald
1 citations
AI and Ethics
Artificial Intelligence in Healthcare and Education
17.70
article

Autonomous artificial intelligence, scientific research, and human values

David B. Resnik, Mohammad Hosseini, Rico Hauswald
article en
1 citations

Abstract

During the initial stage of AI's incorporation into scientific research, AI systems have functioned predominantly as tools under direct human supervision and control. However, AI incorporation into scientific research is now entering a stage in which AI Agents perform research tasks with partial autonomy while remaining under human supervision and control. In the not-too-distant future, a third stage may arise when autonomous AI systems conduct their own research and generate knowledge without human supervision or control. While the second and third stages of AI-augmented research may offer substantial benefits for science and society, they also create novel ethical issues, including (1) Conducting immoral research that may harm humans and other forms of life; (2) Increasing rate of biased, erroneous and deceptive research; (3) Confidentiality challenges; (4) Overreliance on AI; (5) Diffusion of responsibility and accountability; (6) Deskilling; (7) Job losses; (8) AI-generated research beyond human comprehension; and (9) Erosion of trust. We suggest specific solutions to minimize the negative consequences of these issues and offer proposals for ensuring that incorporation of AI into scientific research supports human values.

AI and EthicsVol. 6(1)
Northwestern University (US), National Institute of Environmental Health Sciences (US), Technische Universität Dresden (DE)
National Institutes of Health, National Center for Advancing Translational Sciences
Peace, Justice and strong institutions
Openalex Percentile: Top 2%
Artificial Intelligence in Healthcare and Education
17.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.