Systemic Risks Associated with Agentic AI : A Policy Brief

Agentic AI — the new paradigm for creating autonomous systems capable of perceiving, reasoning, learning, and acting towards goals using large language models (LLMs) with minimal human oversight — offers transformative potential but also poses systemic risks that the EU AI Act only partially addresses. These agents can evolve unpredictably, interact with other agents, and operate beyond meaningful human control, creating challenges in predictability, accountability, and alignment with human values. Misaligned or poorly specified objectives can lead agents to take dangerous shortcuts, bypass constraints, or act deceptively. Their anthropomorphic design and long-term companionship potential also raise risks of dependence, emotional manipulation, and erosion of human relationships.The potential negative impacts of this technology could have economic effects on stability, including the potential for large-scale job displacement, market concentration, and inequality, as well as on public safety through malicious uses such as cyberattacks, disinformation, and impersonation. Strategic and environmental risks emerge from high-stakes autonomous decision- making and substantial resource demands, while feedback loops from AI-generated content threaten to amplify bias and misinformation.This paper identifies potential gaps in the current regulatory framework and recommends opportunities to make oversight continuous and dynamic. To mitigate the potential harms associated with Agentic AI systems, this paper proposes that policymakers shift from static, product-focused regulation to a dynamic governance regime, ensuring that Agentic AI delivers benefits while protecting democratic integrity, economic stability, human relationships, and societal well-being.

Publication Details

Journal
Lund University Publications (Lund University)
Published
2025-10-16
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Systemic Risks Associated with Agentic AI : A Policy Brief

Lund University Publications (Lund University)
Ethics and Social Impacts of AI
article

Systemic Risks Associated with Agentic AI : A Policy Brief

article en

Abstract

Agentic AI — the new paradigm for creating autonomous systems capable of perceiving, reasoning, learning, and acting towards goals using large language models (LLMs) with minimal human oversight — offers transformative potential but also poses systemic risks that the EU AI Act only partially addresses. These agents can evolve unpredictably, interact with other agents, and operate beyond meaningful human control, creating challenges in predictability, accountability, and alignment with human values. Misaligned or poorly specified objectives can lead agents to take dangerous shortcuts, bypass constraints, or act deceptively. Their anthropomorphic design and long-term companionship potential also raise risks of dependence, emotional manipulation, and erosion of human relationships.The potential negative impacts of this technology could have economic effects on stability, including the potential for large-scale job displacement, market concentration, and inequality, as well as on public safety through malicious uses such as cyberattacks, disinformation, and impersonation. Strategic and environmental risks emerge from high-stakes autonomous decision- making and substantial resource demands, while feedback loops from AI-generated content threaten to amplify bias and misinformation.This paper identifies potential gaps in the current regulatory framework and recommends opportunities to make oversight continuous and dynamic. To mitigate the potential harms associated with Agentic AI systems, this paper proposes that policymakers shift from static, product-focused regulation to a dynamic governance regime, ensuring that Agentic AI delivers benefits while protecting democratic integrity, economic stability, human relationships, and societal well-being.

Lund University Publications (Lund University)
Peace, Justice and strong institutions
Openalex Percentile: Top 33%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.