BEHAVE AI: BEst Practices and Guidelines for Human-Centric Design and EvAluation of ProactiVE AI Agents

The last years have seen a significant rise in interest in highly autonomous and proactive agents fueled by the progress of AI. While there is various research on the design, implementation, and evaluation of proactive agents, there remains a critical gap in the methodologies used for both design and evaluation, which are largely informed by reactive system design principles. Our full-day multidisciplinary workshop brings together researchers and practitioners from the IUI community in academia and industry to understand the challenges of designing and evaluating proactive agents in a human-centric manner. We will reflect on existing evaluation methods, identify challenges in designing proactive systems, and discuss potential solutions, best practices, and human-centric guidelines to bridge these gaps. Ultimately, our goal is to map out key focus areas and research challenges, fostering strong interdisciplinary relationships within and across fields related to Artificial Intelligence (AI) and Human-Computer Interaction (HCI).

Authors

Institutions

Publication Details

Published
2025-03-18
DOI
https://doi.org/10.1145/3708557.3716155
Citations
1
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
2.44
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

BEHAVE AI: BEst Practices and Guidelines for Human-Centric Design and EvAluation of ProactiVE AI Agents

Dimosthenis Kontogiorgos, Nicolas Wagner, Sebastian Zepf, Sven Mayer et al.
1 citations
Human-Automation Interaction and Safety
2.44
article

BEHAVE AI: BEst Practices and Guidelines for Human-Centric Design and EvAluation of ProactiVE AI Agents

Dimosthenis Kontogiorgos, Nicolas Wagner, Sebastian Zepf, Sven Mayer, Isabel Feustel, Elisabeth André, Ilhan Aslan, Nima Zargham, Justin Edwards, Matthias Kraus, Rebecca Westhäußer
article en
1 citations

Abstract

The last years have seen a significant rise in interest in highly autonomous and proactive agents fueled by the progress of AI. While there is various research on the design, implementation, and evaluation of proactive agents, there remains a critical gap in the methodologies used for both design and evaluation, which are largely informed by reactive system design principles. Our full-day multidisciplinary workshop brings together researchers and practitioners from the IUI community in academia and industry to understand the challenges of designing and evaluating proactive agents in a human-centric manner. We will reflect on existing evaluation methods, identify challenges in designing proactive systems, and discuss potential solutions, best practices, and human-centric guidelines to bridge these gaps. Ultimately, our goal is to map out key focus areas and research challenges, fostering strong interdisciplinary relationships within and across fields related to Artificial Intelligence (AI) and Human-Computer Interaction (HCI).

Mercedes-Benz (Germany) (DE), University of Augsburg (DE), University of Bremen (DE), Universität Ulm (DE), LMU Klinikum (DE), Massachusetts Institute of Technology (US), Ludwig-Maximilians-Universität München (DE), Aalborg University (DK), University of Bamberg (DE), University of Oulu (FI)
Openalex Percentile: Top 15%
Human-Automation Interaction and Safety
2.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.