The state of human (un) centered AI security research

This position paper argues that security research on AI-assisted programming is overly model-centric and neglects human–AI teaming. While Large Language Model (LLM) coding assistants are widely used, current evaluations focus mainly on model performance and vulnerability detection in generated code, assuming better models alone will improve security. A targeted review of human-subject studies found only five relevant papers, with methodological diversity across studies making direct comparisons challenging. This review provided a clearer framework for our position that there are major gaps in the current research thrusts. We argue that security outcomes depend on human–AI interaction factors such as automation bias and reliance, and call for a shift toward human-centered, socio-technical security research on AI-assisted programming.

Authors

Publication Details

Journal
Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences)
Published
2026-07-24
DOI
https://doi.org/10.21256/zhaw-37151
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The state of human (un) centered AI security research

Rebecca Balebako, Leandra Willi
Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences)
Ethics and Social Impacts of AI
article

The state of human (un) centered AI security research

Rebecca Balebako, Leandra Willi
article en

Abstract

This position paper argues that security research on AI-assisted programming is overly model-centric and neglects human–AI teaming. While Large Language Model (LLM) coding assistants are widely used, current evaluations focus mainly on model performance and vulnerability detection in generated code, assuming better models alone will improve security. A targeted review of human-subject studies found only five relevant papers, with methodological diversity across studies making direct comparisons challenging. This review provided a clearer framework for our position that there are major gaps in the current research thrusts. We argue that security outcomes depend on human–AI interaction factors such as automation bias and reliance, and call for a shift toward human-centered, socio-technical security research on AI-assisted programming.

Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences)
Peace, Justice and strong institutions
Openalex Percentile: Top 5%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.