Human-AI Collaboration in Software Development: A Mixed-Methods Study of Developers’ Use of GitHub Copilot and ChatGPT

The integration of AI-powered coding assistants into software development presents both opportunities and challenges. These tools promise enhanced productivity and code quality while introducing significant concerns related to workflow integration, accuracy, reliability, and ethical considerations. This study investigates how software developers interact with Generative AI (GenAI) tools in a large-scale public sector organization. Using a mixed-methods approach, we analyze 13 interviews and a survey with 114 respondents to explore the impact of GitHub Copilot (IDE-integrated AI) and ChatGPT (conversational AI assistant) on software engineering workflows. The Human-AI Collaboration and Adaptation Framework (HACAF) is central to our analysis, which integrates insights from several technology acceptance models and theories. Our findings reveal that compatibility within existing workflows plays a crucial role in effectively utilizing GenAI tools. We explore individual, technological, and social factors that influence the adoption of these tools, highlighting the importance of organizational support and collective user patterns within teams. By studying both users and non-users, we provide insights into the factors driving GenAI adoption and the barriers preventing full integration. Our findings contribute to discussions on AI-enhanced IDEs, human-AI collaboration in coding, and the evolving role of LLM-based assistants in modern software development.

Authors

Institutions

Publication Details

Published
2025-06-23
DOI
https://doi.org/10.1145/3696630.3730566
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human-AI Collaboration in Software Development: A Mixed-Methods Study of Developers’ Use of GitHub Copilot and ChatGPT

Astri Barbala, Viktoria Stray, Viggo Tellefsen Wivestad
Artificial Intelligence in Healthcare and Education
article

Human-AI Collaboration in Software Development: A Mixed-Methods Study of Developers’ Use of GitHub Copilot and ChatGPT

Astri Barbala, Viktoria Stray, Viggo Tellefsen Wivestad
article en

Abstract

The integration of AI-powered coding assistants into software development presents both opportunities and challenges. These tools promise enhanced productivity and code quality while introducing significant concerns related to workflow integration, accuracy, reliability, and ethical considerations. This study investigates how software developers interact with Generative AI (GenAI) tools in a large-scale public sector organization. Using a mixed-methods approach, we analyze 13 interviews and a survey with 114 respondents to explore the impact of GitHub Copilot (IDE-integrated AI) and ChatGPT (conversational AI assistant) on software engineering workflows. The Human-AI Collaboration and Adaptation Framework (HACAF) is central to our analysis, which integrates insights from several technology acceptance models and theories. Our findings reveal that compatibility within existing workflows plays a crucial role in effectively utilizing GenAI tools. We explore individual, technological, and social factors that influence the adoption of these tools, highlighting the importance of organizational support and collective user patterns within teams. By studying both users and non-users, we provide insights into the factors driving GenAI adoption and the barriers preventing full integration. Our findings contribute to discussions on AI-enhanced IDEs, human-AI collaboration in coding, and the evolving role of LLM-based assistants in modern software development.

SINTEF (NO), University of Oslo (NO), SINTEF Digital
Norges Forskningsråd
Openalex Percentile: Top 87%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Human-AI Collaboration in Software Development: A Mixed-Methods Study of Developers’ Use of GitHub Copilot and ChatGPT — Astri Barbala, Viktoria Stray, et al. · (2025) | TGRS Research Map | TGRS