How Do Users Organize Prompting Workflows in Human–AI Collaboration? A Process Mining Analysis of AI Literacy-Based Strategy Patterns

Growing use of large language models (LLMs) in creative and knowledge work has increased interest in how users collaborate with AI beyond output quality. This study examines how AI literacy and task type relate to prompting strategy organization, workflow, and perceptions of collaboration in ChatGPT-supported writing. Forty university students completed a divergent brand-naming and a convergent writing task. Prompting logs were analyzed using sequential pattern metrics and process mining, complemented by interviews. Higher AI literacy was associated with more structured coordination among prompting strategies, whereas lower literacy showed more repetitive, generation-centered pathways. These differences appeared in specific transition and loop configurations rather than overall transition diversity. Participants described AI as assistive, yet behavioral traces showed substantial AI contribution to outputs. These findings provide process-oriented insights into how AI literacy and task type relate to strategic adaptability in human–AI collaboration.

Authors

Institutions

Publication Details

Journal
International Journal of Human-Computer Interaction
Published
2026-11-17
DOI
https://doi.org/10.1080/10447318.2026.2758472
Primary Topic
Usability and User Interface Design
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

How Do Users Organize Prompting Workflows in Human–AI Collaboration? A Process Mining Analysis of AI Literacy-Based Strategy Patterns

Gyewon Jeon, Sangwon Lee, Dongmin Shin, Younghyun Kim
4 links
International Journal of Human-Computer Interaction
Usability and User Interface Design
article

How Do Users Organize Prompting Workflows in Human–AI Collaboration? A Process Mining Analysis of AI Literacy-Based Strategy Patterns

Gyewon Jeon, Sangwon Lee, Dongmin Shin, Younghyun Kim
article en

Abstract

Growing use of large language models (LLMs) in creative and knowledge work has increased interest in how users collaborate with AI beyond output quality. This study examines how AI literacy and task type relate to prompting strategy organization, workflow, and perceptions of collaboration in ChatGPT-supported writing. Forty university students completed a divergent brand-naming and a convergent writing task. Prompting logs were analyzed using sequential pattern metrics and process mining, complemented by interviews. Higher AI literacy was associated with more structured coordination among prompting strategies, whereas lower literacy showed more repetitive, generation-centered pathways. These differences appeared in specific transition and loop configurations rather than overall transition diversity. Participants described AI as assistive, yet behavioral traces showed substantial AI contribution to outputs. These findings provide process-oriented insights into how AI literacy and task type relate to strategic adaptability in human–AI collaboration.

International Journal of Human-Computer Interaction
Korea University (KR), Hanyang University (KR)
National Research Foundation of Korea, Ministry of Science and ICT, South Korea, Institute for Information and Communications Technology Promotion
Quality education
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon