How Agent-Driven Creative Trace Mining Reshapes Design Behavior in a Deployment Study of Intent-Aligned Multimodal Design

Designers continuously capture inspirations across media, yet these creative traces remain underutilized in computational design support. We present DesignJournal, an agent-driven system that mines multimodal creative traces and transforms them into intent-aligned image generation. The system consolidates artifacts into a unified workspace and employs an agentic pipeline for structured grouping, belief-guided prompt refinement, and iterative intent updates. We developed a framework that classifies sequential design actions, deriving a hierarchical action taxonomy from interaction logs. We used it to examine how agent affordances reshape design behavior. A 10-day deployment study with eight professional designers compared baseline and agent-supported conditions across 5838 classified actions. Agent support significantly reduced the frequency of spatial repositioning actions, particularly small-distance movements, while sequential transition structures shifted from extended repositioning chains toward relational encoding sequences. Awareness of agent interpretation shaped upstream recording behavior, and agent-mediated collaboration extended designers’ creative reach beyond independent exploration.

Authors

Institutions

Publication Details

Journal
International Journal of Human-Computer Interaction
Published
2026-10-07
DOI
https://doi.org/10.1080/10447318.2026.2739092
Primary Topic
Design Education and Practice
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Agent-Driven Creative Trace Mining Reshapes Design Behavior in a Deployment Study of Intent-Aligned Multimodal Design

Yugyeong Jang, Seung Won Lee, Jiin Choi, Kyung Hoon Hyun et al.
International Journal of Human-Computer Interaction
Design Education and Practice
article

How Agent-Driven Creative Trace Mining Reshapes Design Behavior in a Deployment Study of Intent-Aligned Multimodal Design

Yugyeong Jang, Seung Won Lee, Jiin Choi, Kyung Hoon Hyun, Seonghoon Ban, Semin Jin, Geunmin Hwang, Yejin Yun, Sang Woon Park
article en

Abstract

Designers continuously capture inspirations across media, yet these creative traces remain underutilized in computational design support. We present DesignJournal, an agent-driven system that mines multimodal creative traces and transforms them into intent-aligned image generation. The system consolidates artifacts into a unified workspace and employs an agentic pipeline for structured grouping, belief-guided prompt refinement, and iterative intent updates. We developed a framework that classifies sequential design actions, deriving a hierarchical action taxonomy from interaction logs. We used it to examine how agent affordances reshape design behavior. A 10-day deployment study with eight professional designers compared baseline and agent-supported conditions across 5838 classified actions. Agent support significantly reduced the frequency of spatial repositioning actions, particularly small-distance movements, while sequential transition structures shifted from extended repositioning chains toward relational encoding sequences. Awareness of agent interpretation shaped upstream recording behavior, and agent-mediated collaboration extended designers’ creative reach beyond independent exploration.

International Journal of Human-Computer Interaction
Hanyang University (KR)
Openalex Percentile: Top 21%
Design Education and Practice
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

How Agent-Driven Creative Trace Mining Reshapes Design Behavior in a Deployment Study of Intent-Aligned Multimodal Design — Yugyeong Jang, Seung Won Lee, et al. · International Journal of Human-Computer Interaction (2026) | TGRS Research Map | TGRS