How Agent-Driven Creative Trace Mining Reshapes Design Behavior in a Deployment Study of Intent-Aligned Multimodal Design
Designers continuously capture inspirations across media, yet these creative traces remain underutilized in computational design support. We present DesignJournal, an agent-driven system that mines multimodal creative traces and transforms them into intent-aligned image generation. The system consolidates artifacts into a unified workspace and employs an agentic pipeline for structured grouping, belief-guided prompt refinement, and iterative intent updates. We developed a framework that classifies sequential design actions, deriving a hierarchical action taxonomy from interaction logs. We used it to examine how agent affordances reshape design behavior. A 10-day deployment study with eight professional designers compared baseline and agent-supported conditions across 5838 classified actions. Agent support significantly reduced the frequency of spatial repositioning actions, particularly small-distance movements, while sequential transition structures shifted from extended repositioning chains toward relational encoding sequences. Awareness of agent interpretation shaped upstream recording behavior, and agent-mediated collaboration extended designers’ creative reach beyond independent exploration.
Authors
- Yugyeong Jang (ORCID: https://orcid.org/0009-0000-4450-4575)
- Seung Won Lee (ORCID: https://orcid.org/0000-0001-6435-0833)
- Jiin Choi (ORCID: https://orcid.org/0009-0003-2513-6895)
- Kyung Hoon Hyun (ORCID: https://orcid.org/0000-0001-6379-9700)
- Seonghoon Ban (ORCID: https://orcid.org/0000-0002-4963-101X)
- Semin Jin (ORCID: https://orcid.org/0009-0008-7432-053X)
- Geunmin Hwang
- Yejin Yun (ORCID: https://orcid.org/0009-0007-6167-3953)
- Sang Woon Park (ORCID: https://orcid.org/0009-0005-7387-8521)
Institutions
- Hanyang University (KR)
Publication Details
- Journal
- International Journal of Human-Computer Interaction
- Published
- 2026-10-07
- DOI
- https://doi.org/10.1080/10447318.2026.2739092
- Primary Topic
- Design Education and Practice
- Type
- article
- Field-Weighted Citation Impact
- 0.00