“Who” designs better? A competition among human, artificial intelligence and human–AI collaboration

Abstract This research examines whether a machine, specifically artificial intelligence (AI), can be creative by comparing design solutions for a practical competition – a light fixture for a pediatric waiting room – among AI, collaboration efforts and a human designer. Amazon Mechanical Turk and Prolific workers observed the design solutions throughout the design process, from sketches ( $ S $ ) to three-dimensional renderings ( $ 3D $ ) to fully developed models in virtual waiting rooms ( $ VR $ ). Using the well-established Creative Product Semantic Scale (CPSS), the workers rated each design solution in three distinctive stages – $ S $ , $ 3D $ and $ VR $ – on three criteria – novelty (freshness or newness), resolution (relevance and logic) and style (craftsmanship and desirability). Despite some demographic discrepancies, the workers expressed general senses of happiness and calmness, resonating with the competition’s requirements. Statistical results of CPSS ratings revealed that while AI excelled in style for $ 3D $ , the human designer outperformed in novelty for both $ S $ and $ VR $ . Collaboration efforts surprisingly finished last. Such findings challenge current assumptions of AI’s creative ability in design research and highlight the need to be agile in the age of disruptive technologies. This research also offers guidance for product and interior designers and educators on thoughtfully integrating AI into the design process.

Authors

Institutions

Publication Details

Journal
Design Science
Published
2025-01-01
DOI
https://doi.org/10.1017/dsj.2025.10029
Primary Topic
Creativity in Education and Neuroscience
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

“Who” designs better? A competition among human, artificial intelligence and human–AI collaboration

Hoa Vo
Design Science
Creativity in Education and Neuroscience
article

“Who” designs better? A competition among human, artificial intelligence and human–AI collaboration

Hoa Vo
article en

Abstract

Abstract This research examines whether a machine, specifically artificial intelligence (AI), can be creative by comparing design solutions for a practical competition – a light fixture for a pediatric waiting room – among AI, collaboration efforts and a human designer. Amazon Mechanical Turk and Prolific workers observed the design solutions throughout the design process, from sketches ( $ S $ ) to three-dimensional renderings ( $ 3D $ ) to fully developed models in virtual waiting rooms ( $ VR $ ). Using the well-established Creative Product Semantic Scale (CPSS), the workers rated each design solution in three distinctive stages – $ S $ , $ 3D $ and $ VR $ – on three criteria – novelty (freshness or newness), resolution (relevance and logic) and style (craftsmanship and desirability). Despite some demographic discrepancies, the workers expressed general senses of happiness and calmness, resonating with the competition’s requirements. Statistical results of CPSS ratings revealed that while AI excelled in style for $ 3D $ , the human designer outperformed in novelty for both $ S $ and $ VR $ . Collaboration efforts surprisingly finished last. Such findings challenge current assumptions of AI’s creative ability in design research and highlight the need to be agile in the age of disruptive technologies. This research also offers guidance for product and interior designers and educators on thoughtfully integrating AI into the design process.

Design ScienceVol. 11
Indiana University Bloomington (US)
Openalex Percentile: Top 71%
Creativity in Education and Neuroscience
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.