Putting the Ghost in the Machine: Emulating Cognitive Style in Large Language Models

Abstract Large Language Models (LLMs) have emerged as pivotal technology in the evolving world. Their significance in design lies in their transformative potential to support engineers and collaborate with design teams throughout the design process. However, it is not known whether LLMs can emulate the cognitive and social attributes which are known to be important during design, such as cognitive style. This research evaluates the efficacy of LLMs to emulate aspects of Kirton’s Adaption–Innovation theory, which characterizes individual preferences in problem-solving. Specifically, we use LLMs to generate solutions for three design problems using two different cognitive style prompts (adaptively framed and innovatively framed). Solutions are evaluated with respect to feasibility and paradigm relatedness, which are known to have discriminative value in other studies of cognitive style. We found that solutions generated using the adaptive prompt tend to display higher feasibility and are paradigm-preserving, while solutions generated using the innovative prompts were more paradigm-modifying. This aligns with prior work and expectations for design behavior based on Kirton's Adaption–Innovation theory. Ultimately, these results demonstrate that LLMs can be prompted to accurately emulate cognitive style.

Authors

Institutions

Publication Details

Journal
Journal of Computing and Information Science in Engineering
Published
2024-10-14
DOI
https://doi.org/10.1115/1.4066857
Citations
3
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Putting the Ghost in the Machine: Emulating Cognitive Style in Large Language Models

Christopher McComb, Vishakha Agarwal, Kathryn Jablokow
3 citations
Journal of Computing and Information Science in Engineering
Topic Modeling
1.04
article

Putting the Ghost in the Machine: Emulating Cognitive Style in Large Language Models

Christopher McComb, Vishakha Agarwal, Kathryn Jablokow
article en
3 citations

Abstract

Abstract Large Language Models (LLMs) have emerged as pivotal technology in the evolving world. Their significance in design lies in their transformative potential to support engineers and collaborate with design teams throughout the design process. However, it is not known whether LLMs can emulate the cognitive and social attributes which are known to be important during design, such as cognitive style. This research evaluates the efficacy of LLMs to emulate aspects of Kirton’s Adaption–Innovation theory, which characterizes individual preferences in problem-solving. Specifically, we use LLMs to generate solutions for three design problems using two different cognitive style prompts (adaptively framed and innovatively framed). Solutions are evaluated with respect to feasibility and paradigm relatedness, which are known to have discriminative value in other studies of cognitive style. We found that solutions generated using the adaptive prompt tend to display higher feasibility and are paradigm-preserving, while solutions generated using the innovative prompts were more paradigm-modifying. This aligns with prior work and expectations for design behavior based on Kirton's Adaption–Innovation theory. Ultimately, these results demonstrate that LLMs can be prompted to accurately emulate cognitive style.

Journal of Computing and Information Science in EngineeringVol. 25(2)
Pennsylvania State University (US), Carnegie Mellon University (US)
Openalex Percentile: Top 19%
Topic Modeling
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.