Emulating Cognitive Style in Large Language Models

Abstract Large Language Models (LLMs) have emerged as a pivotal technology in the evolving world. With respect to design, the significance of LLMs lies in their transformative potential for collaborating design teams. However, it is not known whether LLMs can emulate cognitive and social attributes which are known to be important during design, such as cognitive style. This research evaluates the efficacy of LLMs to emulate aspects of Kirton’s adaption innovation inventory, which characterizes approaches to problem-solving. Specifically, we use LLMs to generate solutions for three design problems using two different cognitive style prompts (adaptive and innovative), and evaluate the solutions with respect to feasibility and paradigm relatedness. We found that solutions generated using the adaptive prompt tend to display higher feasibility and are paradigm preserving, while solutions generated using the innovative prompts were more paradigm modifying. This aligns with prior work and expectations based on KAI theory. Ultimately, these results demonstrate that LLMs can be prompted to accurately emulate cognitive style.

Authors

Institutions

Publication Details

Published
2024-08-25
DOI
https://doi.org/10.1115/detc2024-143677
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emulating Cognitive Style in Large Language Models

Christopher McComb, Vishakha Agarwal, Kathryn Jablokow
Topic Modeling
article

Emulating Cognitive Style in Large Language Models

Christopher McComb, Vishakha Agarwal, Kathryn Jablokow
article en

Abstract

Abstract Large Language Models (LLMs) have emerged as a pivotal technology in the evolving world. With respect to design, the significance of LLMs lies in their transformative potential for collaborating design teams. However, it is not known whether LLMs can emulate cognitive and social attributes which are known to be important during design, such as cognitive style. This research evaluates the efficacy of LLMs to emulate aspects of Kirton’s adaption innovation inventory, which characterizes approaches to problem-solving. Specifically, we use LLMs to generate solutions for three design problems using two different cognitive style prompts (adaptive and innovative), and evaluate the solutions with respect to feasibility and paradigm relatedness. We found that solutions generated using the adaptive prompt tend to display higher feasibility and are paradigm preserving, while solutions generated using the innovative prompts were more paradigm modifying. This aligns with prior work and expectations based on KAI theory. Ultimately, these results demonstrate that LLMs can be prompted to accurately emulate cognitive style.

Pennsylvania State University (US), Carnegie Mellon University (US)
Industry, innovation and infrastructure
Openalex Percentile: Top 82%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.