Elicitron: A Large Language Model Agent-Based Simulation Framework for Design Requirements Elicitation

Abstract Requirement elicitation, a critical, yet time-consuming and challenging step in product development, often fails to capture the full spectrum of user needs. This may lead to products that fall short of user expectations. This article introduces a novel framework that leverages large language models (LLMs) to automate and enhance the requirement elicitation process. LLMs are used to generate a vast array of simulated users (LLM agents), enabling the exploration of a much broader range of user needs and unforeseen use cases. These agents engage in product experience scenarios, explaining their actions, observations, and challenges. Subsequent agent interviews and analysis uncover valuable user needs, including latent ones. We validate our framework with three experiments. First, we explore different methodologies for the challenge of diverse agent generation, discussing their advantages and shortcomings. We measure the diversity of identified user needs and demonstrate that context-aware agent generation leads to greater diversity. Second, we show how our framework effectively mimics empathic lead user interviews, identifying a greater number of latent needs than conventional human interviews. Third, we show that LLMs can be used to analyze interviews, capture needs, and classify them as latent or not. Our work highlights the potential of using LLMs to accelerate early-stage product development with minimal costs and increase innovation.

Authors

Institutions

Publication Details

Journal
Journal of Computing and Information Science in Engineering
Published
2024-12-11
DOI
https://doi.org/10.1115/1.4067388
Citations
21
Primary Topic
Open Source Software Innovations
Type
article
Field-Weighted Citation Impact
8.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Elicitron: A Large Language Model Agent-Based Simulation Framework for Design Requirements Elicitation

Nigel Morris, Hyunmin Cheong, Daniele Grandi, Alexander Tessier et al.
21 citations
Journal of Computing and Information Science in Engineering
Open Source Software Innovations
8.65
article

Elicitron: A Large Language Model Agent-Based Simulation Framework for Design Requirements Elicitation

Nigel Morris, Hyunmin Cheong, Daniele Grandi, Alexander Tessier, Mohammadmehdi Ataei, Yu Wang
article en
21 citations

Abstract

Abstract Requirement elicitation, a critical, yet time-consuming and challenging step in product development, often fails to capture the full spectrum of user needs. This may lead to products that fall short of user expectations. This article introduces a novel framework that leverages large language models (LLMs) to automate and enhance the requirement elicitation process. LLMs are used to generate a vast array of simulated users (LLM agents), enabling the exploration of a much broader range of user needs and unforeseen use cases. These agents engage in product experience scenarios, explaining their actions, observations, and challenges. Subsequent agent interviews and analysis uncover valuable user needs, including latent ones. We validate our framework with three experiments. First, we explore different methodologies for the challenge of diverse agent generation, discussing their advantages and shortcomings. We measure the diversity of identified user needs and demonstrate that context-aware agent generation leads to greater diversity. Second, we show how our framework effectively mimics empathic lead user interviews, identifying a greater number of latent needs than conventional human interviews. Third, we show that LLMs can be used to analyze interviews, capture needs, and classify them as latent or not. Our work highlights the potential of using LLMs to accelerate early-stage product development with minimal costs and increase innovation.

Journal of Computing and Information Science in EngineeringVol. 25(2)
Autodesk (United States) (US), University of Toronto (CA), Pfleger Institute of Environmental Research (US)
Industry, innovation and infrastructure
Openalex Percentile: Top 2%
Open Source Software Innovations
8.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.