What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Use

Prompting LLMs for complex tasks (e.g., building a trip advisor chatbot) needs humans to clearly articulate customized requirements (e.g., “start the response with a tl;dr”). However, existing prompt engineering instructions often lack focused training on requirement articulation and instead tend to emphasize increasingly automatable strategies (e.g., tricks like adding role-plays and “think step-by-step”). To address the gap, we introduce Requirement-Oriented Prompt Engineering ( ROPE ), a paradigm that focuses human attention on generating clear, complete requirements during prompting. We implement ROPE through an assessment and training suite that provides deliberate practice with LLM-generated feedback. In a randomized controlled experiment with 30 novices, ROPE significantly outperforms conventional prompt engineering training (20% vs. 1% gains), a gap that automatic prompt optimization cannot close. Furthermore, we demonstrate a direct correlation between the quality of input requirements and LLM outputs. Our work paves the way to empower more end-users to build complex LLM applications.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Computer-Human Interaction
Published
2025-04-24
DOI
https://doi.org/10.1145/3731756
Citations
13
Primary Topic
Spreadsheets and End-User Computing
Type
article
Field-Weighted Citation Impact
30.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Use

Tongshuang Wu, Qianou Ma, Weirui Peng, Kenneth R. Koedinger et al.
13 citations
ACM Transactions on Computer-Human Interaction
Spreadsheets and End-User Computing
30.00
article

What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Use

Tongshuang Wu, Qianou Ma, Weirui Peng, Kenneth R. Koedinger, Hua Shen, Chenyang Yang
article en
13 citations

Abstract

Prompting LLMs for complex tasks (e.g., building a trip advisor chatbot) needs humans to clearly articulate customized requirements (e.g., “start the response with a tl;dr”). However, existing prompt engineering instructions often lack focused training on requirement articulation and instead tend to emphasize increasingly automatable strategies (e.g., tricks like adding role-plays and “think step-by-step”). To address the gap, we introduce Requirement-Oriented Prompt Engineering ( ROPE ), a paradigm that focuses human attention on generating clear, complete requirements during prompting. We implement ROPE through an assessment and training suite that provides deliberate practice with LLM-generated feedback. In a randomized controlled experiment with 30 novices, ROPE significantly outperforms conventional prompt engineering training (20% vs. 1% gains), a gap that automatic prompt optimization cannot close. Furthermore, we demonstrate a direct correlation between the quality of input requirements and LLM outputs. Our work paves the way to empower more end-users to build complex LLM applications.

ACM Transactions on Computer-Human InteractionVol. 32(4)
University of Washington (US), Carnegie Mellon University (US), Columbia University (US)
Openalex Percentile: Top 0%
Spreadsheets and End-User Computing
30.00
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.