Model choice and prompt framing in LLM sustainability judgments

Large language models (LLMs) are increasingly proposed for sustainability assessment and decision support, yet their judgments may depend on the selected model and on how the task is defined. We compare 13 locally executed open-weight LLMs on 80 author-written sustainability scenarios using three prompt families that ask which actor should be responsible, bear the costs, or initiate action. Each model answered at two temperature settings with 100 repetitions, producing 624,000 deposited outputs, of which 610,708 contain a complete score vector. Scores were analyzed as relative actor support after removing each response’s overall level. Within this instrument, the cost prompt family produced the highest cross-model disagreement, exceeding both responsibility and catalyst by 7.37 points (question-cluster 95% intervals 5.56−9.15 and 5.38−9.36, describing variation across these 80 scenarios). It also produced the most lead-actor disagreement and the lowest full consensus. Moving from catalyst to cost reduced relative support for government and increased it for individuals and firms; moving from cost to responsibility largely reversed this pattern. These differences exceeded temperature-setting differences and persisted under model exclusion, alternative score transformations and tie rules, missing-response checks, and stems without explicit cost wording. Exploratory category patterns are conditional on uneven item coverage. Secondary rationale-language comparisons show the same within-model ordering but not the most cross-model variation under cost. Operational use should disclose model, prompt, and temperature choices; compare plausible alternatives; repeat generations; and refer high-disagreement judgments for human deliberation.

Authors

Institutions

Publication Details

Journal
Discover Sustainability
Published
2026-11-21
DOI
https://doi.org/10.1007/s43621-026-05369-x
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Model choice and prompt framing in LLM sustainability judgments

Tibor Tőkés, Nayna Babar, Marianna Abuczki, Tamas Olah
3 links
Discover Sustainability
Ethics and Social Impacts of AI
article

Model choice and prompt framing in LLM sustainability judgments

Tibor Tőkés, Nayna Babar, Marianna Abuczki, Tamas Olah
article en

Abstract

Large language models (LLMs) are increasingly proposed for sustainability assessment and decision support, yet their judgments may depend on the selected model and on how the task is defined. We compare 13 locally executed open-weight LLMs on 80 author-written sustainability scenarios using three prompt families that ask which actor should be responsible, bear the costs, or initiate action. Each model answered at two temperature settings with 100 repetitions, producing 624,000 deposited outputs, of which 610,708 contain a complete score vector. Scores were analyzed as relative actor support after removing each response’s overall level. Within this instrument, the cost prompt family produced the highest cross-model disagreement, exceeding both responsibility and catalyst by 7.37 points (question-cluster 95% intervals 5.56−9.15 and 5.38−9.36, describing variation across these 80 scenarios). It also produced the most lead-actor disagreement and the lowest full consensus. Moving from catalyst to cost reduced relative support for government and increased it for individuals and firms; moving from cost to responsibility largely reversed this pattern. These differences exceeded temperature-setting differences and persisted under model exclusion, alternative score transformations and tie rules, missing-response checks, and stems without explicit cost wording. Exploratory category patterns are conditional on uneven item coverage. Secondary rationale-language comparisons show the same within-model ordering but not the most cross-model variation under cost. Operational use should disclose model, prompt, and temperature choices; compare plausible alternatives; repeat generations; and refer high-disagreement judgments for human deliberation.

Discover Sustainability
University of Debrecen (HU), Debrecen Reformed Theological University (HU)
Climate action
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Model choice and prompt framing in LLM sustainability judgments — Tibor Tőkés, Nayna Babar, et al. · Discover Sustainability (2026) | TGRS Research Map | TGRS