What do large language model panels add to multi-criteria decisions? Order-invariant q-rung dual hesitant preference aggregation and a hybrid supercapacitor case study

Abstract Large language models (LLMs) increasingly replace human experts in multi-criteria decision analysis, but their contribution to decisions computable from published data is rarely examined. This is studied with q-rung dual hesitant fuzzy preference relations elicited from five LLMs of five developers. The standard group relation, built with the weighted geometric operator and a reciprocity rebuild, depends on the order of the criteria; a q-power-mean aggregation with row-sum priority weights is proved to be order invariant, to preserve the q-rung constraint and to keep every weight positive, and without consensus adjustments the results depend on each hesitant set only through the means of the q-th powers of its degrees. In a hybrid supercapacitor selection problem built from verified full-cell data, the standard construction yields up to 26 rankings over the criterion orderings, the proposed construction one; the elicited judgments, however, shift with the order of the prompt (four permutation tests, p ≤ 0.009). Single central judgments per entry reproduce the hesitant-set rankings. With the decision table in the prompt, all 18 direct-data configurations reproduce the LLM-pipeline ranking; without it, the LLM performance judgments diverge from the evidence and change the ranking. Under ranking by multi-objective optimization by ratio analysis plus the full multiplicative form, resampling of models and sessions places the lithium-ion capacitor first in 0.748 (standard) and 1.000 (fixed-bound variant) of the draws; with literature source rows also resampled and the rebuilt table as performance matrix, the shares are 0.533 and 0.504. The LLM judgments are not validated against human experts.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-13
DOI
https://doi.org/10.21203/rs.3.rs-11556583/v1
Primary Topic
Multi-Criteria Decision Making
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

What do large language model panels add to multi-criteria decisions? Order-invariant q-rung dual hesitant preference aggregation and a hybrid supercapacitor case study

Yazan Aljeroudi, Omar S. Alhadithi, Mohammed A. Alhartomi, Abdinasir Hirsi et al.
5 links
Research Square
Multi-Criteria Decision Making
preprint

What do large language model panels add to multi-criteria decisions? Order-invariant q-rung dual hesitant preference aggregation and a hybrid supercapacitor case study

Yazan Aljeroudi, Omar S. Alhadithi, Mohammed A. Alhartomi, Abdinasir Hirsi, Godwin Okon Ansa, Lukman Audah‏, Mustafa Maad Hamdi, Abdullahi Farah, Ameer Alhassan
preprint en

Abstract

Abstract Large language models (LLMs) increasingly replace human experts in multi-criteria decision analysis, but their contribution to decisions computable from published data is rarely examined. This is studied with q-rung dual hesitant fuzzy preference relations elicited from five LLMs of five developers. The standard group relation, built with the weighted geometric operator and a reciprocity rebuild, depends on the order of the criteria; a q-power-mean aggregation with row-sum priority weights is proved to be order invariant, to preserve the q-rung constraint and to keep every weight positive, and without consensus adjustments the results depend on each hesitant set only through the means of the q-th powers of its degrees. In a hybrid supercapacitor selection problem built from verified full-cell data, the standard construction yields up to 26 rankings over the criterion orderings, the proposed construction one; the elicited judgments, however, shift with the order of the prompt (four permutation tests, p ≤ 0.009). Single central judgments per entry reproduce the hesitant-set rankings. With the decision table in the prompt, all 18 direct-data configurations reproduce the LLM-pipeline ranking; without it, the LLM performance judgments diverge from the evidence and change the ranking. Under ranking by multi-objective optimization by ratio analysis plus the full multiplicative form, resampling of models and sessions places the lithium-ion capacitor first in 0.748 (standard) and 1.000 (fixed-bound variant) of the draws; with literature source rows also resampled and the rebuilt table as performance matrix, the shares are 0.533 and 0.504. The LLM judgments are not validated against human experts.

Research Square
Akwa Ibom State University (NG), University of Anbar (IQ), Pakistan Telecommunication Company (Pakistan) (PK), Jamhuriya University of Science and Technology (SO), Al-Farabi University (IQ), University of Tabuk (SA), Tun Hussein Onn University of Malaysia (MY)
Universiti Tun Hussein Onn Malaysia
Multi-Criteria Decision Making
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon