Enhancing consistency of AHP-based expert judgements: A new approach and its implementation in an interactive tool

The analytic hierarchy process is an effective method for simplifying complex decision-making processes involving multiple criteria. Experts convey their criteria evaluations through pairwise comparisons that ultimately result in a consistency check of the preferences obtained. However, achieving a predetermined consistency ratio (<i>CR</i>) threshold is challenging for such problems, which may compromise the reliability of expert evaluations. To address this issue, this paper presents a novel interactive software tool designed to enhance the logical coherence of expert judgments during decision-making processes. Utilizing a sophisticated greedy algorithm, which is interactively run vis-à-vis the experts in real time, the tool detects inconsistencies and suggests minor adjustments to improve the <i>CR</i> while preserving the integrity of the original evaluations. In a case study of border delineation, in which 21 senior officials involved in international border negotiations evaluated six criteria, the tool successfully reduced the <i>CR</i> values to the minimum required, significantly improving the consistency and reliability of the evaluations. The proposed tool has broad potential applications in various complex decision-making scenarios. In future developments, the tool could also be adapted to incorporate clustering techniques for managing complex criteria sets, or extended to support group decision making by assessing consensus levels and recommending minimal adjustments.•AHP-based pairwise comparisons of <i>n</i> criteria by experts are recorded in an <i>n</i> <i>×</i> <i>n</i> reiprocal preference matrix whose eigenvalu <i>λ</i> <sub>max</sub> is used to compute the consistency ratio (CR) of the resulting priority vector.•An iterative greedy algorithm developed to enhance the consistency of the solution in case CR>10% enforces minimal intervention by limiting the adjustment to single-step modifications on unaltered pairwise comparisons only.•The algorithm is implemented in an interactive, user-friendly software tool, ensuring transparency and expert engagement through real-time, traceable consistency refinement.

Authors

Institutions

Publication Details

Journal
MethodsX
Published
2025-05-01
DOI
https://doi.org/10.1016/j.mex.2025.103341
Citations
13
Primary Topic
Multi-Criteria Decision Making
Type
article
Field-Weighted Citation Impact
27.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing consistency of AHP-based expert judgements: A new approach and its implementation in an interactive tool

Maxim Shoshany, Irit Talmor, Aviad Shapira, Shimon Frish et al.
13 citations
MethodsX
Multi-Criteria Decision Making
27.39
article

Enhancing consistency of AHP-based expert judgements: A new approach and its implementation in an interactive tool

Maxim Shoshany, Irit Talmor, Aviad Shapira, Shimon Frish, Omer Hadar
article en
13 citations

Abstract

The analytic hierarchy process is an effective method for simplifying complex decision-making processes involving multiple criteria. Experts convey their criteria evaluations through pairwise comparisons that ultimately result in a consistency check of the preferences obtained. However, achieving a predetermined consistency ratio (<i>CR</i>) threshold is challenging for such problems, which may compromise the reliability of expert evaluations. To address this issue, this paper presents a novel interactive software tool designed to enhance the logical coherence of expert judgments during decision-making processes. Utilizing a sophisticated greedy algorithm, which is interactively run vis-à-vis the experts in real time, the tool detects inconsistencies and suggests minor adjustments to improve the <i>CR</i> while preserving the integrity of the original evaluations. In a case study of border delineation, in which 21 senior officials involved in international border negotiations evaluated six criteria, the tool successfully reduced the <i>CR</i> values to the minimum required, significantly improving the consistency and reliability of the evaluations. The proposed tool has broad potential applications in various complex decision-making scenarios. In future developments, the tool could also be adapted to incorporate clustering techniques for managing complex criteria sets, or extended to support group decision making by assessing consensus levels and recommending minimal adjustments.•AHP-based pairwise comparisons of <i>n</i> criteria by experts are recorded in an <i>n</i> <i>×</i> <i>n</i> reiprocal preference matrix whose eigenvalu <i>λ</i> <sub>max</sub> is used to compute the consistency ratio (CR) of the resulting priority vector.•An iterative greedy algorithm developed to enhance the consistency of the solution in case CR>10% enforces minimal intervention by limiting the adjustment to single-step modifications on unaltered pairwise comparisons only.•The algorithm is implemented in an interactive, user-friendly software tool, ensuring transparency and expert engagement through real-time, traceable consistency refinement.

MethodsXVol. 14
Technion – Israel Institute of Technology (IL), Western Galilee College (IL), Academic College of Tel Aviv-Yafo (IL)
Openalex Percentile: Top 0%
Multi-Criteria Decision Making
27.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.