Comment on “On the Failure of the Area Metric for Validation Exercises of Stochastic Simulations” (Eça, L., Dowding, K., and Roache, P. J., 2022, ASME J. Verif., Validation, Uncertainty Quantif., <b>7</b>(4), p. 041005)

The article by Eca, Dowding, and Roache [1] claims that the area metric [2] is a “failure” and “unacceptable” as a model validation metric. They attempt to support their opinion by considering an example problem and the example in ASME V&amp;amp;V Standard 10.1 [3]. They also introduce a new validation metric, which they refer to as the alternative area metric, which they believe will solve the “failure” of the area metric. This response to their article will show that they are conceptually incorrect concerning (a) what a model validation metric should express, (b) what is the proper interpretation of the area metric, and (c) how stochastic simulations inform decision makers.

Authors

Institutions

Publication Details

Journal
Journal of Verification Validation and Uncertainty Quantification
Published
2025-03-01
DOI
https://doi.org/10.1115/1.4068989
Primary Topic
Simulation Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comment on “On the Failure of the Area Metric for Validation Exercises of Stochastic Simulations” (Eça, L., Dowding, K., and Roache, P. J., 2022, ASME J. Verif., Validation, Uncertainty Quantif., 7(4), p. 041005)

William L. Oberkampf, Petar O. Hristov
Journal of Verification Validation and Uncertainty Quantification
Simulation Techniques and Applications
article

Comment on “On the Failure of the Area Metric for Validation Exercises of Stochastic Simulations” (Eça, L., Dowding, K., and Roache, P. J., 2022, ASME J. Verif., Validation, Uncertainty Quantif., 7(4), p. 041005)

William L. Oberkampf, Petar O. Hristov
article en

Abstract

The article by Eca, Dowding, and Roache [1] claims that the area metric [2] is a “failure” and “unacceptable” as a model validation metric. They attempt to support their opinion by considering an example problem and the example in ASME V&amp;amp;V Standard 10.1 [3]. They also introduce a new validation metric, which they refer to as the alternative area metric, which they believe will solve the “failure” of the area metric. This response to their article will show that they are conceptually incorrect concerning (a) what a model validation metric should express, (b) what is the proper interpretation of the area metric, and (c) how stochastic simulations inform decision makers.

Journal of Verification Validation and Uncertainty QuantificationVol. 10(1)
Sofia University "St. Kliment Ohridski" (BG)
Openalex Percentile: Top 81%
Simulation Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.