Silence Is Safety: A Calibrated Clinical NLI Verifier for MedNLI

This preprint presents AetherMind MedNLI Clinical NLI Verifier, a calibrated clinical natural-language inference model for the MedNLI benchmark. The model performs three-way inference over clinical premise-hypothesis pairs: entailment, neutral, and contradiction. On the MedNLI test split, the verifier achieves 88.19% accuracy with 95% confidence interval [86.50 89.87], macro F1 of 88.21%, contradiction recall of 92.41%, and contradiction precision of 93.99%. Temperature scaling fitted on the development split improves expected calibration error from 0.090 to 0.037. The paper also evaluates selective abstention for safer clinical claim verification workflows.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-13
DOI
https://doi.org/10.5281/zenodo.20683189
Primary Topic
Machine Learning in Healthcare
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Silence Is Safety: A Calibrated Clinical NLI Verifier for MedNLI

Sameer Najm
Zenodo (CERN European Organization for Nuclear Research)
Machine Learning in Healthcare
preprint

Silence Is Safety: A Calibrated Clinical NLI Verifier for MedNLI

Sameer Najm
preprint en

Abstract

This preprint presents AetherMind MedNLI Clinical NLI Verifier, a calibrated clinical natural-language inference model for the MedNLI benchmark. The model performs three-way inference over clinical premise-hypothesis pairs: entailment, neutral, and contradiction. On the MedNLI test split, the verifier achieves 88.19% accuracy with 95% confidence interval [86.50 89.87], macro F1 of 88.21%, contradiction recall of 92.41%, and contradiction precision of 93.99%. Temperature scaling fitted on the development split improves expected calibration error from 0.090 to 0.037. The paper also evaluates selective abstention for safer clinical claim verification workflows.

Zenodo (CERN European Organization for Nuclear Research)
Strateji Araşdırmalar Mərkəzi (AZ)
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.