Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings

Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications.A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by generating a set of answers that is guaranteed to include the true answer with a predefined confidence level.However, existing methods provide probabilistic guarantees averaged over a reference set of queries and answers (marginal coverage guarantee).In highstakes applications such as medical diagnosis, a stronger guarantee is often required: the predicted sets must provide consistent coverage per query (conditional coverage guarantee).We propose CONDKGCP, a novel method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets.CONDKGCP merges predicates with similar vector representations and augments calibration with rank information.We prove the theoretical guarantees and demonstrate empirical effectiveness of CONDKGCP by comprehensive evaluations.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.215
Citations
1
Primary Topic
Logic, Reasoning, and Knowledge
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings

Zifeng Ding, Evgeny Kharlamov, Bo Xiong, Yuqicheng Zhu et al.
1 citations
Logic, Reasoning, and Knowledge
2.48
article

Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings

Zifeng Ding, Evgeny Kharlamov, Bo Xiong, Yuqicheng Zhu, Steffen Staab, Daniel Hernández, Yuan He
article en
1 citations

Abstract

Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications.A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by generating a set of answers that is guaranteed to include the true answer with a predefined confidence level.However, existing methods provide probabilistic guarantees averaged over a reference set of queries and answers (marginal coverage guarantee).In highstakes applications such as medical diagnosis, a stronger guarantee is often required: the predicted sets must provide consistent coverage per query (conditional coverage guarantee).We propose CONDKGCP, a novel method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets.CONDKGCP merges predicates with similar vector representations and augments calibration with rank information.We prove the theoretical guarantees and demonstrate empirical effectiveness of CONDKGCP by comprehensive evaluations.

International Max Planck Research School for Environmental, Cellular and Molecular Microbiology, European Commission, Deutsche Forschungsgemeinschaft, International Max Planck Research School for Advanced Methods in Process and Systems Engineering
Openalex Percentile: Top 9%
Logic, Reasoning, and Knowledge
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.