AlexUNLP-FMT at ClimateCheck Shared Task: Hybrid Retrieval with Adaptive Similarity Graph-based Reranking for Climate-related Social Media Claims Fact Checking

In this paper, we describe our work for the Cli-mateCheck shared task at the Scholarly Document Processing (SDP) workshop, ACL 2025.We focus on Subtask 1: Abstracts retrieval.The task involves retrieving relevant abstracts from a large corpus to verify claims made on social media about climate change.We explore various retrieval and reranking techniques, including fine-tuning transformer-based dense retrievers, sparse retrieval methods, and reranking using cross-encoder models.Our final and bestperforming system utilizes a hybrid retrieval approach combining BM25 sparse retrieval with a fine-tuned Stella model for dense retrieval, followed by an MSMARCO-trained MiniLM cross-encoder model for reranking.We adapt an iterative graph-based reranking approach that leverages a document similarity graph built over the document corpus to update the candidate pool for reranking dynamically.Our system achieved a score of 0.415 on the final test set for Subtask 1, securing third place on the final leaderboard.Our code is available on GitHub 1 .

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.sdp-1.27
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AlexUNLP-FMT at ClimateCheck Shared Task: Hybrid Retrieval with Adaptive Similarity Graph-based Reranking for Climate-related Social Media Claims Fact Checking

Marwan Torki, Nagwa El-Makky, Mohamed Fathallah
Topic Modeling
article

AlexUNLP-FMT at ClimateCheck Shared Task: Hybrid Retrieval with Adaptive Similarity Graph-based Reranking for Climate-related Social Media Claims Fact Checking

Marwan Torki, Nagwa El-Makky, Mohamed Fathallah
article en

Abstract

In this paper, we describe our work for the Cli-mateCheck shared task at the Scholarly Document Processing (SDP) workshop, ACL 2025.We focus on Subtask 1: Abstracts retrieval.The task involves retrieving relevant abstracts from a large corpus to verify claims made on social media about climate change.We explore various retrieval and reranking techniques, including fine-tuning transformer-based dense retrievers, sparse retrieval methods, and reranking using cross-encoder models.Our final and bestperforming system utilizes a hybrid retrieval approach combining BM25 sparse retrieval with a fine-tuned Stella model for dense retrieval, followed by an MSMARCO-trained MiniLM cross-encoder model for reranking.We adapt an iterative graph-based reranking approach that leverages a document similarity graph built over the document corpus to update the candidate pool for reranking dynamically.Our system achieved a score of 0.415 on the final test set for Subtask 1, securing third place on the final leaderboard.Our code is available on GitHub 1 .

Alexandria University (EG)
Climate action
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

AlexUNLP-FMT at ClimateCheck Shared Task: Hybrid Retrieval with Adaptive Similarity Graph-based Reranking for Climate-related Social Media Claims Fact Checking — Marwan Torki, Nagwa El-Makky, et al. · (2025) | TGRS Research Map | TGRS