From In-Distribution to Out-of-Distribution: Joint Loss for Improving Generalization in Software Mention and Relation Extraction

Identifying software entities and their semantic relations in scientific texts contributes to improved reproducibility and allows for the construction machine-readable knowledge graphs.However, models struggle with domain variability and sparse supervision.We address this by evaluating joint Named Entity Recognition (NER) and Relation Extraction (RE) models on the SOMD 2025 shared task, emphasizing generalization to out-of-distribution scholarly texts.We propose a unified training objective that jointly optimizes both tasks using a shared loss function and demonstrates that joint loss formulations can improve outof-distribution robustness compared to disjoint training.Our results reveal significant performance gaps between in-and out-of-distribution settings, prompting critical reflections on modeling strategies for software knowledge extraction.Notably, our approach ranked 1st in Phase 2 (out-of-distribution) and 2nd in Phase 1 (indistribution) in the SOMD 2025 shared task, showing strong generalization and robust performance across domains.All code is publicly available. 1

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.sdp-1.14
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From In-Distribution to Out-of-Distribution: Joint Loss for Improving Generalization in Software Mention and Relation Extraction

Roman Kern, Stasa Mandic, Georg Niess
Data Quality and Management
article

From In-Distribution to Out-of-Distribution: Joint Loss for Improving Generalization in Software Mention and Relation Extraction

Roman Kern, Stasa Mandic, Georg Niess
article en

Abstract

Identifying software entities and their semantic relations in scientific texts contributes to improved reproducibility and allows for the construction machine-readable knowledge graphs.However, models struggle with domain variability and sparse supervision.We address this by evaluating joint Named Entity Recognition (NER) and Relation Extraction (RE) models on the SOMD 2025 shared task, emphasizing generalization to out-of-distribution scholarly texts.We propose a unified training objective that jointly optimizes both tasks using a shared loss function and demonstrates that joint loss formulations can improve outof-distribution robustness compared to disjoint training.Our results reveal significant performance gaps between in-and out-of-distribution settings, prompting critical reflections on modeling strategies for software knowledge extraction.Notably, our approach ranked 1st in Phase 2 (out-of-distribution) and 2nd in Phase 1 (indistribution) in the SOMD 2025 shared task, showing strong generalization and robust performance across domains.All code is publicly available. 1

Openalex Percentile: Top 77%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

From In-Distribution to Out-of-Distribution: Joint Loss for Improving Generalization in Software Mention and Relation Extraction — Roman Kern, Stasa Mandic, et al. · (2025) | TGRS Research Map | TGRS