Inductive Learning on Heterogeneous Graphs Enhanced by LLMs for Software Mention Detection

This paper explores the synergy between Knowledge Graphs (KGs), Graph Machine Learning (Graph ML), and Large Language Models (LLMs) for multilingual Named Entity Recognition (NER) and Relation Extraction (RE), specifically targeting software mentions within the SOMD 2025 challenge.We propose a methodology where documents are first transformed into heterogeneous KGs enriched with linguistic features (Universal Dependencies) and external knowledge (entity linking).An inductive GraphSAGE model, operating on PyTorch Geometric's 'HeteroData' structure with dynamically generated multilingual embeddings, performs node classification tasks.For NER, Graph ML identifies candidate entities and types, with an Large Language Model (LLM) (DeepSeek v3) acting as a validation layer.For RE, Graph ML predicts dependency path convergence points indicative of relations, while the LLM classifies the relation type and direction based on entity context.Our results demonstrate the potential of this hybrid approach, showing significant performance gains post-competition (NER Phase 2 Macro F1 improved to 43.6% from 29.5%, RE Phase 1 33.6%Macro F1), which are already described in this paper, and highlighting the benefits of integrating structured graph learning with LLM reasoning for information extraction.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.sdp-1.16
Primary Topic
Software Reliability and Analysis Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Inductive Learning on Heterogeneous Graphs Enhanced by LLMs for Software Mention Detection

Gabriel Silva, Marlene Amorim, António Teixeira, Mário Rodriges
Software Reliability and Analysis Research
article

Inductive Learning on Heterogeneous Graphs Enhanced by LLMs for Software Mention Detection

Gabriel Silva, Marlene Amorim, António Teixeira, Mário Rodriges
article en

Abstract

This paper explores the synergy between Knowledge Graphs (KGs), Graph Machine Learning (Graph ML), and Large Language Models (LLMs) for multilingual Named Entity Recognition (NER) and Relation Extraction (RE), specifically targeting software mentions within the SOMD 2025 challenge.We propose a methodology where documents are first transformed into heterogeneous KGs enriched with linguistic features (Universal Dependencies) and external knowledge (entity linking).An inductive GraphSAGE model, operating on PyTorch Geometric's 'HeteroData' structure with dynamically generated multilingual embeddings, performs node classification tasks.For NER, Graph ML identifies candidate entities and types, with an Large Language Model (LLM) (DeepSeek v3) acting as a validation layer.For RE, Graph ML predicts dependency path convergence points indicative of relations, while the LLM classifies the relation type and direction based on entity context.Our results demonstrate the potential of this hybrid approach, showing significant performance gains post-competition (NER Phase 2 Macro F1 improved to 43.6% from 29.5%, RE Phase 1 33.6%Macro F1), which are already described in this paper, and highlighting the benefits of integrating structured graph learning with LLM reasoning for information extraction.

Fundação para a Ciência e a Tecnologia
Openalex Percentile: Top 80%
Software Reliability and Analysis Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Inductive Learning on Heterogeneous Graphs Enhanced by LLMs for Software Mention Detection — Gabriel Silva, Marlene Amorim, et al. · (2025) | TGRS Research Map | TGRS