Sparse Attention-based Hierarchical Node Representation for Spatial Domain Identification

Using deep learning models on spatial transcriptomics data to identify the spatial domain is crucial for uncovering the spatial distribution of cells and gene expression patterns within tissues, essential for understanding complex biological processes and disease mechanisms. Existing methods for spatial domain partitioning often rely on predefined adjacency relationships at a single scale, overlooking the hierarchical structure and functional characteristics of biological tissues. In this paper, we propose SpaNFM, a novel method that leverages sparse attention-based hierarchical node representation and multi-view contrastive learning for spatial domain identification in spatial transcriptomics data. The SpaNFM first treats each spot as a node and constructs two views using different data augmentation techniques based on tissue image information, gene expression profiles, and spatial coordinates of cells. Subsequently, SpaNFM utilizes a sparse attention-based hierarchical node fusion module to generate coarse-grained node representations. This fine-to-coarse hierarchical structure integrates complementary information from multi-granularity node features and reduces model complexity due to the decreased node size. The model parameters are updated using gene expression reconstruction loss and contrastive loss on the coarse-grained node representations from the two views. Finally, the learned node features are subjected to downstream clustering using the Leiden algorithm. We tested SpaNFM on the human dorsolateral prefrontal cortex dataset. The results demonstrate that SpaNFM outperforms other state-of-the-art methods in most cases. The data and code are available at: https://github.com/weiba/SpaNFM

Authors

Institutions

Publication Details

Published
2024-12-03
DOI
https://doi.org/10.1109/bibm62325.2024.10822744
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sparse Attention-based Hierarchical Node Representation for Spatial Domain Identification

Lijun Liu, Li Liu, Wei Dai, Ning Yu et al.
Domain Adaptation and Few-Shot Learning
article

Sparse Attention-based Hierarchical Node Representation for Spatial Domain Identification

Lijun Liu, Li Liu, Wei Dai, Ning Yu, Wei Peng, Xiaodong Fu, Z. H. Ping
article en

Abstract

Using deep learning models on spatial transcriptomics data to identify the spatial domain is crucial for uncovering the spatial distribution of cells and gene expression patterns within tissues, essential for understanding complex biological processes and disease mechanisms. Existing methods for spatial domain partitioning often rely on predefined adjacency relationships at a single scale, overlooking the hierarchical structure and functional characteristics of biological tissues. In this paper, we propose SpaNFM, a novel method that leverages sparse attention-based hierarchical node representation and multi-view contrastive learning for spatial domain identification in spatial transcriptomics data. The SpaNFM first treats each spot as a node and constructs two views using different data augmentation techniques based on tissue image information, gene expression profiles, and spatial coordinates of cells. Subsequently, SpaNFM utilizes a sparse attention-based hierarchical node fusion module to generate coarse-grained node representations. This fine-to-coarse hierarchical structure integrates complementary information from multi-granularity node features and reduces model complexity due to the decreased node size. The model parameters are updated using gene expression reconstruction loss and contrastive loss on the coarse-grained node representations from the two views. Finally, the learned node features are subjected to downstream clustering using the Leiden algorithm. We tested SpaNFM on the human dorsolateral prefrontal cortex dataset. The results demonstrate that SpaNFM outperforms other state-of-the-art methods in most cases. The data and code are available at: https://github.com/weiba/SpaNFM

Kunming University of Science and Technology (CN), SUNY Brockport (US)
National Natural Science Foundation of China
Openalex Percentile: Top 77%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.