ResSAT: enhancing spatial transcriptomics prediction from H&E-stained histology images with an interactive spot transformer

Spatial transcriptomics has revolutionized RNA quantification with spatial resolution. Hematoxylin and eosin (H&E) images, the gold standard in medical diagnosis, offer insights into tissue structure, correlating with gene expression patterns. We introduce ResSAT (Residual networks with Spatial encoding-self-Attention Transformer), a framework for predicting spatially resolved transcriptomic profiles from H&E images by integrating image features, spatial locations, and self-attention transformer-based spot interactions. Benchmarking on 10 × Visium datasets, ResSAT outperforms existing methods and preserved biologically meaningful spatial patterns, promising reduced spatial transcriptomics profiling costs and rapid acquisition of numerous profiles.