Embedding kernels for sequence-function relationships

A central challenge in biology is understanding how variation in biological sequences (DNA, RNA, and protein) impacts function. Recent advances in high-throughput techniques have enabled the measurement of such sequence-function relationships on an unprecedented scale. However, analyzing these complex datasets requires models that are both flexible and mathematically tractable. We consider Gaussian process regression, a Bayesian method that specifies a Gaussian prior distribution over sequence-function relationships. The prior is defined by a kernel function that encodes the expected covariance between pairs of sequences. We study a family of embedding kernels in which the covariance depends on the distance between sequences in a learned embedding space, making these kernels both expressive and interpretable. We show that linear embedding kernels generalize previously studied classes of kernels and can more flexibly express variability in the expected similarity between mutational effects across genetic backgrounds, allowing the resulting priors to encode more complex biological mechanisms such as RNA base-pairing. We implement these methods using a GPU-accelerated Gaussian process framework, allowing us to learn linear embeddings and make predictions with datasets containing hundreds of thousands of measurements. We find that our embedding kernels match or improve the predictive performance of other kernels across various high-throughput sequence-function datasets, including protein datasets ranging from short motifs to full-length proteins. Furthermore, the learned embedding spaces provide insight into biological mechanisms underlying sequence-function relationships.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-17
DOI
https://doi.org/10.64898/2026.11.15.766687
Primary Topic
Gaussian Processes and Bayesian Inference
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Embedding kernels for sequence-function relationships

David M. McCandlish, Samantha Petti, Carlos Martí‐Gómez, Waverly Carabba
1 links
bioRxiv (Cold Spring Harbor Laboratory)
Gaussian Processes and Bayesian Inference
preprint

Embedding kernels for sequence-function relationships

David M. McCandlish, Samantha Petti, Carlos Martí‐Gómez, Waverly Carabba
preprint en

Abstract

A central challenge in biology is understanding how variation in biological sequences (DNA, RNA, and protein) impacts function. Recent advances in high-throughput techniques have enabled the measurement of such sequence-function relationships on an unprecedented scale. However, analyzing these complex datasets requires models that are both flexible and mathematically tractable. We consider Gaussian process regression, a Bayesian method that specifies a Gaussian prior distribution over sequence-function relationships. The prior is defined by a kernel function that encodes the expected covariance between pairs of sequences. We study a family of embedding kernels in which the covariance depends on the distance between sequences in a learned embedding space, making these kernels both expressive and interpretable. We show that linear embedding kernels generalize previously studied classes of kernels and can more flexibly express variability in the expected similarity between mutational effects across genetic backgrounds, allowing the resulting priors to encode more complex biological mechanisms such as RNA base-pairing. We implement these methods using a GPU-accelerated Gaussian process framework, allowing us to learn linear embeddings and make predictions with datasets containing hundreds of thousands of measurements. We find that our embedding kernels match or improve the predictive performance of other kernels across various high-throughput sequence-function datasets, including protein datasets ranging from short motifs to full-length proteins. Furthermore, the learned embedding spaces provide insight into biological mechanisms underlying sequence-function relationships.

bioRxiv (Cold Spring Harbor Laboratory)
Tufts University (US), Cold Spring Harbor Laboratory (US)
National Institutes of Health, Simons Center for Quantitative Biology, Cold Spring Harbor Laboratory
Gaussian Processes and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon