Large language model surrogates for Bayesian optimization of antibody sequences

Enhancing therapeutic antibody properties typically requires iterative sequence engineering and experimental validation, such as binding assays, making antibody optimization time-consuming and resource intensive. To address these challenges, we introduce AbL2BO, a Bayesian optimization (BO) framework integrating a large language model (LLM) with Bayesian fine-tuning. AbL2BO leverages prior knowledge embedded in an antibody-specific LLM and efficiently updates model parameters using Bayesian Low-Rank Adaptation (LoRA) with approximate inference, including the Laplace approximation or MC dropout. The fine-tuned LLM serves as a surrogate model within the BO framework. Our results show that AbL2BO achieves superior sample efficiency compared to conventional BO methods that rely on Gaussian process regression to model black-box functions. Across experimental and simulated benchmark datasets, AbL2BO consistently demonstrated competitive or superior optimization performance with better-calibrated uncertainty estimates than kernel-based BO approaches. Integrating LLMs into BO offers three key advantages: (1) warm-starting the optimization with pretrained knowledge; (2) easy adaptation to new domains; and (3) bypassing the complexities of kernel design choices, kernel computation, and sequence alignment to handle sequences of varying length. Overall, AbL2BO improves both optimization efficiency and uncertainty estimation, particularly for complex antibody sequence landscapes, with the potential to reduce time and resource requirements in therapeutic antibody development.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-21
DOI
https://doi.org/10.1038/s41598-026-71466-6
Primary Topic
Advanced Bandit Algorithms Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Large language model surrogates for Bayesian optimization of antibody sequences

Eunna Huh, Seungjin Choi, Hyunjin Shin
Scientific Reports
Advanced Bandit Algorithms Research
article

Large language model surrogates for Bayesian optimization of antibody sequences

Eunna Huh, Seungjin Choi, Hyunjin Shin
article en

Abstract

Enhancing therapeutic antibody properties typically requires iterative sequence engineering and experimental validation, such as binding assays, making antibody optimization time-consuming and resource intensive. To address these challenges, we introduce AbL2BO, a Bayesian optimization (BO) framework integrating a large language model (LLM) with Bayesian fine-tuning. AbL2BO leverages prior knowledge embedded in an antibody-specific LLM and efficiently updates model parameters using Bayesian Low-Rank Adaptation (LoRA) with approximate inference, including the Laplace approximation or MC dropout. The fine-tuned LLM serves as a surrogate model within the BO framework. Our results show that AbL2BO achieves superior sample efficiency compared to conventional BO methods that rely on Gaussian process regression to model black-box functions. Across experimental and simulated benchmark datasets, AbL2BO consistently demonstrated competitive or superior optimization performance with better-calibrated uncertainty estimates than kernel-based BO approaches. Integrating LLMs into BO offers three key advantages: (1) warm-starting the optimization with pretrained knowledge; (2) easy adaptation to new domains; and (3) bypassing the complexities of kernel design choices, kernel computation, and sequence alignment to handle sequences of varying length. Overall, AbL2BO improves both optimization efficiency and uncertainty estimation, particularly for complex antibody sequence landscapes, with the potential to reduce time and resource requirements in therapeutic antibody development.

Scientific Reports
Seoul School of Integrated Sciences and Technologies (KR)
Advanced Bandit Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon