Quantifying Homology and Length Bias in Antimicrobial Peptide Prediction

Bacteria are becoming resistant to existing antibiotics faster than new ones are found. Antimicrobial peptides are a promising alternative, but laboratory testing is slow and costly. Candidates are therefore ranked first by a classifier, and published classifiers report near-perfect accuracy. Two controls are missing from the benchmarks behind those numbers. Training and test peptides are not separated by sequence homology. The negative class is not matched to the positive class by length. We propose a controlled evaluation protocol that imposes both, plus a sample-size control that separates matching from the data it removes. We apply it to a four-model ensemble of our own and ten baselines on a benchmark of 16,168 sequences, holding the models fixed. A classifier given nothing but peptide length separates the benchmark far above chance. Homology control costs 0.067 MCC and length matching a further 0.115, taking the reported score from 0.834 to 0.661. Over ten redrawn partitions the length term holds while the homology term shrinks, so length is the effect that survives. The protocol also reorders the methods, and a frozen ESM-2 embedding overtakes the ensemble. Three published benchmarks show the same pattern. We recommend a minimum reporting standard that makes such losses visible.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-18
DOI
https://doi.org/10.64898/2026.11.18.767483
Primary Topic
Antimicrobial Peptides and Activities
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Quantifying Homology and Length Bias in Antimicrobial Peptide Prediction

Mohammad Ali Moni, Amarda Shehu, Sajib Acharjee Dip, Bikash Kumar Paul et al.
2 links
bioRxiv (Cold Spring Harbor Laboratory)
Antimicrobial Peptides and Activities
preprint

Quantifying Homology and Length Bias in Antimicrobial Peptide Prediction

Mohammad Ali Moni, Amarda Shehu, Sajib Acharjee Dip, Bikash Kumar Paul, Liqing Zhang
preprint en

Abstract

Bacteria are becoming resistant to existing antibiotics faster than new ones are found. Antimicrobial peptides are a promising alternative, but laboratory testing is slow and costly. Candidates are therefore ranked first by a classifier, and published classifiers report near-perfect accuracy. Two controls are missing from the benchmarks behind those numbers. Training and test peptides are not separated by sequence homology. The negative class is not matched to the positive class by length. We propose a controlled evaluation protocol that imposes both, plus a sample-size control that separates matching from the data it removes. We apply it to a four-model ensemble of our own and ten baselines on a benchmark of 16,168 sequences, holding the models fixed. A classifier given nothing but peptide length separates the benchmark far above chance. Homology control costs 0.067 MCC and length matching a further 0.115, taking the reported score from 0.834 to 0.661. Over ten redrawn partitions the length term holds while the homology term shrinks, so length is the effect that survives. The protocol also reorders the methods, and a frozen ESM-2 embedding overtakes the ensemble. Three published benchmarks show the same pattern. We recommend a minimum reporting standard that makes such losses visible.

bioRxiv (Cold Spring Harbor Laboratory)
George Mason University (US), The University of Queensland (AU), Virginia Tech (US)
Antimicrobial Peptides and Activities
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon