Mitigating memory latency in FM Index search

Bowtie 2 is a popular short sequence aligner used by many bioinformatics groups, often as part of the Qiita microbial study management platform. One of the key computational steps during alignment is the extraction of seeds from the read sequences and aligning them with the help of the FM Index. This step was memory access-bound, with access latency as the primary limitation due to a pseudo-random-access pattern. In this paper we present the algorithmic changes used and the performance improvements obtained by re-factoring the code to overlap compute with memory pre-fetching.

Authors

Institutions

Publication Details

Published
2024-09-16
DOI
https://doi.org/10.1109/e-science62913.2024.10678707
Primary Topic
Information Retrieval and Search Behavior
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Mitigating memory latency in FM Index search

I. Sfiligoi, Daniel T. McDonald, Rob Knight
Information Retrieval and Search Behavior
article

Mitigating memory latency in FM Index search

I. Sfiligoi, Daniel T. McDonald, Rob Knight
article en

Abstract

Bowtie 2 is a popular short sequence aligner used by many bioinformatics groups, often as part of the Qiita microbial study management platform. One of the key computational steps during alignment is the extraction of seeds from the read sequences and aligning them with the help of the FM Index. This step was memory access-bound, with access latency as the primary limitation due to a pseudo-random-access pattern. In this paper we present the algorithmic changes used and the performance improvements obtained by re-factoring the code to overlap compute with memory pre-fetching.

University of California San Diego (US)
Openalex Percentile: Top 75%
Information Retrieval and Search Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.