dānaSeq nanopore_live: real-time processing of Oxford Nanopore metagenomic reads

Motivation: During an Oxford Nanopore run, MinKNOW writes basecalled reads to disk as a growing series of small FASTQ files. On ships and at field stations, analysis must run on the sequencing workstation, keep up with the run, and end with a loss-free move of the data to archival storage. Results: nanopore_live is the real-time component of the dānaSeq suite, a Nextflow DSL2 workflow that processes a MinKNOW output directory one file at a time, either once (batch mode) or continuously as new files appear (watch mode). Damaged files are salvaged and reads are filtered by length and a Filtlong-style quality score. Optional steps add Kraken2 classification, per-read GTDB sendsketch queries, tetranucleotide profiles, minimap2 mapping to reference genomes, Bakta or Prokka annotation, and HMMER or DIAMOND searches of protein databases such as pollutant-gene catalogues. Results are organised by flow cell and barcode and loaded into one DuckDB database per barcode, which feeds an interactive dashboard that is refreshed every 10 minutes in watch mode and can be published to microscape.app. An optional launcher mode detects the end of the run, waits for the workflow to finish and archives reads and outputs, merging per-barcode chunks only after size, gzip and checksum checks. The pipeline runs on a sequencing workstation or within a cluster allocation, using conda environments or a Docker image. Availability and implementation: dānaSeq is released under the MIT license at https://github.com/rec3141/danaSeq (this description corresponds to release v1.3.0, https://github.com/rec3141/danaSeq/releases/tag/v1.3.0); documentation at https://rec3141.github.io/danaSeq/.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-02
DOI
https://doi.org/10.5281/zenodo.23899191
Primary Topic
Genomics and Phylogenetic Studies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

dānaSeq nanopore_live: real-time processing of Oxford Nanopore metagenomic reads

R. Eric Collins
6 links
Zenodo (CERN European Organization for Nuclear Research)
Genomics and Phylogenetic Studies
preprint

dānaSeq nanopore_live: real-time processing of Oxford Nanopore metagenomic reads

R. Eric Collins
preprint en

Abstract

Motivation: During an Oxford Nanopore run, MinKNOW writes basecalled reads to disk as a growing series of small FASTQ files. On ships and at field stations, analysis must run on the sequencing workstation, keep up with the run, and end with a loss-free move of the data to archival storage. Results: nanopore_live is the real-time component of the dānaSeq suite, a Nextflow DSL2 workflow that processes a MinKNOW output directory one file at a time, either once (batch mode) or continuously as new files appear (watch mode). Damaged files are salvaged and reads are filtered by length and a Filtlong-style quality score. Optional steps add Kraken2 classification, per-read GTDB sendsketch queries, tetranucleotide profiles, minimap2 mapping to reference genomes, Bakta or Prokka annotation, and HMMER or DIAMOND searches of protein databases such as pollutant-gene catalogues. Results are organised by flow cell and barcode and loaded into one DuckDB database per barcode, which feeds an interactive dashboard that is refreshed every 10 minutes in watch mode and can be published to microscape.app. An optional launcher mode detects the end of the run, waits for the workflow to finish and archives reads and outputs, merging per-barcode chunks only after size, gzip and checksum checks. The pipeline runs on a sequencing workstation or within a cluster allocation, using conda environments or a Docker image. Availability and implementation: dānaSeq is released under the MIT license at https://github.com/rec3141/danaSeq (this description corresponds to release v1.3.0, https://github.com/rec3141/danaSeq/releases/tag/v1.3.0); documentation at https://rec3141.github.io/danaSeq/.

Zenodo (CERN European Organization for Nuclear Research)
University of Manitoba (CA)
Genomics and Phylogenetic Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon