Radio Meteor Zoo: Turning Citizen Science Annotations into Reliable Meteor Identifications

Radio meteor observations produce large numbers of spectrograms whose automatic analysis is challenging because meteor echoes vary strongly in morphology and contrast and may overlap with aircraft reflections or other signals. In the Radio Meteor Zoo project, volunteers identify meteor echoes by drawing bounding boxes around their spectrogram signatures, which we refer to as annotations in this paper. We investigate whether multiple independent volunteer annotations can be aggregated into reliable meteor detections for scientific use. We benchmark five aggregation methods: the original pixel-consensus procedure, DBSCAN, HDBSCAN, graph-based clustering, and equal-weight box fusion. The input dataset of 2,199 BRAMS (Belgian RAdio Meteor Stations) spectrograms was divided into a development set (used for method selection) and a held-out test set of 556 spectrograms containing 5,302 expert-marked meteors. In the held-out subset, equal-weight box fusion provided the best overall event recovery, whereas the pixel consensus baseline produced the most conservative catalogue. DBSCAN and graph-based clustering produced identical detections under the selected settings and tighter bounding boxes than box fusion, while HDBSCAN recovered fewer events. Low-contrast events were less likely to be recovered. Moreover, many detections with limited bounding-box overlap still corresponded to the same meteor, highlighting differences in annotated extent rather than event identity. These results show that citizen-science annotations can yield reliable meteor catalogues, with the preferred aggregation method depending on whether completeness or accurate localisation is more important for the intended scientific application.

Authors

Institutions

Publication Details

Journal
Monthly Notices of the Royal Astronomical Society
Published
2026-11-20
DOI
https://doi.org/10.1093/mnras/stag2230
Primary Topic
Astro and Planetary Science
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Radio Meteor Zoo: Turning Citizen Science Annotations into Reliable Meteor Identifications

C. Verbeeck, K. Kolenberg, Johan De Keyser, H. Lamy et al.
Monthly Notices of the Royal Astronomical Society
Astro and Planetary Science
article

Radio Meteor Zoo: Turning Citizen Science Annotations into Reliable Meteor Identifications

C. Verbeeck, K. Kolenberg, Johan De Keyser, H. Lamy, Stijn Calders, Antonio Martínez Picar, Elisabeth Baeten
article en

Abstract

Radio meteor observations produce large numbers of spectrograms whose automatic analysis is challenging because meteor echoes vary strongly in morphology and contrast and may overlap with aircraft reflections or other signals. In the Radio Meteor Zoo project, volunteers identify meteor echoes by drawing bounding boxes around their spectrogram signatures, which we refer to as annotations in this paper. We investigate whether multiple independent volunteer annotations can be aggregated into reliable meteor detections for scientific use. We benchmark five aggregation methods: the original pixel-consensus procedure, DBSCAN, HDBSCAN, graph-based clustering, and equal-weight box fusion. The input dataset of 2,199 BRAMS (Belgian RAdio Meteor Stations) spectrograms was divided into a development set (used for method selection) and a held-out test set of 556 spectrograms containing 5,302 expert-marked meteors. In the held-out subset, equal-weight box fusion provided the best overall event recovery, whereas the pixel consensus baseline produced the most conservative catalogue. DBSCAN and graph-based clustering produced identical detections under the selected settings and tighter bounding boxes than box fusion, while HDBSCAN recovered fewer events. Low-contrast events were less likely to be recovered. Moreover, many detections with limited bounding-box overlap still corresponded to the same meteor, highlighting differences in annotated extent rather than event identity. These results show that citizen-science annotations can yield reliable meteor catalogues, with the preferred aggregation method depending on whether completeness or accurate localisation is more important for the intended scientific application.

Monthly Notices of the Royal Astronomical Society
Vrije Universiteit Brussel (BE), University of Antwerp (BE), Royal Belgian Institute for Space Aeronomy (BE), Royal Observatory of Belgium (BE), University of Oxford (GB), KU Leuven (BE)
Alfred P. Sloan Foundation
Astro and Planetary Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon