A negative Delta-BIC is not a detection: calibrating an orbit-versus-noise test on 87 RR Lyrae binary candidates

Binary companions to RR Lyrae stars are sought through the light-travel-time effect (LTTE) in O−C pulsation timing. The same stars show stochastic period fluctuations, which produce O−C excursions of similar size and timescale. This note measures what an information-criterion comparison between an orbital and a noise-only model family establishes for the 87 candidates of Hajdu et al. (2021, ApJ 915, 50). The O−C curves are rebuilt from public OGLE photometry (4,947 timing points; baselines 7.1–20.3 yr) with a procedure checked on synthetic light curves. The noise family follows Koen's (2006, MNRAS 365, 489) covariance model; each orbital model adds an LTTE term. A negative ΔBIC is not a detection. On 3,480 curves simulated from each star's own fitted noise model on its own cadence, the orbital family has the lower BIC in 72.4% of cases (95% interval over stars 68.8–75.9%), and, a post-hoc finding, more often for stars with fewer timing points. A calibrated per-star test. A parametric-bootstrap tail probability (40 null curves per star) rejects 4 of 87 synthetic noise-only stars at a nominal 2.4% threshold (95% interval 1–11%); at both thresholds used the point estimates are about twice nominal, significantly so (in a post-hoc test) only at the second. Against synthetic stars carrying each candidate's own fitted orbit, its power at that threshold is 32% or 94% under two assumptions about the noise under the orbit, both injecting the orbits fitted to the real curves; the second arm was added after the first had been seen. The catalogue. At that threshold 68 of 87 candidates, including all 25 of Hajdu et al.'s best-quality class (an agreement that is not independent evidence), have O−C curves that the fitted noise family does not describe. That rejects the noise family for those stars; it does not establish orbits. The candidates were chosen by eye from 27,480 O−C diagrams for LTTE-like shapes, with earlier-announced candidates added, so the measured false-positive rate is for the wrong population, and the noise family omits other structure such as Blazhko modulation. No candidate is confirmed and none is refuted. Note on versions. Version 2 supersedes version 1, which stays available. The analysis was redone from the OGLE photometry up, with new O−C and model code, and every result was recomputed. Withdrawn from version 1: its conclusion that the sign rule fires on roughly half of pure noise (72.4% here, against 52.4%); its statement that the pass fraction cannot be reconciled with the measured power (that rested on one power estimate from injections that did not cover the sample's amplitudes; the power here is 32% or 94% depending on the noise assumed under the orbit); its estimate that a noise population of the size searched contains stars as orbit-like as the median candidate in numbers of order tens; its claims that the method had never had a calibration, that Koen's procedure was never accompanied by a null distribution, and that the null was measured for the first time; its approximate bootstrap-correction experiment and conclusions; its accounts of its own earlier drafts and analysis history; and its statement that its allocation of draws was decided before any was looked at. Its description of Protassov et al. (2002) and its count of stars whose published period exceeds the baseline are corrected. Full list in the note's Note on versions. Files: the note (PDF) and the analysis bundle (OGLE photometry and catalogue files as used, with checksums and download script; O−C construction and its synthetic test; model code; campaign protocol and post-hoc log; all per-star outputs; summary, claim-verification and self-check scripts; README). Computations and drafting were assisted by an AI system (Claude).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-29
DOI
https://doi.org/10.5281/zenodo.23048122
Primary Topic
Stellar, planetary, and galactic studies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

A negative Delta-BIC is not a detection: calibrating an orbit-versus-noise test on 87 RR Lyrae binary candidates

Dat Tan Nguyen
Zenodo (CERN European Organization for Nuclear Research)
Stellar, planetary, and galactic studies
preprint

A negative Delta-BIC is not a detection: calibrating an orbit-versus-noise test on 87 RR Lyrae binary candidates

Dat Tan Nguyen
preprint en

Abstract

Binary companions to RR Lyrae stars are sought through the light-travel-time effect (LTTE) in O−C pulsation timing. The same stars show stochastic period fluctuations, which produce O−C excursions of similar size and timescale. This note measures what an information-criterion comparison between an orbital and a noise-only model family establishes for the 87 candidates of Hajdu et al. (2021, ApJ 915, 50). The O−C curves are rebuilt from public OGLE photometry (4,947 timing points; baselines 7.1–20.3 yr) with a procedure checked on synthetic light curves. The noise family follows Koen's (2006, MNRAS 365, 489) covariance model; each orbital model adds an LTTE term. A negative ΔBIC is not a detection. On 3,480 curves simulated from each star's own fitted noise model on its own cadence, the orbital family has the lower BIC in 72.4% of cases (95% interval over stars 68.8–75.9%), and, a post-hoc finding, more often for stars with fewer timing points. A calibrated per-star test. A parametric-bootstrap tail probability (40 null curves per star) rejects 4 of 87 synthetic noise-only stars at a nominal 2.4% threshold (95% interval 1–11%); at both thresholds used the point estimates are about twice nominal, significantly so (in a post-hoc test) only at the second. Against synthetic stars carrying each candidate's own fitted orbit, its power at that threshold is 32% or 94% under two assumptions about the noise under the orbit, both injecting the orbits fitted to the real curves; the second arm was added after the first had been seen. The catalogue. At that threshold 68 of 87 candidates, including all 25 of Hajdu et al.'s best-quality class (an agreement that is not independent evidence), have O−C curves that the fitted noise family does not describe. That rejects the noise family for those stars; it does not establish orbits. The candidates were chosen by eye from 27,480 O−C diagrams for LTTE-like shapes, with earlier-announced candidates added, so the measured false-positive rate is for the wrong population, and the noise family omits other structure such as Blazhko modulation. No candidate is confirmed and none is refuted. Note on versions. Version 2 supersedes version 1, which stays available. The analysis was redone from the OGLE photometry up, with new O−C and model code, and every result was recomputed. Withdrawn from version 1: its conclusion that the sign rule fires on roughly half of pure noise (72.4% here, against 52.4%); its statement that the pass fraction cannot be reconciled with the measured power (that rested on one power estimate from injections that did not cover the sample's amplitudes; the power here is 32% or 94% depending on the noise assumed under the orbit); its estimate that a noise population of the size searched contains stars as orbit-like as the median candidate in numbers of order tens; its claims that the method had never had a calibration, that Koen's procedure was never accompanied by a null distribution, and that the null was measured for the first time; its approximate bootstrap-correction experiment and conclusions; its accounts of its own earlier drafts and analysis history; and its statement that its allocation of draws was decided before any was looked at. Its description of Protassov et al. (2002) and its count of stars whose published period exceeds the baseline are corrected. Full list in the note's Note on versions. Files: the note (PDF) and the analysis bundle (OGLE photometry and catalogue files as used, with checksums and download script; O−C construction and its synthetic test; model code; campaign protocol and post-hoc log; all per-star outputs; summary, claim-verification and self-check scripts; README). Computations and drafting were assisted by an AI system (Claude).

Zenodo (CERN European Organization for Nuclear Research)
Stellar, planetary, and galactic studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.