Too Sharp to Be True? Illusory Gains in Regime-Weighted Conformal Prediction for Daily Rubber Price Changes

This study audits whether regime weighting can sharpen conformal forecast intervals without using target-period information or omitting the required finite-sample correction. Conformal prediction builds such intervals from past forecast errors. A natural refinement gives more weight to errors from days whose volatility resembles the forecast day. On daily natural-rubber prices, the refinement appears to work: intervals become about 20% narrower than plain split-conformal, with a significantly better Winkler score. This paper asks whether that gain is real. Three implementation choices are examined, one at a time. The first uses a regime signal that already sees the price move it is meant to predict. The second estimates the regime model on the same residuals the interval is calibrated on. The third omits a correction that the weighted quantile requires in finite samples. The forecast-feasible construction—predictive regime probabilities, a validation-fitted regime model, and the finite-sample correction—shows no detectable improvement over split-conformal, at a paired Winkler difference of +0.06 (95% CI −0.15 to +0.17). Applying the correction alone is not always enough: it removes the apparent advantage on the VMD-augmented ridge residuals, but the filtered comparison arm survives it on the AR(1) residuals at −0.54. Only withholding target-period information eliminates the artifact on both. Concentrated weights also leave some intervals unbounded, whereas adaptive conformal baselines remain finite throughout. A controlled simulation reproduces the same apparent gain where no regime information exists at all. Apparent sharpness must therefore be audited for information timing, calibration reuse, and the finite-sample correction.

Authors

Institutions

Publication Details

Journal
Forecasting
Published
2026-09-10
DOI
https://doi.org/10.3390/forecast8050082
Primary Topic
Forecasting Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Too Sharp to Be True? Illusory Gains in Regime-Weighted Conformal Prediction for Daily Rubber Price Changes

Montchai Pinitjitsamut
Forecasting
Forecasting Techniques and Applications
article

Too Sharp to Be True? Illusory Gains in Regime-Weighted Conformal Prediction for Daily Rubber Price Changes

Montchai Pinitjitsamut
article en

Abstract

This study audits whether regime weighting can sharpen conformal forecast intervals without using target-period information or omitting the required finite-sample correction. Conformal prediction builds such intervals from past forecast errors. A natural refinement gives more weight to errors from days whose volatility resembles the forecast day. On daily natural-rubber prices, the refinement appears to work: intervals become about 20% narrower than plain split-conformal, with a significantly better Winkler score. This paper asks whether that gain is real. Three implementation choices are examined, one at a time. The first uses a regime signal that already sees the price move it is meant to predict. The second estimates the regime model on the same residuals the interval is calibrated on. The third omits a correction that the weighted quantile requires in finite samples. The forecast-feasible construction—predictive regime probabilities, a validation-fitted regime model, and the finite-sample correction—shows no detectable improvement over split-conformal, at a paired Winkler difference of +0.06 (95% CI −0.15 to +0.17). Applying the correction alone is not always enough: it removes the apparent advantage on the VMD-augmented ridge residuals, but the filtered comparison arm survives it on the AR(1) residuals at −0.54. Only withholding target-period information eliminates the artifact on both. Concentrated weights also leave some intervals unbounded, whereas adaptive conformal baselines remain finite throughout. A controlled simulation reproduces the same apparent gain where no regime information exists at all. Apparent sharpness must therefore be audited for information timing, calibration reuse, and the finite-sample correction.

ForecastingVol. 8(5)
Kasetsart University (TH)
Openalex Percentile: Top 6%
Forecasting Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.