Better Imputation Does Not Guarantee Better Forecasting: Transmission Efficiency in Two-Step Time Series Pipelines

Abstract Reconstruction accuracy often guides imputer selection for time series forecasting. We examine this practice on four datasets under a historical-window protocol. Inputs exclude observations after the forecast origin; learned imputers are fitted only on training data and frozen during validation and testing. The experiment comprises $2{,}880$ unique configurations and $8{,}640$ training runs across three forecasting seeds ($42$, $123$, $2026$), five imputers and three forecasters: long short-term memory (LSTM), a decomposition-based linear model (DLinear), and a patch-based time series transformer (PatchTST). Forecasting errors are averaged across seeds within each configuration before matched comparisons with Mean imputation. Among $2{,}127$ valid comparisons, median relative changes are $-2.90\%$ for forecasting mean absolute error (MAE) and $-41.22\%$ for reconstruction MAE. The median transmission ratio is $0.0449$. Reconstruction improves while forecasting deteriorates in $19.51\%$ of valid comparisons, with model-specific rates of $34.41\%$ for LSTM, $6.91\%$ for DLinear and $17.21\%$ for PatchTST. Across all $2{,}304$ non-Mean configurations, $74.65\%$ retain the same forecasting-error-change sign across the three seeds. Reconstruction accuracy alone is therefore insufficient to assess downstream forecasting performance under these settings.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-17
DOI
https://doi.org/10.21203/rs.3.rs-11420039/v1
Primary Topic
Time Series Analysis and Forecasting
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Better Imputation Does Not Guarantee Better Forecasting: Transmission Efficiency in Two-Step Time Series Pipelines

Sheng Feng, Yujie Guo, Huiqiao Hou, Qi Li et al.
2 links
Research Square
Time Series Analysis and Forecasting
preprint

Better Imputation Does Not Guarantee Better Forecasting: Transmission Efficiency in Two-Step Time Series Pipelines

Sheng Feng, Yujie Guo, Huiqiao Hou, Qi Li, Yu Chang
preprint en

Abstract

Abstract Reconstruction accuracy often guides imputer selection for time series forecasting. We examine this practice on four datasets under a historical-window protocol. Inputs exclude observations after the forecast origin; learned imputers are fitted only on training data and frozen during validation and testing. The experiment comprises $2{,}880$ unique configurations and $8{,}640$ training runs across three forecasting seeds ($42$, $123$, $2026$), five imputers and three forecasters: long short-term memory (LSTM), a decomposition-based linear model (DLinear), and a patch-based time series transformer (PatchTST). Forecasting errors are averaged across seeds within each configuration before matched comparisons with Mean imputation. Among $2{,}127$ valid comparisons, median relative changes are $-2.90\%$ for forecasting mean absolute error (MAE) and $-41.22\%$ for reconstruction MAE. The median transmission ratio is $0.0449$. Reconstruction improves while forecasting deteriorates in $19.51\%$ of valid comparisons, with model-specific rates of $34.41\%$ for LSTM, $6.91\%$ for DLinear and $17.21\%$ for PatchTST. Across all $2{,}304$ non-Mean configurations, $74.65\%$ retain the same forecasting-error-change sign across the three seeds. Reconstruction accuracy alone is therefore insufficient to assess downstream forecasting performance under these settings.

Research Square
Xi'an University of Architecture and Technology (CN), Shaoxing University (CN)
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon