Patch-MLP-TS: A Channel-Independent, Attention-Free Architecture for Long-Term Time Series Forecasting
Patch-MLP-TS is a channel-independent, attention-free architecture for long-term time series forecasting. The work investigates whether patch-based representations can be combined with MLP-based token and feature mixing without relying on attention. During development, a failure mode was identified in a naive patch-plus-MLP design where the absence of positional information and cross-patch interaction caused temporal order information to be lost. The proposed approach addresses this through positional information and cross-patch mixing and is evaluated on the ETT and Electricity benchmarks against linear and attention-based forecasting models. The study includes multi-seed benchmarking, ablation studies, patch-length analysis, and measured training and inference efficiency.
Authors
- Vedant Jadhav (ORCID: https://orcid.org/0009-0002-6784-9511)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-09-29
- DOI
- https://doi.org/10.5281/zenodo.23047307
- Primary Topic
- Forecasting Techniques and Applications
- Type
- preprint