Causal Temporal Neural Networks Using the Conditional Average Treatment Effect
This paper presents a method to integrate causal inference into deep learning for time series forecasting. We consider time series for complex systems characterized by non-linear dynamics, high dimensionality, and uncertainty. The challenge of effectively capturing temporal dependencies persists due to the prevalence of spurious correlations. To overcome this, our method integrates Long Short-Term Memory (LSTM) for sequence forecasting with prior knowledge about the causal structure of the system. For this, we introduce a causal regularization term that controls for the Conditional Average Treatment Effect (CATE). Experimental results across real and synthetic datasets demonstrate superior performance compared to state-of-the-art models. Furthermore, an ablation study highlights the critical role of causal regularization graph-based interventions alongside causal feature selection. By embedding a learned causal graph derived from causal discovery to identify the optimal predictors that improve model performance and reduce uncertainties.
Authors
- Shahenda Youssef (ORCID: https://orcid.org/0000-0002-7697-4456)
- Jürgen Beyerer (ORCID: https://orcid.org/0000-0003-3556-7181)
- Julius Pfrommer (ORCID: https://orcid.org/0000-0002-4204-6758)
Institutions
- Karlsruhe Institute of Technology (DE)
- Fraunhofer Institute of Optronics, System Technologies and Image Exploitation (DE)
Publication Details
- Published
- 2025-05-05
- DOI
- https://doi.org/10.1109/cai64502.2025.00015
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- California Department of Fish and Game