Förbättrad inlärning av lösningsoperatorer med hjälp av linjär approximation

Artificial neural networks have revolutionised the modelling of dynamic systems, offering a data-driven alternative to traditional differential equations. In this thesis, we study how to improve a state-of-the-art RNN-based architecture for learning flow functions of continuous-time control systems by integrating linearised system dynamics knowledge in the hypothesis space. The core problem addressed is whether embedding such prior knowledge can reduce the volume of required training data while improving prediction accuracy and training efficiency. This problem is significant in its complexity and impact. Learning models of high-dimensional nonlinear systems requires a large amount of data and computational resources. This project attempts to bridge the gap between theoretical modelling and practical implementation by combining data-driven learning with insights from linear system theory. To tackle the problem, we analyse in detail the RNN structure proposed in the baseline work. We then implemented a new architecture with a custom RNN cell which incorporates both hidden and system states. The cell update integrates the linearised dynamics, enabling the model to combine physics-informed and learned representations. The experimental results, validated on benchmark systems such as the Van der Pol oscillator, support our hypothesis. The modified architecture achieved comparable or improved accuracy using fewer training epochs, and outperformed the baseline architecture in test loss. These outcomes confirm that embedding approximate system knowledge within the network’s architecture enhances learning efficiency and generalisation. This work contributes to a hybrid modelling framework that can be extended to more complex dynamic systems.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Förbättrad inlärning av lösningsoperatorer med hjälp av linjär approximation

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Geochemistry and Geologic Mapping
article

Förbättrad inlärning av lösningsoperatorer med hjälp av linjär approximation

article en

Abstract

Artificial neural networks have revolutionised the modelling of dynamic systems, offering a data-driven alternative to traditional differential equations. In this thesis, we study how to improve a state-of-the-art RNN-based architecture for learning flow functions of continuous-time control systems by integrating linearised system dynamics knowledge in the hypothesis space. The core problem addressed is whether embedding such prior knowledge can reduce the volume of required training data while improving prediction accuracy and training efficiency. This problem is significant in its complexity and impact. Learning models of high-dimensional nonlinear systems requires a large amount of data and computational resources. This project attempts to bridge the gap between theoretical modelling and practical implementation by combining data-driven learning with insights from linear system theory. To tackle the problem, we analyse in detail the RNN structure proposed in the baseline work. We then implemented a new architecture with a custom RNN cell which incorporates both hidden and system states. The cell update integrates the linearised dynamics, enabling the model to combine physics-informed and learned representations. The experimental results, validated on benchmark systems such as the Van der Pol oscillator, support our hypothesis. The modified architecture achieved comparable or improved accuracy using fewer training epochs, and outperformed the baseline architecture in test loss. These outcomes confirm that embedding approximate system knowledge within the network’s architecture enhances learning efficiency and generalisation. This work contributes to a hybrid modelling framework that can be extended to more complex dynamic systems.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 71%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Förbättrad inlärning av lösningsoperatorer med hjälp av linjär approximation · KTH Publication Database DiVA (KTH Royal Institute of Technology) (2025) | TGRS Research Map | TGRS