Fibration Attention Dynamics
We characterize the dynamics of query updating coming from fibration abductive attention mechanisms, using perturbed Koopman operators that are invertible. Importantly, we identify conditions for Lyapunov stability of solutions near equilibrium points. Depending on the Koopman resolvent, some key-value pairings can have query update trajectories that are Lyapunov stable.
Authors
- Gary Nan Tie
Publication Details
- Journal
- SPIRE - Sciences Po Institutional REpository
- Published
- 2025-01-01
- DOI
- https://doi.org/10.13140/rg.2.2.36796.09600
- Primary Topic
- Structural Health Monitoring Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00