Classical finite-element solvers as differentiable graph programs on GPUs
Abstract Conjugate heat transfer in turbomachinery, heat exchangers, and energy systems couples buoyant flow to the surrounding solid on complex geometries. The cost of simulating it is dominated by large sparse linear solves on CPUs. We recast a mixed finite element discretization on unstructured meshes, and its multigrid pressure solve, as sparse graph layers within an automatic differentiation framework. Nothing is trained: weights are entries of the assembled operator, and manufactured solutions recover theoretical convergence orders. Reverse-mode sensitivities match central finite differences; one gradient costs 5.6 forward solves with unrolling and 4.9 with implicit differentiation, nearly constant from one to 32 parameters. Implicit differentiation through every linear solve substantially reduces truncation-induced sensitivity error and makes memory independent of forward iteration count. Against three established solvers, no single code is fastest; the ranking depends on the regime, the size of the problem, and the accuracy demanded. With the discretization, mesh, time step, and tolerances held fixed, the same problem runs up to 181 times faster per step on one GPU than on 32 CPU cores, and the pressure solve alone runs 18.7 times faster. The graph representation depends on operator sparsity rather than the governing equations, providing a route to other assembled discretizations.
Authors
- Babak Badnava (ORCID: https://orcid.org/0000-0002-6779-0655)
- Christopher C. Pain (ORCID: https://orcid.org/0000-0003-4194-2590)
- Francesco Ballarin (ORCID: https://orcid.org/0000-0001-6460-3538)
- Teeratorn Kadeethum (ORCID: https://orcid.org/0000-0002-6815-9179)
- Boyang Chen (ORCID: https://orcid.org/0000-0002-9091-0352)
- Hongying Li
- Harpreet Sethi
- Vignesh Athreya
- Claire Heaney
Institutions
- Università Cattolica del Sacro Cuore (IT)
- Nvidia (United Kingdom) (GB)
- Nanyang Technological University (SG)
- Nvidia (United States) (US)
- Siemens Energy (DE)
- Imperial College London (GB)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-02
- DOI
- https://doi.org/10.21203/rs.3.rs-11156288/v1
- Primary Topic
- Advanced Numerical Methods in Computational Mathematics
- Type
- preprint