Accelerating Machine Learning Research in Fusion Through a Pydantic‑Centred Human‑in‑the‑Loop Architecture

{"Training":[0],"high-performing":[1],"ML":[2,44,137],"models":[3,102,138],"requires":[4],"large":[5],"volumes":[6],"of":[7,29,35,133],"high":[8],"quality,":[9],"labelled":[10],"data.":[11],"While":[12],"nuclear":[13],"fusion":[14],"experiments":[15],"generate":[16],"extensive":[17],"datasets":[18],"–":[19,33],"JET":[20,210],"produced":[21],"105,929":[22],"pulses,":[23],"each":[24],"with":[25,107,130,145,220],"more":[26],"than":[27,173],"10GB":[28],"raw":[30],"data":[31,37,87,101,124,189,215],"[1]":[32],"much":[34],"this":[36,68],"lacks":[38],"the":[39,58,143,152,161,199],"annotations":[40,109],"necessary":[41],"for":[42,83,116,163],"effective":[43],"training.":[45],"Retrospective":[46],"annotation":[47,81],"is":[48],"both":[49],"challenging":[50],"and":[51,71,95,147,154,184,192,217,227],"time":[52],"consuming,":[53],"as":[54],"domain":[55,72,185],"experts":[56,73],"lack":[57],"appropriate":[59],"tools":[60],"to":[61,76,223],"effectively":[62],"label":[63],"historic":[64],"pulses.":[65],"To":[66],"address":[67],"challenge,":[69],"RSEs":[70,183],"have":[74],"collaborated":[75],"develop":[77],"an":[78],"open-source":[79],"human-in-the-loop":[80],"platform":[82],"labelling":[84,174],"tokamak":[85],"diagnostic":[86],"[2].":[88],"This":[89,177],"combines":[90],"a":[91,96,112,195],"web-based":[92],"user":[93],"interface":[94],"REST":[97],"API":[98],"built":[99],"around":[100],"defined":[103,141],"using":[104,156],"Pydantic":[105],"[3],":[106],"validated":[108],"stored":[110],"in":[111,198,211],"MongoDB":[113,240],"[4]":[114],"database":[115],"later":[117],"reuse.":[118],"The":[119,239],"modular":[120],"design":[121],"supports":[122],"multiple":[123],"access":[125],"layers":[126],"from":[127,175],"different":[128],"machines,":[129],"simple":[131],"integration":[132],"new":[134],"sources.":[135],"Custom":[136],"can":[139,166],"be":[140],"by":[142],"user,":[144],"training":[146],"prediction":[148],"tasks":[149],"scheduled":[150],"via":[151],"UI":[153],"executed":[155],"Ray":[157],"[5].":[158],"These":[159],"reduce":[160],"workload":[162],"scientists,":[164],"who":[165],"focus":[167],"on":[168,188],"refining":[169],"model":[170],"predictions":[171],"rather":[172],"scratch.":[176],"demonstrates":[178],"how":[179],"infrastructure":[180],"co-developed":[181],"between":[182],"experts,":[186],"focussed":[187],"validation,":[190],"extensibility":[191],"reusability,":[193],"plays":[194],"key":[196],"role":[197],"research":[200],"journey.":[201],"[1]:":[202],"Vega,":[203],"J.,":[204],"et":[205],"al.":[206],"\\"New":[207],"developments":[208],"at":[209],"diagnostics,":[212],"real-time":[213],"control,":[214],"acquisition":[216],"information":[218],"retrieval":[219],"potential":[221],"application":[222],"ITER.\\"":[224],"Fusion":[225],"Engineering":[226],"Design":[228],"84.12":[229],"(2009):":[230],"2136-2144.":[231],"[2]:":[232],"TokTagger.":[233],"https://github.com/ukaea/toktagger":[234],"[3]:":[235],"Pydantic.":[236],"https://github.com/pydantic/pydantic":[237],"[4]:":[238],"Database.":[241],"https://github.com/mongodb/mongo":[242],"[5]:":[243],"Ray.":[244],"https://github.com/ray-project/ray":[245]}

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-25
DOI
https://doi.org/10.5281/zenodo.22095083
Primary Topic
Magnetic confinement fusion research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Accelerating Machine Learning Research in Fusion Through a Pydantic‑Centred Human‑in‑the‑Loop Architecture

Saiful Khan, Nathan Cummings, S. Pamela, R.O.S.S. da Costa et al.
Zenodo (CERN European Organization for Nuclear Research)
Magnetic confinement fusion research
article

Accelerating Machine Learning Research in Fusion Through a Pydantic‑Centred Human‑in‑the‑Loop Architecture

Saiful Khan, Nathan Cummings, S. Pamela, R.O.S.S. da Costa, Prakhar Sharma, Joshua Blake, Alejandra González-Beltrán, Matthew Field, Samuel Jackson, Nitesh Bhatia, Abdullah Saleem
article en

Abstract

Training high-performing ML models requires large volumes of high quality, labelled data. While nuclear fusion experiments generate extensive datasets – JET produced 105,929 pulses, each with more than 10GB of raw data [1] – much of this data lacks the annotations necessary for effective ML training. Retrospective annotation is both challenging and time consuming, as domain experts lack the appropriate tools to effectively label historic pulses. To address this challenge, RSEs and domain experts have collaborated to develop an open-source human-in-the-loop annotation platform for labelling tokamak diagnostic data [2]. This combines a web-based user interface and a REST API built around data models defined using Pydantic [3], with validated annotations stored in a MongoDB [4] database for later reuse. The modular design supports multiple data access layers from different machines, with simple integration of new sources. Custom ML models can be defined by the user, with training and prediction tasks scheduled via the UI and executed using Ray [5]. These reduce the workload for scientists, who can focus on refining model predictions rather than labelling from scratch. This demonstrates how infrastructure co-developed between RSEs and domain experts, focussed on data validation, extensibility and reusability, plays a key role in the research journey. [1]: Vega, J., et al. "New developments at JET in diagnostics, real-time control, data acquisition and information retrieval with potential application to ITER." Fusion Engineering and Design 84.12 (2009): 2136-2144. [2]: TokTagger. https://github.com/ukaea/toktagger [3]: Pydantic. https://github.com/pydantic/pydantic [4]: The MongoDB Database. https://github.com/mongodb/mongo [5]: Ray. https://github.com/ray-project/ray

Zenodo (CERN European Organization for Nuclear Research)
Science and Technology Facilities Council (GB), United Kingdom Atomic Energy Authority (GB)
Industry, innovation and infrastructure
Openalex Percentile: Top 11%
Magnetic confinement fusion research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.