A Transformer Architecture for Risk Analysis of Group Effects of Food Nutrients

In medicine, context is crucial for accurate patient diagnosis, as the same indicator can have different implications based on its setting. Transformer architecture models have not yet been applied to analyze nutritional data in patient histories. These models offer significant advantages for biomedical analysis, such as considering global context, interpreting attention weights, and generating informative input vectors. The attention mechanism’s ability to uncover multifactorial relationships can help physicians save time and concentrate on specific patterns identified by the neural network. This study adapted the encoder transformer for tabular data, applying it to classify metabolic disorders in patient history. Research into applying transformer architecture to tabular and dietary data shows great promise, yielding results that align with established medical findings while introducing innovative methods for utilizing attention and vectorizing this data.

Authors

Institutions

Publication Details

Journal
Moscow University Physics Bulletin
Published
2024-12-01
DOI
https://doi.org/10.3103/s0027134924702291
Primary Topic
Biomedical Text Mining and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Transformer Architecture for Risk Analysis of Group Effects of Food Nutrients

Anita Balandina, Andrey Bogdanov, Е. А. Грачев, Sofia I Kisil et al.
Moscow University Physics Bulletin
Biomedical Text Mining and Ontologies
article

A Transformer Architecture for Risk Analysis of Group Effects of Food Nutrients

Anita Balandina, Andrey Bogdanov, Е. А. Грачев, Sofia I Kisil, B. V. Gruzdev, N. A. Savelev, Y. S. Budakyan
article en

Abstract

In medicine, context is crucial for accurate patient diagnosis, as the same indicator can have different implications based on its setting. Transformer architecture models have not yet been applied to analyze nutritional data in patient histories. These models offer significant advantages for biomedical analysis, such as considering global context, interpreting attention weights, and generating informative input vectors. The attention mechanism’s ability to uncover multifactorial relationships can help physicians save time and concentrate on specific patterns identified by the neural network. This study adapted the encoder transformer for tabular data, applying it to classify metabolic disorders in patient history. Research into applying transformer architecture to tabular and dietary data shows great promise, yielding results that align with established medical findings while introducing innovative methods for utilizing attention and vectorizing this data.

Moscow University Physics BulletinVol. 79(S2)
Qualcomm (United Kingdom) (GB), Lomonosov Moscow State University (RU), Moscow City Hospital No 29 (RU)
Zero hunger
Openalex Percentile: Top 77%
Biomedical Text Mining and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.