Accurate Prediction of Knee Joint Angles Using a Hybrid CNN-LSTM-Attention Network from Surface Electromyography

In various fields such as robotics, rehabilitation, biomechanics, human-machine interfaces, and clinical research, human motion prediction has extensive applications. A hybrid networks model based on Convolutional Neural Network-Long Short-Term Memory-Attention (CNN-LSTM-Attention) was employed in this paper to extract features from the high-dimensional space and time series of surface electromyography (sEMG) data for continuous prediction of knee angles. Five able-bodied subjects participated in the study, walking at a self-selected pace while six surface electromyography (sEMG) signals from muscles involved in knee flexion and extension, along with knee angles, were synchronously recorded. The performance was assessed using the root mean square error (RMSE), Pearson Correlation Coefficient <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$(r)$</tex>, and coefficient of determination <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$(R^{2})$</tex> between estimated and measured knee joint angles. Compared to the CNN, LSTM, and CNN-LSTM algorithms, the adopted method estimated knee angles more accurately, achieving an average RMSE, <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\rho$</tex>, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$R^{2}$</tex> of <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$3.09\pm 0.90,\ 0.9911 \pm 0.0052$</tex>, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$0.9817\pm 0.0108$</tex>, respectively. As the advance time increased, the accuracy of knee joint angle estimation decreased, particularly when the advance time reached 100 ms, at which point the RMSE is 4.83 degress. In addition, the computing time of the prediction model was less than 1 ms, which was shorter than the advance time 100 ms it could predict, thereby facilitating real-time computation in practical environments. Compared to previous studies, the proposed method excelled at extracting features directly from raw signals, avoiding the need for handcrafted feature extraction. Consequently, the model effectively achieved continuous and accurate predictions of joint motion angles and demonstrated potential to reduce latency in the human-machine interface.

Authors

Institutions

Publication Details

Published
2024-12-10
DOI
https://doi.org/10.1109/robio64047.2024.10907528
Citations
1
Primary Topic
Muscle activation and electromyography studies
Type
article
Field-Weighted Citation Impact
0.18

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Accurate Prediction of Knee Joint Angles Using a Hybrid CNN-LSTM-Attention Network from Surface Electromyography

Fangliang Yang, Xinyu Wu, Chunjie Chen, Hui Chen et al.
1 citations
Muscle activation and electromyography studies
0.18
article

Accurate Prediction of Knee Joint Angles Using a Hybrid CNN-LSTM-Attention Network from Surface Electromyography

Fangliang Yang, Xinyu Wu, Chunjie Chen, Hui Chen, Zhuo Wang, Xiangyang Wang
article en
1 citations

Abstract

In various fields such as robotics, rehabilitation, biomechanics, human-machine interfaces, and clinical research, human motion prediction has extensive applications. A hybrid networks model based on Convolutional Neural Network-Long Short-Term Memory-Attention (CNN-LSTM-Attention) was employed in this paper to extract features from the high-dimensional space and time series of surface electromyography (sEMG) data for continuous prediction of knee angles. Five able-bodied subjects participated in the study, walking at a self-selected pace while six surface electromyography (sEMG) signals from muscles involved in knee flexion and extension, along with knee angles, were synchronously recorded. The performance was assessed using the root mean square error (RMSE), Pearson Correlation Coefficient <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$(r)$</tex>, and coefficient of determination <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$(R^{2})$</tex> between estimated and measured knee joint angles. Compared to the CNN, LSTM, and CNN-LSTM algorithms, the adopted method estimated knee angles more accurately, achieving an average RMSE, <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\rho$</tex>, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$R^{2}$</tex> of <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$3.09\pm 0.90,\ 0.9911 \pm 0.0052$</tex>, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$0.9817\pm 0.0108$</tex>, respectively. As the advance time increased, the accuracy of knee joint angle estimation decreased, particularly when the advance time reached 100 ms, at which point the RMSE is 4.83 degress. In addition, the computing time of the prediction model was less than 1 ms, which was shorter than the advance time 100 ms it could predict, thereby facilitating real-time computation in practical environments. Compared to previous studies, the proposed method excelled at extracting features directly from raw signals, avoiding the need for handcrafted feature extraction. Consequently, the model effectively achieved continuous and accurate predictions of joint motion angles and demonstrated potential to reduce latency in the human-machine interface.

Chinese Academy of Sciences (CN), Shenzhen Institutes of Advanced Technology (CN)
National Natural Science Foundation of China, China Postdoctoral Science Foundation, National Key Research and Development Program of China
Openalex Percentile: Top 49%
Muscle activation and electromyography studies
0.18
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.