From Movement to Meaning: Real-time Detection of Behavioural Patterns in Human Psychology using Deep Learning and Time Series Sequence

Understanding human behaviour and psychology is complex and involves various fields, including cognitive science, neurology, and artificial intelligence (AI). In this study, we introduce a cutting-edge system that detects both manual (like hand gestures) and non-manual (such as facial expressions or body movements) features in real time, using advanced deep learning techniques and time-series analysis. This system translates these human movements into text, providing a powerful tool to analyse subtle behavioural and psychological signals. By processing real-time data, our system significantly advances psychology by detecting small expressions, involuntary gestures, and behaviour patterns often associated with psychological and neurological conditions. For instance, it can help identify repetitive actions or atypical gestures in people with autism spectrum disorder (ASD), which are critical for early diagnosis. It can also track signs of neurodegenerative diseases like Parkinson’s or Alzheimer’s, detecting tremors, posture changes, or facial expressions, and offer insights for early intervention