Assessing individual speaker state and team based speech communication dynamics within the APOLLO lunar missions: Leveraging fearless steps APOLLO community resource

In naturalistic speech communications, assessing individual speaker state and collaborative team dynamics is useful for problem solving in time sensitive tasks. The NASA Apollo program represents a massive longitudinal effort for team problem-solving. For the last decade, CRSS-UTDallas has worked to recover this data, creating the Fearless Steps Apollo (FS-APOLLO) community resource. This collection of 150000 h of digitized naturalistic audio and associated meta-data from advanced speech diarization/recognition is being released for speech science, technology, and historical preservation. This current effort focuses on comparing three Apollo missions to assess speaker stress/emotion/state and team communication dynamics. Apollo (A11, A7, and A13) missions were chosen, with 5 h of audio across five NASA team channels for each mission. A comprehensive speech and speaker analysis system was developed for independent measurement of stress, vocal intensity, Lombard effect, and emotion metrics. An integrated speech/speaker diarization pipeline was first applied to separate speech blocks. Next, this system was used to analyze Apollo team conversations, employing emotion recognition and task stress profiling to capture the social-linguistic-task based aspects of group interactions. Individual and team results will be presented from this study. Through this effort, we aim to create new opportunities for speech scientists and researchers to collaborate on developing effective metrics for speaker assessment.