AI-enabled Audio and Chat Collaboration Services
In this paper we investigate an approach to improve audio services for use at the tactical edge where networks can be characterized as Disconnected, Intermittent and Limited (DIL). We look at using newer artificial intelligence speech recognition systems, namely Vosk and OpenAI’s Whisper, to bring transcription functionality to the services. Allowing services to convert voice audio to text will reduce the strain on the network, which is an important aspect to consider in DIL environments.To demonstrate our approach to improve audio services, we introduce a speech-to-text (STT) application that implements both Vosk and Whisper as transcriber modules. The application builds on a technology stack with three parts that includes transcription, messaging and Voice over IP. In addition to having STT functionality, we also implement the reverse: a text-to-speech module that translates a text message back to audio for the recipient.The paper discusses the design and architecture of the application, detailing how the technology stack is built using a set of technologies that benefit audio services that are used in DIL networks. The application needs to work at the tactical edge where resources are sparse, and we therefore evaluate the implemented transcribers with regard to resource use. Finally, we investigate the accuracy of both transcribers to assess the quality they deliver.
Authors
- Emil P. Andersen
- Frank T. Johnsen (ORCID: https://orcid.org/0000-0002-7658-4503)
- Jesper R. Goksør
- Sindre E. Halleraker
- Simen Kvalø
- Ole P. Myhre
- Tobias S. Omdal
- Herman H. Seternes
- Leander S. Thorstad
Institutions
- Norwegian Defence Research Establishment (NO)
- Norwegian University of Science and Technology (NO)
Publication Details
- Published
- 2024-10-28
- DOI
- https://doi.org/10.1109/milcom61039.2024.10773645
- Primary Topic
- Business Process Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00