AI-enabled Audio and Chat Collaboration Services

In this paper we investigate an approach to improve audio services for use at the tactical edge where networks can be characterized as Disconnected, Intermittent and Limited (DIL). We look at using newer artificial intelligence speech recognition systems, namely Vosk and OpenAI’s Whisper, to bring transcription functionality to the services. Allowing services to convert voice audio to text will reduce the strain on the network, which is an important aspect to consider in DIL environments.To demonstrate our approach to improve audio services, we introduce a speech-to-text (STT) application that implements both Vosk and Whisper as transcriber modules. The application builds on a technology stack with three parts that includes transcription, messaging and Voice over IP. In addition to having STT functionality, we also implement the reverse: a text-to-speech module that translates a text message back to audio for the recipient.The paper discusses the design and architecture of the application, detailing how the technology stack is built using a set of technologies that benefit audio services that are used in DIL networks. The application needs to work at the tactical edge where resources are sparse, and we therefore evaluate the implemented transcribers with regard to resource use. Finally, we investigate the accuracy of both transcribers to assess the quality they deliver.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/milcom61039.2024.10773645
Primary Topic
Business Process Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-enabled Audio and Chat Collaboration Services

Emil P. Andersen, Frank T. Johnsen, Jesper R. Goksør, Sindre E. Halleraker et al.
Business Process Modeling and Analysis
article

AI-enabled Audio and Chat Collaboration Services

Emil P. Andersen, Frank T. Johnsen, Jesper R. Goksør, Sindre E. Halleraker, Simen Kvalø, Ole P. Myhre, Tobias S. Omdal, Herman H. Seternes, Leander S. Thorstad
article en

Abstract

In this paper we investigate an approach to improve audio services for use at the tactical edge where networks can be characterized as Disconnected, Intermittent and Limited (DIL). We look at using newer artificial intelligence speech recognition systems, namely Vosk and OpenAI’s Whisper, to bring transcription functionality to the services. Allowing services to convert voice audio to text will reduce the strain on the network, which is an important aspect to consider in DIL environments.To demonstrate our approach to improve audio services, we introduce a speech-to-text (STT) application that implements both Vosk and Whisper as transcriber modules. The application builds on a technology stack with three parts that includes transcription, messaging and Voice over IP. In addition to having STT functionality, we also implement the reverse: a text-to-speech module that translates a text message back to audio for the recipient.The paper discusses the design and architecture of the application, detailing how the technology stack is built using a set of technologies that benefit audio services that are used in DIL networks. The application needs to work at the tactical edge where resources are sparse, and we therefore evaluate the implemented transcribers with regard to resource use. Finally, we investigate the accuracy of both transcribers to assess the quality they deliver.

Norwegian Defence Research Establishment (NO), Norwegian University of Science and Technology (NO)
Openalex Percentile: Top 66%
Business Process Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.