AudioFacialMatrix: Dataset for Voice and Face AI
This paper introduces the “AudioFacialMatrix” dataset, which is an amalgam of audio and visual data to aid research on human voice and facial imaging through Artificial Intelligence (AI) techniques. The dataset comprises 10,000 pairs of facial images and corresponding voice clips, organized by the nationality of individuals from eight different countries. In addition to detailing the dataset, this paper describes the methodology used for data generation and expansion. Lastly, a clustering task and a liquid neural network implementation are elucidated with a concluding discussion on potential methods to leverage this dataset.
Authors
- Rahul Singh (ORCID: https://orcid.org/0000-0002-0211-2060)
- Rita Singh (ORCID: https://orcid.org/0000-0003-3743-0162)
Institutions
- Amazon (United States) (US)
- Carnegie Mellon University (US)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/csitss64042.2024.10816934
- Citations
- 2
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.69