Large Model and Lip Feature Extraction: Key Fusion Points for Building an Efficient Lip Recognition System
This article delves into the application of the large model in lip reading recognition, focusing on the basic principles and architecture of large models, and elaborating on their crucial role in lip feature extraction. The article begins by reviewing the development history of deep learning models, highlighting the characteristics and advantages of large models, and providing an in-depth analysis of typical large model architectures. Subsequently, addressing the difficulties and challenges in lip feature extraction, the article discusses the advantages of large models in feature extraction and explores how they can enhance the accuracy of lip reading recognition. Furthermore, the article compares traditional lip feature extraction methods with those based on deep learning, further highlighting the application value of large models. Building on this, the article proposes a fusion strategy of large models and lip feature extraction, and validates its application effects through experiments. The experimental results show that this fusion strategy can effectively improve the performance of lip reading recognition. Finally, the article summarizes the research findings and looks forward to the future development trends of lip reading recognition technology.
Authors
- Kun Nie (ORCID: https://orcid.org/0009-0002-6491-4760)
- Jie Tang (ORCID: https://orcid.org/0000-0002-1538-4532)
- Bo Xiao (ORCID: https://orcid.org/0000-0003-2206-1712)
- Zebin Wen (ORCID: https://orcid.org/0009-0007-1903-5034)
Institutions
- Dongguan University of Technology (CN)
Publication Details
- Published
- 2024-11-29
- DOI
- https://doi.org/10.1109/icmsp64464.2024.10866191
- Citations
- 1
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.35