Transfer Learning for Cross-Language Natural Language Processing Models
Cross-language natural language processing (NLP) presents numerous challenges due to the wide array of linguistic structures and vocabulary found within each language. Transfer learning has proven itself successful at meeting these challenges by drawing upon knowledge gained in highly resourced languages to enhance performance in lower resource ones. This paper investigates the application of transfer learning in cross-language NLP, exploring various methodologies, models and their efficacy. More specifically, we investigate mechanisms related to model adaptation, fine-tuning techniques and integration of multilingual data sources. Through experiments and analyses on tasks such as sentiment analysis, named entity recognition and machine translation across multiple languages, we demonstrate how transfer learning can enhance model performance. Our experiments reveal significant increases in both prediction accuracy and generalization across low-resource languages - providing valuable insight into future research directions as well as global NLP deployment applications.
Institutions
- Georgia Institute of Technology (US)
- Illinois Institute of Technology (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2024-09-01
- DOI
- https://doi.org/10.5281/zenodo.13366733
- Citations
- 1
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.35