Understanding Cross-Domain Adaptation in Low-Resource Topic Modeling
Topic modeling plays a vital role in uncovering hidden semantic structures within text corpora, but existing models struggle in lowresource settings where limited target-domain data leads to unstable and incoherent topic inference.We address this challenge by formally introducing domain adaptation for lowresource topic modeling, where a high-resource source domain informs a low-resource target domain without overwhelming it with irrelevant content.We establish a finite-sample generalization bound showing that effective knowledge transfer depends on robust performance in both domains, minimizing latent-space discrepancy, and preventing overfitting to the data.Guided by these insights, we propose DALTA (Domain-Aligned Latent Topic Adaptation), a new framework that employs a shared encoder for domain-invariant features, specialized decoders for domain-specific nuances, and adversarial alignment to selectively transfer relevant information.Experiments on diverse lowresource datasets demonstrate that DALTA consistently outperforms state-of-the-art methods in terms of topic coherence, stability, and transferability.
Authors
- Pritom Saha Akash
- Kevin Chen–Chuan Chang (ORCID: https://orcid.org/0000-0003-0997-6803)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.298
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- Center for Cognitive Computing Systems Research
- Zhejiang University
- University of Illinois at Urbana-Champaign
- Office of the Vice Chancellor for Research, University of Illinois at Chicago