Domain-Specific Language Models for Continuous Learning

The paper examines the issue of building domain-specific (domain-oriented) language models and the possibility of their continuous learning. A concept is proposed that provides for the introduction of additional cognitive memory with domain administration, designed for the gradual accumulation of new information obtained after the termination of learning the language model. The issue of transition from the inference mode to a new model learning is considered.