Semantic Transfer Learning
For the purposes of zero-shot next-token and sequence-to-sequence learning, Noken implicit deep learning models, can be composed and connected into feedback loops, enabling a myriad of network configurations to be explored, and so find ways to lower average entropy. Beyond statistical correlations, this novel attention mechanism is based on semantic architecture. Suppose we have learned the semantics of two different subject domains and want to explore interdisciplinary inquiries. Without starting over from scratch and training on the all combined data (which may in fact muddle matters) we introduce an algorithm to leverage and transfer the individual semantics to make sense of the interdisciplinary corpus.
Authors
- Gary Nan Tie
Publication Details
- Journal
- SPIRE - Sciences Po Institutional REpository
- Published
- 2026-01-01
- DOI
- https://doi.org/10.13140/rg.2.2.36220.40324
- Primary Topic
- Domain Adaptation and Few-Shot Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00