Feedback-Aided Rateless Codes Unequal Error Protection for Multimodal Communication

In multimodal communication, the importance of different modalities varies due to factors such as the nonuniform distribution of information, differences in error tolerance, variations in information redundancy, network environment, and bandwidth limitations, as well as the synergistic effects between modalities. During transmission, due to network conditions and bandwidth constraints, it may not be possible to transmit the information of each modality to the receiver in an intact form to perform multimodal tasks. In response to the transmission characteristics and the unequal error protection requirements described above, this paper proposes an end-to-end multimodal rateless codes unequal error protection scheme from the perspective of logical links. We also introduced a feedback mechanism to implement algorithms such as adaptive code length adjustment, adaptive degree distribution, adaptive weight rotation allocation, and maximum weight constraints. Compared to previous schemes, the proposed solution in this paper further reduces the decoding overhead and recovery latency of less important modality, thus improving resource utilization.