Random Masked Autoencoders Framework for Multi-View Multi-Label Learning with Incomplete Views and Labels

Dual incomplete multi-view multi-label learning (DIMVMLL) aims to make accurate predictions for multiple labels by exploiting incomplete multi-view information and incomplete multi-label information from input samples. Since the view information and label information of samples are incomplete in this task, existing DIMVMLL methods classify samples based on the semantic relationships between view features and labels. However, in the DIMVMLL task, exploring the consistent and complementary information between views is important for the classification performance of model. To learn high-quality view consistency information and complementary information, we propose random masked autoencoders framework (RMAF). First, we design a triple reconstruction loss for the dual-channel autoencoders to guide the model in extracting consistent and complementary information between views and introduce contrastive learning to guide the model in learning private information for each view. Second, we propose a feature-level random masking strategy to enhance high-level feature extract ability of the autoencoders. Furthermore, to preserve the feature semantic structure, we introduce structure loss. Extensive experiments have validated the effectiveness of our model.