FedDQC: Data Quality Control in Federated Instruction-tuning of Large Language Models

Federated Learning (FL) enables privacypreserving collaborative instruction tuning of large language models (LLMs) by leveraging massively distributed data.However, the decentralized nature of FL exacerbates data quality challenges, as local clients lack global visibility to filter noisy or low-quality samples before training.To resolve this issue, we propose FedDQC, a novel federated instruction tuning framework with dynamic data quality control.Our approach introduces two key innovations.First, we propose instruction-response alignment (IRA)-an efficient client-side metric for quality evaluation requiring only lowcost inference.We validate that higher-IRA data corresponds to more relevant and easierto-learn question-answer pairs.Second, mirroring the human easy-to-hard knowledge acquisition process, we design a quality-aware hierarchical FL training framework, where the LLM is progressively fine-tuned from highto low-IRA data in a collaborative manner.The framework also supports adaptive data quality assessment at each hierarchy, enabling dynamic adjustments throughout the training process.Extensive experiments on synthetic and real-world datasets show that our method significantly improves LLM performance on mixed-quality data in FL.Code is available in https://github.com/DorothyDUUU/FedDQC. Q: 1000 men have provisions for 15 days.If 200 more men join them, for how many days will the provisions last now?A: 100015 = 1200x, x = 12 1000 men have provisions for 15 days.If 200 more men join them, for how many days will the provisions last now?100015 = 1200x, x = 12.