Optimising Active Learning with a Decreasing-Budget-Based Strategy: A Medical Application Case Study

The collection and annotation of data for supervised machine learning remain challenging and costly tasks, particularly in domains that demand expert knowledge. Depending on the application, labelling may require highly specialised professionals, significantly increasing the overall effort and expense. Active learning techniques offer a promising solution by reducing the number of annotations needed, thereby lowering costs without compromising model performance. This work proposes an active learning with a decreasing-budget-based strategy to reduce the effort required to annotate medical images. The strategy encourages data annotators to focus on initial iterations, optimise budget allocation, and ensure that the trained model achieves maximum performance with reduced effort in subsequent iterations. This strategy also improves the performance of deep learning models, which perform better with fewer images, reducing the specialists’ workload. This work also introduces three experiments that contribute to understanding the impact of the strategy in the annotation process.