Scalable Class-Centric Visual Interactive Labeling

Large unlabeled datasets demand efficient and scalable data labeling solutions, in particular when the number of instances and classes is large. This leads to significant visual scalability challenges and imposes a high cognitive load on the users. Traditional instance-centric labeling methods, where (single) instances are labeled in each iteration struggle to scale effectively in these scenarios. To address these challenges, we introduce cVIL, a Class-Centric Visual Interactive Labeling methodology designed for interactive visual data labeling. By shifting the paradigm from assigning-classes-to-instances to assigning-instances-to-classes , cVIL reduces labeling effort and enhances efficiency for annotators working with large, complex and class-rich datasets. We propose a novel visual analytics labeling interface built on top of the conceptual cVIL workflow, enabling improved scalability over traditional visual labeling. In a user study, we demonstrate that cVIL can improve labeling efficiency and user satisfaction over instance-centric interfaces. The effectiveness of cVIL is further demonstrated through a usage scenario, showcasing its potential to alleviate cognitive load and support experts in managing extensive labeling tasks efficiently. • Introduces a scalable Class-Centric Visual Interactive Labeling methodology called cVIL. • cVIL shifts labeling paradigm from “assign-classes-to-instances” to “assign-instances-to-classes”. • Enhances scalability and reduces cognitive load for annotators of large datasets. • User study indicates that class-centric labeling leads to higher accuracy with fewer labeling actions compared to an instance-centric approach. • Usage scenario highlights cVIL’s potential to ease cognitive load and assist experts in labeling complex datasets containing numerous classes.