VisualCent: Visual Human Analysis using Dynamic Centroid Representation

We introduce VisualCent, a unified human pose and instance segmentation framework to address generalizability and scalability limitations to multi-person visual human analysis. VisualCent leverages centroid-based bottomup keypoint detection paradigm and uses Keypoint Heatmap incorporating Disk Representation and KeyCentroid to identify the optimal keypoint coordinates. For the unified segmentation task, an explicit keypoint is defined as a dynamic centroid called MaskCentroid to swiftly cluster pixels to specific human instance during rapid changes in human body movement or significantly occluded environment. Experimental results on COCO and OCHuman datasets demonstrate VisualCent’s accuracy and real-time performance advantages, outperforming existing methods in mAP scores and execution frame rate per second. The implementation is available on the project page<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">†</sup>.<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">†</sup>https://sites.google.com/view/niazahmad/projects/visualcent