PSMP: Category Prototype-Guided Streaming Multi-Level Perturbation for Online Open-World Object Detection

Inspired by the human ability to learn continuously and adapt to changing environments, researchers have proposed Online Open-World Object Detection (OLOWOD). This emerging paradigm faces the challenges of detecting known categories, discovering unknown ones, continuously learning new categories, and mitigating catastrophic forgetting. To address these challenges, we propose Category Prototype-guided Streaming Multi-Level Perturbation, PSMP, a plug-and-play method for OLOWOD. PSMP, comprising semantic-level, enhanced data-level, and enhanced feature-level perturbations jointly guided by category prototypes, operates at different representational levels to collaboratively extract latent knowledge across tasks and improve adaptability. In addition, PSMP constructs the “contrastive tension” based on the relationships among category prototypes. This mechanism inherently leverages the symmetric structure formed by class prototypes in the latent space, where prototypes of semantically similar categories tend to align symmetrically or equidistantly. By guiding perturbations along these symmetric axes, the model can achieve more balanced generalization between known and unknown categories. PSMP requires no additional annotations, is lightweight in design, and can be seamlessly integrated into existing OWOD methods. Extensive experiments show that PSMP achieves an improvement of approximately 1.5% to 3% in mAP for known categories compared to conventional online training methods while significantly increasing the Unknown Recall (UR) by around 4.6%.