PredDETR: An End-to-End Transformer-Based Model for One-Stage Pedestrian Trajectory Prediction

This work remedies the drawbacks of existing methods in pedestrian trajectory prediction for video surveillance. A traditional two-stage approach, which first detects and tracks pedestrians before forecasting their subsequent trajectories, relies solely on historical trajectories to predict future movements, overlooking the rich contextual information within videos. Although some one-stage methods have been introduced to streamline this process, they still struggle with complex model architectures due to their reliance on pixel-wise flow estimation. To resolve these issues, we propose a simple yet effective Transformer-based one-stage model, called PredDETR, that directly anticipates the future trajectories of multiple pedestrians from videos. Following the end-to-end paradigm of DETR, our PredDETR model not only associates the bounding boxes of each pedestrian across subsequent frames but also predicts their future trajectories using an additional predictive decoder. Taking past raw video frames as input, the proposed PredDETR directly forecasts the future locations of each pedestrian in a non-autoregressive manner. The empirical results validate that, despite its simpler design, PredDETR is a compelling method compared to a previous one-stage approach.