Social Interpretable Tree for Pedestrian Trajectory Prediction


  • Liushuai Shi Xi’an Jiaotong University
  • Le Wang Xi'an Jiaotong University
  • Chengjiang Long JD Finance America Corporation
  • Sanping Zhou Xi'an Jiaotong University
  • Fang Zheng Xi’an Jiaotong University
  • Nanning Zheng Xi'an Jiaotong University
  • Gang Hua Wormpex AI Research



Computer Vision (CV), Intelligent Robotics (ROB), Humans And AI (HAI), Machine Learning (ML)


Understanding the multiple socially-acceptable future behaviors is an essential task for many vision applications. In this paper, we propose a tree-based method, termed as Social Interpretable Tree (SIT), to address this multi-modal prediction task, where a hand-crafted tree is built depending on the prior information of observed trajectory to model multiple future trajectories. Specifically, a path in the tree from the root to leaf represents an individual possible future trajectory. SIT employs a coarse-to-fine optimization strategy, in which the tree is first built by high-order velocity to balance the complexity and coverage of the tree and then optimized greedily to encourage multimodality. Finally, a teacher-forcing refining operation is used to predict the final fine trajectory. Compared with prior methods which leverage implicit latent variables to represent possible future trajectories, the path in the tree can explicitly explain the rough moving behaviors (e.g., go straight and then turn right), and thus provides better interpretability. Despite the hand-crafted tree, the experimental results on ETH-UCY and Stanford Drone datasets demonstrate that our method is capable of matching or exceeding the performance of state-of-the-art methods. Interestingly, the experiments show that the raw built tree without training outperforms many prior deep neural network based approaches. Meanwhile, our method presents sufficient flexibility in long-term prediction and different best-of-K predictions.




How to Cite

Shi, L., Wang, L., Long, C., Zhou, S., Zheng, F., Zheng, N., & Hua, G. (2022). Social Interpretable Tree for Pedestrian Trajectory Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, 36(2), 2235-2243.



AAAI Technical Track on Computer Vision II