Reinforcement Learning Approach to Solve Dynamic Bi-objective Police Patrol Dispatching and Rescheduling Problem

Authors

  • Waldy Joe Singapore Management University
  • Hoong Chuin Lau Singapore Management University
  • Jonathan Pan Home Team Science and Technology Agency, Singapore

Keywords:

Dynamic Vehicle Routing Problem, Reinforcement Learning, Police Patrol, Scheduling, Bi-Objective

Abstract

Police patrol aims to fulfill two main objectives namely to project presence and to respond to incidents in a timely manner. Incidents happen dynamically and can disrupt the initially-planned patrol schedules. The key decisions to be made will be which patrol agent to be dispatched to respond to an incident and subsequently how to adapt the patrol schedules in response to such dynamically-occurring incidents whilst still fulfilling both objectives; which sometimes can be conflicting. In this paper, we define this real-world problem as a Dynamic Bi-Objective Police Patrol Dispatching and Rescheduling Problem and propose a solution approach that combines Deep Reinforcement Learning (specifically neural networks-based Temporal-Difference learning with experience replay) to approximate the value function and a rescheduling heuristic based on ejection chains to learn both dispatching and rescheduling policies jointly. To address the dual objectives, we propose a reward function that implicitly tries to maximize the rate of successfully responding to an incident within a response time target while minimizing the reduction in patrol presence without the need to explicitly set predetermined weights for each objective. The proposed approach is able to compute both dispatching and rescheduling decisions almost instantaneously. Our work serves as the first work in the literature that takes into account these dual patrol objectives and real-world operational consideration where incident response may disrupt existing patrol schedules.

Downloads

Published

2022-06-13

How to Cite

Joe, W., Lau, H. C., & Pan, J. (2022). Reinforcement Learning Approach to Solve Dynamic Bi-objective Police Patrol Dispatching and Rescheduling Problem. Proceedings of the International Conference on Automated Planning and Scheduling, 32(1), 453-461. Retrieved from https://ojs.aaai.org/index.php/ICAPS/article/view/19831