General Markov Model for Solving Patrolling Games

Andrzej Nagórko, Michał Tomasz Godziszewski, Marcin Waniek, Barbara Rosiak, Małgorzata Róg, Tomasz Paweł Michalak

Keywords: patrolling games, markov chain, stochastic patrolling, game theory

TL;DR: A solution of patrolling games with hidden Markov models and linear programming.

Abstract:

Safeguarding critical infrastructure has recently emerged as a global challenge. To address complex security concerns raised by broadening array of threats, effective mobile security forces are essential. A key aspect involves designing optimal patrolling strategies for mobile units. Two bodies of research dealt with this: stochastic patrolling and partially observable stochastic games. Alas, the first approach makes too-far-reaching simplifying assumption and the second one is more expressive but computationally challenging.
The model proposed in this paper is inspired by partially observable stochastic games so that it is general enough to enable comprehensive modeling of attacker-defender interactions but a the same time remains computationally friendly.
With our proposed robust SHIELD algorithm, we are able to find a defense strategy where the probability of apprehending the attacker can be nearly doubled compared to the state of the art.

List Of Authors: Nag\'orko, Andrzej and Waniek, Marcin and R\'og, Malgorzata and Godziszewski, Michal and Rosiak, Barbara and Michalak, Tomasz Pawel

Code Url: https://github.com/anagorko/stackelberg-games-core

Video Url: https://youtube.com/playlist?list=PLP8PAD85ju8Z5P5zsEVz7oZ0NkCPAR-8W&si=o70ZwpiVo2DWkcfy

Submission Number: 639