Evaluating probabilistic model checking tools for verification of robot control policies
Academic Article
Publication Date:
2016
Short description:
Evaluating probabilistic model checking tools for verification of robot control policies / Pathak, S., Pulina, L., Tacchella, A.. - In: AI COMMUNICATIONS. - ISSN 0921-7126. - 29:2(2016), pp. 287-299. [10.3233/AIC-150689]
abstract:
Research literature on Probabilistic Model Checking (PMC) encompasses a well-established set of algorithmic techniques whereby probabilistic models can be analyzed. In the last decade, owing to the increasing availability of effective tools, PMC has found applications in many domains, including computer networks, computational biology and robotics. In this paper, we evaluate PMC tools -namely comics, mrmc and prism -to investigate safe reinforcement learning in robots, i.e., to establish safety of policies learned considering feedback signals received upon acting in partially unknown environments. Introduced in previous contributions of ours, this application is a challenging domain wherein PMC tools act as back-engines of an automated methodology aimed to verify and repair control policies. We present an evaluation of the current state-of-the-art PMC tools to assess their potential on various case studies, including both real and simulated robots accomplishing navigation, manipulation and reaching tasks.
Iris type:
1.1 Articolo in rivista
Keywords:
experimental evaluation; PMC case studies; Probabilistic model checking; Artificial Intelligence
List of contributors:
Pathak, Shashank; Pulina, Luca; Tacchella, Armando
Published in: