Verisig: verifying safety properties of hybrid systems with neural network controllers

Loading...
Thumbnail Image
Penn collection
Departmental Papers (CIS)
Degree type
Discipline
Subject
CPS Safe Autonomy
CPS Formal Methods
Neural Network Verification
Hybrid Systems with Neural Network Controllers
Learning-Enabled Components
Computer Engineering
Computer Sciences
Funder
Grant number
License
Copyright date
Distributor
Related resources
Contributor
Abstract

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. We focus on sigmoid-based networks and exploit the fact that the sigmoid is the solution to a quadratic differential equation, which allows us to transform the neural network into an equivalent hybrid system. By composing the network’s hybrid system with the plant’s, we transform the problem into a hybrid system verification problem which can be solved using state-of-theart reachability tools. We show that reachability is decidable for networks with one hidden layer and decidable for general networks if Schanuel’s conjecture is true. We evaluate the applicability and scalability of Verisig in two case studies, one from reinforcement learning and one in which the neural network is used to approximate a model predictive controller.

Advisor
Date of presentation
2019-04-01
Conference name
Departmental Papers (CIS)
Conference dates
2023-05-17T23:32:16.000
Conference location
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
22nd ACM International Conference on Hybrid Systems: Computation and Control (HSCC 2019), Montreal, Canada, April, 16-18, 2019 (http://hscc2019.eecs.umich.edu/)
Recommended citation
Collection