Departmental Papers (CIS)

Date of this Version

11-2020

Document Type

Journal Article

Comments

This article was presented at the International Conference on Embedded Software 2020; original version appears as part of the ESWEEK-TCAD special issue.

Abstract

Run-time monitoring is a vital part of safety-critical systems. However, early-stage assurance of monitoring quality is currently limited: it relies either on complex models that might be inaccurate in unknown ways, or on data that would only be available once the system has been built. To address this issue, we propose a compositional framework for modeling and analysis of noisy monitoring systems. Our novel 3-value detector model uses probability spaces to represent atomic (non-composite) detectors, and it composes them into a temporal logic-based monitor. The error rates of these monitors are estimated by our analysis engine, which combines symbolic probability algebra, independence inference, and estimation from labeled detection data. Our evaluation on an autonomous underwater vehicle found that our framework produces accurate estimates of error rates while using only detector traces, without any monitor traces. Furthermore, when data is scarce, our approach shows higher accuracy than non-compositional data-driven estimates from monitor traces. Thus, this work enables accurate evaluation of logical monitors in early design stages before deploying them.

Subject Area

CPS Formal Methods, CPS Safe Autonomy

Publication Source

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD)

Volume

39

Issue

11

Start Page

3288

Last Page

3299

Share

COinS
 

Date Posted:04 January 2021

This document has been peer reviewed.