Document Type

Conference Paper

Subject Area

CPS Auto, CPS Model-Based Design, CPS Real-Time

Date of this Version


Publication Source

Seventh Workshop on Design, Modeling and Evaluation of Cyber Physical Systems (CyPhy'17)


The testing of Autonomous Vehicles (AVs) requires driving the AV billions of miles under varied scenarios in order to find bugs, accidents and otherwise inappropriate behavior. Because driving a real AV that many miles is too slow and costly, this motivates the use of sophisticated `world simulators', which present the AV's perception pipeline with realistic input scenes, and present the AV's control stack with realistic traffic and physics to which to react. Thus the simulator is a crucial piece of any CAD toolchain for AV testing. In this work, we build a test harness for driving an arbitrary AV's code in a simulated world. We demonstrate this harness by using the game Grand Theft Auto V (GTA) as world simulator for AV testing.
Namely, our AV code, for both perception and control, interacts in real-time with the game engine to drive our AV in the GTA world, and we search for weather conditions and AV operating conditions that lead to dangerous situations. This goes beyond the current state-of-the-art where AVs are tested under ideal weather conditions, and lays the ground work for a more comprehensive testing effort. We also propose and demonstrate necessary analyzes to validate the simulation results relative to the real world. The results of such analyses allow the designers and verification engineers to weigh the results of simulation-based testing.


autonomous vehicles, safety, perception, testing, simulation

Bib Tex


TITLE = {Safe At Any Speed: A Simulation-Based Test Harness for Autonomous Vehicles},

AUTHOR = {Houssam Abbas and Matthew O'Kelly and Alena Rodionova and Rahul Mangharam},

EDITOR = {},

BOOKTITLE = {7th Workshop on Design, Modeling and Evaluation of Cyber Physical Systems (CyPhy17)},

MONTH = {October},

YEAR = {2017} }



Date Posted: 15 July 2018

This document has been peer reviewed.