Thu 7 Dec 2023 11:30 - 11:45 at Golden Gate C1 - Testing IV Chair(s): Jonathan Bell

Automotive software development requires engineers to test their systems to detect violations of both functional and drivability requirements. Functional requirements define the functionality of the automotive software. Drivability requirements refer to the driver's perception of the interactions with the vehicle; for example, they typically require limiting the acceleration and jerk perceived by the driver within given thresholds. While functional requirements are extensively considered by the research literature, drivability requirements garner less attention. This industrial paper describes our experience assessing the usefulness of an automated search-based software testing (SBST) framework in generating failure-revealing test cases for functional and drivability requirements. We report on our experience with the VI-CarRealTime simulator, an industrial virtual modeling and simulation environment widely used in the automotive domain. We designed a Cruise Control system in Simulink for a four-wheel vehicle, in an iterative fashion, by producing 21 model versions. We used the SBST framework for each version of the model to search for failure-revealing test cases revealing requirement violations. Our results show that the SBST framework successfully identified a failure-revealing test case for 66.7% of our model versions, requiring, on average, 245.9s and 3.8 iterations. We present lessons learned, reflect on the generality of our results, and discuss how our results improve the state of practice.

Thu 7 Dec

Displayed time zone: Pacific Time (US & Canada) change

11:00 - 12:30
Testing IVResearch Papers / Industry Papers at Golden Gate C1
Chair(s): Jonathan Bell Northeastern University
11:00
15m
Talk
Code Coverage Criteria for Asynchronous Programs
Research Papers
Mohammad Ganji Simon Fraser University, Saba Alimadadi Simon Fraser University, Frank Tip Northeastern University
Media Attached
11:15
15m
Talk
Automated Test Generation for Medical Rules Web Services: A Case Study at the Cancer Registry of Norway
Industry Papers
Christoph Laaber Simula Research Laboratory, Tao Yue Beihang University, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway
DOI Pre-print Media Attached
11:30
15m
Talk
Test Case Generation for Drivability Requirements of an Automotive Cruise Controller: An Experience with an Industrial Simulator
Industry Papers
Federico Formica McMaster University, Nicholas Petrunti McMaster University, Lucas Bruck McMaster University, Vera Pantelic McMaster University, Mark Lawford McMaster University, Claudio Menghi University of Bergamo; McMaster University
DOI Media Attached
11:45
15m
Talk
Prioritizing Natural Language Test Cases Based on Highly-Used Game Features
Industry Papers
Markos Viggiato University of Alberta, Dale Paas Prodigy Education, Cor-Paul Bezemer University of Alberta
DOI Media Attached
12:00
15m
Talk
EtherDiffer: Differential Testing on RPC Services of Ethereum Nodes
Research Papers
Shinhae Kim The Affiliated Institute of ETRI, Sungjae Hwang Sungkyunkwan University
Media Attached
12:15
15m
Talk
[Remote] API-Knowledge Aware Search-based Software Testing: Where, What and How
Research Papers
Xiaoxue Ren Zhejiang University, Xinyuan Ye Australian National University, Yun Lin Shanghai Jiao Tong University, Zhenchang Xing Data61, Shuqing Li The Chinese University of Hong Kong, Michael Lyu The Chinese University of Hong Kong
Media Attached