Thu 7 Dec 2023 12:15 - 12:30 at Golden Gate C1 - Testing IV Chair(s): Jonathan Bell

Search-based software testing (SBST) has proved its effectiveness in generating test cases to achieve its defined test goals, such as branch and data-dependency coverage. However, to detect more program faults in an effective way, pre-defined goals can hardly be adaptive in diversified projects. In this work, we propose KAT, a novel knowledge-aware SBST approach to generate on-demand assertions in the program under test (PUT) based on its used APIs. KAT constructs an API knowledge graph from the API documentation to derive the constraints that the client codes need to satisfy. Each constraint is instrumented into the PUT as a program branch, serving as a test goal to guide SBST to detect faults. We evaluate KAT with two baselines (i.e., EvoSuite and Catcher) with a close-world and an open-world experiment to detect API bugs. The close-world experiment shows that KAT outperforms the baselines in the F1-score (0.55 vs. 0.24 and 0.30) to detect bugs. The open-world experiment shows that KAT can detect 59.64% and 9.05% more API bugs than the baselines.

Thu 7 Dec

Displayed time zone: Pacific Time (US & Canada) change

11:00 - 12:30
Testing IVResearch Papers / Industry Papers at Golden Gate C1
Chair(s): Jonathan Bell Northeastern University
11:00
15m
Talk
Code Coverage Criteria for Asynchronous Programs
Research Papers
Mohammad Ganji Simon Fraser University, Saba Alimadadi Simon Fraser University, Frank Tip Northeastern University
Media Attached
11:15
15m
Talk
Automated Test Generation for Medical Rules Web Services: A Case Study at the Cancer Registry of Norway
Industry Papers
Christoph Laaber Simula Research Laboratory, Tao Yue Beihang University, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway
DOI Pre-print Media Attached
11:30
15m
Talk
Test Case Generation for Drivability Requirements of an Automotive Cruise Controller: An Experience with an Industrial Simulator
Industry Papers
Federico Formica McMaster University, Nicholas Petrunti McMaster University, Lucas Bruck McMaster University, Vera Pantelic McMaster University, Mark Lawford McMaster University, Claudio Menghi University of Bergamo; McMaster University
DOI Media Attached
11:45
15m
Talk
Prioritizing Natural Language Test Cases Based on Highly-Used Game Features
Industry Papers
Markos Viggiato University of Alberta, Dale Paas Prodigy Education, Cor-Paul Bezemer University of Alberta
DOI Media Attached
12:00
15m
Talk
EtherDiffer: Differential Testing on RPC Services of Ethereum Nodes
Research Papers
Shinhae Kim The Affiliated Institute of ETRI, Sungjae Hwang Sungkyunkwan University
Media Attached
12:15
15m
Talk
[Remote] API-Knowledge Aware Search-based Software Testing: Where, What and How
Research Papers
Xiaoxue Ren Zhejiang University, Xinyuan Ye Australian National University, Yun Lin Shanghai Jiao Tong University, Zhenchang Xing Data61, Shuqing Li The Chinese University of Hong Kong, Michael Lyu The Chinese University of Hong Kong
Media Attached