Wed 6 Dec 2023 11:00 - 11:15 at Golden Gate C1 - Testing III Chair(s): Tianyi Zhang

Ensuring the correctness of code coverage profilers is of critical importance as code coverage has been widely adopted to facilitate substantial software engineering tasks. Recent studies have proposed to leverage differential testing and metamorphic testing to validate code coverage profilers, which have been shown to be effective in uncovering bugs for coverage profilers. However, existing techniques still have a bunch of drawbacks as they only use \textit{homogeneous source}, i.e., different coverage profilers or the profilers themselves, to validate coverage profilers. In this paper, we propose Decov, a \textit{heterogeneous testing} technique, to validate coverage profilers with the support of information provided by a \textit{heterogeneous source}, which are the debuggers. The coverage profilers record the \textit{execution count} for each line of a program during execution, while the debuggers monitor the \textit{hit count} for each line of a program when running the program in debuggers. Our key insight is that the execution count obtained from the coverage profilers for any statement should not conflict with the hit count monitored by the debuggers. As such, Decov constructs a number of \textit{heterogeneous relations} and utilizes them to uncover bugs in coverage profilers. The experiments on Gcov and LLVM-cov, two popular code coverage profilers, have led to 21 new bug reports and 18 of them are directly confirmed by developers. Of which, 5 bugs are fixed/resolved by developers in the latest trunk version. Decov is a simple yet effective coverage profiler validator that can be viewed as a complementary approach to existing ones.

Wed 6 Dec

Displayed time zone: Pacific Time (US & Canada) change

11:00 - 12:30
Testing IIIIndustry Papers / Demonstrations / Research Papers at Golden Gate C1
Chair(s): Tianyi Zhang Purdue University
11:00
15m
Talk
[Remote] Heterogeneous Testing for Coverage Profilers Empowered with Debugging Support
Research Papers
Yibiao Yang State Key Laboratory for Novel Software Technology, Nanjing University, Maolin Sun Nanjing University, Yang Wang National Key Laboratory for Novel Software Technology, Nanjing University, Qingyang Li National Key Laboratory for Novel Software Technology, Nanjing University, Ming Wen Huazhong University of Science and Technology, Yuming Zhou Nanjing University
Pre-print Media Attached
11:15
7m
Talk
[Remote] Testing Real-World Healthcare IoT Application: Experiences and Lessons Learned
Industry Papers
Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Tao Yue Beihang University, Kjetil Moberg Norwegian Health Authority
DOI Pre-print Media Attached
11:23
7m
Talk
Helion: Enabling Natural Testing of Smart Homes
Demonstrations
Prianka Mandal William & Mary, Sunil Manandhar IBM T.J. Watson Research Center, Kaushal Kafle College of William & Mary, Kevin Moran University of Central Florida, Denys Poshyvanyk William & Mary, Adwait Nadkarni William & Mary
Media Attached
11:30
15m
Talk
NeuRI: Diversifying DNN Generation via Inductive Rule Inference
Research Papers
Jiawei Liu University of Illinois at Urbana-Champaign, Jinjun Peng Columbia University, Yuyao Wang Nanjing University, Lingming Zhang University of Illinois at Urbana-Champaign
Pre-print Media Attached
11:45
15m
Talk
Appaction: Automatic GUI Interaction for Mobile Apps via Holistic Widget Perception
Industry Papers
Yongxiang Hu Fudan University, China, Jiazhen Gu Fudan University, China, Shuqing Hu Fudan University, Yu Zhang Meituan, Wenjie Tian Meituan, Shiyu Guo Meituan, Chaoyi Chen Meituan, Yangfan Zhou Fudan University
DOI Media Attached
12:00
15m
Talk
MuRS: Mutant Ranking and Suppression using Identifier Templates
Industry Papers
Zimin Chen KTH Royal Institute of Technology, Malgorzata Salawa Google, Manushree Vijayvergiya Google, Goran Petrović Google Inc, Marko Ivanković Google; Universität Passau, René Just University of Washington
DOI Media Attached
12:15
15m
Talk
Outage-Watch: Early Prediction of Outages using Extreme Event Regularizer
Research Papers
Shubham Agarwal Adobe Research, Sarthak Chakraborty Adobe Research, Shaddy Garg Adobe Research, Sumit Bisht Amazon, Chahat Jain Traceable.ai, Ashritha Gonuguntla Cisco, Shiv Saini Adobe Research
Media Attached