Wed 6 Dec 2023 12:15 - 12:30 at Golden Gate C1 - Testing III Chair(s): Tianyi Zhang

Cloud services are omnipresent and critical cloud service failure is a fact of life. In order to retain customers and prevent revenue loss, it is important to provide high reliability guarantees for these services. One way to do this is by predicting outages in advance, which can help in reducing the severity as well as time to recovery. It is difficult to forecast critical failures due to rarity of these events. Moreover, critical failures are ill-defined in terms of observable data. Our proposed method, Outage-Watch, defines outages as deteriorations in the Quality of Service (QoS) captured by a set of metrics. This definition allow us to capture a large set of critical service outages. Outage-Watch detects outages in advance by using current system state to predict whether the QoS metrics will cross a threshold. A mixture of gaussians is used to model the distribution of the QoS metrics for flexibility and an extreme event regularizer helps in improving learning in tail of the distribution. An outage is predicted if the probability of any one of the QoS metrics crossing threshold changes significantly. Our evaluation on a real-world SAAS company dataset shows that Outage-Watch significantly outperforms traditional methods with an average AUC of 0.98. Additionally, Outage-Watch detects all the outages exhibiting a change in service metrics and reduces the Mean Time To Detection (MTTD) of outages by up to 88% when deployed in an enterprise cloud-service system, demonstrating efficacy of our proposed method.

Wed 6 Dec

Displayed time zone: Pacific Time (US & Canada) change

11:00 - 12:30
Testing IIIIndustry Papers / Demonstrations / Research Papers at Golden Gate C1
Chair(s): Tianyi Zhang Purdue University
11:00
15m
Talk
[Remote] Heterogeneous Testing for Coverage Profilers Empowered with Debugging Support
Research Papers
Yibiao Yang State Key Laboratory for Novel Software Technology, Nanjing University, Maolin Sun Nanjing University, Yang Wang National Key Laboratory for Novel Software Technology, Nanjing University, Qingyang Li National Key Laboratory for Novel Software Technology, Nanjing University, Ming Wen Huazhong University of Science and Technology, Yuming Zhou Nanjing University
Pre-print Media Attached
11:15
7m
Talk
[Remote] Testing Real-World Healthcare IoT Application: Experiences and Lessons Learned
Industry Papers
Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Tao Yue Beihang University, Kjetil Moberg Norwegian Health Authority
DOI Pre-print Media Attached
11:23
7m
Talk
Helion: Enabling Natural Testing of Smart Homes
Demonstrations
Prianka Mandal William & Mary, Sunil Manandhar IBM T.J. Watson Research Center, Kaushal Kafle College of William & Mary, Kevin Moran University of Central Florida, Denys Poshyvanyk William & Mary, Adwait Nadkarni William & Mary
Media Attached
11:30
15m
Talk
NeuRI: Diversifying DNN Generation via Inductive Rule Inference
Research Papers
Jiawei Liu University of Illinois at Urbana-Champaign, Jinjun Peng Columbia University, Yuyao Wang Nanjing University, Lingming Zhang University of Illinois at Urbana-Champaign
Pre-print Media Attached
11:45
15m
Talk
Appaction: Automatic GUI Interaction for Mobile Apps via Holistic Widget Perception
Industry Papers
Yongxiang Hu Fudan University, China, Jiazhen Gu Fudan University, China, Shuqing Hu Fudan University, Yu Zhang Meituan, Wenjie Tian Meituan, Shiyu Guo Meituan, Chaoyi Chen Meituan, Yangfan Zhou Fudan University
DOI Media Attached
12:00
15m
Talk
MuRS: Mutant Ranking and Suppression using Identifier Templates
Industry Papers
Zimin Chen KTH Royal Institute of Technology, Malgorzata Salawa Google, Manushree Vijayvergiya Google, Goran Petrović Google Inc, Marko Ivanković Google; Universität Passau, René Just University of Washington
DOI Media Attached
12:15
15m
Talk
Outage-Watch: Early Prediction of Outages using Extreme Event Regularizer
Research Papers
Shubham Agarwal Adobe Research, Sarthak Chakraborty Adobe Research, Shaddy Garg Adobe Research, Sumit Bisht Amazon, Chahat Jain Traceable.ai, Ashritha Gonuguntla Cisco, Shiv Saini Adobe Research
Media Attached