[Remote] Log Parsing with Generalization Ability under New Log Types
Log parsing, which converts semi-structured logs into structured logs, is the first step for automated log analysis. However, existing parsers are still unsatisfactory in the real world due to new log types in new-coming logs. In practice, the system‘s available logs cannot contain all log types because some latent log types of infrequently activated system states cannot log and systems frequently change to bring new log types. For example, most parsers require preprocessing to extract variables in advance, but preprocessing is based on the operator’s empirical knowledge of available logs and therefore cannot work on new log types. In addition, parser parameters set based on available logs are difficult to generalize to new log types. To support new log types, we propose a variable generation imitation strategy to craft a novel self-supervised log parsing approach, called Log3T. Log3T employs a pretrained transformer encoder-based model to extract log templates and can update parameters at parsing time to adapt to new log types by a modified test-time training. Experimental results on 16 benchmark datasets show that Log3T outperforms the state-of-the-art parsers on parsing accuracy, reaching 0.909. In addition, Log3T can automatically adapt new log types in new-coming logs
Tue 5 DecDisplayed time zone: Pacific Time (US & Canada) change
16:00 - 18:00 | Log Analysis and DebuggingIndustry Papers / Research Papers at Golden Gate C1 Chair(s): Yiming Tang Rochester Institute of Technology | ||
16:00 15mTalk | [Remote] STEAM: Observability-Preserving Trace Sampling Industry Papers Shilin He Microsoft Research, Botao Feng Microsoft, Liqun Li Microsoft Research, Xu Zhang Microsoft Research, Yu Kang Microsoft Research, Qingwei Lin Microsoft, Saravan Rajmohan Microsoft 365, Dongmei Zhang Microsoft Research DOI Media Attached | ||
16:15 15mTalk | [Remote] Demystifying Dependency Bugs in Deep Learning Stack Research Papers Kaifeng Huang Fudan University, Bihuan Chen Fudan University, Susheng Wu Fudan University, Junming Cao Fudan University, Lei Ma The University of Tokyo / University of Alberta, Xin Peng Fudan University Media Attached | ||
16:30 15mTalk | From Point-wise to Group-wise: A Fast and Accurate Microservice Trace Anomaly Detection Approach Industry Papers Zhe Xie Tsinghua University, Changhua Pei Computer Network Information Center at Chinese Academy of Sciences, Wanxue Li eBay, USA, Huai Jiang eBay, USA, Liangfei Su eBay, USA, Jianhui Li Computer Network Information Center at Chinese Academy of Sciences, Gaogang Xie Computer Network Information Center at Chinese Academy of Sciences, Dan Pei Tsinghua University DOI Media Attached | ||
16:45 15mTalk | Semantic Debugging Research Papers Martin Eberlein Humboldt University of Berlin, Marius Smytzek CISPA Helmholtz Center for Information Security, Dominic Steinhöfel CISPA Helmholtz Center for Information Security, Lars Grunske Humboldt-Universität zu Berlin, Andreas Zeller CISPA Helmholtz Center for Information Security Media Attached | ||
17:00 7mTalk | Analyzing Microservice Connectivity with Kubesonde Industry Papers Jacopo Bufalino Aalto University, Mario Di Francesco Eficode; Aalto University, Tuomas Aura Aalto University DOI Media Attached | ||
17:08 15mTalk | [Remote] Hue: A User-Adaptive Parser for Hybrid Logs Research Papers Junjielong Xu Chinese University of Hong Kong, Shenzhen, Qiuai Fu Huawei Cloud Computing Technologies CO., LTD., Zhouruixing Zhu Chinese University of Hong Kong, Shenzhen, Yutong Cheng Chinese University of Hong Kong, Shenzhen, zhijing li , Yuchi Ma Huawei Cloud Computing Technologies CO., LTD., Pinjia He The Chinese University of Hong Kong, Shenzhen Media Attached | ||
17:23 15mTalk | [Remote] Log Parsing with Generalization Ability under New Log Types Research Papers Siyu Yu Guangxi University, Yifan Wu Peking University, Zhijing Li The Chinese University of Hong Kong, Shenzhen, Pinjia He The Chinese University of Hong Kong, Shenzhen, Ningjiang Chen Guangxi University, Changjian Liu Guangxi University Media Attached |