Tue 5 Dec 2023 14:30 - 14:45 at Golden Gate C2 - Software Evolution I Chair(s): Rangeet Pan

In a code review, developers inspect code changes written by a peer and write comments to provide feedback. Good review comments can not only pinpoint defects but may also help improve code quality and the outcome of the review process. As there is no commonly accepted approach to evaluate the quality of review comments, we aim to (1) devise a conceptual model for an explainable evaluation of the quality of review comments, and (2) develop models for the automated evaluation of comments according to the conceptual model. To address these two goals, we conduct mixed-method studies and propose a new approach: EvaCRC (Evaluating Code Review Comments). To achieve the first goal, we collect and synthesize quality attributes of review comments, by triangulating data from authoritative documents defining and standardizing code review, as well as from academic literature. Then, we validate these attributes with real-world examples. Finally, we establish mappings between quality attributes and grades by inquiring domain experts, thus leading to our final explainable conceptual model. To achieve the second goal, we leverage multi-label learning. Given a set of code review comments, EvaCRC automatically determines their quality attributes and then generates overall quality grades based on the aforementioned mappings. To evaluate and improve EvaCRC, we conduct an industrial case study at one global ICT enterprise. The case study indicates that EvaCRC can effectively evaluate code review comments while offering reasons for the grades given.

Tue 5 Dec

Displayed time zone: Pacific Time (US & Canada) change

14:00 - 15:30
Software Evolution IIndustry Papers / Research Papers / Demonstrations at Golden Gate C2
Chair(s): Rangeet Pan IBM Research
14:00
15m
Talk
Understanding Solidity Event Logging Practices in the Wild
Research Papers
Lantian Li Shandong University, Yejian Liang Shandong University, Zhihao Liu Shandong University, Zhongxing Yu Shandong University
Media Attached
14:15
15m
Talk
Last Diff Analyzer: Multi-language Automated Approver for Behavior-Preserving Code Revisions
Industry Papers
Yuxin Wang Uber Technologies, Adam Welc Mysten Labs, Lazaro Clapp Uber Technologies Inc, Lingchao Chen Uber Technologies
DOI Media Attached
14:30
15m
Talk
EvaCRC: Evaluating Code Review Comments
Research Papers
Lanxin Yang Nanjing University, Jinwei Xu Nanjing University, YiFan Zhang Nanjing University, He Zhang Nanjing University, Alberto Bacchelli University of Zurich
Media Attached
14:45
15m
Talk
HyperDiff: Computing Source Code Diffs at Scale
Research Papers
Quentin Le-dilavrec Univ. Rennes, IRISA, INRIA, Djamel Eddine Khelladi CNRS, IRISA, University of Rennes, Arnaud Blouin Univ Rennes, INSA Rennes, Inria, CNRS, IRISA, Jean-Marc Jézéquel Univ Rennes - IRISA
Media Attached
15:00
7m
Talk
npm-follower: A Complete Dataset Tracking the NPM Ecosystem
Demonstrations
Donald Pinckney Northeastern University, Federico Cassano Northeastern University, Arjun Guha Northeastern University and Roblox, Jonathan Bell Northeastern University
Media Attached
15:08
7m
Talk
Issue Report Validation in an Industrial Context
Industry Papers
Ethem Utku Aktas Softtech Inc., Ebru Cakmak Microsoft EMEA, Mete Cihad Inan Softtech Research and Development, Cemal Yilmaz Sabancı University
DOI Media Attached
15:15
15m
Talk
Dead Code Removal at Meta: Automatically Deleting Millions of Lines of Code and Petabytes of Deprecated Data
Industry Papers
DOI