Tue 5 Dec 2023 16:00 - 16:15 at Golden Gate A - Code Search and Text to Code Chair(s): Miryung Kim

Automatic query reformulation is a widely used technology to enhance code search results, by formulating as a machine translation problem of rewriting a query into a more comprehensive alternative. While showing promising results, it typically requires a large parallel corpus of query pairs (i.e., the original query and a reformulated query) that are confidential and unpublished by online code search engines. This restricts its practicality in software development. In this paper, we propose SSQR, a self-supervised query reformulation method that does not rely on any parallel query corpus. Inspired by pre-trained models, SSQR treats query reformulation as a masked language modeling task over a large-scale unlabelled corpus of queries. SSQR extends T5 (a sequence-to-sequence model based on Transformer) with a new pre-training objective named corrupted query completion (CQC), which randomly masks words from a complete query and asks T5 to predict the masked content. Then, for a given query to be reformulated, SSQR enumerates candidate positions to be expanded and employs the pre-trained T5 model to generate the content to fill the spans. Finally, SSQR selects expansions that have the most information gain. Our evaluation shows that SSQR significantly outperforms unsupervised baselines and gains competitive performance over supervised methods.

Tue 5 Dec

Displayed time zone: Pacific Time (US & Canada) change

16:00 - 18:00
Code Search and Text to CodeResearch Papers / Industry Papers / Journal First / Demonstrations at Golden Gate A
Chair(s): Miryung Kim University of California at Los Angeles, USA
16:00
15m
Talk
[Remote] Self-Supervised Query Reformulation for Code Search
Research Papers
Yuetian Mao Shanghai Jiao Tong University, Chengcheng Wan East China Normal University, Yuze Jiang Shanghai Jiao Tong University, Xiaodong Gu Shanghai Jiao Tong University
Media Attached
16:15
15m
Talk
[Remote] Natural Language to Code: How Far are We?
Research Papers
Shangwen Wang National University of Defense Technology, Mingyang Geng National University of Defense Technology, Bo Lin National University of Defense Technology, Zhensu Sun Singapore Management University, Ming Wen Huazhong University of Science and Technology, Yepang Liu Southern University of Science and Technology, Li Li Beihang University, Tegawendé F. Bissyandé University of Luxembourg, Xiaoguang Mao National University of Defense Technology
DOI Pre-print Media Attached
16:30
15m
Talk
[Remote] xASTNN: Improved Code Representations for Industrial Practice
Industry Papers
Zhiwei Xu Tsinghua University, Min Zhou Tsinghua University, Xibin Zhao Tsinghua University, Yang Chen Huazhong University of Science and Technology, Xi Cheng VMware, Hongyu Zhang Chongqing University
DOI Media Attached
16:45
7m
Talk
[Remote] On the Dual Nature of Necessity in Use of Rust Unsafe Code
Industry Papers
Yuchen Zhang New York University, USA, Ashish Kundu Cisco Research, Georgios Portokalidis Stevens Institute of Technology, Jun Xu The University of Utah
DOI Media Attached
16:53
7m
Talk
On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers
Demonstrations
Laura Cabra-Acela Universidad de Los Andes, Anamaria Mojica-Hanke University of Passau, Universidad de Los Andes, Mario Linares-Vásquez Universidad de los Andes, Steffen Herbold University of Passau
Media Attached
17:00
15m
Talk
MultiPL-E: A Scalable and Polyglot Approach to Benchmarking Neural Code Generation
Journal First
Federico Cassano Northeastern University, John Gouwar Northeastern University, Daniel Nguyen Hannover High School, Sydney Nguyen Wellesley College, Luna Phipps-Costin Northeastern University, Donald Pinckney Northeastern University, Ming-Ho Yee Northeastern University, Yangtian Zi Northeastern University, Carolyn Jane Anderson Wellesley College, Molly Q Feldman Oberlin College, Arjun Guha Northeastern University and Roblox, Michael Greenberg Stevens Institute of Technology, Abhinav Jangda Microsoft Research
Link to publication Media Attached
17:15
15m
Talk
NCQ: Code reuse support for Node.js developers
Journal First
Brittany Reid The University of Adelaide, Marcelo d'Amorim North Carolina State University, Markus Wagner Monash University, Australia, Christoph Treude University of Melbourne
Link to publication DOI Pre-print Media Attached
17:30
15m
Talk
Efficient Text-to-Code Retrieval with Cascaded Fast and Slow Transformer Models
Research Papers
Akhilesh Deepak Gotmare Salesforce Research, Junnan Li Salesforce Research, Shafiq Joty Salesforce Research, Steven C.H. Hoi Salesforce Research Asia
Media Attached
17:45
15m
Talk
PEM: Representing Binary Program Semantics for Similarity Analysis via A Probabilistic Execution Model
Research Papers
Xiangzhe Xu Purdue University, Zhou Xuan , Shiwei Feng Purdue University, Siyuan Cheng Purdue University, Yapeng Ye Purdue University, Qingkai Shi The Hong Kong University of Science and Technology, Guanhong Tao Purdue University, Le Yu , Zhuo Zhang Purdue University, Xiangyu Zhang Purdue University
Media Attached