Thu 7 Dec 2023 15:15 - 15:30 at Golden Gate C2 - Machine Learning V Chair(s): Prem Devanbu

Code datasets are of immense value for training neural-network-based code completion models; companies or organizations tend to make substantial investments to establish and process these datasets. Unluckily, these datasets, either built for proprietary or public usage, face the high risk of unauthorized exploits, resulting from data leakages, license violations, etc. Even worse, the ``black-box'' nature of neural models sets a high barrier for externals to audit their training datasets, which further connives these unauthorized usages. Currently, watermarking methods have been proposed to prohibit inappropriate usage of image and natural language datasets. However, due to domain specificity, they are not directly applicable to code datasets, leaving the copyright protection of this emerging and important field of code data still exposed to threats. To fill this gap, we propose a method, named CodeMark, to embed user-defined imperceptible watermarks into code datasets to trace their usage in training neural code completion models. Imperceptibility is vital to prevent adversaries who have an ulterior motive to remove watermarks. CodeMark is based on adaptive semantic-preserving transformations, which preserve the exact functionality of the code data and keep the changes covert against rule-breakers. We implement CodeMark in a toolkit and conduct an extensive evaluation of code completion models. CodeMark is validated to fulfill all desired properties of practical watermarks, including harmlessness to model accuracy, verifiability, robustness, and imperceptibility.

Thu 7 Dec

Displayed time zone: Pacific Time (US & Canada) change

14:00 - 15:30
Machine Learning VResearch Papers / Ideas, Visions and Reflections / Journal First at Golden Gate C2
Chair(s): Prem Devanbu University of California at Davis
14:00
15m
Talk
LExecutor: Learning-Guided Execution
Research Papers
Beatriz Souza Universität Stuttgart, Michael Pradel University of Stuttgart
Media Attached
14:15
15m
Talk
Deeper Notions of Correctness in Image-based DNNs: Lifting Properties from Pixel to Entities
Ideas, Visions and Reflections
Felipe Toledo , David Shriver University of Virginia, Sebastian Elbaum University of Virginia, Matthew B Dwyer University of Virginia
Link to publication DOI Pre-print Media Attached
14:30
15m
Talk
Software Architecture Recovery with Information Fusion
Research Papers
Yiran Zhang Nanyang Technological University, Zhengzi Xu Nanyang Technological University, Chengwei Liu Nanyang Technological University, Hongxu Chen Huawei Technologies Co., Ltd., Sun Jianwen Huawei Technologies Co., Ltd, Dong Qiu Huawei Technologies Co., Ltd, Yang Liu Nanyang Technological University
Media Attached
14:45
15m
Talk
What Kinds of Contracts Do ML APIs Need?
Journal First
Samantha Syeda Khairunnesa Bradley University, Shibbir Ahmed Dept. of Computer Science, Iowa State University, Sayem Mohammad Imtiaz Iowa State University, Hridesh Rajan Dept. of Computer Science, Iowa State University, Gary T. Leavens University of Central Florida
Media Attached
15:00
15m
Talk
Evaluating Transfer Learning for Simplifying GitHub READMEs
Research Papers
Haoyu Gao The University of Melbourne, Christoph Treude University of Melbourne, Mansooreh Zahedi The Univeristy of Melbourne
Pre-print Media Attached
15:15
15m
Talk
[Remote] CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models
Research Papers
Zhensu Sun Singapore Management University, Xiaoning Du Monash University, Australia, Fu Song State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, and University of Chinese Academy of Sciences Beijing, China, Li Li Beihang University
Pre-print Media Attached