[Remote] CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models
Code datasets are of immense value for training neural-network-based code completion models; companies or organizations tend to make substantial investments to establish and process these datasets. Unluckily, these datasets, either built for proprietary or public usage, face the high risk of unauthorized exploits, resulting from data leakages, license violations, etc. Even worse, the ``black-box'' nature of neural models sets a high barrier for externals to audit their training datasets, which further connives these unauthorized usages. Currently, watermarking methods have been proposed to prohibit inappropriate usage of image and natural language datasets. However, due to domain specificity, they are not directly applicable to code datasets, leaving the copyright protection of this emerging and important field of code data still exposed to threats. To fill this gap, we propose a method, named CodeMark, to embed user-defined imperceptible watermarks into code datasets to trace their usage in training neural code completion models. Imperceptibility is vital to prevent adversaries who have an ulterior motive to remove watermarks. CodeMark is based on adaptive semantic-preserving transformations, which preserve the exact functionality of the code data and keep the changes covert against rule-breakers. We implement CodeMark in a toolkit and conduct an extensive evaluation of code completion models. CodeMark is validated to fulfill all desired properties of practical watermarks, including harmlessness to model accuracy, verifiability, robustness, and imperceptibility.
Thu 7 DecDisplayed time zone: Pacific Time (US & Canada) change
14:00 - 15:30 | Machine Learning VResearch Papers / Ideas, Visions and Reflections / Journal First at Golden Gate C2 Chair(s): Prem Devanbu University of California at Davis | ||
14:00 15mTalk | LExecutor: Learning-Guided Execution Research Papers Media Attached | ||
14:15 15mTalk | Deeper Notions of Correctness in Image-based DNNs: Lifting Properties from Pixel to Entities Ideas, Visions and Reflections Felipe Toledo , David Shriver University of Virginia, Sebastian Elbaum University of Virginia, Matthew B Dwyer University of Virginia Link to publication DOI Pre-print Media Attached | ||
14:30 15mTalk | Software Architecture Recovery with Information Fusion Research Papers Yiran Zhang Nanyang Technological University, Zhengzi Xu Nanyang Technological University, Chengwei Liu Nanyang Technological University, Hongxu Chen Huawei Technologies Co., Ltd., Sun Jianwen Huawei Technologies Co., Ltd, Dong Qiu Huawei Technologies Co., Ltd, Yang Liu Nanyang Technological University Media Attached | ||
14:45 15mTalk | What Kinds of Contracts Do ML APIs Need? Journal First Samantha Syeda Khairunnesa Bradley University, Shibbir Ahmed Dept. of Computer Science, Iowa State University, Sayem Mohammad Imtiaz Iowa State University, Hridesh Rajan Dept. of Computer Science, Iowa State University, Gary T. Leavens University of Central Florida Media Attached | ||
15:00 15mTalk | Evaluating Transfer Learning for Simplifying GitHub READMEs Research Papers Haoyu Gao The University of Melbourne, Christoph Treude University of Melbourne, Mansooreh Zahedi The Univeristy of Melbourne Pre-print Media Attached | ||
15:15 15mTalk | [Remote] CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models Research Papers Zhensu Sun Singapore Management University, Xiaoning Du Monash University, Australia, Fu Song State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, and University of Chinese Academy of Sciences Beijing, China, Li Li Beihang University Pre-print Media Attached |