Thu 24 Jun 2021 01:55 - 02:00 at PLDI-A - Talks 2A: Machine Learning
As the demand for machine learning–based inference increases in tandem with concerns about privacy, there is a growing recognition of the need for secure machine learning, in which secret models can be used to classify private data without the model or data being leaked.
Fully Homomorphic Encryption (FHE) allows arbitrary computation to be done over encrypted data, providing an attractive approach to providing such secure inference.
While such computation is often orders of magnitude slower than its plaintext counterpart, the ability of FHE cryptosystems to do \emph{ciphertext packing}—that is, encrypting an entire vector of plaintexts such that operations are evaluated elementwise on the vector—helps ameliorate this overhead, effectively creating a SIMD architecture where computation can be vectorized for more efficient evaluation.
Most recent research in this area has targeted regular, easily vectorizable neural network models.
Applying similar techniques to irregular ML models such as decision forests remains unexplored, due to their complex, hard-to-vectorize structures.
In this paper we present COPSE, the first system that exploits ciphertext packing to perform decision-forest inference. COPSE consists of a staging compiler that automatically restructures and compiles decision forest models down to a new set of vectorizable primitives for secure inference.
We find that COPSE's compiled models outperform the state of the art across a range of decision forest models, often by more than an order of magnitude, while still scaling well.
Wed 23 JunDisplayed time zone: Eastern Time (US & Canada) change
13:30 - 14:05 | |||
13:30 5mTalk | Learning to Find Naming Issues with Big Code and Small Supervision PLDI DOI | ||
13:35 5mTalk | Fast and Precise Certification of Transformers PLDI Gregory Bonaert ETH Zurich, Dimitar I. Dimitrov ETH Zurich, Maximilian Baader ETH Zurich, Martin Vechev ETH Zurich DOI | ||
13:40 5mTalk | Web Question Answering with Neurosymbolic Program Synthesis PLDI Qiaochu Chen University of Texas at Austin, USA, Aaron Lamoreaux University of Texas at Austin, Xinyu Wang University of Michigan, Greg Durrett University of Texas at Austin, USA, Osbert Bastani University of Pennsylvania, Işıl Dillig University of Texas at Austin DOI | ||
13:45 5mTalk | Robustness Certification with Generative Models PLDI Matthew Mirman ETH Zurich, Alexander Hägele ETH Zurich, Timon Gehr ETH Zurich, Pavol Bielik ETH Zurich, Martin Vechev ETH Zurich Link to publication DOI | ||
13:50 5mTalk | DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion PLDI Wei Niu College of William & Mary, Jiexiong Guan College of William & Mary, Yanzhi Wang Northeastern University, Gagan Agrawal Augusta University, Bin Ren College of William & Mary DOI | ||
13:55 5mTalk | Vectorized Secure Evaluation of Decision Forests PLDI Raghav Malik Purdue University, Vidush Singhal Purdue University, Benjamin Gottfried Purdue University, Milind Kulkarni Purdue University DOI Pre-print | ||
14:00 5mTalk | AKG: Automatic Kernel Generation for Neural Processing Units using Polyhedral Transformations PLDI Jie Zhao State Key Laboratory of Mathematical Engineering and Advanced Computing, Bojie Li Huawei Technologies, Wang Nie Huawei Technologies, Zhen Geng Huawei Technologies, Renwei Zhang Huawei Technologies, Xiong Gao Huawei Technologies, Bin Cheng Huawei Technologies, Chen Wu Huawei, Yun Cheng Huawei Technologies, Zheng Li Huawei Technologies, Peng Di Huawei Technologies, Kun Zhang Huawei Technologies, Xuefeng Jin Huawei Technologies DOI |
Thu 24 JunDisplayed time zone: Eastern Time (US & Canada) change
01:30 - 02:05 | |||
01:30 5mTalk | Learning to Find Naming Issues with Big Code and Small Supervision PLDI DOI | ||
01:35 5mTalk | Fast and Precise Certification of Transformers PLDI Gregory Bonaert ETH Zurich, Dimitar I. Dimitrov ETH Zurich, Maximilian Baader ETH Zurich, Martin Vechev ETH Zurich DOI | ||
01:40 5mTalk | Web Question Answering with Neurosymbolic Program Synthesis PLDI Qiaochu Chen University of Texas at Austin, USA, Aaron Lamoreaux University of Texas at Austin, Xinyu Wang University of Michigan, Greg Durrett University of Texas at Austin, USA, Osbert Bastani University of Pennsylvania, Işıl Dillig University of Texas at Austin DOI | ||
01:45 5mTalk | Robustness Certification with Generative Models PLDI Matthew Mirman ETH Zurich, Alexander Hägele ETH Zurich, Timon Gehr ETH Zurich, Pavol Bielik ETH Zurich, Martin Vechev ETH Zurich Link to publication DOI | ||
01:50 5mTalk | DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion PLDI Wei Niu College of William & Mary, Jiexiong Guan College of William & Mary, Yanzhi Wang Northeastern University, Gagan Agrawal Augusta University, Bin Ren College of William & Mary DOI | ||
01:55 5mTalk | Vectorized Secure Evaluation of Decision Forests PLDI Raghav Malik Purdue University, Vidush Singhal Purdue University, Benjamin Gottfried Purdue University, Milind Kulkarni Purdue University DOI Pre-print | ||
02:00 5mTalk | AKG: Automatic Kernel Generation for Neural Processing Units using Polyhedral Transformations PLDI Jie Zhao State Key Laboratory of Mathematical Engineering and Advanced Computing, Bojie Li Huawei Technologies, Wang Nie Huawei Technologies, Zhen Geng Huawei Technologies, Renwei Zhang Huawei Technologies, Xiong Gao Huawei Technologies, Bin Cheng Huawei Technologies, Chen Wu Huawei, Yun Cheng Huawei Technologies, Zheng Li Huawei Technologies, Peng Di Huawei Technologies, Kun Zhang Huawei Technologies, Xuefeng Jin Huawei Technologies DOI |