BadNets: Backdooring Attacks on Deep Neural Network Training (and What to Do about Them)

Wednesday, May 8, 2019 - 2:00pm to Thursday, May 9, 2019 - 2:55pm

Event Calendar Category

Uncategorized

Speaker Name

Siddharth Garg

Affiliation

New York University, Tandon School of Engineering

Building and Room number

36-462

Abstract

With the tremendous success of deep learning, modern artificial intelligence technology hold tremendous potential to transform human society for the better. Yet, there are emerging concerns about how this technology might be misused, either inadvertently or by malicious adversaries. This talk will provide an overview of the new security vulnerabilities in deep neural networks and specifically how they can be stealthily "backdoored" during training such that they misbehave on certain special inputs. We refer to such maliciously modified networks are referred to as Backdoored Neural Networks of BadNets. These vulnerabilities can be exploited by attackers to perpetrate harm, for instance, causing deep learning based traffic sign detectors to misclassify stop signs with special stickers stuck on them. Emerging solutions to detect and mitigate backdoor attacks, including the presenter's recent work on "fine-pruning" defenses will be discussed. Finally, implications of adversarial attacks on AI on the use of deep learning in other domains, including 5G wireless and medical informatics, will be discussed.

Biography

Siddharth Garg is an Assistant Professor in the ECE Department at NYU Tandon. His research interests are in computer hardware design, cyber-security and machine learning. Siddharth has received the NSF CAREER Award (2015), and best paper awards at the NIPS'17 ML Security Workshop, IEEE Symposium on Security and Privacy (S&P) 2016, USENIX Security Symposium 2013, and the Semiconductor Research Consortium TECHCON in 2010. In 2016, he was listed in Popular Science Magazine's annual list of "Brilliant 10" researchers for his work on hardware security. Siddharth also received the Angel G. Jordan Award from ECE department of Carnegie Mellon University for outstanding thesis contributions and service to the community. He received his Ph.D. degree in Electrical and Computer Engineering from Carnegie Mellon University in 2009, an M.S. in EE from Stanford and a B.Tech. degree in Electrical Engineering from the Indian Institute of Technology Madras.