Data protection with unlearnable examples

• Main Author: Ma, Xiaoyu
• Other Authors: Alex Chichung Kot
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Engineering; Deep learning; Unlearnable examples; Data protection
• Online Access: https://hdl.handle.net/10356/177180
• Institution: Nanyang Technological University

The pervasive success of deep learning across diverse fields hinges on the extensive use of large datasets, which often contain sensitive personal information collected without explicit consent. This practice has raised significant privacy concerns, prompting the development of unlearnable examples (UE) as a novel data protection strategy. Unlearnable examples aim to modify data with subtle perturbations that, while imperceptible to humans, prevent machine learning models from effectively learning from them. Existing research has primarily focused on unimodal data, such as images, leaving a gap in the study of UE for multimodal data, which includes complex interactions between different data types like video and audio. This project explores the extension of UE techniques to multimodal learning environments, addressing the unique challenges posed by these datasets. By innovating and testing new UE strategies tailored for multimodal data and assessing their impact on model learning and data interpretability, this study aims to advance the field of data privacy in deep learning. Through a comprehensive survey of current UE technology, experimentation with multimodal datasets like CREMA-D and Kinetics-Sounds, and rigorous analysis, the project seeks to enhance privacy protections in multimodal deep learning frameworks, offering insights and practical solutions for the creation of robust and transferable unlearnable examples.