Skip to main content

Research Repository

Advanced Search

Preserving Differential Privacy in Deep Learning Based on Feature Relevance Region Segmentation

Wang, Fangwei; Xie, Meiyun; Tan, Zhiyuan; Li, Qingru; Wang, Changguang

Authors

Fangwei Wang

Meiyun Xie

Qingru Li

Changguang Wang



Abstract

In the era of big data, deep learning techniques provide intelligent solutions for various problems in real-life scenarios. However, deep neural networks depend on large-scale datasets including sensitive data, which causes the potential risk of privacy leakage. In addition, various constantly evolving attack methods are also threatening the data security in deep learning models. Protecting data privacy effectively at a lower cost has become an urgent challenge. This paper proposes an Adaptive Feature Relevance Region Segmentation (AFRRS) mechanism to provide differential privacy preservation. The core idea is to divide the input features into different regions with different relevance according to the relevance between input features and the model output. Less noise is intentionally injected into the region with stronger relevance, and more noise is injected into the regions with weaker relevance. Furthermore, we perturb loss functions by injecting noise into the polynomial coefficients of the expansion of the objective function to protect the privacy of data labels. Theoretical analysis and experiments have shown that the proposed AFRRS mechanism can not only provide strong privacy preservation for the deep learning model, but also maintain the good utility of the model under a given moderate privacy budget compared with existing methods.

Citation

Wang, F., Xie, M., Tan, Z., Li, Q., & Wang, C. (in press). Preserving Differential Privacy in Deep Learning Based on Feature Relevance Region Segmentation. IEEE Transactions on Emerging Topics in Computing, https://doi.org/10.1109/TETC.2023.3244174

Journal Article Type Article
Acceptance Date Feb 1, 2023
Online Publication Date Feb 15, 2023
Deposit Date Feb 3, 2023
Publicly Available Date Feb 15, 2023
Print ISSN 2168-6750
Electronic ISSN 2376-4562
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.1109/TETC.2023.3244174
Keywords Deep learning, differential privacy, feature relevance region segmentation, privacy leakage

Files

Preserving Differential Privacy in Deep Learning Based on Feature Relevance Region Segmentation (accepted version) (2.6 Mb)
PDF








You might also like



Downloadable Citations