中国科学技术大学学报 ›› 2020, Vol. 50 ›› Issue (8): 1064-1071.DOI: 10.3969/j.issn.0253-2778.2020.08.004

• 论著 • 上一篇    下一篇

基于WGAN反馈的深度学习差分隐私保护方法

陶陶,柏建树,刘恒,侯书东,郑啸   

  1. 1.安徽工业大学计算机科学与技术学院,安徽马鞍山 243002;2.合肥综合性国家科学中心人工智能研究院,安徽合肥 230026
  • 收稿日期:2020-06-05 修回日期:2020-08-18 接受日期:2020-08-18 出版日期:2020-08-31 发布日期:2020-08-18

Differential privacy protection method for deep learning based on WGAN feedback

  1. TAO Tao,2, BAI Jianshu, LIU Heng, HOU Shudong, ZHENG Xiao,2
  • Received:2020-06-05 Revised:2020-08-18 Accepted:2020-08-18 Online:2020-08-31 Published:2020-08-18
  • Contact: TAO Tao
  • About author:TAO Tao(corresponding author), male, born in 1977, PhD/Associate Professor.
  • Supported by:
    Supported by the Key Research and Development Program Project of Anhui Province of China(201904d07020020), the Natural Science Foundation Project of Anhui Province of China(1908085MF212, 2008085MF190, 1808085QF210), the Program for Synergy Innovation in the Anhui Higher Education Institutions of China(GXXT-2020-012).

摘要: 针对攻击者可能通过某些技术手段如生成式对抗网络(GAN)等窃取深度学习训练数据集中敏感信息的问题,结合差分隐私理论,提出经沃瑟斯坦生成式对抗网络(WGAN)反馈调参的深度学习差分隐私保护的方法.该方法使用随机梯度下降进行优化,设置梯度阈值进行梯度裁剪,对深度学习的优化过程添加噪声实施隐私保护;利用WGAN生成与原始数据相似的最优结果,对比生成结果与原始数据的差异进行反馈调参.实验结果表明,该方法可以有效保护数据集的敏感信息并且具有较好的数据可用性.

关键词: 差分隐私, 深度学习, 沃瑟斯坦生成式对抗网络(WGAN)

Abstract: Aiming at the problem that attackers may steal sensitive information of the deep learning training dataset by some technological means such as the Generative Adversarial Network(GAN), combining the differential privacy theory, the differential privacy protection method was proposed for deep learning based on the Wasserstein generative adversarial network(WGAN) feedback parameter tuning. This privacy protection method is realized by optimization of the stochastic gradient descent, gradient clipping of setting gradient threshold, and noise adding to the optimization process of deep learning; WGAN was used to generate optimized results similar to the original data. The difference of the generated results and the original data were used for feedback parameter tuning. The experiment result shows that this method can effectively protect sensitive private information of the dataset and has preferable data usability.

Key words: differential privacy protection, deep learning, Wasserstein generative adversarial network(WGAN)

中图分类号: