• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Meng, Xianjia (Meng, Xianjia.) [1] | Yang, Yong (Yang, Yong.) [2] | Liu, Ximeng (Liu, Ximeng.) [3] (Scholars:刘西蒙) | Jiang, Nan (Jiang, Nan.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

The rapidly exploding of user data, especially applications of neural networks, involves analyzing data collected from individuals, which brings convenience to life. Meanwhile, privacy leakage in the applications as a potential threat needs to be addressed urgently. However, removing private information from models is difficult once the user's sensitive data enters machine learning models, particularly neural networks. Most of the previous amnestic methods based on retraining require full access to the training set of the target model and have limited improvements in computational resources and time improvement. In this paper, we propose Scrubber, which removes sensitive data from the original model via influence estimation to produce an unlearning model that is approximately indistinguishable from the retrained model. S crubber builds on the essential concept of influence function and reformulates the influence estimation as a closed-form update of forgetting. For learned models with strictly convex loss functions, our approach theoretically guarantees the effectiveness of forgetting while empirically demonstrating forgetting performance. For models with non-convex losses, we relax strictly convex assumptions by applying a damping term that allows us to make approximate estimates with negligible errors from the original assumption. Furthermore, experiments show that S crubber only causes less than 1% and 3% accuracy drop with more than 80% forgetting rate on average for logistic regression models and convolutional neural networks. The accuracy drop is reduced by 2%-3% compared to most state-of-the-art methods.

Keyword:

active forgetting Hessian matrix influence function machine unlearning neural networks

Community:

  • [ 1 ] [Meng, Xianjia]Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
  • [ 2 ] [Yang, Yong]Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
  • [ 3 ] [Liu, Ximeng]Fuzhou Univ, Fujian Prov Key Lab Informat Secur Network Syst, Fuzhou, Peoples R China
  • [ 4 ] [Liu, Ximeng]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 5 ] [Liu, Ximeng]Cyberspace Secur Res Ctr, Peng Cheng Lab, Shenzhen, Peoples R China
  • [ 6 ] [Jiang, Nan]East China Jiao Tong Univ, Sch Informat Engn, Dept Internet Things, Nanchang, Jiangxi, Peoples R China

Reprint 's Address:

Show more details

Version:

Related Keywords:

Related Article:

Source :

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS

ISSN: 0884-8173

Year: 2022

Issue: 11

Volume: 37

Page: 9080-9107

7 . 0

JCR@2022

5 . 0 0 0

JCR@2023

ESI Discipline: ENGINEERING;

ESI HC Threshold:66

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:98/10286816
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1