• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Shiping (Wang, Shiping.) [1] | Chen, Zhaoliang (Chen, Zhaoliang.) [2] | Du, Shide (Du, Shide.) [3] | Lin, Zhouchen (Lin, Zhouchen.) [4]

Indexed by:

EI

Abstract:

Sparsity-constrained optimization problems are common in machine learning, such as sparse coding, low-rank minimization and compressive sensing. However, most of previous studies focused on constructing various hand-crafted sparse regularizers, while little work was devoted to learning adaptive sparse regularizers from given input data for specific tasks. In this paper, we propose a deep sparse regularizer learning model that learns data-driven sparse regularizers adaptively. Via the proximal gradient algorithm, we find that the sparse regularizer learning is equivalent to learning a parameterized activation function. This encourages us to learn sparse regularizers in the deep learning framework. Therefore, we build a neural network composed of multiple blocks, each being differentiable and reusable. All blocks contain learnable piecewise linear activation functions which correspond to the sparse regularizer to be learned. Furthermore, the proposed model is trained with back propagation, and all parameters in this model are learned end-To-end. We apply our framework to multi-view clustering and semi-supervised classification tasks to learn a latent compact representation. Experimental results demonstrate the superiority of the proposed framework over state-of-The-Art multi-view learning models. © 1979-2012 IEEE.

Keyword:

Backpropagation Chemical activation Constrained optimization Deep learning Learning systems Piecewise linear techniques Semi-supervised learning

Community:

  • [ 1 ] [Wang, Shiping]Fuzhou University, College of Mathematics and Computer Science, Fuzhou; 350108, China
  • [ 2 ] [Wang, Shiping]Fuzhou University, Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou; 350108, China
  • [ 3 ] [Chen, Zhaoliang]Fuzhou University, College of Mathematics and Computer Science, Fuzhou; 350108, China
  • [ 4 ] [Chen, Zhaoliang]Fuzhou University, Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou; 350108, China
  • [ 5 ] [Du, Shide]Fuzhou University, College of Mathematics and Computer Science, Fuzhou; 350108, China
  • [ 6 ] [Du, Shide]Fuzhou University, Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou; 350108, China
  • [ 7 ] [Lin, Zhouchen]Peking University, School of Eecs, Key Laboratory of Machine Perception (MoE), Beijing; 100871, China
  • [ 8 ] [Lin, Zhouchen]Pazhou Lab, Guangzhou; 510330, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Pattern Analysis and Machine Intelligence

ISSN: 0162-8828

Year: 2022

Issue: 9

Volume: 44

Page: 5042-5055

2 3 . 6

JCR@2022

2 0 . 8 0 0

JCR@2023

ESI HC Threshold:66

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 67

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:23/10096675
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1