• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Shiping (Wang, Shiping.) [1] (Scholars:王石平) | Chen, Zhaoliang (Chen, Zhaoliang.) [2] | Du, Shide (Du, Shide.) [3] | Lin, Zhouchen (Lin, Zhouchen.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

Sparsity-constrained optimization problems are common in machine learning, such as sparse coding, low-rank minimization and compressive sensing. However, most of previous studies focused on constructing various hand-crafted sparse regularizers, while little work was devoted to learning adaptive sparse regularizers from given input data for specific tasks. In this paper, we propose a deep sparse regularizer learning model that learns data-driven sparse regularizers adaptively. Via the proximal gradient algorithm, we find that the sparse regularizer learning is equivalent to learning a parameterized activation function. This encourages us to learn sparse regularizers in the deep learning framework. Therefore, we build a neural network composed of multiple blocks, each being differentiable and reusable. All blocks contain learnable piecewise linear activation functions which correspond to the sparse regularizer to be learned. Furthermore, the proposed model is trained with back propagation, and all parameters in this model are learned end-to-end. We apply our framework to multi-view clustering and semi-supervised classification tasks to learn a latent compact representation. Experimental results demonstrate the superiority of the proposed framework over state-of-the-art multi-view learning models.

Keyword:

Backpropagation Compressed sensing Deep learning Minimization multi-view learning Neural networks Optimization parameterized activation function proximal operator sparse regularizer Task analysis

Community:

  • [ 1 ] [Wang, Shiping]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 2 ] [Chen, Zhaoliang]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 3 ] [Du, Shide]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 4 ] [Wang, Shiping]Fuzhou Univ, Key Lab Network Comp & Intelligent Informat Proc, Fuzhou 350108, Peoples R China
  • [ 5 ] [Chen, Zhaoliang]Fuzhou Univ, Key Lab Network Comp & Intelligent Informat Proc, Fuzhou 350108, Peoples R China
  • [ 6 ] [Du, Shide]Fuzhou Univ, Key Lab Network Comp & Intelligent Informat Proc, Fuzhou 350108, Peoples R China
  • [ 7 ] [Lin, Zhouchen]Peking Univ, Sch EECS, Key Lab Machine Percept MoE, Beijing 100871, Peoples R China
  • [ 8 ] [Lin, Zhouchen]Pazhou Lab, Guangzhou 510330, Peoples R China

Reprint 's Address:

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

ISSN: 0162-8828

Year: 2022

Issue: 9

Volume: 44

Page: 5042-5055

2 3 . 6

JCR@2022

2 0 . 8 0 0

JCR@2023

ESI Discipline: ENGINEERING;

ESI HC Threshold:66

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 98

SCOPUS Cited Count: 112

ESI Highly Cited Papers on the List: 3 Unfold All

  • 2025-1
  • 2024-11
  • 2024-7

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:13/10090668
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1