• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Sun, Zhenzhen (Sun, Zhenzhen.) [1] | Chen, Zexiang (Chen, Zexiang.) [2] | Liu, Jinghua (Liu, Jinghua.) [3] | Yu, Yuanlong (Yu, Yuanlong.) [4] (Scholars:于元隆)

Indexed by:

EI Scopus SCIE

Abstract:

Feature selection plays a critical role in many machine learning applications as it effectively addresses the challenges posed by "the curse of dimensionality" and enhances the generalization capability of trained models. However, existing approaches for multi-class feature selection (MFS) often combine sparse regularization with a simple classification model, such as least squares regression, which can result in suboptimal performance. To address this limitation, this paper introduces a novel MFS method called Sparse Softmax Feature Selection ((SFS)-F-2). (SFS)-F-2 combines a l(2,0)-norm regularization with the Softmax model to perform feature selection. By utilizing the l(2,0)-norm, (SFS)-F-2 produces a more precise sparsity solution for the feature selection matrix. Additionally, the Softmax model improves the interpretability of the model's outputs, thereby enhancing the classification performance. To further enhance discriminative feature selection, a discriminative regularization, derived based on linear discriminate analysis (LDA), is incorporated into the learning model. Furthermore, an efficient optimization algorithm, based on the alternating direction method of multipliers (ADMM), is designed to solve the objective function of (SFS)-F-2. Extensive experiments conducted on various datasets demonstrate that (SFS)-F-2 achieves higher accuracy in classification tasks compared to several contemporary MFS methods.

Keyword:

Alternating direction method of multipliers Discriminative regularization L-2,L-0-norm regularization Multi-class feature selection

Community:

  • [ 1 ] [Sun, Zhenzhen]HuaQiao Univ, Coll Comp Sci & Technol, Jimei Ave, Xiamen 361021, Fujian, Peoples R China
  • [ 2 ] [Chen, Zexiang]HuaQiao Univ, Coll Comp Sci & Technol, Jimei Ave, Xiamen 361021, Fujian, Peoples R China
  • [ 3 ] [Liu, Jinghua]HuaQiao Univ, Coll Comp Sci & Technol, Jimei Ave, Xiamen 361021, Fujian, Peoples R China
  • [ 4 ] [Sun, Zhenzhen]HuaQiao Univ, Xiamen Key Lab Comp Vis & Pattern Recognit, Jimei Ave, Xiamen 361021, Fujian, Peoples R China
  • [ 5 ] [Yu, Yuanlong]Fuzhou Univ, Coll Comp & Data Sci, Wulong Jiangbei Ave, Fuzhou 350108, Fujian, Peoples R China

Reprint 's Address:

  • 于元隆

    [Sun, Zhenzhen]HuaQiao Univ, Coll Comp Sci & Technol, Jimei Ave, Xiamen 361021, Fujian, Peoples R China;;[Sun, Zhenzhen]HuaQiao Univ, Xiamen Key Lab Comp Vis & Pattern Recognit, Jimei Ave, Xiamen 361021, Fujian, Peoples R China;;[Yu, Yuanlong]Fuzhou Univ, Coll Comp & Data Sci, Wulong Jiangbei Ave, Fuzhou 350108, Fujian, Peoples R China

Show more details

Version:

Related Keywords:

Source :

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS

ISSN: 1868-8071

Year: 2024

Issue: 1

Volume: 16

Page: 159-172

3 . 1 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:87/10007258
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1