• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Tian, Yuan (Tian, Yuan.) [1] | Yu, Yuanlong (Yu, Yuanlong.) [2] (Scholars:于元隆)

Indexed by:

CPCI-S

Abstract:

This paper presents a new pruning extreme learning machine (N-PELM) algorithm which can generate a compact single-hidden-layer neural network (SLNN) by automatically pruning the number of hidden nodes while keep high accuracy. The proposed N-PELM algorithm initializes a SLNN by using extreme learning machine (ELM) algorithm given superfluous number of hidden nodes. The following part consists of two iterative processes. First, the significance of the hidden node is estimated and the insignificant node is removed. Secondly, once the node be removed, the existing hidden nodes are updated using ELM algorithm. These two processes continue until all of each hidden nodes is estimated or the number of the hidden nodes is small enough. Compared against other neural network algorithms, N-PELM algorithm has mainly three improvements. Firstly, the significance of hidden nodes is estimated in output layer such that the relevance of hidden nodes and classes can be estimated more precisely. Secondly, the pruning threshold is selected automatically from a base set of potential relevance threshold values using Akaike information criterion (AIC) such that the threshold can accommodate any data type. Thirdly, P-ELM uses Kullback-Leibler (KL) divergence and Jensen Shannon (JS) divergence to measure the significance of hidden nodes. Experimental results have shown that the P-ELM algorithm can automatically achieve a reasonable compact network structure while keep comparable or much higher accuracy in classification and regression.

Keyword:

Akaike Information Criterion (AIC) Extreme Learning Machine (ELM) Jensen-Shannon (JS) Divergence Kullback-Leibler (KL) Divergence Pruning

Community:

  • [ 1 ] [Tian, Yuan]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350116, Fujian, Peoples R China
  • [ 2 ] [Yu, Yuanlong]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350116, Fujian, Peoples R China

Reprint 's Address:

  • 于元隆

    [Yu, Yuanlong]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350116, Fujian, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

2017 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (IEEE ICIA 2017)

Year: 2017

Page: 704-709

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:698/10125660
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1