Home>Results

  • Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

[期刊论文]

Named Entity Recognition of Chinese Crop Diseases and Pests Based on RoBERTa-wwm with Adversarial Training

Share
Edit Delete 报错

author:

Liang, J. (Liang, J..) [1] | Li, D. (Li, D..) [2] | Lin, Y. (Lin, Y..) [3] | Unfold

Indexed by:

Scopus

Abstract:

This paper proposes a novel model for named entity recognition of Chinese crop diseases and pests. The model is intended to solve the problems of uneven entity distribution, incomplete recognition of complex terms, and unclear entity boundaries. First, a robustly optimized BERT pre-training approach-whole word masking (RoBERTa-wwm) model is used to extract diseases and pests’ text semantics, acquiring dynamic word vectors to solve the problem of incomplete word recognition. Adversarial training is then introduced to address unclear boundaries of diseases and pest entities and to improve the generalization ability of models in an effective manner. The context features are obtained by the bi-directional gated recurrent unit (BiGRU) neural network. Finally, the optimal tag sequence is obtained by conditional random fields (CRF) decoding. A focal loss function is introduced to optimize conditional random fields (CRF) and thus solve the problem of unbalanced label classification in the sequence. The experimental results show that the model’s precision, recall, and F1 values on the crop diseases and pests corpus reached 89.23%, 90.90%, and 90.04%, respectively, demonstrating effectiveness at improving the accuracy of named entity recognition for Chinese crop diseases and pests. The named entity recognition model proposed in this study can provide a high-quality technical basis for downstream tasks such as crop diseases and pests knowledge graphs and question-answering systems. © 2023 by the authors.

Keyword:

adversarial training crop diseases and pests deep learning named entity recognition pre-training language model

Community:

  • [ 1 ] [Liang J.]The Academy of Digital China (Fujian), Fuzhou University, Fuzhou, 350116, China
  • [ 2 ] [Li D.]The Academy of Digital China (Fujian), Fuzhou University, Fuzhou, 350116, China
  • [ 3 ] [Lin Y.]The Academy of Digital China (Fujian), Fuzhou University, Fuzhou, 350116, China
  • [ 4 ] [Wu S.]The Academy of Digital China (Fujian), Fuzhou University, Fuzhou, 350116, China
  • [ 5 ] [Huang Z.]State Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing, 100101, China

Reprint 's Address:

Show more details

Source :

Agronomy

ISSN: 2073-4395

Year: 2023

Issue: 3

Volume: 13

2 . 2 5 9

JCR@2018

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 6

30 Days PV: 0

Affiliated Colleges:

Online/Total:79/10036914
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1