• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Lin, Changkai (Lin, Changkai.) [1] | Cheng, Hongju (Cheng, Hongju.) [2] (Scholars:程红举) | Rao, Qiang (Rao, Qiang.) [3] | Yang, Yang (Yang, Yang.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

Sentiment analysis plays an indispensable part in human-computer interaction. Multimodal sentiment analysis can overcome the shortcomings of unimodal sentiment analysis by fusing multimodal data. However, how to extracte improved feature representations and how to execute effective modality fusion are two crucial problems in multimodal sentiment analysis. Traditional work uses simple sub-models for feature extraction, and they ignore features of different scales and fuse different modalities of data equally, making it easier to incorporate extraneous information and affect analysis accuracy. In this paper, we propose a Multimodal Sentiment Analysis model based on Multi-scale feature extraction and Multi-task learning (M(3)SA). First, we propose a multi-scale feature extraction method that models the outputs of different hidden layers with the method of channel attention. Second, a multimodal fusion strategy based on the key modality is proposed, which utilizes the attention mechanism to raise the proportion of the key modality and mines the relationship between the key modality and other modalities. Finally, we use the multi-task learning approach to train the proposed model, ensuring that the model can learn better feature representations. Experimental results on two publicly available multimodal sentiment analysis datasets demonstrate that the proposed method is effective and that the proposed model outperforms baselines.

Keyword:

multimodal data fusion Multimodal sentiment analysis multi-scale feature extraction Multitasking multi-task learning

Community:

  • [ 1 ] [Lin, Changkai]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 2 ] [Cheng, Hongju]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 3 ] [Rao, Qiang]Fujian Jingwei Digital Technol Corp Ltd, Fuzhou 350002, Peoples R China
  • [ 4 ] [Yang, Yang]Singapore Management Univ, Sch Comp & Informat Syst, Singapore 188065, Singapore

Reprint 's Address:

  • [Cheng, Hongju]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China;;

Show more details

Version:

Related Keywords:

Related Article:

Source :

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING

ISSN: 2329-9290

Year: 2024

Volume: 32

Page: 1416-1429

4 . 1 0 0

JCR@2023

Cited Count:

WoS CC Cited Count: 4

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:98/10067606
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1