• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cheng, Hongju (Cheng, Hongju.) [1] (Scholars:程红举) | Yang, Zizhen (Yang, Zizhen.) [2] | Zhang, Xiaoqi (Zhang, Xiaoqi.) [3] | Yang, Yang (Yang, Yang.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

Multimodal sentiment analysis aims to extract and integrate information from different modalities to accurately identify the sentiment expressed in multimodal data. How to effectively capture the relevant information within a specific modality and how to fully exploit the complementary information among multiple modalities are two major challenges in multimodal sentiment analysis. Traditional approaches fail to obtain the global contextual information of long time-series data when extracting unimodal temporal features, and they usually fuse the features from multiple modalities with the same method and ignore the correlation between different modalities when modeling inter-modal interactions. In this paper, we first propose an Attentional Temporal Convolutional Network (ATCN) to extract unimodal temporal features for enhancing the feature representation ability, then introduce a Multi-layer Feature Fusion (MFF) model to improve the effectiveness of multimodal fusion, which fuses the different-level features by different methods according to the correlation coefficient between the features, and cross-modal multi-head attention is used to fully explore the potential relationship between the low-level features. The experimental results on SIMS and CMU-MOSI datasets show that the proposed model achieves superior performance on sentiment analysis tasks compared to state-of-the-art baselines.

Keyword:

Attentional temporal convolutional network cross-modal multi-head attention multi-layer feature fusion multimodal sentiment analysis

Community:

  • [ 1 ] [Cheng, Hongju]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 2 ] [Yang, Zizhen]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 3 ] [Zhang, Xiaoqi]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 4 ] [Yang, Yang]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China

Reprint 's Address:

Show more details

Related Keywords:

Source :

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING

ISSN: 1949-3045

Year: 2023

Issue: 4

Volume: 14

Page: 3149-3163

9 . 6

JCR@2023

9 . 6 0 0

JCR@2023

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 213

SCOPUS Cited Count: 9

ESI Highly Cited Papers on the List: 5 Unfold All

  • 2025-1
  • 2024-11
  • 2024-9
  • 2024-7
  • 2024-5

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:64/10070142
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1