• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Niu, Yuzhen (Niu, Yuzhen.) [1] | Chen, Shanshan (Chen, Shanshan.) [2] | Song, Bingrui (Song, Bingrui.) [3] | Chen, Zhixian (Chen, Zhixian.) [4] | Liu, Wenxi (Liu, Wenxi.) [5]

Indexed by:

EI

Abstract:

Existing image aesthetics assessment methods mainly rely on the visual features of images but ignore their rich semantics. Nowadays, with the widespread application of social media, the comments corresponding to images in the form of texts can be easily accessed and provide rich semantic information, which can be utilized to effectively complement image features. This paper proposes a comment-guided semantics-aware image aesthetics assessment method, which is built upon a multi-task learning framework for image aesthetics prediction and comment-guided semantics classification. To assist image aesthetics assessment, we first model the semantics of an image as the topic features of its corresponding comments using Latent Dirichlet Allocation. We then propose a two-stream multitask learning framework for both topic feature prediction and aesthetic score distribution prediction. Topic feature prediction task enables to infer the semantics from images, since the comments are usually unavailable during inference and comment-guided semantics can only serve as supervision during training. We further propose to deeply fuse aesthetics and semantic features using a layerwise feature fusion method. Experimental results demonstrate that the proposed method outperforms state-of-the-art image aesthetics assessment methods. © 1991-2012 IEEE.

Keyword:

Forecasting Job analysis Learning systems Media streaming Semantics Statistics

Community:

  • [ 1 ] [Niu, Yuzhen]Fuzhou University, Fujian Key Laboratory of Network Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 2 ] [Niu, Yuzhen]Key Laboratory of Spatial Data Mining and Information Sharing, Ministry of Education, Fuzhou; 350108, China
  • [ 3 ] [Chen, Shanshan]Fuzhou University, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 4 ] [Song, Bingrui]Fuzhou University, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 5 ] [Chen, Zhixian]Fuzhou University, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 6 ] [Liu, Wenxi]Fuzhou University, Fujian Key Laboratory of Network Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Circuits and Systems for Video Technology

ISSN: 1051-8215

Year: 2023

Issue: 3

Volume: 33

Page: 1487-1492

8 . 3

JCR@2023

8 . 3 0 0

JCR@2023

ESI HC Threshold:35

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 20

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:99/10198620
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1