Home>Results

  • Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

[期刊论文]

Comment-Guided Semantics-Aware Image Aesthetics Assessment

Share
Edit Delete 报错

author:

Niu, Yuzhen (Niu, Yuzhen.) [1] | Chen, Shanshan (Chen, Shanshan.) [2] | Song, Bingrui (Song, Bingrui.) [3] | Unfold

Indexed by:

EI Scopus SCIE

Abstract:

Existing image aesthetics assessment methods mainly rely on the visual features of images but ignore their rich semantics. Nowadays, with the widespread application of social media, the comments corresponding to images in the form of texts can be easily accessed and provide rich semantic information, which can be utilized to effectively complement image features. This paper proposes a comment-guided semantics-aware image aesthetics assessment method, which is built upon a multi-task learning framework for image aesthetics prediction and comment-guided semantics classification. To assist image aesthetics assessment, we first model the semantics of an image as the topic features of its corresponding comments using Latent Dirichlet Allocation. We then propose a two-stream multitask learning framework for both topic feature prediction and aesthetic score distribution prediction. Topic feature prediction task enables to infer the semantics from images, since the comments are usually unavailable during inference and comment-guided semantics can only serve as supervision during training. We further propose to deeply fuse aesthetics and semantic features using a layerwise feature fusion method. Experimental results demonstrate that the proposed method outperforms state-of-the-art image aesthetics assessment methods.

Keyword:

aesthetic score distribution Image aesthetics assessment (IAA) multi-task learning topic feature

Community:

  • [ 1 ] [Niu, Yuzhen]Fuzhou Univ, Coll Comp & Data Sci, Fujian Key Lab Network Comp & Intelligent Informat, Fuzhou 350108, Fujian, Peoples R China
  • [ 2 ] [Niu, Yuzhen]Minist Educ, Key Lab Spatial Data Min & Informat Sharing, Fuzhou 350108, Fujian, Peoples R China
  • [ 3 ] [Chen, Shanshan]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 4 ] [Song, Bingrui]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 5 ] [Chen, Zhixian]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 6 ] [Liu, Wenxi]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China

Reprint 's Address:

Show more details

Version:

Source :

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

ISSN: 1051-8215

Year: 2023

Issue: 3

Volume: 33

Page: 1487-1492

8 . 3

JCR@2023

8 . 3 0 0

JCR@2023

ESI Discipline: ENGINEERING;

ESI HC Threshold:35

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 20

30 Days PV: 1

Online/Total:5/10197573
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1