• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Xu, Yiwen (Xu, Yiwen.) [1] (Scholars:徐艺文) | Huang, Liangtao (Huang, Liangtao.) [2] | Zhao, Tiesong (Zhao, Tiesong.) [3] (Scholars:赵铁松) | Fang, Ying (Fang, Ying.) [4] | Lin, Liqun (Lin, Liqun.) [5] (Scholars:林丽群)

Indexed by:

EI Scopus SCIE

Abstract:

The booming haptic data significantly improve the users' immersion during multimedia interaction. As a result, the study of a Haptic-based Interaction System has attracted the attention of the multimedia community. To construct such a system, a challenging task is the synchronization of multiple sensorial signals that is critical to the user experience. Despite audio-visual synchronization efforts, there is still a lack of a haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic-visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic-visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics and a key frame extraction of visual signals based on deep-object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic-visual signals. Without timestamps in the signal flow, the proposed method is still effective and more robust in complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method.

Keyword:

haptic-based interaction system haptic-visual synchronization human-centric multimedia multimedia environment

Community:

  • [ 1 ] [Xu, Yiwen]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350108, Peoples R China
  • [ 2 ] [Huang, Liangtao]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350108, Peoples R China
  • [ 3 ] [Zhao, Tiesong]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350108, Peoples R China
  • [ 4 ] [Fang, Ying]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350108, Peoples R China
  • [ 5 ] [Lin, Liqun]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350108, Peoples R China
  • [ 6 ] [Xu, Yiwen]Fuzhou Univ, Coll Zhicheng, Fuzhou 350108, Peoples R China

Reprint 's Address:

Show more details

Related Keywords:

Related Article:

Source :

SENSORS

ISSN: 1424-8220

Year: 2022

Issue: 15

Volume: 22

3 . 9

JCR@2022

3 . 4 0 0

JCR@2023

ESI Discipline: CHEMISTRY;

ESI HC Threshold:74

JCR Journal Grade:2

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 2

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:107/10284660
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1