• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Xu, Yiwen (Xu, Yiwen.) [1] | Huang, Liangtao (Huang, Liangtao.) [2] | Zhao, Tiesong (Zhao, Tiesong.) [3] | Fang, Ying (Fang, Ying.) [4] | Lin, Liqun (Lin, Liqun.) [5]

Indexed by:

EI

Abstract:

The booming haptic data significantly improve the users’ immersion during multimedia interaction. As a result, the study of a Haptic-based Interaction System has attracted the attention of the multimedia community. To construct such a system, a challenging task is the synchronization of multiple sensorial signals that is critical to the user experience. Despite audio-visual synchronization efforts, there is still a lack of a haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic–visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic–visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics and a key frame extraction of visual signals based on deep-object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic–visual signals. Without timestamps in the signal flow, the proposed method is still effective and more robust in complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method. © 2022 by the authors.

Keyword:

Extraction Object detection Synchronization Visual communication

Community:

  • [ 1 ] [Xu, Yiwen]Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350108, China
  • [ 2 ] [Xu, Yiwen]College of Zhicheng, Fuzhou University, Fuzhou; 350108, China
  • [ 3 ] [Huang, Liangtao]Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350108, China
  • [ 4 ] [Zhao, Tiesong]Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350108, China
  • [ 5 ] [Fang, Ying]Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350108, China
  • [ 6 ] [Lin, Liqun]Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Sensors

ISSN: 1424-8220

Year: 2022

Issue: 15

Volume: 22

3 . 9

JCR@2022

3 . 4 0 0

JCR@2023

ESI HC Threshold:74

JCR Journal Grade:2

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:82/10285692
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1