• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Lu, H. (Lu, H..) [1] | Tan, X. (Tan, X..) [2] | Chen, M. (Chen, M..) [3] | Zhang, Z. (Zhang, Z..) [4] | Zhang, X. (Zhang, X..) [5] | Chen, J. (Chen, J..) [6] | Wei, X. (Wei, X..) [7] | Zhao, T. (Zhao, T..) [8]

Indexed by:

Scopus

Abstract:

Haptic data compression has gradually become a key issue for emerging real-time haptic communications in Tactile Internet (TI). However, it is challenging to achieve a tradeoff between high perceptual quality and compression ratio in haptic data compression scheme. Inspired by the perspective of embodied AI, we propose a cross-modal haptic compression scheme for haptic communications to improve the perception quality on TI devices in this paper. Since multimodal fusion is routinely employed to improve the ability of system in cognition, we assume that haptic codec is guided by visual semantics to optimize parameter settings in the coding process. We first design a multi-dimensional tactile feature fusion network (MTFFN) relying on multi-head attention mechanism. The MTFFN extracts the multi-dimensional features from the material surface and maps them to infer the coding parameters. Secondly, we provide second-order difference and linear interpolation to establish an criterion for the determination of optimal codec parameters, which are customized by the material categories so as to give high robustness. Finally, the simulation results reveal that our compression scheme can efficiently make a personalized codec procedure for different materials, obtaining more than 17% improvement in terms of compression ratio with high perceptual quality at the same time.  © 2025 IEEE.

Keyword:

codec cross-modal haptic compression multi-head attention perception

Community:

  • [ 1 ] [Lu H.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 2 ] [Tan X.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 3 ] [Chen M.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 4 ] [Zhang Z.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 5 ] [Zhang X.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 6 ] [Chen J.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 7 ] [Wei X.]Nanjing University of Posts and Telecommunications, Key Laboratory of Broadband Wireless Communication and Sensor Network Technology, China
  • [ 8 ] [Zhao T.]Fuzhou University, Fujian Key Laboratory for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou, 350108, China
  • [ 9 ] [Zhao T.]Fuzhou University, Fujian Science & Technology Innovation Laboratory for Optoelectronic Information, Fuzhou, 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Multimedia

ISSN: 1520-9210

Year: 2025

8 . 4 0 0

JCR@2023

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:64/10118843
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1