• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, X. (Wang, X..) [1] | He, Z. (He, Z..) [2] | Zhang, Q. (Zhang, Q..) [3] | Yang, Y. (Yang, Y..) [4] | Zhao, T. (Zhao, T..) [5] | Jiang, J. (Jiang, J..) [6]

Indexed by:

Scopus

Abstract:

Being able to estimate monocular depth for spherical panoramas is of fundamental importance in 3D scene perception. However, spherical distortion severely limits the effectiveness of vanilla convolutions. To push the envelope of accuracy, recent approaches attempt to utilize Tangent projection (TP) to estimate the depth of 360° images. Yet, these methods still suffer from discrepancies and inconsistencies among patch-wise tangent images, as well as the lack of accurate ground truth depth maps under a supervised fashion. In this paper, we propose a geometry-aware self-supervised 360° image depth estimation methodology that explores the complementary advantages of TP and Equirectangular projection (ERP) by an asymmetric dual-domain collaborative learning strategy. Especially, we first develop a lightweight asymmetric dual-domain depth estimation network, which enables to aggregate depth-related features from a single TP domain, and then produce depth distributions of the TP and ERP domains via collaborative learning. This effectively mitigates stitching artifacts and preserves fine details in depth inference without overspending model parameters. In addition, a frequent-spatial feature concentration module is devised to simultaneously capture non-local Fourier features and local spatial features, such that facilitating the efficient exploration of monocular depth cues. Moreover, we introduce a geometric structural alignment module to further improve geometric structural consistency among tangent images. Extensive experiments illustrate that our designed approach outperforms existing self-supervised 360° depth estimation methods on three publicly available benchmark datasets.  © 1999-2012 IEEE.

Keyword:

360° image depth estimation self-supervised learning tangent projection

Community:

  • [ 1 ] [Wang X.]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen, 518060, China
  • [ 2 ] [He Z.]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen, 518060, China
  • [ 3 ] [Zhang Q.]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen, 518060, China
  • [ 4 ] [Yang Y.]Huangzhong University of Science and Technology, School of Electronic Information and Communications, Wuhan, 430074, China
  • [ 5 ] [Zhao T.]Fuzhou University, College of Physics and Information Engineering, Fuzhou, 350108, China
  • [ 6 ] [Jiang J.]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen, 518060, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Multimedia

ISSN: 1520-9210

Year: 2025

8 . 4 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:209/9986459
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1