• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Liang, Yuan (Liang, Yuan.) [1] | Deng, Bailin (Deng, Bailin.) [2] | Liu, Wenxi (Liu, Wenxi.) [3] (Scholars:刘文犀) | Qin, Jing (Qin, Jing.) [4] | He, Shengfeng (He, Shengfeng.) [5]

Indexed by:

EI Scopus SCIE

Abstract:

Traditional monocular depth estimation assumes that all objects are reliably visible in the RGB color domain. However, this is not always the case as more and more buildings are decorated with transparent glass walls. This problem has not been explored due to the difficulties in annotating the depth levels of glass walls, as commercial depth sensors cannot provide correct feedbacks on transparent objects. Furthermore, estimating depths from transparent glass walls requires the aids of surrounding context, which has not been considered in prior works. To cope with this problem, we introduce the first Glass Walls Depth Dataset (GW-Depth dataset). We annotate the depth levels of transparent glass walls by propagating the context depth values within neighboring flat areas, and the glass segmentation mask and instance level line segments of glass edges are also provided. On the other hand, a tailored monocular depth estimation method is proposed to fully activate the glass wall contextual understanding. First, we propose to exploit the glass structure context by incorporating the structural prior knowledge embedded in glass boundary line segment detections. Furthermore, to make our method adaptive to scenes without structure context where the glass boundary is either absent in the image or too narrow to be recognized, we propose to derive a reflection context by utilizing the depth reliable points sampled according to the variance between two depth estimations from different resolutions. High-resolution depth is thus estimated by the weighted summation of depths by those reliable points. Extensive experiments are conducted to evaluate the effectiveness of the proposed dual context design. Superior performances of our method is also demonstrated by comparing with state-of-the-art methods. We present the first feasible solution for monocular depth estimation in the presence of glass walls, which can be widely adopted in autonomous navigation.

Keyword:

Cameras Estimation Glass Glass detection line segment detection monocular depth estimation Reflection Reliability Task analysis Transformers

Community:

  • [ 1 ] [Liang, Yuan]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
  • [ 2 ] [Liang, Yuan]Singapore Management Univ, Sch Comp & Informat Syst, Singapore 188065, Singapore
  • [ 3 ] [He, Shengfeng]Singapore Management Univ, Sch Comp & Informat Syst, Singapore 188065, Singapore
  • [ 4 ] [Deng, Bailin]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF10 3AT, Wales
  • [ 5 ] [Liu, Wenxi]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350025, Peoples R China
  • [ 6 ] [Qin, Jing]Hong Kong Polytech Univ, Sch Nursing, Hung Hom, Hong Kong, Peoples R China

Reprint 's Address:

Show more details

Version:

Related Keywords:

Source :

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

ISSN: 0162-8828

Year: 2023

Issue: 12

Volume: 45

Page: 15081-15097

2 0 . 8

JCR@2023

2 0 . 8 0 0

JCR@2023

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:299/9982111
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1