• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhou, Yuanbo (Zhou, Yuanbo.) [1] | Zhang, Xinlin (Zhang, Xinlin.) [2] | Deng, Wei (Deng, Wei.) [3] | Wang, Tao (Wang, Tao.) [4] | Tan, Tao (Tan, Tao.) [5] | Gao, Qinquan (Gao, Qinquan.) [6] (Scholars:高钦泉) | Tong, Tong (Tong, Tong.) [7] (Scholars:童同)

Indexed by:

EI Scopus SCIE

Abstract:

Although diffusion prior-based single-image super-resolution has demonstrated remarkable reconstruction capabilities, its potential in the domain of stereo image super-resolution remains underexplored. One significant challenge lies in the inherent stochasticity of diffusion models, which makes it difficult to ensure that the generated left and right images exhibit high semantic and texture consistency. This poses a considerable obstacle to advancing research in this field. Therefore, We introduce DiffSteISR, a pioneering framework for reconstructing real-world stereo images. DiffSteISR utilizes the powerful prior knowledge embedded in pre-trained text-to-image model to efficiently recover the lost texture details in low-resolution stereo images. Specifically, DiffSteISR implements a time-aware stereo cross attention with temperature adapter (TASCATA) to guide the diffusion process, ensuring that the generated left and right views exhibit high texture consistency thereby reducing disparity error between the super-resolved images and the ground truth (GT) images. Additionally, a stereo omni attention control network (SOA ControlNet) is proposed to enhance the consistency of super-resolved images with GT images in the pixel, perceptual, and distribution space. Finally, DiffSteISR incorporates a stereo semantic extractor (SSE) to capture unique viewpoint soft semantic information and shared hard tag semantic information, thereby effectively improving the semantic accuracy and consistency of the generated left and right images. Extensive experimental results demonstrate that DiffSteISR accurately reconstructs natural and precise textures from low-resolution stereo images while maintaining a high consistency of semantic and texture between the left and right views.

Keyword:

ControlNet Diffusion model Reconstructing Stereo image super-resolution Texture consistency

Community:

  • [ 1 ] [Zhou, Yuanbo]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 2 ] [Zhang, Xinlin]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 3 ] [Wang, Tao]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 4 ] [Gao, Qinquan]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 5 ] [Tong, Tong]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 6 ] [Deng, Wei]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 7 ] [Gao, Qinquan]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 8 ] [Tong, Tong]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 9 ] [Tan, Tao]Macao Polytech Univ, Macau 999078, Peoples R China

Reprint 's Address:

  • 童同

    [Tong, Tong]Fuzhou Univ, Fuzhou 350108, Peoples R China;;[Tong, Tong]Imperial Vis Technol, Fuzhou 350002, Peoples R China

Show more details

Related Keywords:

Online/Total:105/9987443
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1