• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Fang, Zheng (Fang, Zheng.) [1] | Zheng, Mingkui (Zheng, Mingkui.) [2] (Scholars:郑明魁) | Chen, Pingping (Chen, Pingping.) [3] (Scholars:陈平平) | Chen, Zhifeng (Chen, Zhifeng.) [4] | Oliver Wu, Dapeng (Oliver Wu, Dapeng.) [5]

Indexed by:

EI Scopus SCIE

Abstract:

For moving cameras, the video content changes significantly, which leads to inaccurate prediction in traditional inter prediction and results in limited compression efficiency. To solve these problems, first, we propose a camera pose-based background modeling (CP-BM) framework that uses the camera motion and the textures of reconstructed frames to model the background of the current frame. Compared with the reconstructed frames, the predicted background frame generated by CP-BM is more geometrically similar to the current frame in position and is more strongly correlated with it at the pixel level; thus, it can serve as a higher-quality reference for inter prediction, and the compression efficiency can be improved. Second, to compensate the motion of the background pixels, we construct a pixel-level motion vector field that can accurately describe various complex motions with only a small overhead. Our method is more general than other motion models because it has more degrees of freedom, and when the degrees of freedom are decreased, it encompasses other motion models as special cases. Third, we propose an optical flow-based depth estimation (OF-DE) method to synchronize the depth information at the codec, which is used to build the motion vector field. Finally, we integrate the overall scheme into the High Efficiency Video Coding (HEVC) and Versatile Video Coding (VVC) reference software HM-16.7 and VTM-10.0. Experimental results demonstrate that in HM-16.7, for in-vehicle video sequences, our solution has an average Bj & oslash;ntegaard delta bit rate (BD-rate) gain of 8.02% and reduces the encoding time by 20.9% due to the superiority of our scheme in motion estimation. Moreover, in VTM-10.0 with affine motion compensation (MC) turned off and turned on, our method has average BD-rate gains of 5.68% and 0.56%, respectively.

Keyword:

background modeling Bit rate camera pose Cameras Computational modeling Encoding Estimation moving cameras Predictive models Video coding

Community:

  • [ 1 ] [Fang, Zheng]Fuzhou Univ, Dept Phys & Informat Engn, Fuzhou 350108, Fujian, Peoples R China
  • [ 2 ] [Zheng, Mingkui]Fuzhou Univ, Dept Phys & Informat Engn, Fuzhou 350108, Fujian, Peoples R China
  • [ 3 ] [Chen, Pingping]Fuzhou Univ, Dept Phys & Informat Engn, Fuzhou 350108, Fujian, Peoples R China
  • [ 4 ] [Chen, Zhifeng]IVISIONIC Corp, Shanghai 200030, Peoples R China
  • [ 5 ] [Chen, Zhifeng]City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China

Reprint 's Address:

  • [Chen, Zhifeng]IVISIONIC Corp, Shanghai 200030, Peoples R China;;

Show more details

Version:

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

ISSN: 1051-8215

Year: 2024

Issue: 5

Volume: 34

Page: 4054-4069

8 . 3 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:108/10044093
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1