Mutual-structure weighted guided image filtering for depth map restoration
Author:
Affiliation:

1. Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, School of Microelectronics, Tianjin;University, Tianjin 300072, China;2. Spikesee Technology Co., Ltd., Beijing 100083, China

  • Article
  • | |
  • Metrics
  • |
  • Reference [20]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Although guided image filtering (GIF) is known for preserving edges and fast computation, it may produce inaccurate outputs in depth map restoration. In this paper, a novel confidence-weighted GIF called mutual-structure weighted GIF (MSWGIF) is proposed, which replaces the mean filtering strategy in GIF during handling overlapping windows. The confidence value is composed of a depth term and a mutual-structure term, where the depth term is utilized to protect the edges of the output, and the mutual-structure term helps to select accurate windows during the structure characteristics of the guidance image are transferred to the output. Experimental results show that MSWGIF reduces the root mean square error (RMSE) by an average of 12.37%, and the average growth rate of correlation (CORR) is 0.07% on average. Additionally, the average growth rate of structure similarity index measure (SSIM) is 0.34%.

    Reference
    [1] WANG H T, YANG M, LAN X, et al. Depth map recovery based on a unified depth boundary distortion model[J]. IEEE transactions on image processing, 2022, 31:7020-7035.
    [2] ZHAO Y W, WANG X, FANG Y J, et al. Depth recovery with large-area data loss guided by polarization cues for time-of-flight imaging[J]. IEEE access, 2023, 11:38840-38849.
    [3] QIAO X, GE C, DENG P, et al. Depth restoration in under-display time-of-flight imaging[J]. IEEE transactions on pattern analysis and machine intelligence, 2023, 45(5):5668-5683.
    [4] WANG H T, YANG M, ZHU C, et al. RGB-guided depth map recovery by two-stage coarse-to-fine dense CRF models[J]. IEEE transactions on image processing, 2023, 32:1315-13284.
    [5] BU P H, ZHAO H, JIN Y S, et al. Linear recursive non-local edge-aware filter[J]. IEEE transactions on circuits and systems for video technology, 2021, 31(5):1751-1763.
    [6] LIU W, ZHANG P P, LEI Y J, et al. A generalized framework for edge-preserving and structure-preserving image smoothing[J]. IEEE transactions on pattern analysis and machine intelligence, 2022, 44(10):6631-6648.
    [7] YANG Y, HUI H J, ZENG L L, et al. Edge-preserving image filtering based on soft clustering[J]. IEEE transactions on circuits and systems for video technology, 2022, 32(7):4150-4162.
    [8] MISHIBA K. Fast guided median filter[J]. IEEE transactions on image processing, 2023, 32:737-749.
    [9] HE K M, SUN J, TANG X O, et al. Guided image filtering[J]. IEEE transactions on pattern analysis and machine intelligence, 2013, 35(6):1397-1409.
    [10] LI Z G, ZHENG J H, ZHU Z J, et al. Weighted guided image filtering[J]. IEEE transactions on image processing, 2015, 24(1):120-129.
    [11] KOU F, CHEN W H, WEN C Y, et al. Gradient domain guided image filtering[J]. IEEE transactions on image processing, 2015, 24(11):4528-4539.
    [12] LU Z W, LONG B Y, LI K, et al. Effective guided image filtering for contrast enhancement[J]. IEEE signal processing letters, 2018, 25(10):1585-1589.
    [13] CHEN B, WU S Q. Weighted aggregation for guided image filtering[J]. Signal, image and video processing, 2020, 14:491-498.
    [14] SUN Z G, HAN B, LI J, et al. Weighted guided image filtering with steering kernel[J]. IEEE transactions on image processing, 2020, 29:500-508.
    [15] SHI Z L, CHEN Y L, GAVVES E, et al. Unsharp mask guided filtering[J]. IEEE transactions on image processing, 2021, 30:7472-7485.
    [16] KHODDAMI A A, MOALLEM P, KAZEMI M, et al. Depth map super resolution using structure-preserving guided filtering[J]. IEEE sensors journal, 2022, 22(13):13144-13152.
    [17] WANG B, WANG Y H, SUI X B, et al. Gradient domain weighted guided image filtering[J]. Signal, image and video processing, 2023, 17:4097-4105.
    [18] SHEN X Y, ZHOU C, XU L, et al. Mutual-structure for joint filtering[J]. International journal of computer vision, 2017, 125:19-33.
    [19] PAUL C J, WEINMAN J J, TRAN L C, et al. On learning conditional random fields for stereo[J]. International journal of computer vision, 2007, 99:319-337.
    [20] HIRSCHMULLER H, SCHARSTEIN D. Evaluation of cost functions for stereo matching[C]//2007 IEEE Conference on Computer Vision and Pattern Recognition, July 21-26, 2017, Minneapolis, MN, USA. New York:IEEE, 2007:1-8.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

LIU Zijian, SONG Jian, CHEN Quanmin, XU Jiangtao. Mutual-structure weighted guided image filtering for depth map restoration[J]. Optoelectronics Letters,2025,(1):51-56

Copy
Share
Article Metrics
  • Abstract:26
  • PDF: 0
  • HTML: 0
  • Cited by: 0
History
  • Received:December 08,2023
  • Revised:June 17,2024
  • Online: December 13,2024
Article QR Code