Home > Archive>Volume 17, Issue 11, 2021 >688-692. DOI:https://doi.org/10.1007/s11801-021-1033-2
PDF HTML XML Export Cite reminder
Video image mosaic via multi-module cooperation
CSTR:
[cstr]
Author:
Affiliation:

Engineering Research Center of Learning-Based Intelligent System, Ministry of Education, School of Computer Science and Engineering, Tianjin University of Technology, Tianjin 300384, China

  • Article
    • | |
  • Metrics
    • |
  • Reference [19]
    • |
  • Related [20]
    • | | |
  • Comments
    Abstract:

    We propose a video image mosaic method based on multi-module cooperation. This method stitches the video into a panorama with a large field of view, divided into three modules:the key frame selection module, the image mosaic module, and the optimization module. The key frame selection module obtains key frames by comprehensively evaluating the overlap rate and image quality. The image mosaic module stitches the key frames into a panoramic image to generate an initial mosaic result. The optimization module makes the mosaic result more natural and eliminates ghosts by using object detection advantages. Our method is tested on videos taken in real scenes, and the results have a more comprehensive and natural description.

    Reference
    [1]XIANG T Z, XIA G S, ZHANG L P. Image stitching by line-guided local warping with global similarity constraint[J]. Pattern recognition, 2018, 83：481-497.
    [2]HERRMANN C, WANG C, BOWEN R S, et al. Object-centered image stitching[C]//European Conference on Computer Vision, September 8-14, 2018, Munich, Germany. Berlin：Springer, 2018, 11207：846-861.
    [3]LIAO T L, LI N. Single-perspective warps in natural image stitching[J]. IEEE transactions on image processing, 2020, 29：724-735.
    [4]ZARAGOZA J, CHIN T J, TRAN Q H, et al. As-projective-as-possible image stitching with moving dlt[J]. IEEE transactions on pattern analysis and machine intelligence, 2014, 36：1285-1298.
    [5]CHANG C H, SATO Y, CHUANG Y Y. Shape-preserving half-projective warps for image stitching[C]//IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2014, Columbus, OH, USA. New York：IEEE, 2014：3254-3261.
    [6]LIN C C, PANKANTI S U, RAMAMURTHY K N, et al. Adaptive as-natural-as-possible image stitching[C] //IEEE Conference on Computer Vision and Pattern Recognition, June 7-12, 2015, Boston, MA, USA. New York：IEEE, 2015：1155-1163.
    [7]LI N, XU Y F, WANG C. Quasi-homography warps in image stitching[J]. IEEE transactions on multimedia, 2018, 20(6)：1365-1375.
    [8]GAO J, KIM S J, BROWN M S. Constructing image panoramas using dual-homography warping[C]//IEEE Conference on Computer Vision and Pattern Recognition, June 20-25, 2011, Colorado Springs, CO, USA. New York：IEEE, 2011：49-56.
    [9]LI J, WANG Z M, LAI S M, et al. Parallax-tolerant image stitching based on robust elastic warping[J]. IEEE transactions on multimedia, 2018, 20(7)：1672-1687.
    [10]LEE K Y, SIM J Y. Warping residual based image stitching for large parallax[C]//IEEE Conference on Computer Vision and Pattern Recognition, June 13-19, 2020, Seattle, WA, USA. New York：IEEE, 2020：8195-8203.
    [11]LIN K, JIANG N J, CHEONG L F, et al. Seagull：seam-guided local alignment for parallax-tolerant image stitching[C]//European Conference on Computer Vision, October 11-14, 2016, Amsterdam, The Netherlands. Berlin：Springer, 2016：370-385.
    [12]YUAN Y T, FANG F M, ZHANG G X. Superpixel-based seamless image stitching for UAV images[J]. IEEE transactions on geoscience and remote sensing, 2021, 59(2)：1565-1576.
    [13]XUE W L, XIE W L, ZHANG Y, et al. Stable linear structures and seam measurements for parallax image stitching[J]. IEEE transactions on circuits and systems for video technology, 2021, PP(99)：1-1.
    [14]YANG T, LI J, YU S, et al. Diverse scene stitching from a large-scale aerial video dataset[J]. Remote sensing,2015, 7(6)：6932-6949.
    [15]BANG S, KIM H, KIM H. UAV-based automatic generation of high-resolution panorama at a construction site with a focus on preprocessing for image stitching[J]. Automation in construction, 2017, 84：70-80.
    [16]CRéTé-ROFFET F, DOLMIERE T, LADRET P, et al. The blur effect：perception and estimation with a new no-reference perceptual blur metric[J]. Proceedings of SPIE-the international society for optical engineering, 2007, 12：64920I-64920I-11.
    [17]ZHANG Z, XUE W, HUANG W, et al. Effective video frame acquisition for image stitching[J]. IEEE access, 2020, 8：217086-217097.
    [18]LIU W, ANGUELOV D, ERHAN D, et al. SSD：single shot multibox detector[C]//European Conference on Computer Vision, October 11-14, 2016, Amsterdam, The Netherlands. Berlin：Springer, 2016, 9905：21-37.
    [19]PéREZ P, GANGNET M, BLAKE A. Poisson image editing[J]. ACM transactions on graphics, 2003, 22(3)：313-318.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

ZHANG Zhe, XUE Wanli. Video image mosaic via multi-module cooperation[J]. Optoelectronics Letters,2021,17(11):688-692

Copy
Share
Article Metrics
  • Abstract:634
  • PDF: 5
  • HTML: 0
  • Cited by: 0
History
  • Received:March 12,2021
  • Revised:April 07,2021
  • Online: November 26,2021
Article QR Code
Phone：86-22-60214471
URL：http://www.oelett.com E-mail：oel@263.net
Supported by:Beijing E-Tiller Technology Development Co., Ltd.
® 2025 All Rights Reserved