ECALL: Expectation-calibrated learning for unsupervised blind deconvolution (2402.00670v2)
Abstract: Blind deconvolution aims to recover an original image from a blurred version in the case where the blurring kernel is unknown. It has wide applications in diverse fields such as astronomy, microscopy, and medical imaging. Blind deconvolution is a challenging ill-posed problem that suffers from significant non-uniqueness. Solution methods therefore require the integration of appropriate prior information. Early approaches rely on hand-crafted priors for the original image and the kernel. Recently, deep learning methods have shown excellent performance in addressing this challenge. However, most existing learning methods for blind deconvolution require a paired dataset of original and blurred images, which is often difficult to obtain. In this paper, we present a novel unsupervised learning approach named ECALL (Expectation-CALibrated Learning) that uses separate unpaired collections of original and blurred images. Key features of the proposed loss function are cycle consistency involving the kernel and associated reconstruction operator, and terms that use expectation values of data distributions to obtain information about the kernel. Numerical results are used to support ECALL.
- Computed tomography reconstruction using deep image prior and learned reconstruction methods. Inverse Problems, 36(9):094004, 2020.
- Ayan Chakrabarti. A neural approach to blind motion deblurring. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III 14, pages 221–235. Springer, 2016.
- Total variation blind deconvolution. IEEE transactions on Image Processing, 7(3):370–375, 1998.
- Fast motion deblurring. In ACM SIGGRAPH Asia 2009 papers, pages 1–8. 2009.
- Generative adversarial networks: An overview. IEEE signal processing magazine, 35(1):53–65, 2018.
- “Double-DIP”: Unsupervised image decomposition via coupled deep-image-priors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11026–11035, 2019.
- Blind image deconvolution by automatic gradient activation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1827–1836, 2016.
- From motion blur to motion flow: A deep learning solution for removing heterogeneous motion blur. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2319–2328, 2017.
- Good regions to deblur. In Computer Vision–ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7-13, 2012, Proceedings, Part V 12, pages 59–72. Springer, 2012.
- A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4401–4410, 2019.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- Fast image deconvolution using hyper-laplacian priors. Advances in neural information processing systems, 22, 2009.
- Blind deconvolution using a normalized sparsity measure. In CVPR 2011, pages 233–240. IEEE, 2011.
- Blind image deconvolution. IEEE signal processing magazine, 13(3):43–64, 1996.
- Deblurgan: Blind motion deblurring using conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8183–8192, 2018.
- Understanding and evaluating blind deconvolution algorithms. In 2009 IEEE conference on computer vision and pattern recognition, pages 1964–1971. IEEE, 2009.
- Efficient marginal likelihood optimization in blind deconvolution. In CVPR 2011, pages 2657–2664. IEEE, 2011.
- Un-supervised learning for blind image deconvolution via monte-carlo sampling. Inverse Problems, 38(3):035012, 2022.
- Reducing boundary artifacts in image deconvolution. In 2008 15th IEEE International Conference on Image Processing, pages 505–508. IEEE, 2008.
- Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017.
- Unsupervised domain-specific deblurring via disentangled representations. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10225–10234, 2019.
- Convex blind image deconvolution with inverse filtering. Inverse Problems, 34(3):035003, 2018.
- Antonio Marquina. Nonlinear inverse scale space methods for total variation blind deconvolution. SIAM Journal on Imaging Sciences, 2(1):64–83, 2009.
- Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3883–3891, 2017.
- Motion deblurring in the wild. In Pattern Recognition: 39th German Conference, GCPR 2017, Basel, Switzerland, September 12–15, 2017, Proceedings 39, pages 65–77. Springer, 2017.
- Blind image deblurring using dark channel prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1628–1636, 2016.
- Deep generative filter for motion deblurring. In Proceedings of the IEEE international conference on computer vision workshops, pages 2993–3000, 2017.
- Neural blind deconvolution using deep priors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3341–3350, 2020.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
- Variational methods in imaging, volume 167. Springer, 2009.
- Learning to deblur. IEEE transactions on pattern analysis and machine intelligence, 38(7):1439–1451, 2015.
- High-quality motion deblurring from a single image. Acm transactions on graphics (tog), 27(3):1–10, 2008.
- Learning a convolutional neural network for non-uniform motion blur removal. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 769–777, 2015.
- Scale-recurrent network for deep image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8174–8182, 2018.
- Deep image prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 9446–9454, 2018.
- Vladimir Vapnik. The nature of statistical learning theory. Springer science & business media, 1999.
- Revisiting bayesian blind deconvolution. Journal of Machine Learning Research (JMLR), 2014.
- Li Xu and Jiaya Jia. Two-phase kernel estimation for robust motion deblurring. In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part I 11, pages 157–170. Springer, 2010.
- Unnatural l0 sparse representation for natural image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1107–1114, 2013.
- Dynamic scene deblurring using spatially variant recurrent neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2521–2529, 2018.
- Deep image deblurring: A survey. International Journal of Computer Vision, 130(9):2103–2130, 2022.
- Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2223–2232, 2017.
- Markus Haltmeier (104 papers)
- Gyeongha Hwang (17 papers)