Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancement (2309.04089v2)
Abstract: Underwater images suffer from complex and diverse degradation, which inevitably affects the performance of underwater visual tasks. However, most existing learning-based Underwater image enhancement (UIE) methods mainly restore such degradations in the spatial domain, and rarely pay attention to the fourier frequency information. In this paper, we develop a novel UIE framework based on spatial-frequency interaction and gradient maps, namely SFGNet, which consists of two stages. Specifically, in the first stage, we propose a dense spatial-frequency fusion network (DSFFNet), mainly including our designed dense fourier fusion block and dense spatial fusion block, achieving sufficient spatial-frequency interaction by cross connections between these two blocks. In the second stage, we propose a gradient-aware corrector (GAC) to further enhance perceptual details and geometric structures of images by gradient map. Experimental results on two real-world underwater image datasets show that our approach can successfully enhance underwater images, and achieves competitive performance in visual quality improvement. The code is available at https://github.com/zhihefang/SFGNet.
- “What is the Space of Attenuation Coefficients in Underwater Computer Vision?,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
- “Real-world underwater enhancement: Challenges, benchmarks, and solutions under natural light,” IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 30, no. 12, pp. 4861-4875, 2020.
- Yan-Tsung Peng and Pamela C. Cosman, “Underwater image restoration based on image blurriness and light absorption,” IEEE Transactions on Image Processing (TIP), vol. 26, no. 4, pp. 1579–1594, 2017.
- “Transmission estimation in underwater single images,” in Proceedings of the IEEE International Conference on Computer Vision Workshops, 2013.
- “Generalization of the dark channel prior for single image restoration,” IEEE Transactions on Image Processing (TIP), vol. 27, no. 6, pp. 2856-2868, 2018.
- “Underwater Image Restoration with Light-Aware Progressive Network,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
- “Underwater image enhancement via learning water type desensitized representations,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
- “A wavelet-based dual-stream network for underwater image enhancement,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
- “Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement,” in The Eleventh International Conference on Learning Representations (ICLR) , 2023.
- “Underwater image restoration based on image blurriness and light absorption,” IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), vol. 44, no. 11, pp. 7898–7911, 2022.
- E Oran Brigham and RE Morrow, “The fast Fourier transform,” IEEE spectrum, 1967.
- “DSDNet: Toward single image deraining with self-paced curricular dual stimulations,” Comput. Vision Image Understanding. (CVIU), 2023.
- “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
- “SGDR: Stochastic gradient descent with warm restarts,” arXiv preprint arXiv:1608.03983, 2016.
- Guo Chunle Li, Chongyi and Ren Wenqi, “An underwater image enhancement benchmark dataset and beyond,” IEEE Transactions on Image Processing (TIP), vol. 29, pp. 4376-4389, 2020.
- “U-shape transformer for underwater image enhancement,” IEEE Transactions on Image Processing (TIP), vol. 32, pp. 3066-3079, 2023.
- “UIEC^2-Net: CNN-based underwater image enhancement using two color space,” Signal Process. Image Commun, vol. 96, pp. 116250, 2021.
- Saeed Anwar, Chongyi Li and Fatih Porikli, “Deep Underwater Image Enhancement,” arXiv preprint arXiv:1807.03528, 2018.
- “ Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing (TIP), vol. 13, pp. 600-612, 2004.
- “The unreasonable effectiveness of deep features as a perceptual metric,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.