Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
11 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancement (2309.04089v2)

Published 8 Sep 2023 in cs.CV

Abstract: Underwater images suffer from complex and diverse degradation, which inevitably affects the performance of underwater visual tasks. However, most existing learning-based Underwater image enhancement (UIE) methods mainly restore such degradations in the spatial domain, and rarely pay attention to the fourier frequency information. In this paper, we develop a novel UIE framework based on spatial-frequency interaction and gradient maps, namely SFGNet, which consists of two stages. Specifically, in the first stage, we propose a dense spatial-frequency fusion network (DSFFNet), mainly including our designed dense fourier fusion block and dense spatial fusion block, achieving sufficient spatial-frequency interaction by cross connections between these two blocks. In the second stage, we propose a gradient-aware corrector (GAC) to further enhance perceptual details and geometric structures of images by gradient map. Experimental results on two real-world underwater image datasets show that our approach can successfully enhance underwater images, and achieves competitive performance in visual quality improvement. The code is available at https://github.com/zhihefang/SFGNet.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. “What is the Space of Attenuation Coefficients in Underwater Computer Vision?,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  2. “Real-world underwater enhancement: Challenges, benchmarks, and solutions under natural light,” IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 30, no. 12, pp. 4861-4875, 2020.
  3. Yan-Tsung Peng and Pamela C. Cosman, “Underwater image restoration based on image blurriness and light absorption,” IEEE Transactions on Image Processing (TIP), vol. 26, no. 4, pp. 1579–1594, 2017.
  4. “Transmission estimation in underwater single images,” in Proceedings of the IEEE International Conference on Computer Vision Workshops, 2013.
  5. “Generalization of the dark channel prior for single image restoration,” IEEE Transactions on Image Processing (TIP), vol. 27, no. 6, pp. 2856-2868, 2018.
  6. “Underwater Image Restoration with Light-Aware Progressive Network,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  7. “Underwater image enhancement via learning water type desensitized representations,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
  8. “A wavelet-based dual-stream network for underwater image enhancement,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
  9. “Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement,” in The Eleventh International Conference on Learning Representations (ICLR) , 2023.
  10. “Underwater image restoration based on image blurriness and light absorption,” IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), vol. 44, no. 11, pp. 7898–7911, 2022.
  11. E Oran Brigham and RE Morrow, “The fast Fourier transform,” IEEE spectrum, 1967.
  12. “DSDNet: Toward single image deraining with self-paced curricular dual stimulations,” Comput. Vision Image Understanding. (CVIU), 2023.
  13. “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
  14. “SGDR: Stochastic gradient descent with warm restarts,” arXiv preprint arXiv:1608.03983, 2016.
  15. Guo Chunle Li, Chongyi and Ren Wenqi, “An underwater image enhancement benchmark dataset and beyond,” IEEE Transactions on Image Processing (TIP), vol. 29, pp. 4376-4389, 2020.
  16. “U-shape transformer for underwater image enhancement,” IEEE Transactions on Image Processing (TIP), vol. 32, pp. 3066-3079, 2023.
  17. “UIEC^2-Net: CNN-based underwater image enhancement using two color space,” Signal Process. Image Commun, vol. 96, pp. 116250, 2021.
  18. Saeed Anwar, Chongyi Li and Fatih Porikli, “Deep Underwater Image Enhancement,” arXiv preprint arXiv:1807.03528, 2018.
  19. “ Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing (TIP), vol. 13, pp. 600-612, 2004.
  20. “The unreasonable effectiveness of deep features as a perceptual metric,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Citations (6)

Summary

We haven't generated a summary for this paper yet.

Github Logo Streamline Icon: https://streamlinehq.com

GitHub