Geometric-Aware Low-Light Image and Video Enhancement via Depth Guidance (2312.15855v1)
Abstract: Low-Light Enhancement (LLE) is aimed at improving the quality of photos/videos captured under low-light conditions. It is worth noting that most existing LLE methods do not take advantage of geometric modeling. We believe that incorporating geometric information can enhance LLE performance, as it provides insights into the physical structure of the scene that influences illumination conditions. To address this, we propose a Geometry-Guided Low-Light Enhancement Refine Framework (GG-LLERF) designed to assist low-light enhancement models in learning improved features for LLE by integrating geometric priors into the feature representation space. In this paper, we employ depth priors as the geometric representation. Our approach focuses on the integration of depth priors into various LLE frameworks using a unified methodology. This methodology comprises two key novel modules. First, a depth-aware feature extraction module is designed to inject depth priors into the image representation. Then, Hierarchical Depth-Guided Feature Fusion Module (HDGFFM) is formulated with a cross-domain attention mechanism, which combines depth-aware features with the original image features within the LLE model. We conducted extensive experiments on public low-light image and video enhancement benchmarks. The results illustrate that our designed framework significantly enhances existing LLE methods.
- Retinexformer: One-stage retinex-based transformer for low-light image enhancement. In ICCV, 2023.
- Learning to see in the dark. In CVPR, 2018.
- Seeing motion in the dark. In ICCV, 2019.
- You do not need additional priors or regularizers in retinex-based low-light image enhancement. In CVPR, 2023a.
- Learning a simple low-light image enhancer from paired low-light instances. In CVPR, 2023b.
- Self-supervised 3d mesh reconstruction from single images. In CVPR, 2021.
- EnlightenGAN: Deep light enhancement without paired supervision. IEEE TIP, 2021.
- Representative color transform for image enhancement. In ICCV, 2021.
- Towards fast and light-weight restoration of dark images. In BMVC, 2020.
- Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. In CVPR, 2021.
- The 2017 davis challenge on video object segmentation. arXiv, 2017.
- Image2mesh: A learning framework for single image 3d reconstruction. In ACCV, 2019.
- Vision transformers for dense prediction. In ICCV, 2021.
- Low light video enhancement using synthetic data produced with an intermediate domain mapping. In ECCV, 2020.
- Attention is all you need. In NeurIPS, 2017.
- Sfnet-n: An improved sfnet algorithm for semantic segmentation of low-light autonomous driving road scenes. IEEE Transactions on Intelligent Transportation Systems, 2022.
- Lighting up nerf via unsupervised decomposition and enhancement. In ICCV, 2023.
- Underexposed photo enhancement using deep illumination estimation. In CVPR, 2019.
- Seeing dynamic scene in the dark: High-quality video dataset with mechatronic alignment. In ICCV, 2021a.
- Real-time image enhancer via learnable spatial-aware 3D lookup tables. In ICCV, 2021b.
- Image quality assessment: from error visibility to structural similarity. IEEE TIP, 2004.
- Deep Retinex decomposition for low-light enhancement. In BMVC, 2018.
- Learning semantic-aware knowledge guidance for low-light image enhancement. In CVPR, 2023.
- Learning to restore low-light images via decomposition-and-enhancement. In CVPR, 2020.
- SNR-Aware low-light image enhancement. In CVPR, 2022.
- Deep parametric 3d filters for joint video denoising and illumination enhancement in video super resolution. In AAAI, 2023a.
- Low-light image enhancement via structure modeling and guidance. In CVPR, 2023b.
- Implicit neural representation for cooperative low-light image enhancement. In ICCV, 2023.
- Band representation-based semi-supervised low-light image enhancement: Bridging the gap between signal fidelity and perceptual quality. IEEE TIP, 2021a.
- Sparse gradient regularized deep Retinex network for robust low-light image enhancement. IEEE TIP, 2021b.
- Learning enriched features for real image restoration and enhancement. In ECCV, 2020a.
- Learning enriched features for real image restoration and enhancement. In ECCV, 2020b.
- Restormer: Efficient transformer for high-resolution image restoration. In CVPR, 2022.
- Learning image-adaptive 3D lookup tables for high performance photo enhancement in real-time. IEEE TPAMI, 2020.
- Learning temporal consistency for low light video enhancement from single images. In CVPR, 2021.
- Deep symmetric network for underexposed image enhancement with recurrent attentional learning. In ICCV, 2021.
- Adaptive unfolding total variation network for low-light image enhancement. In ICCV, 2021.
- Yingqi Lin (3 papers)
- Xiaogang Xu (63 papers)
- Yan Han (43 papers)
- Jiafei Wu (15 papers)
- Zhe Liu (234 papers)