PiRD: Physics-informed Residual Diffusion for Flow Field Reconstruction (2404.08412v2)
Abstract: The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural network (CNN)-based methods for data fidelity enhancement is their reliance on specific low-fidelity data patterns and distributions during the training phase. In addition, the CNN-based method essentially treats the flow reconstruction task as a computer vision task that prioritizes the element-wise precision which lacks a physical and mathematical explanation. This dependence can dramatically affect the models' effectiveness in real-world scenarios, especially when the low-fidelity input deviates from the training data or contains noise not accounted for during training. The introduction of diffusion models in this context shows promise for improving performance and generalizability. Unlike direct mapping from a specific low-fidelity to a high-fidelity distribution, diffusion models learn to transition from any low-fidelity distribution towards a high-fidelity one. Our proposed model - Physics-informed Residual Diffusion, demonstrates the capability to elevate the quality of data from both standard low-fidelity inputs, to low-fidelity inputs with injected Gaussian noise, and randomly collected samples. By integrating physics-based insights into the objective function, it further refines the accuracy and the fidelity of the inferred high-quality data. Experimental results have shown that our approach can effectively reconstruct high-quality outcomes for two-dimensional turbulent flows from a range of low-fidelity input conditions without requiring retraining.
- State estimation of a physical system with unknown governing equations. Nature, 622(7982):261–267, 2023.
- Shallow neural networks for fluid flow reconstruction with limited sensors. Proceedings of the Royal Society A, 476(2238):20200097, 2020.
- Missing information reconstruction of remote sensing data: A technical review. IEEE Geoscience and Remote Sensing Magazine, 3(3):61–85, 2015.
- Image reconstruction: From sparsity to data-adaptive methods and machine learning. Proceedings of the IEEE, 108(1):86–109, 2019.
- Machine learning for fluid mechanics. Annual review of fluid mechanics, 52:477–508, 2020.
- A fast and scalable computational framework for large-scale high-dimensional bayesian optimal experimental design. SIAM/ASA Journal on Uncertainty Quantification, 11(1):235–261, 2023.
- Ugo Piomelli. Large-eddy simulation: achievements and challenges. Progress in Aerospace Sciences, 35(4):335–362, 1999.
- Giancarlo Alfonsi. Reynolds-averaged navier–stokes equations for turbulence modeling. 2009.
- Stefan Heinz. A review of hybrid RANS-LES methods for turbulent flows: Concepts and applications. Progress in Aerospace Sciences, 114:100597, 2020.
- State estimation in turbulent channel flow from limited observations. Journal of Fluid Mechanics, 917:A9, 2021.
- Discrete adjoint of fractional-step incompressible Navier-Stokes solver in curvilinear coordinates and application to data assimilation. Journal of Computational Physics, 396:427–450, 2019.
- Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2):295–307, 2015.
- Coarse-to-fine cnn for image super-resolution. IEEE Transactions on Multimedia, 23:1489–1502, 2020.
- Activating more pixels in image super-resolution transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22367–22377, 2023.
- Learning texture transformer network for image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5791–5800, 2020.
- Bsrt: Improving burst super-resolution with swin transformer and flow-guided deformable alignment. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 998–1008, 2022.
- Ct super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE). IEEE Transactions on Medical Imaging, 39(1):188–203, 2019.
- Blind super-resolution kernel estimation using an internal-GAN. Advances in Neural Information Processing Systems, 32, 2019.
- Edge-enhanced gan for remote sensing image superresolution. IEEE Transactions on Geoscience and Remote Sensing, 57(8):5799–5812, 2019.
- Probabilistic neural networks for fluid flow surrogate modeling and data recovery. Physical Review Fluids, 5(10):104401, 2020.
- Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels. Physics of Fluids, 33(7), 2021.
- Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data. Theoretical and Applied Mechanics Letters, 10(3):161–169, 2020.
- Uncovering near-wall blood flow from sparse data with physics-informed neural networks. Physics of Fluids, 33(7), 2021.
- Machine learning-based vorticity evolution and super-resolution of homogeneous isotropic turbulence using wavelet projection. Physics of Fluids, 36(2), 2024.
- Diffusion decision model: Current issues and history. Trends in cognitive sciences, 20(4):260–281, 2016.
- Variational diffusion models. Advances in Neural Information Processing Systems, 34:21696–21707, 2021.
- Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840–6851, 2020.
- A physics-informed diffusion model for high-fidelity flow field reconstruction. Journal of Computational Physics, 478:111972, 2023.
- Resshift: Efficient diffusion model for image super-resolution by residual shifting. Advances in Neural Information Processing Systems, 36, 2024.
- Deep learning for efficient reconstruction of high-resolution turbulent dns data. arXiv preprint arXiv:2010.11348, 2020.