RT-Splatting: Unified Reflection-Transmission Modeling with Gaussian Splatting
This presentation introduces RT-Splatting, a breakthrough approach that solves the longstanding challenge of rendering thin semi-transparent surfaces like glass and plastic in real-time. By factorizing each Gaussian primitive into geometric occupancy and optical opacity, the method simultaneously captures sharp reflections and clear background transmission without the artifacts that plague existing techniques. Through a hybrid surface-volume architecture, specular-aware gradient gating, and joint optimization, RT-Splatting achieves state-of-the-art quality at real-time speeds, enabling new possibilities for interactive graphics and scene editing.Script
Glass breaks rendering. When you try to model both the sharp reflections on a window and the clear view through it, traditional methods fail, forcing you to choose one or blur both.
The authors crack this problem with a simple factorization. Each Gaussian primitive gets two independent parameters: geometric occupancy that determines whether a surface exists, and optical opacity that controls how much light it blocks.
This factorization unlocks a hybrid architecture. One branch extracts surfaces and renders sharp reflections through deferred shading, while a parallel branch accumulates transmitted light volumetrically, both operating on the same unified set of primitives.
On transparent regions specifically, RT-Splatting jumps nearly 2 full PSNR points above prior methods while maintaining real-time performance. The system jointly optimizes everything, so it reconstructs backgrounds visible only through transparency, something segment-and-stitch pipelines cannot do.
A specular-aware gradient gate solves a subtle failure mode. When strong reflections dominate a pixel, naive backpropagation sends spurious gradients into the transmission pathway, spawning floating artifacts. The gate detects high-frequency specular variance and suppresses those misleading signals.
Because reflection and transmission are explicitly decomposed, you can now edit material properties in real-time: dial up roughness, tint the transmitted color, or adjust transparency independently. If you want to explore more breakthroughs like this and create your own research video summaries, visit EmergentMind.com.
