Advances in Dynamic Scene Reconstruction and Real-time Rendering

The recent advancements in dynamic scene reconstruction and real-time rendering have seen significant innovations, particularly in the use of 3D and 4D Gaussian Splatting techniques. Researchers are focusing on improving the efficiency and quality of dynamic scene representations, addressing challenges such as motion blur, temporal complexity, and memory constraints. Notable developments include methods for handling blurry monocular videos, compressing Gaussian representations for real-time applications, and optimizing for complex temporal dynamics. These approaches not only enhance visual fidelity but also enable real-time rendering on various devices, making them suitable for AR/VR and gaming applications. Additionally, there is a growing emphasis on adaptive optimization strategies and hierarchical representations to manage long volumetric videos efficiently. These advancements collectively push the boundaries of what is possible in dynamic scene synthesis and rendering, paving the way for more immersive and interactive experiences.

Noteworthy Papers:

  • Deblur4DGS: Introduces the first 4D Gaussian Splatting framework for high-quality reconstruction from blurry monocular videos.
  • TC3DGS: Achieves substantial compression of dynamic 3D Gaussian representations with minimal quality loss, suitable for real-time applications.
  • SaRO-GS: Proposes a novel dynamic scene representation with real-time rendering capabilities and adaptive optimization for handling temporal complexities.

Sources

Template-free Articulated Gaussian Splatting for Real-time Reposable Dynamic View Synthesis

Temporally Compressed 3D Gaussian Splatting for Dynamic Scenes

SizeGS: Size-aware Compression of 3D Gaussians with Hierarchical Mixed Precision Quantization

4D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenes

Deblur4DGS: 4D Gaussian Splatting from Blurry Monocular Video

Fitting Spherical Gaussians to Dynamic HDRI Sequences

EventSplat: 3D Gaussian Splatting from Moving Event Cameras for Real-time Rendering

PRM: Photometric Stereo based Large Reconstruction Model

GN-FR:Generalizable Neural Radiance Fields for Flare Removal

Representing Long Volumetric Video with Temporal Gaussian Hierarchy

Built with on top of