Advances in 3D Gaussian Splatting for Multi-View Reconstruction and Surface Extraction

The recent advancements in the field of 3D Gaussian Splatting have significantly enhanced the capabilities of multi-view reconstruction, surface extraction, and novel view synthesis. Innovations such as the use of spatially varying functions within Gaussian primitives, adaptive meshing strategies, and geometry-guided optimizations have pushed the boundaries of what can be achieved with this technique. Notably, the integration of diffusion models and multi-view consistency has provided new avenues for improving reconstruction quality and computational efficiency. Additionally, the application of Gaussian Splatting in large-scale and dynamic environments, such as urban scene reconstruction and free-viewpoint video streaming, showcases its versatility and potential for real-world applications. These developments not only improve the accuracy and detail of 3D models but also accelerate the rendering process, making it more feasible for real-time applications.

Noteworthy Papers:

  • SuperGaussians introduces spatially varying colors and opacity in Gaussian primitives, significantly enhancing novel view synthesis performance.
  • AGS-Mesh adaptsively filters low-quality depth and normal estimates, demonstrating significant improvements in mesh estimation and novel-view synthesis.
  • Tortho-Gaussian simplifies orthophoto generation with orthogonal splatting, outperforming existing commercial software in large-scale urban scene reconstruction.
  • TexGaussian uses octant-aligned 3D Gaussian Splatting for rapid PBR material generation, synthesizing more visually pleasing materials faster than previous methods.
  • GausSurf employs geometry guidance from multi-view consistency and normal priors, surpassing state-of-the-art methods in surface reconstruction quality and computation time.
  • RF-3DGS models radio propagation with radio radiance fields, significantly improving rendering quality and speed for wireless communication applications.
  • Speedy-Splat optimizes rendering pipeline and introduces pruning techniques, achieving substantial improvements in rendering speed and model size.
  • SplatDiffusion uses a diffusion model for Gaussian Splats generation, enhancing performance with a novel training strategy and multi-view guidance.
  • ULSR-GS addresses large-scale surface extraction with multi-view geometric consistency, outperforming other GS-based methods in complex urban environments.
  • Horizon-GS unifies aerial and street view reconstruction, overcoming viewpoint discrepancies for immersive environments.
  • IPSM leverages inline priors for sparse-view 3D reconstruction, achieving state-of-the-art quality with diffusion visual guidance.
  • 2DGS-Room employs seed-guided 2D Gaussian Splatting with geometric constraints, achieving state-of-the-art performance in indoor scene reconstruction.
  • QUEEN proposes a quantized efficient encoding for streaming free-viewpoint videos, reducing model size and training time while maintaining high-quality reconstruction.

Sources

SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors

AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones

Tortho-Gaussian: Splatting True Digital Orthophoto Maps

TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splatting

GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction

RF-3DGS: Wireless Channel Modeling with Radio Radiance Field and 3D Gaussian Splatting

Speedy-Splat: Fast 3D Gaussian Splatting with Sparse Pixels and Sparse Primitives

A Lesson in Splats: Teacher-Guided Diffusion for 3D Gaussian Splats Generation with 2D Supervision

ULSR-GS: Ultra Large-scale Surface Reconstruction Gaussian Splatting with Multi-View Geometric Consistency

Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes

How to Use Diffusion Priors under Sparse Views?

2DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstruction

QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos

Built with on top of