Advances in Gaussian Splatting for 3D Avatar and Scene Reconstruction

The recent advancements in the field of 3D avatar and scene reconstruction have shown a significant shift towards leveraging Gaussian Splatting techniques for both efficiency and accuracy. Researchers are increasingly focusing on methods that combine 2D and 3D Gaussian representations to achieve high-fidelity rendering while maintaining geometric precision. This hybrid approach allows for the creation of realistic avatars and scenes from sparse views, addressing the limitations of traditional methods that often struggle with training and rendering speeds or geometric inconsistencies. Notable innovations include the integration of neural networks with Gaussian Splatting to refine geometry and enhance photorealism, as well as the development of frameworks capable of handling wide-baseline panoramic images. These developments not only push the boundaries of real-time rendering but also open new possibilities for applications in virtual reality, gaming, and robotics.

Among the noteworthy papers, 'MixedGaussianAvatar' introduces a novel mixed 2D-3D Gaussian representation for head avatar reconstruction, achieving both geometric accuracy and rendering fidelity. 'GBR' stands out for its generative bundle refinement method, significantly improving geometry accuracy and fidelity under sparse-view conditions. 'Splatter-360' is particularly innovative for its generalizable 3D Gaussian Splatting framework designed to handle wide-baseline panoramic images, enhancing depth perception and geometry estimation.

Sources

MixedGaussianAvatar: Realistically and Geometrically Accurate Head Avatar via Mixed 2D-3D Gaussian Splatting

GBR: Generative Bundle Refinement for High-fidelity Gaussian Splatting and Meshing

Splatter-360: Generalizable 360$^{\circ}$ Gaussian Splatting for Wide-baseline Panoramic Images

MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Views

GASP: Gaussian Avatars with Synthetic Priors

SLGaussian: Fast Language Gaussian Splatting in Sparse Views

ConvMesh: Reimagining Mesh Quality Through Convex Optimization

Feat2GS: Probing Visual Foundation Models with Gaussian Splatting

Built with on top of