NeRF에 대한 개선 방향 및 기술 동향 (이전글) 과 비슷한 방식으로, 3D-GS가 발전 할 수 있는 방향성과 기술 동향에 대해서 설명하겠습니다.
※ 2024년 2월까지는 발표되는 논문수가 적어서 중요도를 고려하지 않았지만, 2024년 3월부터는 논문이 많이 쏟아지면서 중요도가 높아보이는 것들을 선별했습니다.
<latest update : 27-Oct 2024>
Base Paper
- 3D Gaussian Splatting (SIGGRAPH 2023 / code / inria / 논문 리뷰 바로가기)
3D Gaussian Splatting for Real-Time Radiance Field Rendering - gsplat (10.Sep.arXiv2024 / code / Apache 2.0 license )
gsplat: An Open-Source Library for Gaussian Splatting
Speed / Quality / Memory
Train Speed
- Long-LRM (16.Oct.arXiv2024)
Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats - Efficient Perspective-Correct 3DGS (10.Oct.arXiv2024)
Efficient Perspective-Correct 3D Gaussian Splatting Using Hybrid Transparency - 3DGS-LM (19.Sep.arXiv2024)
3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-Marquardt - AdR-Gaussian (13.Sep.arXiv2024)
AdR-Gaussian: Accelerating Gaussian Splatting with Adaptive Radius - Textured-GS (13.Jul.arXiv2024)
Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity - Taming 3DGS (21.Jun.arXiv2024)
Taming 3DGS: High-Quality Radiance Fields with Limited Resources - Mini-Splatting (21.Mar.arXiv2024)
Mini-Splatting: Representing Scenes with a Constrained Number of Gaussians - DISTWAR (arXiv2023 / code / 논문 리뷰 바로가기)
DISTWAR: Fast Differentiable Rendering on Raster-based Rendering Pipelines - Scaffold-GS (arXiv2023 / CVPR2024 / code / fast converge + fast rendering / 논문 리뷰 바로가기)
Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering - Human101 (arXiv 2023 / fast rendering + 1 view on RTX3090)
Human101: Training 100+FPS Human Gaussians in 100s from 1 View
Render Speed
- PRoGS (03.Sep.arXiv2024)
PRoGS: Progressive Rendering of Gaussian Splats - FlashGS (15.Aug.arXiv2024)
FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Rendering - RTGS (29.Jun.arXiv2024 / code)
RTGS: Enabling Real-Time Gaussian Splatting on Mobile Devices Using Efficiency-Guided Pruning and Foveated Rendering - PUP 3D-GS (14.Jun.arXiv2024)
PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splatting - Octree-GS (26.Mar.arXiv2024 / code)
Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians - Identifying Unnecessary 3D Gaussian (21.Feb.arXiv2024)
Identifying Unnecessary 3D Gaussians using Clustering for Fast Rendering of 3D Gaussian Splatting - EAGLES (arXiv 2023)
EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS - LightGaussian (arXiv 2023 / code )
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Quality
- Soft-free GS (24.Oct.arXiv2024)
Sort-free Gaussian Splatting via Weighted Sum Rendering - 3DGS Enhancer (21.Oct.arXiv2024 / NIPS2024 / code TBA)
3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors - EVER (02.Oct.arxiv2024)
EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis - Spectral-GS (19.Sep.arXiv2024)
Spectral-GS: Taming 3D Gaussian Splatting with Spectral Entropy - Sources of Uncertainty (10.Sep.arXiv2024)
Sources of Uncertainty in 3D Scene Reconstruction - RayGauss (06.Aug.arXiv2024)
RayGauss: Volumetric Gaussian-Based Ray Casting for Photorealistic Novel View Synthesis - Bootstrap 3D reconstructed scenes from 3DGS (29.Apr.arXiv2024)
Bootstrap 3D Reconstructed Scenes from 3D Gaussian Splatting - Revising Densification in GS (09.Apr.arXiv2024)
Revising Densification in Gaussian Splatting - RadSplat (20.Mar.arXiv2024 / Google / 논문 리뷰 바로가기)
RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS - RAIN-GS (14.Mar.arXiv2024 / code)
Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting - FreGS (11.Mar.arXiv2024)
FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization - Spec-Gaussian (24.Feb.arXiv 2024)
Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting - GaussianPro (22.Feb.arXiv 2024 / code / 논문 리뷰 바로가기)
GaussianPro: 3D Gaussian Splatting with Progressive Propagation - GS++ (01.Feb.arXiv 2024)
GS++: Error Analyzing and Optimal Gaussian Splatting - StopThePop (01.Feb.arXiv 2024)
StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Rendering - Trips (11.Jan.arXiv2024 / Eurographics 2024 / code / 논문리뷰 바로가기)
TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering - Deblurring-3DGS (01.Jan.arXiv2024)
Deblurring 3D Gaussian Splatting
Quality - Adapted on existing model
- PH-Dropout (07.Oct.arxiv2024)
PH-Dropout: Prctical Epistemic Uncertainty Quantification for View Synthesis - MVGS (02.Oct.arxiv2024)
MVGS: Multi-view-regulated Gaussian Splatting for Novel View Synthesis
Quality - Reflection Remove
- Flash-Splat (03.Oct.arXiv2024 / ECCV2024)
Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats
Anti-Aliasing
- SuperGS (03.Oct.arxiv2024)
SuperGS: Super-Resolution 3D Gaussian Splatting via Latent Feature Field and Gradient-guided Splitting - Mipmap-GS (12.Aug.arXiv2024)
Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Rendering - GaussianSR (25.Jul.arXiv2024)
GaussianSR: High Fidelity 2D Gaussian Splatting for Arbitrary-Scale Image Super-Resolution - GaussianSR (14.Jun.arXiv2024)
GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors - SuperGaussian (02.Jun.arXiv2024)
SuperGaussian: Repurposing Video Models for 3D Super Resolution - SRGS (16.Apr.arXiv2024)
SRGS: Super-Resolution 3D Gaussian Splatting - SA-GS (28.Mar.arXiv2024 / code)
SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasing - Analytic-Splatting (17.Mar.arXiv2024)
Analytic-Splatting: Anti-Aliased 3D Gaussian Splatting via Analytic Integration - BAGS (07.Mar.arXiv2024)
BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modeling - Mip-splatting (CVPR2024 / code / 논문 리뷰 바로가기)
Mip-Splatting : Alias-free 3D Gaussian Splatting
Deblur
- CRiM-GS (04.Jul.arXiv2024)
CRiM-GS: Continuous Rigid Motion-Aware Gaussian Splatting from Motion Blur Images - E2GS (21.Jun.arXiv2024)
E2GS: Event Enhanced Gaussian Splatting - EvaGaussians (29.May.arXiv2024)
EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images - DOF-GS (27.May.arXiv2024)
DOF-GS: Adjustable Depth-of-Field 3D Gaussian Splatting for Refocusing,Defocus Rendering and Blur Removal - DeblurGS (17.Apr.arXiv2024)
DeblurGS: Gaussian Splatting for Camera Motion Blur - Gaussian Splatting on the Move (20.Mar.arXiv2024)
Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion - BAD-Gaussians (18.Mar.arXiv2024 / code)
BAD-Gaussians: Bundle-Adjusted Deblur Gaussian Splatting
Memory
- Plenoptic PNG (24.Sep.arXiv2024)
Plenoptic PNG: Real-Time Neural Radiance Fields in 150 KB - MesonGS (15.Sep.arXiv2024 / ECCV2024 / code )
MesonGS: Post-training Compression of 3D Gaussians via Efficient Attribute Transformation - Lagrangian Hashing (09.Sep.arXiv2024 / code)
Lagrangian Hashing for Compressed Neural Field Representations - C3DGS-extended (07.Aug.arXiv2024)
Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fields - Trimming the Fat (26.Jun.arXiv2024)
Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruning - Reduce the memory Footprint of 3DGS (24.Jun.arXiv2024)
Reducing the Memory Footprint of 3D Gaussian Splatting - ContextGS (31.May.arXiv2024)
ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Model - HAC (21.Mar.arXiv2024 / ECCV2024 / code)
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression - GES (15.Feb.arXiv2024 / CVPR 2024 / code)
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering - Compact3D-self-organizing (arXiv 2023 / ECCV2024 / code)
Compact 3D Scene Representation via Self-Organizing Gaussian Grids - C3DGS (arXiv 2024 / CVPR2024 / code )
Compact 3D Gaussian Representation for Radiance Field - Compact3D (arXiv 2023 / code)
Compact3D: Compressing Gaussian Splat Radiance Field Models with Vector Quantization - Compressed 3DGS (arXiv2023 / CVPR2024 / code / 1.5GB?->47MB)
Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis
Sparse Inputs
- MVPGS (22.Sep.arXiv2024 / ECCV2024 / code)
MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Views - SplatFields (17.Sep.arXiv2024 / ECCV2024)
SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction - Self-augmented GS (09.Aug.arXiv2024)
Self-augmented Gaussian Splatting with Structure-aware Masks for Sparse-view 3D Reconstruction - LoopSparseGS (01.Aug.arXiv2024)
LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splatting - Flash3D (06.jun.arXiv2024 / code)
Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image - Tele-Aloha (23.May.arXiv2024)
Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras - MVSGaussian (20.May.arXiv2024 / code / 논문 리뷰 바로가기)
Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo - GS-LRM (30.Apr.arXiv2024)
GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting - CoherentGS (28.Mar.arXiv2024 / 2views)
CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians - LatentSplat (26.Mar.arXiv2024 / code / 2views, training using 2x A40 for 4days for latentSplat & pixelSplat)
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction - MVSplat (21.Mar.arXiv2024 / code / 2-3 views)
MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images - DNGaussian (11.Mar.arXiv2024 / CVPR2024 / code / 3 views)
DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization - GaussianObject (20.Feb.arXiv 2024 / code / 4 views)
GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting - PixelSplat (arXiv 2023 / code / 2 views)
pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction - DRO for 3D-GS (arXiv 2023 / 2~5 views)
Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images
Human
- EVA-Gaussian (02.Oct.arXiv2024)
EVA-Gaussian: 3D Gaussian-based Real-time Human Novel View Synthesis under Diverse Camera Settings - HeadGAP (12.Aug.arXiv2024)
HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors - GGHead (13.Jun.arXiv2024)
GGHead: Fast and Generalizable 3D Gaussian Heads - GPS-Gaussian (arXiv 2023 / CVPR2024 / 8 views / + train speed / 논문 리뷰 바로가기)
GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis
Pose-Free
General Scene
- Correspondence-Guided SfM-Free 3DGS (16.Aug.arXiv2024)
Correspondence-Guided SfM-Free 3D Gaussian Splatting for NVS - COGS (06.May.arXiv2024 / SIGGRAPH2024 / code)
A Construct-Optimize Approach to Sparse View Synthesis without Camera Pose - InstantSplat (29.Mar.arXiv2024 / 논문 리뷰 바로가기)
InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds - iComMa (arXiv 2023 / focusing on pose estimation)
iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching - COLMAP-Free 3DGS (arxiv2023 / CVPR2024 / NVIDIA)
COLMAP-Free 3D Gaussian Splatting
Driving Scene
- VEGS (03.Jul.arXiv2024, ECCV2024)
VEGS : View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priors - VDG (26.Jun.arXiv2024)
VDG: Vision-Only Dynamic Gaussian for Driving Simulation - GGRt (15.Mar.arXiv2024 / ECCV2024)
GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-time
Dynamic Scene Rendering
Training Speed
- Fully Explicit Dynamic Gaussian Splatting (21.Oct.arXiv2024)
Fully Explicit Dynamic Gaussian Splatting - 3DGStream (03.Mar.arXiv2024 / CVPR 2024 / code / 논문 리뷰 바로가기)
3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos
Rendering Speed
- SwinGS (12.Sep.arXiv2024)
SwinGS: Sliding Window Gaussian Splatting for Volumetric Video Streaming with Arbitrary Length - 4D Gaussian Splatting (05.Feb.arXiv 2024 / 277-583fps rendering on RTX 3090-4090 & 1352x1014 resolution + 60min training on 8GPU + high quality)
4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes - GauFRe (arXiv 2023 / meta)
GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis - Street Gaussians (04.Jan.arXiv2024, training 30mins, 1066x1600, 144FPS on RTX 4090)
Street Gaussians for Modeling Dynamic Urban Scenes - Spacetime GFS (arxiv 2023 / code / oppo / 8K resolution, training 3.5hours, 60FPS rendering on RTX 4090)
Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis - 4D Gaussian Splatting (CVPR 2024 / code / 논문 리뷰 바로가기)
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering - 4d-gaussian-splatting (ICLR 2024 / code)
Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
3D Point Track Trajectories
- DynOMo (03.Sep.arXiv2024)
DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstruction - DG-Mesh (18.Apr.arXiv2024)
Dynamic Gaussian Mesh: Consistent Mesh Reconstruction from Monocular Videos - Motion-Aware 3DGS (18.Mar.arXiv2024)
Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction - MD-Splatting (arXiv2023)
MD-Splatting: Learning Metric Deformation from 4D Gaussians in Highly Deformable Scenes - Dynamic 3D Gaussians (3DV 2024 / code)
Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
Human
- GaussianBody (18.Jan.arXiv 2024)
GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splatting - Animatable Gaussians (arXiv 2023 / CVPR2024 / link)
Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling - DynMF (arXiv 2023)
DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splatting
Quality
- DaRePlane (18.Oct.arXiv2024)
DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction - DN-4DGS(17.Oct.arXiv2024)
DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Rendering - MotionGS (10.Oct.arXiv2024)
MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting - Modeling Ambient Scene Dynamics (13.Jun.arXiv2024 / SIGRAPH2024)
Modeling Ambient Scene Dynamics for Free-view Synthesis - SP-GS (05.Jun.arXiv2024 / ICML2024)
Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstruction - S3Gaussian (30.May.arXiv2024 / code)
S3 Gaussian: Self-Supervised Street Gaussians for Autonomous Driving - Gaussian Time Machine (22.May.arXiv2024)
Gaussian Time Machine: A Real-Time Rendering Methodology for Time-Variant Appearances - E-D3DGS (04.Apr.arXiv2024 / ECCV2024 / code )
E-D3DGS : Embedding-Based Deformable 3D Gaussian Splatting
= Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting - GaussianFlow (arXiv2024 / Luminere and SORA input -> optical flow output)
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation - Gaussian-Flow (arXiv 2023 / CVPR 2024 )
Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle - An Efficient 3D Gaussian (arXiv 2023)
An Efficient 3D Gaussian Representation for Monocular/Multi-view Dynamic Scenes - Deformable 3D Gaussians (arXiv 2023 / CVPR2024 / code)
Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction
Single-view Video
- DreamMesh4D (09.Oct.arXiv2024 / NeurIPS 2024 / code)
DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representation - L4GM (14.Jun.arXiv2024)
L4GM: Large 4D Gaussian Reconstruction Model - GFlow (28.May.arXiv2024)
GFlow: Recovering 4D World from Monocular Video - MoSca (27.May.arXiv2024)
MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds - Guess The Unseen (22.Mar.arXiv2024)
Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses - STAG4D (22.Mar.arXiv2024)
STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians - BAGS (18.Mar.arXiv2024)
BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors - Efficient4D(16.Jan.arXiv2024)
Fast Dynamic 3D Object Generation from a Single-view Video
Driving Scene
- OmniRe (29.Aug.arXiv2024)
OmniRe: Omni Urban Scene Reconstruction - AutoSplat (03.Jul.arXiv2024)
AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstruction - DrivingGaussian (arXiv 2023 / Google Research)
DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes
Memory
- MEGA (17.Oct.arXiv2024)
MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenes - Robust Dual GS (12.Sep.arXiv2024)
Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videos
Scene Editing
Physical Simulation
- MiraGe (02.Oct.arxiv2024)
MiraGe: Editable 2D Images using Gaussian Splatting - GASP (09.Sep.arXiv2024)
GASP: Gaussian Splatting for Physic-Based Simulations - Simplicits (09.Jun.arXiv2024)
Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation - PhysGaussian (arXiv 2023 / CVPR2024 / code / 논문 리뷰 바로가기)
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Text-based
- Avatar Concept Slider (26.Aug.arXiv2024)
Avatar Concept Slider: Manipulate Concepts In Your Human Avatar With Fine-grained Control - 3DEgo (14.Jul.arXiv2024 / ECCV2024)
3DEgo: 3D Editing on the Go! - TrAME (02.Jul.arXiv2024)
TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulation - DGE (29.Apr.arXiv2024)
DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing - Interactive3D (25.Apr.arXiv2024 / generation + editing)
Interactive3D: Create What You Want by Interactive 3D Generation - FeatureSplatting (02.Apr.arXiv2024 / code TBA)
Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing - GaussCtrl (13.Mar.arXiv2024)
GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing - GSEdit (08.Mar.arXiv2024)
GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting - Control4D (arXiv 2023 / text-based)
Control4D: Efficient 4D Portrait Editing with Text - TIP-Editor (26.Jan.arXiv2024)
TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts - GaussianEditor - delicately (arXiv 2023)
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions - Gaussian-Editor - controllable (arXiv 2023 / CVPR2024 / code / 논문 리뷰 바로가기)
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
Style Image-based
- WaSt-3D (26.Sep.arXiv2024)
WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians - InstantStyleGaussian (08.Aug.arXiv2024)
InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splatting - ICE-G (12.Jun.arXiv2024)
ICE-G: Image Conditional Editing of 3D Gaussian Splats - TIGER (23.May.arXiv2024)
TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing - StylizedGS (08.Apr.arXiv2024)
StylizedGS: Controllable Stylization for 3D Gaussian Splatting - Gaussian Splatting in Style (13.Mar.arXiv2024)
Gaussian Splatting in Style - StyleGaussian (12.Mar.arXiv2024 / code / 논문 리뷰 바로가기)
StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting
Human
- Insant Facial Gaussians (11.Sep.arXiv2024)
Instant Facial Gaussians Translator for Relightable and Interactable Facial Rendering - MeGA (29.Apr.arXiv2024 / + texture insertion)
MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing - SplattingAvatar (08.Mar.arXiv2024 / CVPR2024 / code)
SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting - ImplicitDeepfake (09.Feb.arXiv2024 / face swap = 얼굴만 변경)
ImplicitDeepfake: Plausible Face-wapping through Implicit Deepfake Generation using NeRF and GaussianSplatting - Rig3DGS (06.Feb.arXiv 2024)
Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos - PSAvatar (23.Jan.arXiv 2024)
PSAvatar: A Point-based Morphable Shape Model for Real-Time Head Avatar Creation with 3D Gaussian Splatting - BakedAvatar (SIGGRAPH Asia 2023 / code / Realtime Rendering iPad pro 2021 43FPS, Face Reenactment, Expression Editing, Pose Editing)
BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis - GaussianAvatars (arXiv 2023 / code)
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians - HUGS (arXiv 2023 / Apple)
HUGS:Human Gaussian Splats - SplatArmor (arXiv 2023)
SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos - D3GA (arXiv 2023 / code TBA / Meta Research)
Drivable 3D Gaussian Avatars
Human : Pose Control
- DEGAS (20.Aug.arXiv2024)
DEGAS: Detailed Expressions on Full-Body Gaussian Avatars - HUGS (21.May.arXiv2024 / code)
Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery - GoMAvatar (11.Apr.arXiv2024 / CVPR2024 / code)
GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh - Gaussian Shadow Casting (11.Jan.arXiv2024)
Gaussian Shadow Casting for Neural Characters - GART (arXiv2023 / CVPR2024 / code)
GART: Gaussian Articulated Template Models - GaussianAvatar (arXiv2023 / code)
GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians - 3DGS-Avatar (arXiv 2023 / CVPR2024 / code)
3DGS-Avatar : Animatable Avatars via Deformable 3D Gaussian Splatting - ASH (arXiv 2023 / CVPR2024 / code / + dynamic skeleton control)
ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Human : Face Control
- TextToon (23.Sep.arXiv2024)
TextToon: Real-Time Text Toonify Head Avatar from Single Video - GEM (05.Jul.arXiv2024 / code TBD)
Gaussian Eigen Models for Human Heads - NPGA (29.May.2024)
NPGA: Neural Parametric Gaussian Avatars
Vritual Try-On
- GS-VTON (07.Oct.arXiv2024)
GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splatting - PICA (07.Jul.arXiv2024)
PICA: Physics-Integrated Clothed Avatar - GaussianVTON (13.May.2024 / code)
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting
Object : Control
- GaussianBlock (02.Oct.arxiv2024)
GaussianBlock: Building Part-Aware Compositional and Editable 3D Scene by Primitives and Gaussians - 3D Gaussian Editing (14.Aug.arXiv2024)
3D Gaussian Editing with A Single Image - ManiGS (28.May.arXiv2024)
Mani-GS: Gaussian Splatting Manipulation with Triangular Mesh - GSDeformer (24.may.arXiv2024)
GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting - D-Miso (23.Mar.arXiv 2024)
D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soup - Gaussian Frosting (21.Mar.2024)
Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering - Mesh-based GS (07.Feb.arXiv 2024)
Mesh-based Gaussian Splatting for Real-time Large-scale Deformation - GaMeS (02.Feb.arXiv 2024 / code / editing after 3d mesh)
GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting - VR-GS (30.Jan.arXiv 2024 / + segmentation + inpaint + VR interaction)
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality - Gaussian Splashing (27.Jan.arXiv 2024 / +inpaint)
Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting - CoGS (arXiv 2023 / CVPR2024 / +object-control)
CoGS : Controllable Gaussian Splatting - SC-GS (arXiv 2023 / CVPR2024)
SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes - Point'n Move (arXiv2023)
Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
Religthing
- GlossyGS (17.Oct.arXiv2024 + Material Editting)
GlossyGS: Inverse Rendering of Glossy Objects with 3D Gaussian Splatting - GS^3 (15.Oct.arXiv2024 / SIGGRAPH Asia 2024 / code)
GS^3: Efficient Relighting with Triple Gaussian Splatting - DifFRelight (10.Oct.arXiv2024)
DifFRelight: Diffusion-Based Facial Performance Relighting - Relit-LRM (08.Oct.arXiv2024)
RelitLRM: Generative Relightable Radiance for Large Reconstruction Models - RNG (29.Sep.arXiv2024)
RNG: Relightable Neural Gaussians - A Diffusion Appraoch to RF Relighting (13.Sep.arXiv2024)
A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis - SSS GS (22.Aug.arXiv2024)
Subsurface Scattering for 3D Gaussian Splatting - LumiGauss (06.Aug.arXiv2024)
LumiGauss: High-Fidelity Outdoor Relighting with 2D Gaussian Splatting - RRTGS (07.Aug.arXiv2024)
PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relighting - Unified Gaussian Primitives (14.Jun.arXiv 2024)
Unified Gaussian Primitives for Scene Representation and Rendering - Relightable Gaussian Codec Avatars (arXiv 2023 / meta)
Relightable Gaussian Codec Avatars - Relightable 3D Gaussian (arXiv 2023)
Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing
Removing
- EgoGaussian (28.Jun.arXiv2024)
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting - Gscream (21.Apr.arXiv2024)
GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal - Split Algorithm for 3DGS (14.Mar.arXiv2024)
A New Split Algorithm for 3D Gaussian Splatting - Gaussain Grouping (arXiv 2023 / code / +Segmentation + Inpainting + Style Transfer + Editing)
Gaussian Grouping: Segment and Edit Anything in 3D Scenes
Text-based Video Editing
- 4-LEGS (14.Oct.arXiv2024)
4-LEGS 4D Language Embedded Gaussian Splatting - video-3dgs (04.Jun.arXiv2024)
Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
2Scene Merging
- GS-Stitching (28.Aug.arXiv2024)
Towards Realistic Example-based Modeling via 3D Gaussian Stitching
Diffusion Model to 3D
Image to 3D & Text to 3D
- MVGamba (10.Jun.arXiv2024)
MVGamba: Unify 3D Content Generation as State Space Sequence Modeling - Tet-Splatting (03.Jun.arXiv2024)
Tetrahedron Splatting for 3D Generation - RealmDreamer (10.Apr.arXiv2024)
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion - Hash3D (09.Apr.arXiv2024 / code)
Hash3D: Training-free Acceleration for 3D Generation Preprint - GVGEN (19.Mar.arXiv2024)
GVGEN:Text-to-3D Generation with Volumetric Representation - FDGaussian (15.Mar.arXiv2024)
FDGaussian: Fast Gaussian Splatting from Single Image via Geometric-aware Diffusion Model - LGM (07.Feb.arXiv2024 / code)
LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation - LODS (arXiv 2023 / code)
Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting - DreamGaussian (arXiv 2023 / code / 논문 리뷰 바로가기)
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation
Single Image to 3D only (Sparse view)
- Vista3D (18.Sep.arXiv2024 / ECCV2024)
Vista3D: Unravel the 3D Darkside of a Single Image - Hi3D (11.Sep.arXiv2024)
Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models - Human-VDM (04.Sep.arXiv2024)
Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models - GSD (05.Jul.arXiv2024 / ECCV2024)
GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction - Human 3Diffusion (12.Jun.arXiv2024)
Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models - Splatter-Image (arXiv 2023 / code / reconstruction 38FPS on V100)
Splatter Image: Ultra-Fast Single-View 3D Reconstruction - TGS (arXiv 2023 / code )
Triplane Meets Gaussian Splatting:Fast and Generalizable Single-View 3D Reconstruction with Transformers
Multi Images to 3D (Sparse View)
- HiSplat (08.Oct.arXiv2024)
HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstruction - LM-Gaussian (05.Sep.arXiv2024)
LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors
Text to 3D only
- DreamMapping (08.Sep.arXiv2024)
DreamMapping: High-Fidelity Text-to-3D Generation via Variational Distribution Mapping - GradeADreamer (14.Jun.arXiv2024 / code)
GradeADreamer: Enhanced Text-to-3D Generation Using Gaussian Splatting and Multi-View Diffusion - GarmentDreamer (20.May.arXiv2024)
GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details - Dremaer XL (18.May.arXiv2024)
Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching - FastScene (09.May.arXiv2024)
FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splatting - DreamScene360 (10.Apr.arXiv2024)
DreamScene360 : Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting - DreamPolisher (26.Mar.arXiv2024)
DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion - BrightDreamer (17.Mar.arXiv2024 / code / generation time 79ms on RTX3090)
BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis - IM-3D (13.Feb.arXiv 2024)
IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generation - CG3D (arXiv 2023)
CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting - HumanGaussian (arXiv 2023 / CVPR2024 / code)
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting - GaussianDiffusion (arXiv 2023)
GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise - GaussianDreamer (arXiv 2023 / code)
GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors - GSGEN (arXiv 2023 / code)
Text-to-3D using Gaussian Splatting
Text to 3D Scene
- SceneTeller (30.Jul.arXiv2024)
SceneTeller: Language-to-3D Scene Generation - HoloDreamer (21.July.arXiv2024)
HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions - GALA3D (11.Feb.arXiv2024)
GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting - Text2Immersion (arXiv2023, Google)
Text2Immersion: Generative Immersive Scene with 3D Gaussians - LucidDreamer - 3D Object (arXiv 2023 / CVPR2024 / code)
LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching - LucidDreamer - 3D Scene (arXiv 2023)
LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
Text to 3D Animation
- Gaussian Dreamerpro (26.Jun.arXiv2024 / code TBD?)
GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality - HeadStudio (09.Feb.arXiv2024)
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting - AlignYourGaussians (arXiv2023 / CVPR2024 / Nvidia)
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models - GAvatar (arXiv2023 / Nvidia)
GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
Image to 4D
- EG4D (28.May.arXiv2024)
EG4D: Explicit Generation of 4D Object without Score Distillation - Diffusion4D(26.May.arXiv2024)
Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models - Dreamgaussian4D (arXIv 2023 / code / 4D)
DreamGaussian4D:Generative 4D Gaussian Splatting
Image and text to 3D
- 3DitScene (28.May.arXiv2024)
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting - MVControl (15.Mar.arXiv2024 / 논문 리뷰 바로가기)
Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting
Video to 3D
- ReconX (29.Aug.arXiv2024)
ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model
Surface Reconstruction
- Neural SDF (18.Oct.arXiv2024 / NeurIPS 2024 / code TBD )
Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set - Spiking GS(09.Oct.arXiv2024 / code)
Spiking GS: Towards High-Accuracy and Low-Cost Surface Reconstruction via Spiking Neuron-based Gaussian Splatting - MVG-Splatting(16.Jul.arXiv2024)
MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile Based Geometric Consistency Densification - GS-Octree (26.Jun.arXiv2024)
GS-Octree: Octree-based 3D Gaussian Splatting for Robust Object-level 3D Reconstruction Under Strong Lighting - TrimGS (11.Jun.arXiv2024 / code TBA)
Trim 3D Gaussian Splatting for Accurate Geometry Representation - PGSR (10.Jun.arXiv2024)
PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction - VCR-GauS (09.Jun.arXiv2024)
View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction - Rade-GS (03.Jun.arXiv2024)
RaDe-GS: Rasterizing Depth in Gaussian Splatting - GaussianRoom (30.May.arXiv2024)
GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction - Direct Learning of Mesh(11.May.arXiv2024)
Direct Learning of Mesh and Appearance via 3D Gaussian Splatting - SAGS (29.Apr.arXiv2024 / accurate depth)
SAGS: Structure-Aware 3D Gaussian Splatting - GaussianSurfels (27.Apr.arXiv2024 / code)
High-quality Surface Reconstruction using Gaussian Surfels - OMEGAS (24.Apr.arXiv2024)
OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation - Gaussian Opacity Fields (16.Apr.arXiv2024)
Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes - Surface Reconstruction from GS (02.Apr.arXiv2024)
Surface Reconstruction from Gaussian Splatting via Novel Stereo Views - 3DGSR (30.Mar.arXiv2024)
3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting - SurfSplatting (26.Mar.arXiv2024 / 5.5min training on RTX 3090 for DTU dataset)
2D Gaussian Splatting for Geometrically Accurate Radiance Fields - DN-Splatter (26.Mar.arXiv2024)
DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing - GSDF (26.Mar.arXiv2024)
GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction - NeuSG (arXiv2023)
NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance - SuGaR (arXiv 2023 / 논문 리뷰 바로가기)
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
Dynamic
- DynaSurfGS (26.Aug.arXiv2024)
DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splatting
Tracking and Mapping
- CaRtGS (Oct.arXiv2024)
CaRtGS: Computational Alignment for Real-Time Gaussian Splatting SLAM - Robust GS SLAM (30.Sep.arXiv2024)
Robust Gaussian Splatting SLAM by Leveraging Loop Closure - GLC-SLAM (17.Sep.arXiv2024)
GLC-SLAM: Gaussian Splatting SLAM with Efficient Loop Closure - I2-SLAM (16.Jul.arXiv2024)
I2-SLAM: Inverting Imaging Process for Robust Photorealistic Dense SLAM - MotionGS (18.May.arXiv2024)
MotionGS : Compact Gaussian Splatting SLAM by Motion Filter - RTG-SLAM (30.Apr.arXiv2024)
RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting - Gaussian-LIC (10.Apr.arXiv2024 / IMU + Lidar, Camera)
Gaussian-LIC: Photo-realistic LiDAR-Inertial-Camera SLAM with 3D Gaussian Splatting - CG-SLAM (24.Mar.arXiv2024)
Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field - GS-ICP SLAM (19.Mar.arXiv2024 / code / 100fps on RTX4090 for the entire system)
RGBD GS-ICP SLAM - High-Fidelity SLAM (19.Mar.arXiv2024)
High-Fidelity SLAM Using Gaussian Splatting with Rendering-Guided Densification and Regularized Optimization - NEDS-SLAM (18.Mar.arXiv2024 / depth input + sementic output)
NEDS-SLAM: A Novel Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting - SemGauss-SLAM (12.Mar.arXiv2024 / depth input + semantic output)
SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM - How-NeRF&3DGS-to-SLAM (20.Feb.arXiv 2024 / survey)
How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey - SGS-SLAM (05.Feb.arXiv 2024 / high fidelity)
SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM - Gaussian-SLAM (arXiv 2023 / code TBA / mapping 1.66sec, rendering 7e-07sec on A6000)
Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting - GaussianSplattingSLAM (arXiv2023 / Dyson Robotics)
Gaussian Splatting SLAM - SplaTAM (arXiv 2023 / code)
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM - PVG (arXiv 2023)
Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering - GS-SLAM (arXiv 2023 / CVPR 2024)
GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting
Street View
- StreetUnveiler (28.May.arXiv2024)
3D StreetUnveiler with Semantic-Aware 2DGS - HGS-Mapping (29.Mar.arXiv2024)
HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes - SGD (29.Mar.arXiv2024)
SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
Segmentation
- 3D VL GS (10.Oct.arxiv2024)
3D Vision-Language Gaussian Splatting - Hi-SLAM (19.Sep.arXiv2024)
Hi-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian Splatting - FlashSplat (12.Sep.arXiv2024 / ECCV2024 / code)
FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimally - Click-Gaussian (16.Jul.arXiv2024 / ECCV2024)
Click-Gaussian: Interactive Segmentation to Any 3D Gaussians - OpenGaussian (04.Jun.arXiv2024)
OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understanding - FastLGS (04.Jun.arXiv2024)
FastLGS: Speeding up Language Embedded Gaussians with Feature Grid Mapping - GOI (27.May.arXiv2024)
GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane - Semantic-Gaussians (22.Mar.arXiv2024 / +remove,edit)
Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting - HUGS (19.Mar.arXiv2024 / CVPR2024 / depth, optical flow, segmentation output)
HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting - SA-GS(31.Jan.arXiv2024)
Segment Anything in 3D Gaussians - CoSSegGaussians (11.Jan.arXiv2024)
CoSSegGaussians: Compact and Swift Scene Segmenting 3D Gaussians - FMGS (03.Jan.arXiv2024)
FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understanding - LangSplat (arXiv 2023 / code / 25min training on RTX3090)
LangSplat: 3D Language Gaussian Splatting - Feature 3DGS (arXiv2023 / text prompt-based)
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields - SAGA (arXiv 2023 / code )
Segment Any 3D Gaussians
Dynamic
- SA4D (05.Jul.arXiv2024)
Segment Any 4D Gaussians
Large Scene
- GarField++ (19.Sep.arXiv2024)
GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction - GigaGS (10.Sep.arXiv2024)
GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstruction - GaussianCity (10.Jun.arXiv2024)
GaussianCity: Generative Gaussian Splatting for Unbounded 3D City Generation - PyGS (27.May.arXiv2024)
PyGS: Large-scale Scene Representation with Pyramidal 3D Gaussian Splatting - DoGaussian (22.May.arXiv2024)
DoGaussian: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus - Photorealistic 3D Urban Scene Reconstruction (17.May.arXiv2024)
Photorealistic 3D Urban Scene Reconstruction and Point Cloud Extraction using Google Earth Imagery and Gaussian Splatting - LetsGo (15.Apr.arXiv2024)
LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives - CityGaussian (01.Apr.arXiv2024)
CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians - Fed3DGS (18.Mar.arXiv2024 / code / 1000장에서 100장정도 샘플링 후 학습, 0.29h training on V100)
Fed3DGS: Scalable 3D Gaussian Splatting with Federated Learning - VastGaussian (27.Feb.arXiv2024 / code / 논문 리뷰 바로가기)
VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction - GauU-Scene (25.Jan.arXiv2024)
GauU-Scene: A Scene Reconstruction Benchmark on Large Scale 3D Reconstruction Dataset Using Gaussian Splatting
Multi GPU
- Grendel-GS (26.Jun.arXiv2024 / code / 논문 리뷰 바로가기)
On Scaling Up 3D Gaussian Splatting Training
Etc
Survey
- Neural Fields in Robotics: A Survey (26.Oct.arXiv2024)
Neural Fields in Robotics: A Survey - 3D Gaussian Splatting in Robotics: A Survey (16.Oct.arXiv2024)
3D Gaussian Splatting in Robotics: A Survey - Learning-based MVS : A Survey (27.Aug.arXiv2024)
Learning-based Multi-View Stereo: A Survey - 3DGS survey (24.Jul.arXiv2024)
3D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities - Survey on Fundamental (11.Jul.arXiv2024)
Survey on Fundamental Deep Learning 3D Reconstruction Techniques - NerfBaselines (25.Jun.arXiv2024 / code )
NerfBaselines: Consistent and Reproducible Evaluation of Novel View Synthesis Methods - A Survey on 3D Human Avatar Modeling (06.Jun.arXiv2024)
A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation - GS: 3D Recon and NVSs, a Review (06.May.arXiv2024)
Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review - Recent Advances in 3D Gaussian Splatting (17.Mar.arXiv2024)
Recent Advances in 3D Gaussian Splatting - 3D Gaussian as a New Vision Era (11.Feb.arXiv2024)
3D Gaussian as a New Vision Era: A Survey - A Survey on 3DGS (08.Jan.arXiv2024 / 논문 리뷰 바로가기)
A Survey on 3D Gaussian Splatting - Progress and Prospects in 3D Generative AI (05.Jan.arXiv2024)
Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human
Framework
- GauStudio (28.Mar.arXiv2024 / code)
GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond
Unconstrained Photo
- Splatfacto-W (17.Jul.arXiv2024 / code)
Splatfacto-W: A Nerfstudio Implementation of Gaussian Splatting for Unconstrained Photo Collections - Wild Gaussian (11.Jul.arXiv2024)
WildGaussians: 3D Gaussian Splatting in the Wild - SpolessSplats (28.Jun.arXiv2024)
SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting - Wild-GS (14.Jun.arXiv2024)
Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collections - WE-GS (04.Jun.arXiv2024)
WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collections - GS-W (22.Mar.arXiv2024)
Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections - SWAG (15.Mar.arXiv2024)
SWAG: Splatting in the Wild images with Appearance-conditioned Gaussians
Ray Tracing
- 3D Gaussian Ray Tracing (09.Jul.arXiv2024 / NVIDIA)
3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes
Physical Properties Extraction
- GS-IR (arXiv 2023)
GS-IR: 3D Gaussian Splatting for Inverse Rendering
2D Image Compression
- GaussianImage (13.Mar.arXiv2024)
GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splatting
Training Dataset Generation
- PEGASUS (04.Jan.arXiv2024)
PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DOF Object Pose Dataset Generation
Medical
- Multi-Layer Gaussian Splatting for Immersive Anatomy Visualization(22.Oct.arXiv2024)
Multi-Layer Gaussian Splatting for Immersive Anatomy Visualization - OnlineEndoTrack (09.Sep.arXiv2024)
Online 3D reconstruction and dense tracking in endoscopic videos - Realistic Surgical Image (20.Jul.arXiv2024 / MICCAI2024)
Realistic Surgical Image Dataset Generation Based On 3D Gaussian Splatting - SurgicalGaussian (06.Jul.arXiv2024)
SurgicalGaussian: Deformable 3D Gaussians for High-Fidelity Surgical Scene Reconstruction - Deform3DGS (28.May.arXiv2024 / code)
Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splatting - NVS for Cinematic Anatomy (17.Apr.arXiv2024)
Novel View Synthesis for Cinematic Anatomy on Mobile and Immersive Displays - GaSpCT (04.Apr.arXiv2024)
GaSpCT: Gaussian Splatting for Novel CT Projection View Synthesis - EndoGSLAM (22.Mar.arXiv2024)
EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting - X-Gaussian (06.Mar.arXiv2024)
Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis - Endo-4DGS (29.Jan.arXiv2024)
Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting - EndoGaussian (23.Jan.arXiv2024 / code)
EndoGaussian: Gaussian Splatting for Deformable Surgical Scene Reconstruction - EndoGS (21.Jan.arXiv2024 / code)
Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting
Medical - Pose free
- Free-DyGS (02.Sep.arXiv2024)
Free-DyGS: Camera-Pose-Free Scene Reconstruction based on Gaussian Splatting for Dynamic Surgical Videos
Robot Manupulation
- Differentiable Robot Rendering (17.Oct.arXiv2024 / code)
Differentiable Robot Rendering - RoboStudio (27.Aug.arXiv2024)
RoboStudio: A Physics Consistent World Model for Robotic Arm with Hybrid Representation - Physically Embodied GS (16.Jun.arXiv2024)
Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Robotics - Splat-Mover (07.May.arXiv2024)
Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splatting - GaussianGrasper (14.Mar.arXiv2024)
GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping - ManiGaussian (13.Mar.arXiv2024 / code)
ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation
Panoramas Input
- ODGS (28.Oct.arXiv2024 / NeurIPS 2024 / code TBA)
ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings - SceneDreamer360 (25.Aug.arXiv2024)
SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splatting - Pano2Room (21.Aug.arXiv2024 / SIGGRAPH Asia 2024 / code)
Pano2Room: Novel View Synthesis from a Single Indoor Panorama - 4k4dgen (19.Jun.arXiv2024 / img-to-4D)
4K4DGen: Panoramic 4D Generation at 4K Resolution - OmniGS (04.Apr.arXiv2024)
OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images - 360GS (01.Feb.arXiv2024)
360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming
Various Input
- EF-3DGS (20.Oct.arXiv2024)
EF-3DGS: Event-Aided Free-Trajectory 3D Gaussian Splatting - IncEventGS (10.Oct.arXiv2024)
IncEventGS: Pose-Free Gaussian Splatting from a Single Event Camera - LiDAR-GS (07.Oct.arxiv2024)
LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splatting - GS-EVT (28.Sep.arXiv2024)
GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting - LiDAR-3DGS (09.Sep.arXiv2024)
LiDAR-3DGS: LiDAR Reinforced 3D Gaussian Splatting for Multimodal Radiance Field Rendering - Thermal3D-GS (12.Sep.arXiv2024)
Thermal3D-GS: Physics-induced 3D Gaussians for Thermal Infrared Novel-view Synthesis - ThermalGaussian (11.Sep.arXiv2024)
ThermalGaussian: Thermal 3D Gaussian Splatting - SpikeGS (04.Jul.arXiv2024)
SpikeGS: Reconstruct 3D scene via fast-moving bio-inspired sensors
3D Gaussian Input
- ShapeSplat (20.Aug.arXiv2024)
ShapeSplat: A Large-scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining
Reflection
- Mirror-gaussian (20.May.arXiv2024)
MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections - 3DGS with Deffered Reflection (29.Apr.arXiv2024)
3D Gaussian Splatting with Deferred Reflection - DeferredGS (15.Apr.arXiv2024)
DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading - Mirror-3DGS (01.Apr.arXiv2024)
Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting - GaussianShader (arXiv 2023 / code)
GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces
Texture Transfer
- Topo4D (01.Jun.arXiv 2024)
Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture - TextureGS (15.Mar.arXiv 2024)
Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing - 3DG for anomation and Texturing (29.Feb.arXiv 2024)
3D Gaussian Model for Animation and Texturing
Navigation in 3DGS
- Splat-Nav (05.Mar.arXiv 2024)
Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps
6D Object Pose Estimation
- 6DGS (22.Jul.arXiv2024 / code)
6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model - GS-Pose (arXiv2024 / code)
GS-Pose: Cascaded Framework for Generalizable Segmentation-based 6D Object Pose Estimation
Image to Video
- LoopGaussian (13.Apr.arXiv2024)
LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion Field
Speech to Face Motion to 3DGS
- GaussianTalker (24.Apr.arXiv2024 / code)
GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting - GaussianTalker (22.Apr.arXiv2024)
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting - Learn2Talk (19.Apr.arXiv2024)
Learn2Talk: 3D Talking Face Learns from 2D Talking Face
Editing Mesh
- MaGS (03.Jun.arXiv2024)
Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splatting
3D Gaussian Prediction
- GsGAN (05.Jun.arXiv2024)
Adversarial Generation of Hierarchical Gaussians for 3D Generative Model
HDR View Synthesis
- HDRSplat (23.Jul.arXiv2024 / code)
HDRSplat: Gaussian Splatting for High Dynamic Range 3D Scene Reconstruction from Raw Images - From Chaos to Clarity (12.Jun.arXiv2024)
From Chaos to Clarity: 3DGS in the Dark - Cinematic Gaussians (11.Jun.arXiv2024)
Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field - LE3D (10.Jun.arXiv2024)
Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesis
Hidden Information Embedding
- GaussianStego (01.Jul.arXiv2024)
GaussianStego: A Generalizable Stenography Pipeline for Generative 3D Gaussians Splatting
LightField Display
- DirectL (10.Jul.arXiv2024)
DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays
Benchmark
- A Benchmark for GSC (19.Jul.arXiv2024 / code)
A Benchmark for Gaussian Splatting Compression and Quality Assessment Study
Water
- SeaSplat (25.Sep.arXiv2024)
SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Model - DeRainGS (21.Aug.arXiv2024)
DeRainGS: Gaussian Splatting for Enhanced Scene Reconstruction in Rainy Environments - WaterSplatting (15.Aug.arXiv2024)
WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian
Camera Pose Estimation
- LoGS (15.Oct.arXiv2024)
LoGS: Visual Localization via Gaussian Splatting with Fewer Training Images - GSLoc (20.Aug.arXiv2024)
GSLoc: Efficient Camera Pose Refinement via 3D Gaussian Splatting
Depth Estimation
- DepthSplat (17.Oct.arXiv2024)
DepthSplat: Connecting Gaussian Splatting and Depth - Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus (18.Sep.arXiv2024)
Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus - Self-Envolving Depth-supervised 3D GS (11.Sep.arXiv2024)
Self-Evolving Depth-Supervised 3D Gaussian Splatting from Rendered Stereo Pairs
3D Object Detection
- 3DGS-DET (02.Oct.arxiv2024)
3DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for 3D Object Detection - Gaussian-Det (02.Oct.arxiv2024)
Gaussian-Det: Learning Closed-Surface Gaussians for 3D Object Detection
Human Hair
- GaussianHaircut (23.Sep.arXiv2024 / ECCV2024)
Human Hair Reconstruction with Strand-Aligned 3D Gaussians
Camera Trajectory Generation
- SplaTraj (08.Oct.arXiv2024)
SplaTraj: Camera Trajectory Generation with Semantic Gaussian Splatting
'AI Trends' 카테고리의 다른 글
| [정리] Generative AI 발전 : GPT와 Diffusion 중심으로 (0) | 2024.01.01 |
|---|---|
| [공유] NeRF 기술 트렌드 세미나 (0) | 2023.12.19 |
| [논문 정리] NeRF 개선 방향 및 기술 동향 (5) | 2022.10.10 |
댓글