NeRF에 대한 개선 방향 및 기술 동향 (이전글) 과 비슷한 방식으로, 3D-GS가 발전 할 수 있는 방향성과 기술 동향에 대해서 설명하겠습니다.
※ 2024년 2월까지는 발표되는 논문수가 적어서 중요도를 고려하지 않았지만, 2024년 3월부터는 논문이 많이 쏟아지면서 중요도가 높아보이는 것들을 선별했습니다.
<latest update : 26-Apr 2024>
Base Paper
- 3D Gaussian Splatting (SIGGRAPH 2023 / code / inria / 논문 리뷰 바로가기)
3D Gaussian Splatting for Real-Time Radiance Field Rendering
Speed / Quality / Memory
Train Speed
- DISTWAR (arXiv2023 / code / 논문 리뷰 바로가기)
DISTWAR: Fast Differentiable Rendering on Raster-based Rendering Pipelines - Scaffold-GS (arXiv2023 / code / fast converge + fast rendering)
Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering - Human101 (arXiv 2023 / fast rendering + 1 view on RTX3090)
Human101: Training 100+FPS Human Gaussians in 100s from 1 View
Render Speed
- Octree-GS (26.Mar.arXiv2024)
Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians - Identifying Unnecessary 3D Gaussian (21.Feb.arXiv2024)
Identifying Unnecessary 3D Gaussians using Clustering for Fast Rendering of 3D Gaussian Splatting - EAGLES (arXiv 2023)
EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS - LightGaussian (arXiv 2023 / code )
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Quality
- Revising Densification in Gaussian Splatting (09.Apr.arXiv2024)
- Mini-Splatting (21.Mar.arXiv2024)
Mini-Splatting: Representing Scenes with a Constrained Number of Gaussians - RadSplat (20.Mar.arXiv2024 / Google)
RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS - RAIN-GS (14.Mar.arXiv2024 / code)
Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting - FreGS (11.Mar.arXiv2024)
FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization - Spec-Gaussian (24.Feb.arXiv 2024)
Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting - GaussianPro (22.Feb.arXiv 2024 / code)
GaussianPro: 3D Gaussian Splatting with Progressive Propagation - GS++ (01.Feb.arXiv 2024)
GS++: Error Analyzing and Optimal Gaussian Splatting - StopThePop (01.Feb.arXiv 2024)
StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Rendering - Trips (11.Jan.arXiv2024 / code / 논문리뷰 바로가기)
TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering - Deblurring-3DGS (01.Jan.arXiv2024)
Deblurring 3D Gaussian Splatting
Memory
- HAC (21.Mar.arXiv2024 / code)
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression - GES (15.Feb.arXiv2024 / CVPR 2024 / code)
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering - Compact3D-self-organizing (arXiv 2023 / code)
Compact 3D Scene Representation via Self-Organizing Gaussian Grids - Compact3D (arXiv 2023 / code)
Compact3D: Compressing Gaussian Splat Radiance Field Models with Vector Quantization - Compressed 3DGS (arXiv2023 / code / 1.5GB?->47MB)
Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis
Sparse Inputs
- CoherentGS (28.Mar.arXiv2024 / 2views)
CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians - LatentSplat (26.Mar.arXiv2024 / 2views, training using 2x A40 for 4days for latentSplat & pixelSplat)
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction - MVSplat (21.Mar.arXiv2024 / code / 2-3 views)
MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images - DNGaussian (11.Mar.arXiv2024 / CVPR2024 / code / 3 views)
DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization - GaussianObject (20.Feb.arXiv 2024 / code / 4 views)
GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting - PixelSplat (arXiv 2023 / code / 2 views)
pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction - GPS-Gaussian (arXiv 2023 / CVPR2024 / 8 views / + train speed / 논문 리뷰 바로가기)
GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis - DRO for 3D-GS (arXiv 2023 / 2~5 views)
Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images
Pose-Free
- InstantSplat (29.Mar.arXiv2024)
InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds - GGRt (15.Mar.arXiv2024)
GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-time - iComMa (arXiv 2023 / focusing on pose estimation)
iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching - COLMAP-Free 3DGS (arxiv2023 / NVIDIA)
COLMAP-Free 3D Gaussian Splatting
Dynamic Scene Rendering
Training Speed
- 3DGStream (03.Mar.arXiv2024 / CVPR 2024)
3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos
Rendering Speed
- 4D Gaussian Splatting (05.Feb.arXiv 2024 / 277-583fps rendering on RTX 3090-4090 & 1352x1014 resolution + 60min training on 8GPU + high quality)
4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes - GauFRe (arXiv 2023 / meta)
GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis - Street Gaussians (04.Jan.arXiv2024, training 30mins, 1066x1600, 144FPS on RTX 4090)
Street Gaussians for Modeling Dynamic Urban Scenes - Spacetime GFS (arxiv 2023 / code / oppo / 8K resolution, training 3.5hours, 60FPS rendering on RTX 4090)
Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis - 4D Gaussian Splatting (CVPR 2024 / code / 논문 리뷰 바로가기)
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering - 4d-gaussian-splatting (ICLR 2024 / code)
Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
3D Point Track Trajectories
- DG-Mesh (18.Apr.arXiv2024)
Dynamic Gaussian Mesh: Consistent Mesh Reconstruction from Monocular Videos - Motion-Aware 3DGS (18.Mar.arXiv2024)
Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction - MD-Splatting (arXiv2023)
MD-Splatting: Learning Metric Deformation from 4D Gaussians in Highly Deformable Scenes - Dynamic 3D Gaussians (3DV 2024 / code)
Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
Human
- GaussianBody (18.Jan.arXiv 2024)
GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splatting - Animatable Gaussians (arXiv 2023)
Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling - DynMF (arXiv 2023)
DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splatting
Quality
- Per-Gaussian (04.Apr.arXiv2024 / code TBA)
Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting - GaussianFlow (arXiv2024 / Luminere and SORA input -> optical flow output)
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation - DrivingGaussian (arXiv 2023 / Google Research)
DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes - Gaussian-Flow (arXiv 2023 / CVPR 2024 )
Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle - An Efficient 3D Gaussian (arXiv 2023)
An Efficient 3D Gaussian Representation for Monocular/Multi-view Dynamic Scenes - Deformable 3D Gaussians (arXiv 2023 / code)
Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction
Single-view Video
- Guess The Unseen (22.Mar.arXiv2024)
Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses - STAG4D (22.Mar.arXiv2024)
STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians - BAGS (18.Mar.arXiv2024)
BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors - Efficient4D(16.Jan.arXiv2024)
Fast Dynamic 3D Object Generation from a Single-view Video
Scene Editing
All
- PhysGaussian (arXiv 2023 / CVPR2024 / code TBA )
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Text-based
- Interactive3D (25.Apr.arXiv2024 / generation + editing)
Interactive3D: Create What You Want by Interactive 3D Generation - FeatureSplatting (02.Apr.arXiv2024 / code TBA)
Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing - GaussCtrl (13.Mar.arXiv2024)
GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing - GSEdit (08.Mar.arXiv2024)
GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting - Control4D (arXiv 2023 / text-based)
Control4D: Efficient 4D Portrait Editing with Text - TIP-Editor (26.Jan.arXiv2024)
TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts - GaussianEditor - delicately (arXiv 2023)
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions - Gaussian-Editor - controllable (arXiv 2023 / CVPR2024 / code)
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
Style Image-based
- StylizedGS (08.Apr.arXiv2024)
StylizedGS: Controllable Stylization for 3D Gaussian Splatting - Gaussian Splatting in Style (13.Mar.arXiv2024)
Gaussian Splatting in Style - StyleGaussian (12.Mar.arXiv2024 / code)
StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting
Human
- SplattingAvatar (08.Mar.arXiv2024 / CVPR2024 / code)
- SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting
- ImplicitDeepfake (09.Feb.arXiv2024 / face swap = 얼굴만 변경)
ImplicitDeepfake: Plausible Face-wapping through Implicit Deepfake Generation using NeRF and GaussianSplatting - Rig3DGS (06.Feb.arXiv 2024)
Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos - PSAvatar (23.Jan.arXiv 2024)
PSAvatar: A Point-based Morphable Shape Model for Real-Time Head Avatar Creation with 3D Gaussian Splatting - BakedAvatar (SIGGRAPH Asia 2023 / code / Realtime Rendering iPad pro 2021 43FPS, Face Reenactment, Expression Editting, Pose Editting)
BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis - GaussianAvatars (arXiv 2023 / code)
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians - HUGS (arXiv 2023 / Apple)
HUGS:Human Gaussian Splats - SplatArmor (arXiv 2023)
SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos - D3GA (arXiv 2023 / code TBA / Meta Research)
Drivable 3D Gaussian Avatars
Human : Pose Control
- GoMAvatar (11.Apr.arXiv2024 / CVPR2024 / code)
GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh - Gaussian Shadow Casting (11.Jan.arXiv2024)
Gaussian Shadow Casting for Neural Characters - GART (arXiv2023 / CVPR2024 / code)
GART: Gaussian Articulated Template Models - GaussianAvatar (arXiv2023 / code)
GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians - 3DGS-Avatar (arXiv 2023 / code)
3DGS-Avatar : Animatable Avatars via Deformable 3D Gaussian Splatting - ASH (arXiv 2023 / + dynamic skeleton control)
ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Object : Control
- Gaussian Frosting (21.Mar.2024)
Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering - Mesh-based GS (07.Feb.arXiv 2024)
Mesh-based Gaussian Splatting for Real-time Large-scale Deformation - GaMeS (02.Feb.arXiv 2024 / code / editing after 3d mesh)
GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting - VR-GS (30.Jan.arXiv 2024 / + segmentation + inpaint + VR interaction)
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality - Gaussian Splashing (27.Jan.arXiv 2024 / +inpaint)
Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting - CoGS (arXiv 2023 / +object-control)
CoGS : Controllable Gaussian Splatting - SC-GS (arXiv 2023 / CVPR2024)
SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes - Point'n Move (arXiv2023)
Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
Religthing
- Relightable Gaussian Codec Avatars (arXiv 2023 / meta)
Relightable Gaussian Codec Avatars - Relightable 3D Gaussian (arXiv 2023)
Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing
Removing
- Gscream (21.Apr.arXiv2024)
GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal - Split Algorithm for 3DGS (14.Mar.arXiv2024)
A New Split Algorithm for 3D Gaussian Splatting - Gaussain Grouping (arXiv 2023 / code / +Segmentation + Inpainting + Style Transfer + Editting)
Gaussian Grouping: Segment and Edit Anything in 3D Scenes
Diffusion Model to 3D
Image to 3D & Text to 3D
- RealmDreamer (10.Apr.arXiv2024)
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion - Hash3D (09.Apr.arXiv2024 / code)
Hash3D: Training-free Acceleration for 3D Generation Preprint - GVGEN (19.Mar.arXiv2024)
GVGEN:Text-to-3D Generation with Volumetric Representation - FDGaussian (15.Mar.arXiv2024)
FDGaussian: Fast Gaussian Splatting from Single Image via Geometric-aware Diffusion Model - LGM (07.Feb.arXiv2024 / code)
LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation - LODS (arXiv 2023 / code)
Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting - DreamGaussian (arXiv 2023 / code / 논문 리뷰 바로가기)
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation
Image to 3D only
- Splatter-Image (arXiv 2023 / code / reconstruction 38FPS on V100)
Splatter Image: Ultra-Fast Single-View 3D Reconstruction - TGS (arXiv 2023 / code )
Triplane Meets Gaussian Splatting:Fast and Generalizable Single-View 3D Reconstruction with Transformers
Text to 3D only
- DreamScene360 (10.Apr.arXiv2024)
DreamScene360 : Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting - DreamPolisher (26.Mar.arXiv2024)
DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion - BrightDreamer (17.Mar.arXiv2024 / code / generation time 79ms on RTX3090)
BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis - IM-3D (13.Feb.arXiv 2024)
IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generation - CG3D (arXiv 2023)
CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting - HumanGaussian (arXiv 2023 / CVPR2024 / code)
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting - LucidDreamer - 3D Object (arXiv 2023 / CVPR2024 / code)
LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching - LucidDreamer - 3D Scene (arXiv 2023)
LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes - GaussianDiffusion (arXiv 2023)
GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise - GaussianDreamer (arXiv 2023 / code)
GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors - GSGEN (arXiv 2023 / code)
Text-to-3D using Gaussian Splatting
Text to 3D Scene
- GALA3D (11.Feb.arXiv2024)
GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting - Text2Immersion (arXiv2023, Google)
Text2Immersion: Generative Immersive Scene with 3D Gaussians
Text to 3D Animation
- HeadStudio (09.Feb.arXiv2024)
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting - AlignYourGaussians (arXiv2023 / Nvidia)
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models - GAvatar (arXiv2023 / Nvidia)
GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
Image to 4D
- Dreamgaussian4D (arXIv 2023 / code / 4D)
DreamGaussian4D:Generative 4D Gaussian Splatting
Surface Reconstruction
- OMEGAS (24.Apr.arXiv2024)
OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation - Gaussian Opacity Fields (16.Apr.arXiv2024)
Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes - Surface Reconstruction from GS (02.Apr.arXiv2024)
Surface Reconstruction from Gaussian Splatting via Novel Stereo Views - 3DGSR (30.Mar.arXiv2024)
3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting - SurfSplatting (26.Mar.arXiv2024 / 5.5min training on RTX 3090 for DTU dataset)
2D Gaussian Splatting for Geometrically Accurate Radiance Fields - DN-Splatter (26.Mar.arXiv2024)
DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing - GSDF (26.Mar.arXiv2024)
GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction - NeuSG (arXiv2023)
NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance - SuGaR (arXiv 2023 / 논문 리뷰 바로가기)
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
Tracking and Mapping
- Gaussian-LIC (10.Apr.arXiv2024 / IMU + Lidar, Camera)
Gaussian-LIC: Photo-realistic LiDAR-Inertial-Camera SLAM with 3D Gaussian Splatting - CG-SLAM (24.Mar.arXiv2024)
Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field - GS-ICP SLAM (19.Mar.arXiv2024 / code / 100fps on RTX4090 for the entire system)
RGBD GS-ICP SLAM - High-Fidelity SLAM (19.Mar.arXiv2024)
High-Fidelity SLAM Using Gaussian Splatting with Rendering-Guided Densification and Regularized Optimization - NEDS-SLAM (18.Mar.arXiv2024 / depth input + sementic output)
NEDS-SLAM: A Novel Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting - SemGauss-SLAM (12.Mar.arXiv2024 / depth input + semantic output)
SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM - How-NeRF&3DGS-to-SLAM (20.Feb.arXiv 2024 / survey)
How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey - SGS-SLAM (05.Feb.arXiv 2024 / high fidelity)
SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM - Gaussian-SLAM (arXiv 2023 / code TBA / mapping 1.66sec, rendering 7e-07sec on A6000)
Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting - GaussianSplattingSLAM (arXiv2023 / Dyson Robotics)
Gaussian Splatting SLAM - SplaTAM (arXiv 2023 / code)
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM - PVG (arXiv 2023)
Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering - GS-SLAM (arXiv 2023 / CVPR 2024)
GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting
Street View
- HGS-Mapping (29.Mar.arXiv2024)
HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes - SGD (29.Mar.arXiv2024)
SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
Segmentation
- Semantic-Gaussians (22.Mar.arXiv2024 / +remove,edit)
Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting - HUGS (19.Mar.arXiv2024 / CVPR2024 / depth, optical flow, segmentation output)
HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting - SA-GS(31.Jan.arXiv2024)
Segment Anything in 3D Gaussians - CoSSegGaussians (11.Jan.arXiv2024)
CoSSegGaussians: Compact and Swift Scene Segmenting 3D Gaussians - FMGS (03.Jan.arXiv2024)
FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understanding - LangSplat (arXiv 2023 / code / 25min training on RTX3090)
LangSplat: 3D Language Gaussian Splatting - Feature 3DGS (arXiv2023 / text prompt-based)
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields - SAGA (arXiv 2023 / code )
Segment Any 3D Gaussians
Large Scene
- LetsGo (15.Apr.arXiv2024)
LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives - CityGaussian (01.Apr.arXiv2024)
CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians - Fed3DGS (18.Mar.arXiv2024 / code / 1000장에서 100장정도 샘플링 후 학습, 0.29h training on V100)
Fed3DGS: Scalable 3D Gaussian Splatting with Federated Learning - VastGaussian (27.Feb.arXiv2024)
VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction - GauU-Scene (25.Jan.arXiv2024)
GauU-Scene: A Scene Reconstruction Benchmark on Large Scale 3D Reconstruction Dataset Using Gaussian Splatting
Etc
Survey
- Recent Advances in 3D Gaussian Splatting (17.Mar.arXiv2024)
Recent Advances in 3D Gaussian Splatting - 3D Gaussian as a New Vision Era (11.Feb.arXiv2024)
3D Gaussian as a New Vision Era: A Survey - A Survey on 3DGS (08.Jan.arXiv2024 / 논문 리뷰 바로가기)
A Survey on 3D Gaussian Splatting - Progress and Prospects in 3D Generative AI (05.Jan.arXiv2024)
Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human
Framework
- GauStudio (28.Mar.arXiv2024 / code)
GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond
Unconstrained Photo
- GS-W (22.Mar.arXiv2024)
Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections - SWAG (15.Mar.arXiv2024)
SWAG: Splatting in the Wild images with Appearance-conditioned Gaussians
Anti-Aliasing
- SRGS (16.Apr.arXiv2024)
SRGS: Super-Resolution 3D Gaussian Splatting - SA-GS (28.Mar.arXiv2024 / code)
SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasing - Analytic-Splatting (17.Mar.arXiv2024)
Analytic-Splatting: Anti-Aliased 3D Gaussian Splatting via Analytic Integration - BAGS (07.Mar.arXiv2024)
BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modeling - Mip-splatting (arXiv 2023 / code)
Mip-Splatting : Alias-free 3D Gaussian Splatting
Deblur
- DeblurGS (17.Apr.arXiv2024)
DeblurGS: Gaussian Splatting for Camera Motion Blur - Gaussian Splatting on the Move (20.Mar.arXiv2024)
Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion - BAD-Gaussians (18.Mar.arXiv2024 / code)
BAD-Gaussians: Bundle-Adjusted Deblur Gaussian Splatting
Physical Properties Extraction
- GS-IR (arXiv 2023)
GS-IR: 3D Gaussian Splatting for Inverse Rendering
2D Image Compression
- GaussianImage (13.Mar.arXiv2024)
GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splatting
Training Dataset Generation
- PEGASUS (04.Jan.arXiv2024)
PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DOF Object Pose Dataset Generation
Medical
- NVS for Cinematic Anatomy (17.Apr.arXiv2024)
Novel View Synthesis for Cinematic Anatomy on Mobile and Immersive Displays - GaSpCT (04.Apr.arXiv2024)
GaSpCT: Gaussian Splatting for Novel CT Projection View Synthesis - EndoGSLAM (22.Mar.arXiv2024)
EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting - X-Gaussian (06.Mar.arXiv2024)
Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis - Endo-4DGS (29.Jan.arXiv2024)
Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting - EndoGaussian (23.Jan.arXiv2024 / code)
EndoGaussian: Gaussian Splatting for Deformable Surgical Scene Reconstruction - EndoGS (21.Jan.arXiv2024 / code)
Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting
Robot Manupulation
- GaussianGrasper (14.Mar.arXiv2024)
GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping - ManiGaussian (13.Mar.arXiv2024 / code)
ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation
Panoramas Input
- OmniGS (04.Apr.arXiv2024)
OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images - 360GS (01.Feb.arXiv2024)
360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming
Reflection
- DeferredGS (15.Apr.arXiv2024)
DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading - Mirror-3DGS (01.Apr.arXiv2024)
Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting - GaussianShader (arXiv 2023 / code)
GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces
Texture Transfer
- TextureGS (15.Mar.arXiv 2024)
Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing - 3DG for anomation and Texturing (29.Feb.arXiv 2024)
3D Gaussian Model for Animation and Texturing
Navigation in 3DGS
- Splat-Nav (05.Mar.arXiv 2024)
Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps
6D Object Pose Estimation
- GS-Pose (arXiv2024 / code)
GS-Pose: Cascaded Framework for Generalizable Segmentation-based 6D Object Pose Estimation
Image to Video
- LoopGaussian (13.Apr.arXiv2024)
LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion Field
Speech to Face Motion to 3DGS
- GaussianTalker (24.Apr.arXiv2024 / code)
GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting - GaussianTalker (22.Apr.arXiv2024)
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting - Learn2Talk (19.Apr.arXiv2024)
Learn2Talk: 3D Talking Face Learns from 2D Talking Face
'AI Trends' 카테고리의 다른 글
| [정리] Generative AI 발전 : GPT와 Diffusion 중심으로 (0) | 2024.01.01 |
|---|---|
| [공유] NeRF 기술 트렌드 세미나 (0) | 2023.12.19 |
| [논문 정리] NeRF 개선 방향 및 기술 동향 (5) | 2022.10.10 |
댓글