Realtime Free-Viewpoint Streaming with 3D Gaussian Splatting

Overview

Built a Unity scene with a 5×5 camera rig and third-person controller for deterministic, replayable data capture. • Scripted Cinemachine trajectories & GameRecorder to export aligned RGB and G-Buffer streams for low-res proxy scoring. • Reconstructed geometry with COLMAP and trained 3D Gaussian Splatting from poses using multi-view frames. • Achieved 34.4 dB PSNR and 0.97 SSIM on unseen cameras; analyzed ghosting under character motion. • Benchmarked QUEEN and IGS vs 3DGS, validating target-conditioned camera selection.