New scene generation using advanced 3D Gaussian splatting

This study investigates a limitation of 3D Gaussian Splatting in real-time novel view synthesis and proposes a solution to address it. Despite its state-of-the-art performance, 3D Gaussian Splatting often results in unbalanced degrees of reconstruction, leading to blurred areas in rendered images (a...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Wan, Yaxin
مؤلفون آخرون: Lu Shijian
التنسيق: Final Year Project
اللغة:English
منشور في: Nanyang Technological University 2024
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/10356/175315
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
المؤسسة: Nanyang Technological University
اللغة: English
الوصف
الملخص:This study investigates a limitation of 3D Gaussian Splatting in real-time novel view synthesis and proposes a solution to address it. Despite its state-of-the-art performance, 3D Gaussian Splatting often results in unbalanced degrees of reconstruction, leading to blurred areas in rendered images (as depicted in Fig. 1). To address this issue, a progressive frequency control technique is implemented within the training process as inspired by FreeNeRF and FreGS. Specifically, Fourier transformation is applied to both the resulting images and ground truth to map them into frequency spectrums, facilitating the learning of different frequency levels separately through the introduction of smooth filter masks. Experimental results on widely adopted benchmarks, including Mip-NeRF360, Tanks&Temples, and Deep Blending, demonstrate enhanced performance through the proposed frequency optimization technique. The study concludes that integrating frequency optimization into 3D Gaussian Splatting holds promise for enhancing rendering quality. Moreover, recommendations for future research include exploring additional techniques such as compression and regularization to further enhance performance during the optimization process.