3D snapshot: Invertible embedding of 3D neural representations in a single image

• Main Authors: LU, Yuqin, DENG, Bailin, ZHONG, Zhixuan, ZHANG, Tianle, QUAN, Yuhui, CAI, Hongmin, HE, Shengfeng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Three Dimensional Displays; Rendering Computer Graphics; Solid Modeling; Image Reconstruction; Image Color Analysis; Neural Networks; Metaverse; Invertible Image Processing; Neural Representations; Single Image; Neural Coding; 3 D Snapshots; Neural Network; Dynamic Network; Image Representation; Reconstruction Quality; 3 D Scene; Compact Network; Scene Representation; Dynamic Neural Network; Neural Image; Loss Function; Data Storage; Model Size; Wavelet Transform; Spatial Domain; Spatial Coordinates; Volume Density; Short Video; Image Embedding; View Synthesis; Steganography; Noisy Images; Dynamic Update; Least Significant Bit; View Direction; Spherical Harmonics; Intermediate Representation; Half Of The Channel; Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9765; https://ink.library.smu.edu.sg/context/sis_research/article/10765/viewcontent/6197abae_9c0c_4818_a024_0ea407ca20f9__1_.pdf
• Institution: Singapore Management University

3D neural rendering enables photo-realistic reconstruction of a specific scene by encoding discontinuous inputs into a neural representation. Despite the remarkable rendering results, the storage of network parameters is not transmission-friendly and not extendable to metaverse applications. In this...