Real-time 3D reconstruction method for holographic telepresence

• Main Authors: Fadzli, Fazliaty Edora, Ismail, Ajune Wanis, Abd. Karim Ishigaki, Shafina, Nor’a, Muhammad Nur Affendy, Aladin, Mohamad Yahya Fekri
• Format: Article
• Language: English
• Published: MDPI 2022
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://eprints.utm.my/id/eprint/100972/1/AjuneWanisIsmail2022_RealTime3DReconstructionMethodforHolographicTelepresence.pdf; http://eprints.utm.my/id/eprint/100972/; http://dx.doi.org/10.3390/app12084009
• Institution: Universiti Teknologi Malaysia

This paper introduces a real-time 3D reconstruction of a human captured using a depth sensor and has integrated it with a holographic telepresence application. Holographic projection is widely recognized as one of the most promising 3D display technologies, and it is expected to become more widely available in the near future. This technology may also be deployed in various ways, including holographic prisms and Z-Hologram, which this research has used to demonstrate the initial results by displaying the reconstructed 3D representation of the user. The realization of a stable and inexpensive 3D data acquisition system is a problem that has yet to be solved. When we involve multiple sensors we need to compress and optimize the data so that it can be sent to a server for a telepresence. Therefore the paper presents the processes in real-time 3D reconstruction, which consists of data acquisition, background removal, point cloud extraction, and a surface generation which applies a marching cube algorithm to finally form an isosurface from the set of points in the point cloud which later texture mapping is applied on the isosurface generated. The compression results has been presented in this paper, and the results of the integration process after sending the data over the network also have been discussed.