Developing a mixed-reality metaverse immersive experience using HoloLens2

• Main Author: Ma, Xin
• Other Authors: Dusit Niyato
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2023
• Subjects: Engineering::Computer science and engineering
• Online Access: https://hdl.handle.net/10356/165890
• Institution: Nanyang Technological University

Being one of the busiest industries with a large number of transactions, real estate always faces numerous constraints nowadays. The problems are greatly magnified during the pandemic period. Despite the long distances and time differences, providing a clear and comprehensive presentation or demonstration for clients has become one of the toughest challenges that agents or design companies are facing. Moreover, most clients are keen on working with designers and construction workers to design their houses according to their preferences. Apart from viewing 2D pictures and imagining the outcome, companies are also trying to find ways to provide more realistic views for their clients. To overcome these challenges, we developed an application on Microsoft HoloLens2 that makes use of Mixed-Reality technology. The application benefits agents, manufacturing companies, designers, and clients by providing an immersive world that combines real-world and 3D furniture objects, greatly increasing efficiency. The spatial awareness feature helps scan the bare room and allows clients to customize their house as much as possible. To address the issue of portable head-wear having low-end GPU running, a remote rendering method has also been applied in this project, allowing many complex 3D furniture models to be rendered simultaneously in the same scene. Meanwhile, in order to showcase the potential benefits of Mixed-Reality and HoloLens in other industries, such as education, we have also created a demo scene that includes customization functions for remote models.