Improved Real-time 3D Reconstruction Method for Mixed Reality Telepresence

Abstract

The advancement of current technologies has allowed long-distance communication between human-to-human to be closer to lifelike encounters. Mixed Reality (MR) telepresence focuses on user involvement within the real and virtual world for telecommunication, which are the current advancement in telepresence applications and are widely recognized. Even so, developing a reliable and affordable three-dimensional (3D) reconstruction of humans in action in real-time for MR telepresence is challenging. Most existing methods have required high computational processes and rely on a large data set to produce a dynamic 3D reconstruction. Therefore, this research introduces an improved real-time three-dimensional reconstruction method that could potentially utilized for MR telepresence. An experiment was carried out to evaluate the performance of an improved real-time 3D reconstruction method for MR telepresence. We found the amount of the data transmitted in bytes per frame using the improved method was appropriate for the MR telepresence application. The findings indicate that the real-time performance of 3D reconstruction was accomplished by reducing the data size by twice, resulting in an optimal size that does not impose any limitations on the available bandwidth. The implementation of double compression techniques on the 3D reconstruction data resulted in substantial enhancements to the real-time 3D reconstruction methodology, hence strengthening the overall framework of the MR telepresence system. The present article culminates in a comprehensive conclusion, followed by recommendations for potential avenues of future research.