Leveraging 360° Camera in 3D Reconstruction: A Vision-Based Approach
Hoi Chuen Cheng, Babar Hussain, Ziyang Hong, and C. Patrick Yue
The Hong Kong University of Science and Technology, Hong Kong
Email: hcchengaa@connect.ust.hk (H.C.C.); bhussain@connect.ust.hk (B.H.); zhongad@connect.ust.hk (Z.H.);
eepatrick@ust.hk (C.P.Y.)
Manuscript received October 1, 2023; revised November 15, 2023; accepted December 25, 2023; published January 16, 2024
Email: hcchengaa@connect.ust.hk (H.C.C.); bhussain@connect.ust.hk (B.H.); zhongad@connect.ust.hk (Z.H.);
eepatrick@ust.hk (C.P.Y.)
Manuscript received October 1, 2023; revised November 15, 2023; accepted December 25, 2023; published January 16, 2024
Abstract—In this paper, we present a novel vision-based approach for 3D reconstruction using a single 360° camera, aiming to offer a simplified and accessible solution for various consumer-oriented applications. Consumer-grade 360° cameras have gained significant popularity due to their affordability and ease of use. However, traditional methods for 3D reconstruction often require complex setups with multiple cameras or expensive hardware such as Light Detection and Ranging (LiDAR). Our approach addresses the challenges associated with 360° cameras by converting the distorted Equirectangular Projection (ERP) into four perspective views, allowing compatibility with deep learning models trained on undistorted perspective images. We leverage Visual Simultaneous Localization and Mapping (VSLAM) techniques for camera pose estimation and employ a standard 3D reconstruction pipeline for generating detailed 3D mesh representations of the indoor environment. Through experimental evaluation, we compare the performance of 360° cameras with traditional perspective cameras in 3D reconstruction and analyze the accuracy and performance of our vision-based approach. Our findings demonstrate the potential of using 360° cameras for constructing high-quality models and facilitating efficient data collection for 3D reconstructions, opening up new possibilities for various consumer-oriented applications in multiple fields.
Index Terms—360° camera, 3D reconstruction, computer vision
Cite: Hoi Chuen Cheng, Babar Hussain, Ziyang Hong, and C. Patrick Yue, "Leveraging 360° Camera in 3D Reconstruction: A Vision-Based Approach," International Journal of Signal Processing Systems, vol. 12, pp. 1-6, 2024. doi: 10.18178/ijsps.2024.12.1-6
Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.
Index Terms—360° camera, 3D reconstruction, computer vision
Cite: Hoi Chuen Cheng, Babar Hussain, Ziyang Hong, and C. Patrick Yue, "Leveraging 360° Camera in 3D Reconstruction: A Vision-Based Approach," International Journal of Signal Processing Systems, vol. 12, pp. 1-6, 2024. doi: 10.18178/ijsps.2024.12.1-6
Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.