Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding

Due to the large amount of data involved in the three-dimensional (3D) LiDAR point clouds, point cloud compression (PCC) becomes indispensable to many real-time applications. In autonomous driving of connected vehicles for example, point clouds are constantly acquired along the time and subjected to...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhao, Lili, Ma, Kai-Kuang, Lin, Xuhu, Wang, Wenyi, Chen, Jianwen
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/163768
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-163768
record_format dspace
spelling sg-ntu-dr.10356-1637682022-12-16T03:28:48Z Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding Zhao, Lili Ma, Kai-Kuang Lin, Xuhu Wang, Wenyi Chen, Jianwen School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Point Cloud Compression Laser Radar Due to the large amount of data involved in the three-dimensional (3D) LiDAR point clouds, point cloud compression (PCC) becomes indispensable to many real-time applications. In autonomous driving of connected vehicles for example, point clouds are constantly acquired along the time and subjected to be compressed. Among the existing PCC methods, very few of them have effectively removed the temporal redundancy inherited in the point clouds. To address this issue, a novel lossy LiDAR PCC system is proposed in this paper, which consists of the inter-frame coding and the intra-frame coding. For the former, a deep-learning approach is proposed to conduct bi-directional frame prediction using an asymmetric residual module and 3D space-time convolutions; the proposed network is called the bi-directional prediction network (BPNet). For the latter, a novel range-adaptive floating-point coding (RAFC) algorithm is proposed for encoding the reference frames and the B-frame prediction residuals in the 32-bit floating-point precision. Since the pixel-value distribution of these two types of data are quite different, various encoding modes are designed for providing adaptive selection. Extensive simulation experiments have been conducted using multiple point cloud datasets, and the results clearly show that our proposed PCC system consistently outperforms the state-of-the-art MPEG G-PCC in terms of data fidelity and localization, while delivering real-time performance. This work was supported by the Nanyang Technological University & Wallenberg AI, Autonomous Systems and Software Program Joint Project (NTU-WASP) under Grant M4082184. 2022-12-16T03:28:48Z 2022-12-16T03:28:48Z 2022 Journal Article Zhao, L., Ma, K., Lin, X., Wang, W. & Chen, J. (2022). Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding. IEEE Transactions On Broadcasting, 68(3), 620-635. https://dx.doi.org/10.1109/TBC.2022.3162406 0018-9316 https://hdl.handle.net/10356/163768 10.1109/TBC.2022.3162406 2-s2.0-85127468191 3 68 620 635 en M4082184 IEEE Transactions on Broadcasting © 2022 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
Point Cloud Compression
Laser Radar
spellingShingle Engineering::Electrical and electronic engineering
Point Cloud Compression
Laser Radar
Zhao, Lili
Ma, Kai-Kuang
Lin, Xuhu
Wang, Wenyi
Chen, Jianwen
Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
description Due to the large amount of data involved in the three-dimensional (3D) LiDAR point clouds, point cloud compression (PCC) becomes indispensable to many real-time applications. In autonomous driving of connected vehicles for example, point clouds are constantly acquired along the time and subjected to be compressed. Among the existing PCC methods, very few of them have effectively removed the temporal redundancy inherited in the point clouds. To address this issue, a novel lossy LiDAR PCC system is proposed in this paper, which consists of the inter-frame coding and the intra-frame coding. For the former, a deep-learning approach is proposed to conduct bi-directional frame prediction using an asymmetric residual module and 3D space-time convolutions; the proposed network is called the bi-directional prediction network (BPNet). For the latter, a novel range-adaptive floating-point coding (RAFC) algorithm is proposed for encoding the reference frames and the B-frame prediction residuals in the 32-bit floating-point precision. Since the pixel-value distribution of these two types of data are quite different, various encoding modes are designed for providing adaptive selection. Extensive simulation experiments have been conducted using multiple point cloud datasets, and the results clearly show that our proposed PCC system consistently outperforms the state-of-the-art MPEG G-PCC in terms of data fidelity and localization, while delivering real-time performance.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Zhao, Lili
Ma, Kai-Kuang
Lin, Xuhu
Wang, Wenyi
Chen, Jianwen
format Article
author Zhao, Lili
Ma, Kai-Kuang
Lin, Xuhu
Wang, Wenyi
Chen, Jianwen
author_sort Zhao, Lili
title Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
title_short Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
title_full Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
title_fullStr Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
title_full_unstemmed Real-time LiDAR point cloud compression using bi-directional prediction and range-adaptive floating-point coding
title_sort real-time lidar point cloud compression using bi-directional prediction and range-adaptive floating-point coding
publishDate 2022
url https://hdl.handle.net/10356/163768
_version_ 1753801087087804416