Deep Learning for 3D Point Clouds: A Survey (IEEE TPAMI, 2020)

This is the official repository of Deep Learning for 3D Point Clouds: A Survey (IEEE TPAMI), a comprehensive survey of recent progress in deep learning methods for point clouds. For details, please refer to:

Deep Learning for 3D Point Clouds: A Survey

Yulan Guo^∗, Hanyun Wang^∗, Qingyong Hu^∗, Hao Liu^∗, Li Liu, and Mohammed Bennamoun.
(* indicates equal contribution)

[Paper] [Blog]

Introduction

We present a comprehensive review of recent deep learning methods for point clouds. It covers major tasks in 3D point cloud analysis, including 3D shape classification, 3D object detection, and 3D point cloud segmentation. It also presents comparative results on several publicly available datasets, together with insightful observations and inspiring future research directions. Please feel free to contact me or create an issue on this page if you have new results to add or any suggestions!

We will update this page on a regular basis! So stay tuned~ 🎉 🎉 🎉

(1) Datasets

(2) 3D Shape Classification

Public Datasets

• ModelNet (CVPR'15) [paper] [project page]
  • ModelNet10 [data] [results]
  • ModelNet40 [data] [results]
• PartNet (CVPR'19) [paper] [data] [project page]
• ScanObjectNN (ICCV'19) [paper] [data] [project page]

Benchmark Results

(3) 3D Object Detection

Public Datasets

• KITTI (CVPR'12) [paper] [project page]
  • 3D objecct detection [data] [results]
  • BEV [data] [results]
• ApolloScape (TPAMI'19) [paper] [data] [results]
• Argoverse (CVPR'19) [paper] [data] [project page]
• A*3D (arXiv'19) [paper] [data] [project page]
• Waymo (arXiv'19) [paper] [data] [project page]

Benchmark Results

(4) 3D Point Cloud Segmentation

Public Datasets

• Semantic3D (ISPRS'17) [paper] [project page]
  • semantic-8 [data] [results]
  • reduced-8 [data] [results]
• S3DIS (CVPR'17) [paper] [data] [project page]
• ScanNet (CVPR'17) [paper] [data] [project page] [results]
• NPM3D (IJRR'18) [paper] [data] [project page] [results]
• DublinCity (BMVC'19) [paper] [data] [project page]
• SemanticKITTI (ICCV'19) [paper] [data] [project page] [results]
• nuScenes (CVPR'20) [paper] [data] [project page] [results]
• Toronto-3D (CVPRW'20) [paper] [data] [project page] [results]
• DALES (CVPRW'20) [paper] [data] [project page] [results]
• Campus3D (ACM MM'20) [paper] [data] [project page] [results]
• SensatUrban (CVPR'21) [paper] [data][project page] [results]

Benchmark Results

Citation

If you find our work useful in your research, please consider citing:

@article{guo2020deep,
  title={Deep learning for 3d point clouds: A survey},
  author={Guo, Yulan and Wang, Hanyun and Hu, Qingyong and Liu, Hao and Liu, Li and Bennamoun, Mohammed},
  journal={IEEE transactions on pattern analysis and machine intelligence},
  year={2020},
  publisher={IEEE}
}

Updates

• 26/02/2020: Adding the dataset information
• 27/12/2019: Initial release.

Related Repos

1. RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
2. SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Clouds
3. 3D-BoNet: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds
4. SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
5. SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds with 1000x Fewer Labels