Zhipeng Cai

蔡志鹏（Zhipeng Cai）
Research scientist at Intel Embodied AI Lab, Santa Clara, California, USA.
Education: PhD of Computer Science at The University of Adelaide, Australia. Supervisor: Prof. Tat-Jun Chin & Prof. David Suter.
Email: czptc2h@gmail.com
Google Scholar
I have (co-)supervised Ph.D students/interns from various countries (send me an email if you are interested in internships/collaborations, different base locations are possible, e.g., US, Germany, China).

About me

I am interested in general machine learning and computer vision problems. During PhD, I was interested in robust geometric perception, which estimates computer vision models (correspondences between images, poses, 3D reconstructions) given outlier contaminated data. I was specifically interested in designing efficient algorithms that have optimality guarantees, i.e., guarantee to return the best solution. After joining Intel, my interests shift towards a mixture of learning and vision, where I study various problems such as 1) learning-based perception (feature matching, finding correspondences, pose estimation, depth estimation etc) 2) Continual Learning 3) Generative models (e.g., novel view synthesis, image/3D scene generation). My work has been selected as one of the 12 best papers at ECCV'18.

News

Sep-2023: Paper accepted (topic: Event camera to point cloud registration) to NeurIPS2023 .
Aug-2023: Paper accepted (topic: object detection in remote sensing images) to IEEE Transactions on Geoscience and Remote Sensing (TGRS) .
July-2023: Two papers (topic: 1. continual learning on NeRFs 2. zero-shot metric depth estimation) accepted to ICCV 2023 .
June-2023: SimCS accepted to CVPR 2023 Workshop on Continual Learning in Computer Vision .
May-2022: Co-organizing the ICRA 2022 Gereral Place Recognition Competition .
July-2021: Paper accepted to ICCV2021 ! Subject: online continual learning.
Sep-2020: Got my Ph.D degree (my thesis was awarded the Dean’s Commendation for Doctoral Thesis Excellence)! Now a postdoc at Intel Intelligent Systems Lab.
June-2020: Served as a "wingman" during TJ's RANSAC CVPR 2020 Tutorial . Find me here
July-2019: Paper accepted to IJCV Special Issue on Best of ECCV 2018
July-2019: Paper accepted as oral presentation to ICCV2019 ! Subject: robust fitting.
Jan-2019 to July-2019: Internship at Intel Intelligent Systems Lab at Silicon Valley. Working with Dr. Vladlen Koltun.
Nov-2018: Paper "Robust fitting in computer vision: easy or hard?" has been selected as one of the 12 best papers of ECCV2018
Nov-2018: Paper accepted to ISPRS Journal of Photogrammetry and Remote Sensing . Subject: point cloud registration.
July-2018: Two papers accepted as oral presentation to ECCV2018 ! Subject: robust fitting.

Publication (Check the ArXiv version for modifications after publication)

2023

E2PNet: Event to Point Cloud Registration with Spatio-Temporal Representation Learning
Xiuhong Lin, Changjie Qiu, Zhipeng Cai, Siqi Shen, Yu Zang, Weiquan Liu, Xuesheng Bian, Matthias Müller, Cheng Wang
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS) 2023
[Paper (coming soon)]

GSDDet: Ground Sample Distance Guided Object Detection for Remote Sensing Images
Yunuo Yang, Zhipeng Cai , Pinqing Song, Yu Zang, Guanjie Huang, Ming Cheng, Cheng Wang
IEEE Transactions on Geoscience and Remote Sensing (TGRS)
[Paper (coming soon)]

CLNeRF: Continual Learning Meets NeRF
Zhipeng Cai , Matthias Müller
International Conference on Computer Vision (ICCV) 2023
[Paper] [Code] [dataset]

Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image
Wei Yin, Chi Zhang, Hao Chen, Zhipeng Cai , Xiaozhi Chen, Kaixuan Wang, Gang Yu, Chunhua Shen
International Conference on Computer Vision (ICCV) 2023
[ArXiv preprint] [Code]

Online Continual Learning Without the Storage Constraint
Ameya Prabhu, Zhipeng Cai , Puneet Dokania, Philip Torr, Vladlen Koltun, Ozan Sener
[ArXiv preprint] [Code]

Revisiting Test Time Adaptation under Online Evaluation
Motasem Alfarra, Hani Itani, Alejandro Pardo, Shyma Alhuwaider, Merey Ramazanova, Juan C. Pérez, Zhipeng Cai , Matthias Müller, Bernard Ghanem
[ArXiv preprint] [Code]

2022

SimCS: Simulation for Online Domain-Incremental Continual Segmentation
Motasem Alfarra, Zhipeng Cai , Adel Bibi, Bernard Ghanem, Matthias Muller
CVPR Workshop on Continual Learning (CLVision) 2023
[ArXiv preprint]

Improving Information Retention in Large Scale Online Continual Learning
Zhipeng Cai, Vladlen Koltun, Ozan Sener
[ArXiv preprint]

2021

Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Data
Zhipeng Cai, Ozan Sener, Vladlen Koltun
International Conference on Computer Vision (ICCV) 2021
[ArXiv preprint] [Code]

2020

Consensus Maximization: Theoretical Analysis and New Algorithms
Zhipeng Cai
Ph.D thesis (Supervised by: Prof. Tat-Jun Chin and Prof. David Suter)
[PDF]

Globally Optimal and Efficient Vanishing Point Estimation in Atlanta World
Haoang Li, Pyojin Kim, Ji Zhao, Kyungdon Joo, Zhipeng Cai, Zhe Liu, Yun-Hui Liu
European Conference on Computer Vision (ECCV) 2020
[Paper]

2019

Robust fitting in computer vision: easy or hard?
Tat-Jun Chin, Zhipeng Cai, Frank Neumann
International Journal on Computer Vision (IJCV), Special Issue on Best of ECCV 2018.
[Paper]

Consensus Maximization Tree Search Revisited
Zhipeng Cai, Tat-Jun Chin, Vladlen Koltun
International Conference on Computer Vision (ICCV) 2019, oral presentation.
[Arxiv preprint] [Code]

Practical Optimal Registration of Terrestrial LiDAR Scan Pairs
Zhipeng Cai, Tat-Jun Chin, Alvaro Parra Bustos, Konrad Schindler
ISPRS Journal of Photogrammetry and Remote Sensing, 2019.
[Arxiv preprint] [PDF] [Code]

2018

Deterministic consensus maximization with biconvex programming
Zhipeng Cai, Tat-Jun Chin, Huu Le, David Suter
European Conference on Computer Vision (ECCV) 2018, oral presentation.
[Arxiv preprint] [Code] [Slides]

Robust fitting in computer vision: easy or hard?
Tat-Jun Chin, Zhipeng Cai, Frank Neumann
European Conference on Computer Vision (ECCV) 2018, oral presentation.
Selected as one of the 12 best papers from the conference
[Arxiv preprint] [Slides]

2016

Spatial-Related Traffic Sign Inspection for Inventory Purposes Using Mobile Laser Scanning Data
Chenglu Wen, Jonathan Li, Huan Luo, Yongtao Yu, Zhipeng Cai, Hanyun Wang, Cheng Wang
IEEE Transactions on Intelligent Transportation Systems, 2016
[PDF]

Patch-based semantic labeling of road scene using colorized mobile LiDAR point clouds
Huan Luo, Cheng Wang, Chenglu Wen, Zhipeng Cai, Ziyi Chen, Hanyun Wang, Yongtao Yu, Jonathan Li
IEEE Transactions on Intelligent Transportation Systems, 2016
[PDF]

2015

Occluded Boundary Detection for Small-footprint Ground-borne LIDAR Point Cloud Guided by Last-echo
Zhipeng Cai, Cheng Wang, Chenglu Wen, Jonathan Li
IEEE Geoscience and Remote Sensing Letters, 2015
[PDF]

3D-PatchMach: an Optimization Algorithm for Point Cloud Completion
Zhipeng Cai, Cheng Wang, Chenglu Wen, Jonathan Li
Second IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services(ICSDM2015)
[PDF]

2012

Automatic road extraction from mobile laser scanning data
Hanyun Wang, Zhipeng Cai, Huan Luo, Cheng Wang, Peng Li, Wentao Yang, Suoping Ren, Jonathan Li
International Conference on Computer Vision in Remote Sensing (CVRS), 2012
[PDF]

Scale invariant kernel-based object tracking
Peng Li, Zhipeng Cai, Hanyun Wang, Zhuo Sun, Yunhui Yi, Cheng Wang, Jonathan Li
International Conference on Computer Vision in Remote Sensing (CVRS), 2012
[PDF]

Cascade framework for object extraction in image sequences
Peng Li, Zhipeng Cai, Cheng Wang, Zhuo Sun, Hanyun Wang, Jonathan Li
International Conference on Computer Vision in Remote Sensing (CVRS), 2012
[PDF]

Patent:

1. Interactive three-dimensional point cloud color editing method. Publication number: CN 103489224 A

2. Three-dimensional point cloud auto-completion method. Publication number: CN 104063898 A

Award

2020 Dean’s Commendation for Doctoral Thesis Excellence
2018 One of the 12 best papers in ECCV'2018
2018 Ranked the first 30th in the Ranking List of 2018 Potential Computer Vision Developers
2016 Excellent Master Degree Graduation Thesis
2013 Excellent Bachelor Degree Graduation Thesis
2013 The CCF Outstanding Undergraduate Award
2012 The Meritorious Winner of 2012 Mathematical Contest In Modeling Certificate of Achievement

Working experience

Jan-2019 to June-2020: Internship at Intel Intelligent Systems Lab at Santa Clara, CA, USA. Working with Dr. Vladlen Koltun.
July-2020 to May-2022: Postdoc at Intel Intelligent Systems Lab at Santa Clara, CA, USA. Working with Dr. Vladlen Koltun.
June-2022 to Now: Research scientist at Intel Embodied AI Lab at Santa Clara, CA, USA.

Academic Service

Conference reviewer: CVPR, ICCV, ECCV, AAAI, ICLR, ICML
Journal reviewer: TPAMI, IJCV, ISPRS Journal of Photogrammetry and Remote Sensing, Pattern Recognition, RA-L

Last Updated on 22th Nov, 2016

Published with GitHub Pages