Publications [Google Scholar]
*: equal contributions; †: corresponding author.
Digital Life Project: Autonomous 3D Characters with Social Intelligence
Zhongang Cai*, Jianping Jiang*, Zhongfei Qing*, Xinying Guo*, Mingyuan Zhang*, Zhengyu Lin, Haiyi Mei,
Chen Wei, Ruisi Wang, Wanqi Yin, Xiangyu Fan, Han Du, Liang Pan, Peng Gao, Zhitao Yang, Yang Gao, Jiaqi Li,
Tianxiang Ren, Yukun Wei, Xiaogang Wang, Chen Change Loy, Lei Yang, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024
Project Page
PDF
Video
机器之心
AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation
Qingping Sun*, Yanjun Wang*, Ailing Zeng, Wanqi Yin, Chen Wei, Wenjia Wang, Haiyi Mei, Chi Sing Leung, Ziwei Liu, Lei Yang, Zhongang Cai†.
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Project Page
PDF
Code
Video
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
Yiwen Chen*, Zilong Chen*, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin.
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Project Page
PDF
Code
Story-to-Motion: Synthesizing Infinite and Controllable Character Animation from Long Text
Zhongfei Qing, Zhongang Cai, Zhitao Yang, Lei Yang
SIGGRAPH Asia (Technical Communications), 2023
Project Page
PDF
Video
SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation
Zhongang Cai*, Wanqi Yin*, Ailing Zeng, Chen Wei, Qingping Sun, Yanjun Wang, Hui En Pang, Haiyi Mei, Mingyuan Zhang, Lei Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
NeurIPS (Datasets and Benchmarks Track), 2023
Project Page
PDF
Code
Video
Demo
新智元
商汤学术
我爱计算机视觉
IDEA论文一刻(B站)
CVer(B站)
Towards Robust and Expressive Whole-body Human Pose and Shape Estimation
Hui En Pang, Zhongang Cai, Lei Yang, Qingyi Tao, Zhonghua Wu, Tianwei Zhang, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023
Project Page
PDF
Code
FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing
Mingyuan Zhang, Huirong Li, Zhongang Cai, Jiawei Ren, Lei Yang, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023
Project Page
PDF
Code
Video
PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Clouds
Zhongang Cai*, Liang Pan*, Chen Wei, Wanqi Yin, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
ArXiv, 2023
Project Page
PDF
Code
Video
SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling
Zhitao Yang*, Zhongang Cai*, Haiyi Mei*, Shuai Liu*, Zhaoxi Chen*, Weiye Xiao, Yukun Wei, Zhongfei Qing, Chen Wei, Bo Dai, Wayne Wu, Chen Qian, Dahua Lin, Ziwei Liu, Lei Yang.
International Conference on Computer Vision (ICCV), 2023
Project Page
PDF
Code
Video
Press
ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model
Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023
Project Page
PDF
Code
Video
Zolly: Zoom Focal Length Correctly for Perspective-Distorted Human Mesh Reconstruction
Wenjia Wang, Yongtao Ge, Haiyi Mei, Zhongang Cai, Qingping Sun, Yanjun Wang, Chunhua Shen, Lei Yang, Taku Komura.
International Conference on Computer Vision (ICCV), 2023 (Oral)
Project Page
PDF
Code
DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Rendering
Wei Cheng*, Ruixiang Chen*, Wanqi Yin*, Siming Fan*, Keyu Chen*, Honglin He, Huiwen Luo,
Zhongang Cai, Jingbo Wang, Yang Gao, Zhengming Yu, Zhengyu Lin, Daxuan Ren, Lei Yang,
Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Bo Dai, Kwan-Yee Lin.
International Conference on Computer Vision (ICCV), 2023
Project Page
PDF
Code
Video
Press
BiBench: Benchmarking and Analyzing Network Binarization
Haotong Qin*, Mingyuan Zhang*, Yifu Ding, Aoyu Li, Zhongang Cai, Ziwei Liu, Fisher Yu, Xianglong Liu.
International Conference on Machine Learning (ICML), 2023
Project Page
PDF
Code
Variational Relational Point Completion Network for Robust 3D Classification
Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang, Haiyu Zhao, Shuai Yi, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Project Page
PDF
Code
Data
Video
MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
Mingyuan Zhang*, Zhongang Cai*, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Project Page
PDF
Code
Video
Press
Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms
Hui En Pang, Zhongang Cai, Lei Yang, Tianwei Zhang, Ziwei Liu.
NeurIPS (Datasets and Benchmarks Track), 2022
Project Page
PDF
Code
HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling
Zhongang Cai*, Daxuan Ren*, Ailing Zeng*, Zhengyu Lin*, Tao Yu*, Wenjia Wang*, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022 (Oral)
(PREMIA Best Student Paper Awards)
Project Page
PDF
Code
Data
Video
Slides
商汤学术
Monocular 3D Object Reconstruction with GAN Inversion
Junzhe Zhang, Daxuan Ren, Zhongang Cai, Chai Kiat Yeo, Bo Dai, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2022
Project Page
PDF
Code
Video
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars
Fangzhou Hong*, Mingyuan Zhang*, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu.
ACM Transactions on Graphics (SIGGRAPH), 2022
Project Page
PDF
Code
Video
Press
Versatile Multi-Modal Pre-Training for Human-Centric Perception
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
Conference on Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)
PDF
Project Page
Code
Data
Delving Deep into the Generalization of Vision Transformers under Distribution Shifts
Chongzhi Zhang*, Mingyuan Zhang*, Shanghang Zhang*, Daisheng Jin, Qiang Zhou, Zhongang Cai, Haiyu Zhao, Shuai Yi, Xianglong Liu, Ziwei Liu.
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
PDF
Code
PTTR: Relational 3D Point Cloud Object Tracking with Transformer
Changqing Zhou, Zhipeng Luo, Yueru Luo, Tianrui Liu, Liang Pan, Zhongang Cai, Haiyu Zhao, Shijian Lu.
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
PDF
Code
Robust Partial-to-Partial Point Cloud Registration in a Full Range
Liang Pan, Zhongang Cai, Ziwei Liu.
IEEE Robotics and Automation Letters (RA-L), 2024
PDF
Code
Data
Playing for 3D Human Recovery
Zhongang Cai*, Mingyuan Zhang*, Jiawei Ren*, Chen Wei, Daxuan Ren, Jiatong Li, Zhengyu Lin, Haiyu Zhao, Shuai Yi, Lei Yang, Chen Change Loy, Ziwei Liu.
arXiv Preprint, 2021
Project Page
PDF
Code
Data
Garment4D: Garment Reconstruction from Point Cloud Sequences
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2021
Project Page
PDF
Code
Video
Press
Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency
Zhipeng Luo*, Zhongang Cai*, Changqing Zhou*, Gongjie Zhang, Haiyu Zhao, Shuai Yi, Shijian Lu, Hongsheng Li, Shanghang Zhang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2021
PDF
Code
CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsing
Daxuan Ren, Jianmin Zheng, Jianfei Cai, Jiatong Li, Haiyong Jiang, Zhongang Cai, Junzhe Zhang, Liang Pan, Mingyuan Zhang, Haiyu Zhao, Shuai Yi.
International Conference on Computer Vision (ICCV), 2021
Project Page
PDF
Code
Unsupervised 3D Shape Completion through GAN Inversion
Junzhe Zhang, Xinyi Chen, Zhongang Cai, Liang Pan, Haiyu Zhao, Shuai Yi, Chai Kiat Yeo, Bo Dai, Chen Change Loy.
Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Project Page
PDF
Code
Variational Relational Point Completion Network
Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang, Haiyu Zhao, Shuai Yi, Ziwei Liu.
Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)
Project Page
PDF
Code
Data
BiPointNet: Binary Neural Network for Point Clouds
Haotong Qin*, Zhongang Cai*, Mingyuan Zhang*, Yifu Ding, Haiyu Zhao, Shuai Yi, Xianglong Liu, Hao Su.
International Conference on Learning Representations (ICLR), 2021
PDF
Code
REFINE: Prediction Fusion Network for Panoptic Segmentation
Jiawei Ren*, Cunjun Yu*, Zhongang Cai*, Mingyuan Zhang, Chongsong Chen, Haiyu Zhao, Shuai Yi, Hongsheng Li.
AAAI Conference on Artificial Intelligence (AAAI), 2021
PDF
Project Page
MessyTable: Instance Association in Multiple Camera Views
Zhongang Cai*, Junzhe Zhang*, Daxuan Ren, Cunjun Yu, Haiyu Zhao, Shuai Yi, Chai Kiat Yeo, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2020
Project Page
PDF
Code
Data
Siamese Convolutional Neural Network for Sub-millimeter-accurate Camera Pose Estimation and Visual Servoing
Cunjun Yu*, Zhongang Cai*, Hung Pham, Quang-Cuong Pham.
International Conference on Intelligent Robots and Systems (IROS), 2019
PDF
