Xu Chen

PhD Student
xuchen@inf.ethz.ch
ETH Zurich, Department of Computer Science, STD, H 25
Stampfenbachstrasse 48, 8092 Zürich, Switzerland

Biography

I'm a fourth-year doctoral fellow in the Max Plank ETH Center for Learning Systems, a joint program between ETH Zurich and Max Planck Institute for Intelligent Systems. I am supervised by Prof. Otmar Hilliges, Prof. Andreas Geiger and Prof. Michael Black. I am working in the AIT lab at ETH Zurich.

My research interest lies in 3D deep generative models, with a goal to build learning-based approaches capable of generating photo-realistic simulations of human activity. The resulting data could be useful in the context of training methods for human-centric perception tasks.

Publications

Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Captures
Marcel C. Buehler, Gengyan Li, Erroll Wood, Leonhard Helminger, Xu Chen, Tanmay Shah, Daoye Wang, Stephan Garbin, Sergio Orts-Escolano, Otmar Hilliges, Dmitry Lagun, Jérémy Riviere, Paulo Gotardo, Thabo Beeler, Abhimitra Meka, Kripasindhu Sarkar
Conference paper at SIGGRAPH Asia, 2024
Video Talk Paper Data
HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video
Zicong Fan, Maria Parelli, Maria Eleni Kadoglou, Muhammed Kocabas, Xu Chen, Michael J. Black, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2024
Accepted as Highlight (Top 11.9%)
Video Paper Code
AG3D: Learning to Generate 3D Avatars from 2D Image Collections
Zijian Dong*, Xu Chen*, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger
International Conference on Computer Vision (ICCV), 2023
Paper Code
Fast-SNARF: A Fast Deformer for Articulated Neural Fields
Xu Chen*, Tianjian Jiang*, Jie Song, Max Rietmann, Andreas Geiger, Michael Black, Otmar Hilliges * Equal contribution
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
Paper Code
Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition
Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2023
Video Paper Code
InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds
Tianjian Jiang*, Xu Chen*, Jie Song, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2023
Video Paper Code
PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence
Zijian Dong*, Chen Guo*, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2022
Video Paper
gDNA: Towards Generative Detailed Neural Avatars
Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael Black, Andreas Geiger, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
Video Paper Code
IM Avatar: Implicit Morphable Head Avatars from Videos
Yufeng Zheng, Victoria Abrevaya, Marcel Buehler, Xu Chen, Michael Black, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
Accepted as Oral Presentation
Video Paper Data Code
Human Performance Capture from Monocular Video in the Wild
Chen Guo, Xu Chen, Jie Song, Otmar Hilliges
2021 International Conference on 3D Vision (3DV), 2021
Video Paper Code
Render In-between: Motion Guided Video Synthesis for Action Interpolation
Hsuan-I Ho, Xu Chen, Jie Song, Otmar Hilliges
British Machine Vision Conference (BMVC), 2021
Video Paper Code
SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes
Xu Chen, Yufeng Zheng, Michael Black, Otmar Hilliges, Andreas Geiger
International Conference on Computer Vision (ICCV), 2021
Video Paper Code
Shape-aware Multi-Person Pose Estimation from Multi-view Images
Zijian Dong, Jie Song, Xu Chen, Chen Guo, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2021
Video Paper Code
Category Level Object Pose Estimation via Neural Analysis-by-Synthesis
Xu Chen*, Zijian Dong*, Jie Song, Andreas Geiger, Otmar Hilliges * Equal contribution
European Conference on Computer Vision (ECCV), 2020
Video Paper Code
Human Body Model Fitting by Learned Gradient Descent
Jie Song*, Xu Chen*, Otmar Hilliges * Equal contribution
European Conference on Computer Vision (ECCV), 2020
Video Paper Code
Monocular Neural Image Based Rendering with Continuous View Control
Xu Chen*, Jie Song*, Otmar Hilliges * Equal contribution
International Conference on Computer Vision (ICCV), 2019
Paper Code
Unpaired Pose Guided Human Image Generation
Xu Chen, Jie Song, Otmar Hilliges
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019
Paper Code
StreetMap - Mapping and Localization on Ground Planes using a Downward Facing Camera
Xu Chen, Anurag Vempati, Paul Beardsley
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
Video Paper