Dr. Manuel Kaufmann

Postdoc
manuel.kaufmann@inf.ethz.ch
ETH Zurich, Department of Computer Science, STD, H 29.1
Stampfenbachstrasse 48, 8092 Zürich, Switzerland

About me

I joined the Advanced Interactive Technologies lab in December 2017 as a Ph.D. student under the supervision of Prof. Otmar Hilliges. I received my BSc in Computer Science from the University of Basel (2014) where I wrote my Bachelor thesis under the supervision of Prof. Thomas Vetter on "A Statistical Shape Model of the Human Ear to Customize Hearing Devices". I subsequently obtained a MSc in Computer Science at ETH Zürich (2017). My Master thesis was titled "A Deep Learning Approach to Human Motion Sequences Infilling" supervised by Prof. Hilliges and in collaboration with vizrt Switzerland.

In my research I focus on estimating 3D human body pose from wearable sensors such as IMUs and electromagnetic sensing technology to bring about full body pose in mixed reality settings. I am further interested in human motion modelling, for example to predict motions into the future, fill in missing frames or clean up noisy data.

You can also find me on Twitter, Linkedin, and Google scholar.

Publications

EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild
Manuel Kaufmann, Jie Song, Chen Guo, Kaiyue Shen, Tianjian Jiang, Chengcheng Tang, Juan Zarate, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2023
Video Paper Data Code
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation
Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael Black, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2023
Video Paper Code
X-Avatar: Expressive Human Avatars
Kaiyue Shen*, Chen Guo*, Manuel Kaufmann, Juan Zarate, Julien Valentin, Jie Song, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2023
Video Paper Data Code
Hi4D: 4D Instance Segmentation of Close Human Interaction
Yifei Yin, Chen Guo, Manuel Kaufmann, Juan Zarate, Jie Song, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2023
Video Paper Data Code
A Spatio-temporal Transformer for 3D Human Motion Prediction
Emre Aksan, Manuel Kaufmann, Peng Cao, Otmar Hilliges
International Conference on 3D Vision (3DV), 2021
Video Paper Code
EM-POSE: 3D Human Pose Estimation from Sparse Electromagnetic Trackers
Manuel Kaufmann, Yi Zhao, Chengcheng Tang, Lingling Tao, Christopher Twigg, Jie Song, Robert Wang, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2021
Video Paper Data Code
Convolutional Autoencoders for Human Motion Infilling
Manuel Kaufmann, Emre Aksan, Jie Song, Fabrizio Pece, Remo Ziegler, Otmar Hilliges
2020 International Conference on 3D Vision (3DV), 2020
Video Paper Code
Structured Prediction Helps 3D Human Motion Modelling
Emre Aksan*, Manuel Kaufmann*, Otmar Hilliges * Equal contribution
The IEEE International Conference on Computer Vision (ICCV), 2019
Video Paper Code
Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time
Yinghao Huang*, Manuel Kaufmann*, Emre Aksan, Michael Black, Otmar Hilliges, Gerard Pons-Moll * Equal contribution
ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 2018
Video Paper Data Code

Academic Activities

Reviewing

2023
CVPR, ICCV
2022
CVPR, ECCV (outstanding reviewer), 3DV, SIGGRAPH Asia, ACM UIST
2021
ICCV, SIGGRAPH, SIGGRAPH Asia
2020
ACM UIST, CVPR, ECCV, Eurographics, WACV
2019
Biocybernetics and Biomedical Engineering

Student Theses

2023
Alexander Häfliger Master Thesis
Deep Kinematics: Uncovering Human Biomechanics with IMUs and Deep Learning
2022
Nina Weng Master Thesis
Explainability in Deep Learning for Prediction of Gaze Position from EEG Data
Yelan Tao Semester Project
Synthesis of Egocentric Views Showing Hand-Object Interactions
2021
Seok Joon Kim Master Thesis
Conditional Hand Motion Synthesis
2020
Dominik Bornand Semester Project
Simulating Sparse Inertial Measurements for Human Pose Reconstruction
2019
Jonathan Lehner Bachelor Thesis
Real-Time Hand Tracking from Wrist-Worn RGB Cameras
2018
Martin Blapp Bachelor Thesis
Evaluation of Human Motion Models

Teaching