About me
I'm a Postdoctoral researcher at ETH Zurich in the Advanced Interactive Technologies lab. Briefly, I am interested in how to incorporate structured information into deep learning pipeline, either semantically or geometrically. Application-wise, I am mainly working on hand-pose/body-pose-shape/human-motion estimation and also learning based view synthesis and 6D pose estimation. If you are interested in Semester/Master projects, please directly contact me by email. Especially, if you are a fan of football, check this link for thesis.
Awards
- 3DV best paper award 2017
- Qualcomm innovation fellowship finalist 2015
- Swisscom innovation award 2014
- Birkigt Scholarship of ETH Zürich 2013
- National Scholarship 2009/2010
Publications
Bonan Liu*,
Handi Yin*,
Manuel Kaufmann,
Jinhao He,
Sammy Christen,
Jie Song,
Pan Hui
* Equal contribution
SIGGRAPH Asia 2024 (TOG), 2024
Video
Paper
Chen Guo*,
Tianjian Jiang*,
Manuel Kaufmann,
Chengwei Zheng,
Julien Valentin,
Jie Song,
Otmar Hilliges
* Equal contribution
European Conference on Computer Vision (ECCV), 2024
Tianjian Jiang,
Johsan Billingham,
Sebastian Müksch,
Juan Zarate,
Nicolas Evans,
Martin Oswald,
Marc Pollefeys,
Otmar Hilliges,
Manuel Kaufmann,
Jie Song
European Conference on Computer Vision (ECCV), 2024
Lixin Xue,
Chen Guo,
Chengwei Zheng,
Fangjinhua Wang,
Tianjian Jiang,
Hsuan-I Ho,
Manuel Kaufmann,
Jie Song,
Otmar Hilliges
European Conference on Computer Vision (ECCV), 2024
European Conference on Computer Vision (ECCV), 2024
Code
European Conference on Computer Vision (ECCV), 2024
Zeren Jiang*,
Chen Guo*,
Manuel Kaufmann,
Tianjian Jiang,
Julien Valentin,
Otmar Hilliges,
Jie Song
* Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2024
Accepted as Oral Presentation (Top 3.3%)
Accepted as Oral Presentation (Top 3.3%)
Computer Vision and Pattern Recognition (CVPR), 2024
Wenbo Wang*,
Hsuan-I Ho*,
Chen Guo,
Boxiang Rong,
Artur Grigorev,
Jie Song,
Juan Zarate,
Otmar Hilliges
* Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2024
Accepted as Highlight (Top 11.9%)
Accepted as Highlight (Top 11.9%)
Data
International Conference on Robotics and Automation 2024 (ICRA), 2024
Hui Zhang*,
Sammy Christen*,
Zicong Fan,
Luocheng Zheng,
Jemin Hwangbo,
Jie Song,
Otmar Hilliges
* Equal contribution
International Conference on 3D Vision 2024 (3DV), 2024
Accepted as Spotlight Presentation
Accepted as Spotlight Presentation
Manuel Kaufmann,
Jie Song,
Chen Guo,
Kaiyue Shen,
Tianjian Jiang,
Chengcheng Tang,
Juan Zarate,
Otmar Hilliges
International Conference on Computer Vision (ICCV), 2023
Xu Chen*,
Tianjian Jiang*,
Jie Song,
Max Rietmann,
Andreas Geiger,
Michael Black,
Otmar Hilliges
* Equal contribution
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition
Computer Vision and Pattern Recognition (CVPR), 2023
Computer Vision and Pattern Recognition (CVPR), 2023
Kaiyue Shen*,
Chen Guo*,
Manuel Kaufmann,
Juan Zarate,
Julien Valentin,
Jie Song,
Otmar Hilliges
* Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2023
Computer Vision and Pattern Recognition (CVPR), 2023
Computer Vision and Pattern Recognition (CVPR), 2023
Computer Vision and Pattern Recognition (CVPR), 2022
Computer Vision and Pattern Recognition (CVPR), 2022
Computer Vision and Pattern Recognition (CVPR), 2022
2021 International Conference on 3D Vision (3DV), 2021
British Machine Vision Conference (BMVC), 2021
International Conference on Computer Vision (ICCV), 2021
Manuel Kaufmann,
Yi Zhao,
Chengcheng Tang,
Lingling Tao,
Christopher Twigg,
Jie Song,
Robert Wang,
Otmar Hilliges
International Conference on Computer Vision (ICCV), 2021
2020 International Conference on 3D Vision (3DV), 2020
European Conference on Computer Vision (ECCV), 2020
European Conference on Computer Vision (ECCV), 2020
International Conference on Computer Vision (ICCV), 2019
International Conference on Computer Vision (ICCV), 2019
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Accepted as Spotlight Presentation
Accepted as Spotlight Presentation
2017 International Conference on 3D Vision (3DV), 2017
Best Paper Award
Best Paper Award
Jie Song,
Limin Wang,
Luc VanGool,
Otmar Hilliges
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
Accepted as oral presentation
Accepted as oral presentation
Talk
Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 2016
Yifan Wang,
Jie Song,
Limin Wang,
Luc VanGool,
Otmar Hilliges
BMVC, 2016
ACM Conference on Human Factors in Computing Systems (CHI), 2015
ACM User Interface Software and Technology Symposium, 2014
Student Theses
Past Student Projects
- Personalized neural avatar reconstruction. Chen Guo, 2021, MA (now PHD at ETH)
- Multi-person pose estimation. Zijian Dong, 2021, MA (now PHD at ETH)
- Pose guided human image generation. Xu Chen, 2019, MA (now PHD at ETH)
- Skeleton based human motion modelling. Partha Gosh, 2017, MA (now PHD at MPI tuebingen)
- Skeleton based human action recognition. Sephora Madjiheurem,2017, MA (now PHD at UCL)
- RNN based gesture recognition for Radio-frequency spectrum. Saiwen Wang, 2016, MA (now Apple)
- CNN based action recognition in videos. Yifan Wang, 2015, MA (now PHD at Disney/ETHZ)
Teaching Assistant
- Visual Computing (D-INFK) — 2019,2018,2017;
- Machine Perception (D-INFK) — 2020,2019,2018;
- Parallel Programming (D-INFK) — 2017,2016;
- Machine Learning (D-INFK) — 2016,2015;
- User Interface Engineering (D-INFK) — 2015,2014;