About me

I'm a Postdoctoral researcher at ETH Zurich in the Advanced Interactive Technologies lab. Briefly, I am interested in how to incorporate structured information into deep learning pipeline, either semantically or geometrically. Application-wise, I am mainly working on hand-pose/body-pose-shape/human-motion estimation and also learning based view synthesis and 6D pose estimation. If you are interested in Semester/Master projects, please directly contact me by email. Especially, if you are a fan of football, check this link for thesis.

Awards

Publications

Bonan Liu*, Handi Yin*, Manuel Kaufmann, Jinhao He, Sammy Christen, Jie Song, Pan Hui * Equal contribution
SIGGRAPH Asia 2024 (TOG), 2024
Chen Guo*, Tianjian Jiang*, Manuel Kaufmann, Chengwei Zheng, Julien Valentin, Jie Song, Otmar Hilliges * Equal contribution
European Conference on Computer Vision (ECCV), 2024
Zeren Jiang*, Chen Guo*, Manuel Kaufmann, Tianjian Jiang, Julien Valentin, Otmar Hilliges, Jie Song * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2024
Accepted as Oral Presentation (Top 3.3%)
Wenbo Wang*, Hsuan-I Ho*, Chen Guo, Boxiang Rong, Artur Grigorev, Jie Song, Juan Zarate, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2024
Accepted as Highlight (Top 11.9%)
Sammy Christen*, Lan Feng*, Wei Yang, Yu-Wei Chao, Otmar Hilliges, Jie Song * Equal contribution
International Conference on Robotics and Automation 2024 (ICRA), 2024
Hui Zhang*, Sammy Christen*, Zicong Fan, Luocheng Zheng, Jemin Hwangbo, Jie Song, Otmar Hilliges * Equal contribution
International Conference on 3D Vision 2024 (3DV), 2024
Accepted as Spotlight Presentation
Manuel Kaufmann, Jie Song, Chen Guo, Kaiyue Shen, Tianjian Jiang, Chengcheng Tang, Juan Zarate, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2023
Xu Chen*, Tianjian Jiang*, Jie Song, Max Rietmann, Andreas Geiger, Michael Black, Otmar Hilliges * Equal contribution
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
Kaiyue Shen*, Chen Guo*, Manuel Kaufmann, Juan Zarate, Julien Valentin, Jie Song, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2023
Tianjian Jiang*, Xu Chen*, Jie Song, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2023
Zijian Dong*, Chen Guo*, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges * Equal contribution
Computer Vision and Pattern Recognition (CVPR), 2022
Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael Black, Andreas Geiger, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
Manuel Kaufmann, Yi Zhao, Chengcheng Tang, Lingling Tao, Christopher Twigg, Jie Song, Robert Wang, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2021
Xu Chen*, Zijian Dong*, Jie Song, Andreas Geiger, Otmar Hilliges * Equal contribution
European Conference on Computer Vision (ECCV), 2020
Jie Song*, Xu Chen*, Otmar Hilliges * Equal contribution
European Conference on Computer Vision (ECCV), 2020
Jie Song, Bjoern Andres, Michael Black, Otmar Hilliges, Siyu Tang
International Conference on Computer Vision (ICCV), 2019
Xu Chen*, Jie Song*, Otmar Hilliges * Equal contribution
International Conference on Computer Vision (ICCV), 2019
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Accepted as Spotlight Presentation
2017 International Conference on 3D Vision (3DV), 2017
Best Paper Award
Jie Song, Limin Wang, Luc VanGool, Otmar Hilliges
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
Accepted as oral presentation
Saiwen Wang*, Jie Song*, Jaime Lien, Ivan Poupyrev, Otmar Hilliges * Equal contribution
Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 2016
Jie Song, Fabrizio Pece, Gábor Sörös, Marion Koelle, Otmar Hilliges
ACM Conference on Human Factors in Computing Systems (CHI), 2015
Jie Song, Gabor Soros, Fabrizio Pece, Sean Ryan Fanello, Shahram Izadi, Cem Keskin, Otmar Hilliges
ACM User Interface Software and Technology Symposium, 2014

Student Theses

Past Student Projects
  • Personalized neural avatar reconstruction. Chen Guo, 2021, MA (now PHD at ETH)
  • Multi-person pose estimation. Zijian Dong, 2021, MA (now PHD at ETH)
  • Pose guided human image generation. Xu Chen, 2019, MA (now PHD at ETH)
  • Skeleton based human motion modelling. Partha Gosh, 2017, MA (now PHD at MPI tuebingen)
  • Skeleton based human action recognition. Sephora Madjiheurem,2017, MA (now PHD at UCL)
  • RNN based gesture recognition for Radio-frequency spectrum. Saiwen Wang, 2016, MA (now Apple)
  • CNN based action recognition in videos. Yifan Wang, 2015, MA (now PHD at Disney/ETHZ)

Teaching Assistant

  • Visual Computing (D-INFK) — 2019,2018,2017;
  • Machine Perception (D-INFK) — 2020,2019,2018;
  • Parallel Programming (D-INFK) — 2017,2016;
  • Machine Learning (D-INFK) — 2016,2015;
  • User Interface Engineering (D-INFK) — 2015,2014;