Advanced Interactive Technologies, ETH Zürich

Jie Song

PHD student
Advanced Interactive Technologies Lab, ETH Zürich

E-Mail: jsong@inf.ethz.ch
Address: Universitätstrasse 6, 8092 Zürich, Switzerland
Room: ETH Zurich, Department of Computer Science, CNB, H 102

Biography

I'm a PHD candidate at ETH Zurich, working with Professor Otmar Hilliges in the Advanced Interactive Technologies lab. . Currently I am working on vision based human analysis(like human action recognition, human 2d/3d pose estimation). If you are interested in Semester/Master project in our group, you can check our available projects. We also welcome skilled and motivated students for exchange/internship.

Awards

Qualcomm innovation fellowship finalist 2015
Swisscom innovation award 2014
Birkigt Scholarship of ETH Zürich 2013

Papers

Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videos

Authors J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsCVPR, Hawaii, USA, 2017 (oral)
Code and models will be available soon at GitHub.

Project PDF Video BibTeX

Two-Stream SR-CNNs for Action Recognition in Videos

Authors Y. Wang, J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsBMVC, York, UK, 2016
Code and Models are on GitHub.

PDF BibTeX

Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

Authors S. Wang*, J. Song*, J. Lien, I. Poupyrev, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Tokyo, Japan, 2016
Code and dataset is on GitHub.
*The first two authors contributed equally to this work.

Project PDF Video BibTeX

Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction

Authors J. Song, F. Pece, G. Sörös, M. Koelle, O. Hilliges
In ProceedingsACM SIGCHI, Seoul, South Korea, Apr. 2015

Project PDF Video BibTeX

In-air Gestures Around Unmodified Mobile Devices

Authors J. Song, G. Sörös, F. Pece, S. Fanello, S. Izadi, C. Keskin, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Honolulu, Hawaii, Oct. 2014

Project PDF Video BibTeX

Theses

In air gestures around unmodified mobile devices， AIT ETH Zurich
A Hidden Markov Model approach for Voronoi Localization， ASL ETH Zurich

Student Theses

Past Student Projects

Skeleton based human motion modelling. Partha Gosh, 2017, RA (now PHD at MPI tuebingen)
Skeleton based human action recognition. Sephora Madjiheurem,2017, MA (now at EPFL)
Human pose estimation based on flow. Susanne Keller, 2016, BA (now master at ETHZ)
RNN based gesture recognition for Radio-frequency spectrum. Saiwen Wang, 2016, MA (now Apple)
CNN based action recognition in videos. Yifan Wang, 2015, MA (now PHD at Disney/ETHZ)

Teaching Assistant

Visual Computing (D-INFK) — HH2016;
Parallel Programming (D-INFK) — FS2016;
Machine Learning (D-INFK) — HH2015;
User Interface Engineering (D-INFK) — FS2014