Biography

I'm a PHD candidate at ETH Zurich, working with Professor Otmar Hilliges in the Advanced Interactive Technologies lab. . Currently I am working on vision based human analysis(like human action recognition, human 2d/3d pose estimation). If you are interested in Semester/Master project in our group, you can check our available projects. We also welcome skilled and motivated students for exchange/internship.

Awards

• Qualcomm innovation fellowship finalist 2015
• Swisscom innovation award 2014
• Birkigt Scholarship of ETH Zürich 2013

Papers

Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videos

Authors J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsCVPR, Hawaii, USA, 2017 (oral)
Code and models will be available soon at GitHub.

Project PDF Video BibTeX

---

Two-Stream SR-CNNs for Action Recognition in Videos

Authors Y. Wang, J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsBMVC, York, UK, 2016
Code and Models are on GitHub.

PDF BibTeX

---

Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

Authors S. Wang*, J. Song*, J. Lien, I. Poupyrev, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Tokyo, Japan, 2016
Code and dataset is on GitHub.
*The first two authors contributed equally to this work.

Project PDF Video BibTeX

---

Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction

Authors J. Song, F. Pece, G. Sörös, M. Koelle, O. Hilliges
In ProceedingsACM SIGCHI, Seoul, South Korea, Apr. 2015

Project PDF Video BibTeX

---

In-air Gestures Around Unmodified Mobile Devices

Authors J. Song, G. Sörös, F. Pece, S. Fanello, S. Izadi, C. Keskin, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Honolulu, Hawaii, Oct. 2014

Project PDF Video BibTeX

---

Theses

• In air gestures around unmodified mobile devices， AIT ETH Zurich
• A Hidden Markov Model approach for Voronoi Localization， ASL ETH Zurich

Student Theses

Past Student Projects

• Skeleton based human motion modelling. Partha Gosh, 2017, RA (now PHD at MPI tuebingen)
• Skeleton based human action recognition. Sephora Madjiheurem,2017, MA (now at EPFL)
• Human pose estimation based on flow. Susanne Keller, 2016, BA (now master at ETHZ)
• RNN based gesture recognition for Radio-frequency spectrum. Saiwen Wang, 2016, MA (now Apple)
• CNN based action recognition in videos. Yifan Wang, 2015, MA (now PHD at Disney/ETHZ)

Teaching Assistant

• Visual Computing (D-INFK) — HH2016;
• Parallel Programming (D-INFK) — FS2016;
• Machine Learning (D-INFK) — HH2015;
• User Interface Engineering (D-INFK) — FS2014