Research Overview

Welcome to the AIT Lab where AI meets Interactive Technologies. We do research at the intersection of Machine Learning, Computer Vision and Human Computer Interaction (HCI). Our main mission is to develop new ways for humans to interact with complex interactive systems (computers, wearables, robots), powered by advanced algorithms and technologies in machine perception, planning and data driven user modelling. Please see research and publications for more information.

The AIT Lab, led by Prof. Dr. Otmar Hilliges, is within the Departement of Computer Science at ETH Zurich. The group is jointly affiliated with the Institute of Visual Computing and Institute of Pervasive Computing.

Latest News

30.03.2017
Two papers accepted at ACM SIGGRAPH and IEEE CVPR.
18.01.2017
Journal paper accepted for IEEE Robotics & Automation Letters (RA-L) presentation at IEEE ICRA.
21.12.2016
We are hiring!
15.12.2016
Otmar Hilliges receives an ERC starting grant.
19.09.2016
C++/Python code for UWB tracking on GitHub.
19.09.2016
Fast Random Forest library on GitHub.
04.07.2016
Three new papers conditionally accepted at ACM UIST 2016 and at IEEE IROS.
21.03.2016
One paper accepted at ACM SIGGRAPH 2016.

Open PhD and PostDoc positions

We are currently looking for motivated and creative PhD students who are eager to get involved in cutting edge research in the areas of interactive machine learning, machine perception and numerical optimization for UI synthesis.

We are also looking for 2 post-docs with a back ground in either i) machine learning, bayesian optimisation, active learning, variational methods, deep-learning or related areas or ii) computer vision, graphics, robotics, numerical methods or physical simulation.

Excellent programming skills in C++ or other high-level language are expected and experience in Matlab, Phython, OpenGL, or CUDA are beneficial. Fluent communication skills (written and presentation) in English are essential.

Positions are fully funded (via ERC starting grant) and are available to students of any nationality (some knowledge of German is beneficial but not essential). For more details see how to apply.


Latest Projects


Teaser-Picture

Real-time Planning for Automated Multi-View Drone Cinematography

AuthorsT. Nägeli, L. Meier, A. Domahidi, J. Alonso-Mora, O. Hilliges
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH), Los Angeles, USA, 2017

Teaser-Picture

Guiding InfoGAN with Semi-Supervision

AuthorsA. Spurr, E. Aksan, O. Hilliges
In ProceedingsArXiv e-prints, Jul 2017

Teaser-Picture

Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videos

AuthorsJ. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsCVPR, Hawaii, USA, 2017

Accepted as oral presentation

Teaser-Picture

Real-time Motion Planning for Aerial Videography with Dynamic Obstacle Avoidance and Viewpoint Optimization

AuthorsT. Nägeli, J. Alonso-Mora, A. Domahidi, D. Rus, O. Hilliges
In ProceedingsIEEE Robotics and Automation Letters (Volume: 2, Issue: 3), July 2017

Teaser-Picture

Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

AuthorsS. Wang*, J. Song*, J. Lien, I. Poupyrev, O. Hilliges
In ProceedingsACM Symposium on User Interface Software and Technologies (UIST), Tokyo, Japan, Oct 2016
* These two authors contributed equally to this work.

Teaser-Picture

Rig Animation with a Tangible and Modular Input Device

AuthorsO. Glauser, W. Ma, D. Panozzo, A. Jacobson, O. Hilliges, O. Sorkine-Hornung
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH), Anaheim, CA, USA, Jul 2016

Teaser-Picture

Airways: Optimization-based Planning of Quadrotor Trajectories according to High-Level User Goals

AuthorsC. Gebhardt*, B. Hepp*, T. Nägeli, S. Stevsic, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, 2016
* These two authors contributed equally to this work.

Teaser-Picture

DefSense: Computational Design of Customized Deformable Input Devices

AuthorsM. Bächer, B. Hepp*, F. Pece*, P. Kry, B. Bickel, B. Thomaszewski, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, 2016
* These two authors contributed equally to this work.

Teaser-Picture

Two-Stream SR-CNNs for Action Recognition in Videos

AuthorsY. Wang, J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsBritish Machine Vision Conference (BMVC), York, UK, 2016

Teaser-Picture

Duo-VIO: Fast, Light-weight, Stereo Inertial Odometry

AuthorsN. de Palezieux, T. Nägeli, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea, Oct 2016

Teaser-Picture

Omni-directional person tracking on a flying robot using occlusion-robust ultra-wideband signals

AuthorsB. Hepp*, T. Nägeli*, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea, Oct 2016
* These two authors contributed equally to this work.

Teaser-Picture

Interactive Design of 3D-printable Robotic Creatures

AuthorsV. Megaro, B. Thomaszewski, M. Nitti, O. Hilliges, M. Gross, S. Coros
In ProceedingsACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) (Volume: 34, Issue: 6), Kobe, Japan, Nov 2015

Teaser-Picture

Semi-Direct EKF-based Monocular Visual-Inertial Odometry

AuthorsP. Tanskanen, T. Nägeli, M. Pollefeys, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, Sep 2015

Teaser-Picture

Fast Blur Removal for Wearable QR Code Scanners

AuthorsG. Sörös, S. Semmler, L. Humair, O. Hilliges
In ProceedingsACM International Symposium on Wearable Computers (ISWC), Osaka, Japan, Sep 2015

Teaser-Picture

An Interactive System for Data Structure Development

AuthorsJ. Ou, M. Vechev, O. Hilliges
In ProceedingsACM Conference on Human Factors in Computing Systems (CHI), Seoul, Republic of Korea, 2015

Teaser-Picture

Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction

AuthorsJ. Song, F. Pece, G. Sörös, M. Koelle, O. Hilliges
In ProceedingsACM Conference on Human Factors in Computing Systems (CHI), Seoul, Republic of Korea, 2015