Research Overview

Welcome to the AIT Lab where AI meets Interactive Technologies. We do research at the intersection of Machine Learning, Computer Vision and Human Computer Interaction (HCI). Our main mission is to develop new ways for humans to interact with complex interactive systems (computers, wearables, robots), powered by advanced algorithms and technologies in machine perception, planning and data driven user modelling. Please see research and publications for more information.

The AIT Lab, led by Prof. Dr. Otmar Hilliges, is within the Departement of Computer Science at ETH Zurich. The group is jointly affiliated with the Institute of Visual Computing and Institute of Pervasive Computing.

Latest News

30.03.2017
Two papers accepted at ACM SIGGRAPH and IEEE CVPR.
18.01.2017
Journal paper accepted for IEEE Robotics & Automation Letters (RA-L) presentation at IEEE ICRA.
21.12.2016
We are hiring!
15.12.2016
Otmar Hilliges receives an ERC starting grant.
19.09.2016
C++/Python code for UWB tracking on GitHub.
19.09.2016
Fast Random Forest library on GitHub.
04.07.2016
Three new papers conditionally accepted at ACM UIST 2016 and at IEEE IROS.
21.03.2016
One paper accepted at ACM SIGGRAPH 2016.

Open PhD and PostDoc positions

We are currently looking for motivated and creative PhD students who are eager to get involved in cutting edge research in the areas of interactive machine learning, machine perception and numerical optimization for UI synthesis.

We are also looking for 2 post-docs with a back ground in either i) machine learning, bayesian optimisation, active learning, variational methods, deep-learning or related areas or ii) computer vision, graphics, robotics, numerical methods or physical simulation.

Excellent programming skills in C++ or other high-level language are expected and experience in Matlab, Phython, OpenGL, or CUDA are beneficial. Fluent communication skills (written and presentation) in English are essential.

Positions are fully funded (via ERC starting grant) and are available to students of any nationality (some knowledge of German is beneficial but not essential). For more details see how to apply.


Latest Projects


Teaser-Picture

Real-time Motion Planning for Aerial Videography with Dynamic Obstacle Avoidance and Viewpoint Optimization

Authors T. Nägeli, Javier Alonso-Mora, Alexander Domahidi, Daniela Rus, O. Hilliges
In ProceedingsIEEE Robotics and Automation Letters ( Volume: PP, Issue: 99 )

Teaser-Picture

Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

Authors Saiwen Wang*, J. Song*, Jamie Lien, Ivan Poupyrev, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Tokyo, Japan, Oct. 2016
*The first two authors contributed equally to this work.

Teaser-Picture

Rig Animation with a Tangible and Modular Input Device

Authors Glauser Oliver, Wan-Chun Ma, Daniele Panozzo, Alec Jacobson, O. Hilliges, O. Sorkine
In ProceedingsACM SIGGRAPH, Anaheim, CA, USA, Jul 2016

Teaser-Picture

Airways: Optimization-Based Planning of Quadrotor Trajectories according to High-Level User Goals

Authors C. Gebhardt*, B. Hepp*, T. Nägeli, S. Stevsic, O. Hilliges
In ProceedingsACM SIGCHI, San Jose, CA, USA, May 2016
*The first two authors contributed equally to this work.

Teaser-Picture

DefSense: Computational Design of Customized Deformable Input Devices

Authors M. Bächer, B. Hepp*, F. Pece*, P. G. Kry, B. Bickel, B. Thomaszewski, O. Hilliges
In ProceedingsACM SIGCHI, San Jose, CA, USA, May 2016
*These two authors contributed equally to this work.

Teaser-Picture

Two-Stream SR-CNNs for Action Recognition in Videos

Authors Yifan Wang, J. Song, Limin Wang, Luc Van Gool, O. Hilliges
In BMVC, York, UK, 2016

Teaser-Picture

Duo-VIO: Fast, Light-weight, Stereo Inertial Odometry

Authors N. De Palezieux, T. Nägeli*, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems, Daejeon, South Korea, 2016

Teaser-Picture

Omni-directional person tracking on a flying robot using occlusion-robust ultra-wideband signals

Authors B. Hepp*, T. Nägeli*, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems, Daejeon, South Korea, 2016
*The first two authors contributed equally to this work.

Teaser-Picture

Interactive Design of 3D-Printable Robotic Creatures

Authors V. Megaro, B. Thomaszewski (Disney Research Zurich), M. Nitti (Disney Research Zurich), O. Hilliges, M. Gross, S. Coros (CMU)
In ProceedingsACM SIGGRAPH Asia, Kobe, Japan, Nov 2015

Teaser-Picture

Semi-Direct EKF-based Monocular Visual-Inertial Odometry

Authors P. Tanskanen, T. Naegeli, M. Pollefeys, O. Hilliges,
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems, Hamburg, Ger, Sept. 2015

Teaser-Picture

Fast Blur Removal for Wearable QR Code Scanners

Authors G. Sörös, S. Semmler, L. Humair, O. Hilliges
In ProceedingsACM ISWC, Osaka, Japan, Sep. 2015

Teaser-Picture

An Interactive System for Data Structure Development

Authors J. Ou M. Vechev, O. Hilliges
In ProceedingsACM SIGCHI, Seoul, South Korea, Apr. 2015

Teaser-Picture

Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction

Authors J. Song, F. Pece, G. Sörös, M. Koelle, O. Hilliges
In ProceedingsACM SIGCHI, Seoul, South Korea, Apr. 2015

Teaser-Picture

In-air Gestures Around Unmodified Mobile Devices

Authors J. Song, G. Sörös, F. Pece, S. Fanello, S. Izadi, C. Keskin, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Honolulu, Hawaii, Oct. 2014

Teaser-Picture

Environment-independent Formation Flight for Micro Aerial Vehicles

Authors T. Naegeli, C. Conte, A. Domahidi, M. Morari, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, Illinois, Sept. 2014

Teaser-Picture

Tangible and Modular Input Device for Character Articulation

Authors A. Jacobson, D. Panozzo, O. Glauser, C. Pradalier, O. Hilliges, O. Sorkine
In ProceedingsACM SIGGRAPH, Vancouver, Ca, Aug 2014

Teaser-Picture

Type–Hover–Swipe in 96 Bytes: A Motion Sensing Mechanical Keyboard

Authors S. Taylor, C. Keskin, O. Hilliges, S. Izadi
In ProceedingsACM Conference on Human Factors in Computing Systems (ACM SIGCHI), Toronto, Ca, Apr 2014 / Best Paper Award