Research Overview

Welcome to the AIT Lab where AI meets Interactive Technologies. We do research at the intersection of Machine Learning, Computer Vision and Human Computer Interaction (HCI). Our main mission is to develop new ways for humans to interact with complex interactive systems (computers, wearables, robots), powered by advanced algorithms and technologies in machine perception, planning and data driven user modelling. Please see research and publications for more information.

The AIT Lab, led by Prof. Dr. Otmar Hilliges, is within the Department of Computer Science at ETH Zurich. The group is jointly affiliated with the Institute of Visual Computing and Institute of Pervasive Computing.

Latest News

16.10.2018
Prof. Dr. Otmar Hilliges serves as General Chair at ISMAR'18
01.10.2018
Thomas Langerak joins the AIT lab. Welcome!
29.09.2018
One paper on real-time human pose estimation from sparse IMUs and one paper on a drone-based motion capture system (Flycon) accepted at SIGGRAPH Asia'18.
01.09.2018
David Lindlbauer joins the AIT lab. Welcome!
01.09.2018
Anna Feit joins the AIT lab. Welcome!
23.08.2018
Our paper on learned quadrotor obstacle avoidance is accepted to IEEE RA-L.
17.08.2018
Our paper on wearable electrostatic brakes for haptic feedback in VR is accepted at ACM UIST'18.
26.07.2018
Two papers accepted at ECCV'18.
23.05.2018
Our paper on aesthetically pleasing quadrotor camera motion is accepted at SIGGRAPH'18.
18.05.2018
Prof. Dr. Otmar Hilliges is appointed as Associate Professor. Congratulations!

Open PostDoc positions

We are currently looking for 2 post-docs with a background in either i) machine learning, bayesian optimisation, active learning, variational methods, deep-learning or related areas or ii) computer vision, graphics, robotics, numerical methods or physical simulation.

Excellent programming skills in C++ or other high-level language are expected and experience in Matlab, Python, OpenGL, or CUDA are beneficial. Fluent communication skills (written and presentation) in English are essential.

Positions are fully funded (via ERC starting grant) and are available to those of any nationality (some knowledge of German is beneficial but not essential). For more details see how to apply.


Latest Projects


2018

Teaser-Picture

Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction

AuthorsB. Hepp, M. Niessner, O. Hilliges
In ProceedingsACM Transactions on Graphics 2018 (TOG), 2018
ProjectCodePDFVideoBibTeX
Teaser-Picture

Real-time Environment-independent Multi-view Human Pose Estimation with Aerial Vehicles

AuthorsT. Nägeli, S. Oberholzer, S. Plüss, J. Alonso-Mora, O. Hilliges
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH ASIA), Tokyo, Japan, 2018
ProjectPDFVideoBibTeX
Teaser-Picture

Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time

AuthorsY. Huang*, M. Kaufmann*, E. Aksan, M. Black, O. Hilliges, G. Pons-Moll
In ProceedingsACM Transactions on Graphics, (Proc. SIGGRAPH Asia), Nov 2018
* These two authors contributed equally to this work.
ProjectCodePDFVideoBibTeX
Teaser-Picture

Sample Efficient Learning of Path Following and Obstacle Avoidance Behavior for Quadrotors

AuthorsS. Stevsic, T. Nägeli, J. Alonso-Mora, O. Hilliges
In ProceedingsIEEE Robotics and Automation Letters (Volume: 3, Issue: 4), Oct 2018
ProjectPDFVideoBibTeX
Teaser-Picture

DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake

AuthorsR. Hinchet*, V. Vechev*, H. Shea, O. Hilliges
In ProceedingsACM Symposium on User Interface Software and Technologies (UIST), Berlin, Germany, Oct 2018
* These two authors contributed equally to this work.
ProjectPDFVideoBibTeX
Teaser-Picture

Learn-to-Score: Efficient 3D Scene Exploration by Predicting View Utility

AuthorsB. Hepp, D. Dey, S. Sinha, A. Kapoor, N. Joshi, O. Hilliges
In ProceedingsEuropean Conference on Computer Vision (ECCV), Munich, Germany, 2018
ProjectPDFVideoBibTeX
Teaser-Picture

Deep Pictorial Gaze Estimation

AuthorsS. Park, A. Spurr, O. Hilliges
In ProceedingsEuropean Conference on Computer Vision (ECCV), Munich, Germany, 2018
ProjectPDFVideoBibTeX
Teaser-Picture

Optimizing for Aesthetically Pleasing Quadrotor Camera Motion

AuthorsC. Gebhardt, S. Stevsic, O. Hilliges
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH) (Volume: 37, Issue: 4), August 2018
ProjectPDFVideoBibTeX
Teaser-Picture

Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

AuthorsS. Park, X. Zhang, A. Bulling, O. Hilliges
In ProceedingsACM Symposium on Eye Tracking Research and Applications (ETRA), Warsaw, Poland, 2018

Best Presentation Award
ProjectCodePDFVideoBibTeX
Teaser-Picture

Cross-modal Deep Variational Hand Pose Estimation

AuthorsA. Spurr, J. Song, S. Park, O. Hilliges
In ProceedingsCVPR, Salt Lake City, USA, 2018

Accepted as Spotlight Presentation
ProjectCodePDFVideoBibTeXVideo
Teaser-Picture

WYFIWYG: Investigating Effective User Support in Aerial Videography

AuthorsC. Gebhardt, O. Hilliges
In ProceedingsarXiv:1801.05972, 2018
ProjectPDFVideoBibTeX
Teaser-Picture

DeepWriting: Making Digital Ink Editable via Deep Generative Modeling

AuthorsE. Aksan, F. Pece, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, Montréal, Canada, 2018

Honorable Mention Best Paper Award
ProjectCodePDFVideoBibTeX
Teaser-Picture

AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time

AuthorsS. Park, C. Gebhardt*, R. Rädle*, A. Feit, H. Vrzakova, N. Dayama, H. Yeo, C. Klokmose, A. Quigley, A. Oulasvirta, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, Montréal, Canada, 2018
* These two authors contributed equally to this work.
ProjectCodePDFVideoBibTeX

2017

Teaser-Picture

Learning Human Motion Models for Long-term Predictions

AuthorsP. Ghosh, J. Song, E. Aksan, O. Hilliges
In Proceedings3D Vision (3DV), 2017 International Conference on, 2017

Best Paper Award
ProjectCodePDFVideoBibTeX
Teaser-Picture

MagTics: Flexible and Thin Form Factor Magnetic Actuators for Dynamic and Wearable Haptic Feedback

AuthorsF. Pece*, J. Zarate*, V. Vechev, N. Besse, O. Gudozhnik, H. Shea, O. Hilliges
In ProceedingsACM Symposium on User Interface Software and Technologies (UIST), Quebec City, Canada, Oct 2017
* These two authors contributed equally to this work.

Honorable Mention Best Paper Award
ProjectPDFVideoBibTeX
Teaser-Picture

Real-time Planning for Automated Multi-View Drone Cinematography

AuthorsT. Nägeli, L. Meier, A. Domahidi, J. Alonso-Mora, O. Hilliges
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH), Los Angeles, USA, 2017
ProjectPDFBibTeX
Teaser-Picture

Guiding InfoGAN with Semi-Supervision

AuthorsA. Spurr, E. Aksan, O. Hilliges
In ProceedingsECML PKDD, Skopje, Macedonia, 2017
ProjectCodePDFBibTeX
Teaser-Picture

Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videos

AuthorsJ. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsCVPR, Hawaii, USA, 2017

Accepted as oral presentation
ProjectPDFVideoVideoBibTeX
Teaser-Picture

Real-time Motion Planning for Aerial Videography with Dynamic Obstacle Avoidance and Viewpoint Optimization

AuthorsT. Nägeli, J. Alonso-Mora, A. Domahidi, D. Rus, O. Hilliges
In ProceedingsIEEE Robotics and Automation Letters (Volume: 2, Issue: 3), July 2017
ProjectPDFVideoBibTeX

2016

Teaser-Picture

Duo-VIO: Fast, Light-weight, Stereo Inertial Odometry

AuthorsN. de Palezieux, T. Nägeli, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea, Oct 2016
ProjectPDFVideoBibTeXVideo
Teaser-Picture

Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

AuthorsS. Wang*, J. Song*, J. Lien, I. Poupyrev, O. Hilliges
In ProceedingsACM Symposium on User Interface Software and Technologies (UIST), Tokyo, Japan, Oct 2016
* These two authors contributed equally to this work.
ProjectPDFVideoBibTeX
Teaser-Picture

Two-Stream SR-CNNs for Action Recognition in Videos

AuthorsY. Wang, J. Song, L. Wang, L. Van Gool, O. Hilliges
In ProceedingsBritish Machine Vision Conference (BMVC), York, UK, 2016
PDFBibTeX
Teaser-Picture

Omni-directional person tracking on a flying robot using occlusion-robust ultra-wideband signals

AuthorsB. Hepp*, T. Nägeli*, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea, Oct 2016
* These two authors contributed equally to this work.
ProjectPDFVideoBibTeX
Teaser-Picture

Rig Animation with a Tangible and Modular Input Device

AuthorsO. Glauser, W. Ma, D. Panozzo, A. Jacobson, O. Hilliges, O. Sorkine-Hornung
In ProceedingsACM Transactions on Graphics (Proceedings of ACM SIGGRAPH), Anaheim, CA, USA, Jul 2016
ProjectPDFVideoBibTeX
Teaser-Picture

Airways: Optimization-based Planning of Quadrotor Trajectories according to High-Level User Goals

AuthorsC. Gebhardt*, B. Hepp*, T. Nägeli, S. Stevsic, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, 2016
* These two authors contributed equally to this work.
ProjectPDFVideoBibTeX
Teaser-Picture

DefSense: Computational Design of Customized Deformable Input Devices

AuthorsM. Bächer, B. Hepp*, F. Pece*, P. Kry, B. Bickel, B. Thomaszewski, O. Hilliges
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, 2016
* These two authors contributed equally to this work.
ProjectPDFVideoBibTeX

The Effect of Richer Visualizations on Code Comprehension

AuthorsD. Asenov, O. Hilliges, P. Müller
In ProceedingsSIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, May 2016
PDFBibTeX

2015

Teaser-Picture

Interactive Design of 3D-printable Robotic Creatures

AuthorsV. Megaro, B. Thomaszewski, M. Nitti, O. Hilliges, M. Gross, S. Coros
In ProceedingsACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) (Volume: 34, Issue: 6), Kobe, Japan, Nov 2015
ProjectPDFVideoBibTeX
Teaser-Picture

Semi-Direct EKF-based Monocular Visual-Inertial Odometry

AuthorsP. Tanskanen, T. Nägeli, M. Pollefeys, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, Sep 2015
PDFVideoBibTeX
Teaser-Picture

Fast Blur Removal for Wearable QR Code Scanners

AuthorsG. Sörös, S. Semmler, L. Humair, O. Hilliges
In ProceedingsACM International Symposium on Wearable Computers (ISWC), Osaka, Japan, Sep 2015
PDFBibTeX
Teaser-Picture

An Interactive System for Data Structure Development

AuthorsJ. Ou, M. Vechev, O. Hilliges
In ProceedingsACM Conference on Human Factors in Computing Systems (CHI), Seoul, Republic of Korea, 2015
ProjectPDFVideoBibTeX
Teaser-Picture

Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction

AuthorsJ. Song, F. Pece, G. Sörös, M. Koelle, O. Hilliges
In ProceedingsACM Conference on Human Factors in Computing Systems (CHI), Seoul, Republic of Korea, 2015
ProjectPDFVideoBibTeX