Prof. Dr. Otmar Hilliges

Prof. Dr. Otmar Hilliges

Assistant Professor of Computer Science
Advanced Interactive Technologies Lab, ETH Zürich

+41 44 632 39 56
Universitätstrasse 6, 8092 Zürich, Switzerland
ETH Zurich, Department of Computer Science, CNB, H 103.1


I'm originally from Munich, Germany where I was born and raised. Currently I'm an Assistant Professor of Computer Science (tenure-track) at ETH Zurich. I lead the AIT lab affiliated with the Institute of Pervasive Computing and the Institute of Visual Computing. Prior to joining ETH I was Researcher at Microsoft Research Cambridge, in the I3D group(2010-2013). I was awarded a Diplom (equiv. MSc) in Computer Science from Technische Universität München, Germany (Summa Cum Laude 2004) and my PhD in Computer Science from LMU München, Germany (Summa Cum Laude 2009). Following my studies, I spent two years as a postdoc at Microsoft Research Cambridge (2010-2012).

Research Interests

My research interests are centered around the computational aspects of Human-Computer-Interaction (HCI). As technologies shift computing away from the desktop, it is becoming increasingly clear that traditional means of interaction need to be replaced or complemented with new forms of input and output. My main objective is to push the boundaries of what humans can do with computers and how they interact with them.

Concretely, I am interested in machine perception of human activity, including pose estimation, gesture recognition and other forms of input sensing. Furthermore, I am interested in algorithms that can extract high-level concepts such as style and semantic meaning from observations of human activities and algorithms that continously update individualised user models (based on such data). Finally, we investigate how mathematical optimization techniques can be used to synthesize and optimize user interfaces, at design- and run-time. For example, finding optimal parametrizations of sensor-based interactive devices for a given input task or finding optimized ways to display information given the systems current best believe about the user's intention, attention and other states.

I'm interested in many different application domains such as Augmented and Virtual Reality, Human Robot Interaction and Smart Environments and more. We work in diverse areas including HCI, robotics, computer vision and computer graphics as well as in applied machine learning and numerical optimization.

CV, Research and Teaching statements

(These were in part compiled for my tenure case - I apologise for the usual boasting.)

Academic and Professional Activities


Technical Program Comittee Member

Organizing Comittee Member


I routinely review paper for ACM CHI, UIST, ITS, TEI, Ubicomp, IEEE ISMAR, 3DV as well as for many journal publications.

Selected Publications

Please see our full publications list. Also check Google Scholar, DBLP or the ACM DL.


Rig Animation with a Tangible and Modular Input Device

Authors Glauser Oliver, Wan-Chun Ma, Daniele Panozzo, Alec Jacobson, O. Hilliges, O. Sorkine
To appear in ProceedingsACM SIGGRAPH, Anaheim, CA, USA, Jul 2016


Airways: Optimization-Based Planning of Quadrotor Trajectories according to High-Level User Goals

Authors C. Gebhardt*, B. Hepp*, T. Nägeli, S. Stevsic, O. Hilliges
To appear in ProceedingsACM SIGCHI, San Jose, CA, USA, May 2016
*The first two authors contributed equally to this work.


DefSense: Computational Design of Customized Deformable Input Devices

Authors M. Bächer, B. Hepp*, F. Pece*, P. G. Kry, B. Bickel, B. Thomaszewski, O. Hilliges
To appear in ProceedingsACM SIGCHI, San Jose, CA, USA, May 2016
*These two authors contributed equally to this work.


In-air Gestures Around Unmodified Mobile Devices

Authors J. Song, G. Sörös, F. Pece, S. Fanello, S. Izadi, C. Keskin, O. Hilliges
In ProceedingsACM User Interface Software and Technology Symposium, Honolulu, Hawaii, Oct. 2014


Environment-independent Formation Flight for Micro Aerial Vehicles

Authors T. Naegeli, C. Conte, A. Domahidi, M. Morari, O. Hilliges
In ProceedingsIEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, Illinois, Sept. 2014


Tangible and Modular Input Device for Character Articulation

Authors A. Jacobson, D. Panozzo, O. Glauser, C. Pradalier, O. Hilliges, O. Sorkine
In ProceedingsACM SIGGRAPH, Vancouver, Ca, Aug 2014


Type–Hover–Swipe in 96 Bytes: A Motion Sensing Mechanical Keyboard

Authors S. Taylor, C. Keskin, O. Hilliges, S. Izadi
In ProceedingsACM Conference on Human Factors in Computing Systems (ACM SIGCHI), Toronto, Ca, Apr 2014 / Best Paper Award


Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor

Authors D. Kim, O. Hilliges, S. Izadi, A. Butler, J. Chen, I. Oikonomidis, P. Olivier
In ProceedingsACM User Interface and Software Technologies, Boston, MA, USA, Oct 2012 / runner-up Best Demo Award


HoloDesk: Direct 3D Interactions with a Situated See-Through Display

Authors O. Hilliges, D. Kim, S. Izadi, M. Weiss
In ProceedingsHuman Factors in Computing Systems (ACM CHI), Austin, Tx, USA, Apr 2012