CS547 Human-Computer Interaction Seminar   (Seminar on People, Computers, and Design)

Fridays 11:30am-12:30pm PT · Gates B3 · Open to the public
Previous | Next
Yang Li
Google Research
Enabling New Input Dimensions for Mobile Interaction
February 20, 2015

Mobile interaction suffers from two fundamental issues: the small form factor of mobile devices – the device constraint – and the divided attention of users by real-world tasks – the user constraint. Meanwhile, the rich sensing capabilities of mobile and wearable devices as well as their seamless integration into our everyday activity create new opportunities for mobile interaction beyond the pointing and clicking of traditional GUIs. In this talk, I first describe how we can significantly reduce user effort in mobile interaction, at scale, by leveraging gestural input. I then describe how to empower developers to leverage these new input dimensions in their applications, such as gestural and contextual input, through new tools and frameworks. Through these systems, I will discuss how these input dimensions, though natural to the user, deeply challenge traditional interactive computing, and how we can address this challenge by providing high-level tool support.


Yang Li is a Senior Research Scientist in Human Computer Interaction and Mobile Computing at Google, and an affiliate faculty member in Computer Science & Engineering at the University of Washington. Yang’s research focuses on novel tools and methods for creating mobile interaction behaviors, particularly regarding emerging input modalities (such as gestures and cameras), cross-device interaction and predictive user interfaces. Yang wrote Gesture Search, a popular Android app for random access of mobile content using gestures. Yang develops software tool support and recognition methods by drawing insights from user behaviors, and leveraging techniques such as machine learning, computer vision and crowdsourcing to make complex tasks simple and intuitive. Some of this work has made a real world impact and benefited millions of end users and developers.