CS547 Human-Computer Interaction Seminar   (Seminar on People, Computers, and Design)

Fridays 11:30am-12:30pm PT · Gates B3 · Open to the public
Previous | Next
Zoya Bylinskii
Adobe Research
Why does where people look matter? Applications of visual attention modeling
January 14, 2022

Knowing where people look has attracted the attention of many interdisciplinary scientists, with applications in computer vision, visualization, user interface and graphic design. Individual eye fixation patterns can hold clues to the intention and state of mind of the user; while pooling the eye movements of a group of individuals can reveal patterns in images and videos to help prioritize visual content for image processing and graphic design applications. I will motivate some of the automatic applications possible when computational models of visual attention are available. These include image and video cropping, as well as graphic design retargeting and reflow. At the heart of these applications and models are datasets of human visual attention patterns, many collected without explicit eye tracking, instead using a variety of crowdsourcing techniques. This talk will feature the data collection interfaces, models, and applications of human eye movements to natural images, graphic designs, visualizations, and written text.


Zoya Bylinskii is a Research Scientist in the Creative Intelligence Lab at Adobe Research as of 2018, and an affiliate at the Massachusetts Institute of Technology. Previously, Zoya was affiliated with the Harvard Institute of Applied Computational Science, where she advised masters theses (2019-2020). Zoya received her Computer Science Ph.D. and M.Sc. from MIT in 2018 and 2015, writing theses on multi-modal document understanding and image memorability, respectively. Prior was an Hon. B.Sc. in Computer Science and Statistics, with a focus on Artificial Intelligence, from the University of Toronto in 2012. Zoya has always been attracted to interdisciplinary topics at the cross-section of human perception & cognition, artificial intelligence, and human-computer interaction, including image memorability, visual attention, and most recently, readability.