CS547 Human-Computer Interaction Seminar   (Seminar on People, Computers, and Design)

Fridays 11:30am-12:30pm PT · Gates B3 · Open to the public
Previous | Next
Cynthia Bennett
Google PAIR
Towards Respectful Representation of People in Text Descriptions of Visual Information
June 2, 2023

An approach to increasing nonvisual access to information for people who are blind or low vision is artificial intelligence (AI), which promises automation and scalability. However, research and media reports continue to illuminate AI-bias and malicious applications. As these harms tend to impact people who already experience marginalization, the ethics of applying AI to solve perennial accessibility challenges is complicated. This impact is compounded by the conversational communication style of recent generative AI advancements, which may make false information read as convincing to audiences who experience accessibility barriers to confirming ground truth (e.g., people who are blind or low vision may not be able to decide whether an AI-generated image description is accurate since the description remediates fundamental access).

In this talk I will overview one project I led concerning one facet of information accessibility—how people are represented in human and AI-generated alternative (alt) text descriptions. I will share findings from interviews I conducted with blind people who rely on alt text to understand visual information and who also identified as a minoritized race or gender shown to be disproportionately misrepresented and harmed by algorithmic decision-making. From their experiences and perspectives, triangulated with recent disability activism and artistic visual description movements, I synthesized human representation alt text design considerations. I will conclude the talk with brief windows into my current research and collaborations which explores how context might be represented in datasets, towards richer and more situated alt text.


Dr. Cynthia (Cindy) Bennett is a Senior Research Scientist in Google's Responsible AI and Human-Centered Technology organization. Her research concerns the intersection of AI ethics and disability. Bennett is regularly invited to speak; recent hosts include Stanford University's Center for Spatial and Textual Analysis (2022) and Apple's Worldwide Developers Conference (2021). Previously, Bennett has worked at Carnegie Mellon University, Apple, and the University of Washington. Her work has received grant funding from Microsoft Research and the National Science Foundation, and eight of her peer reviewed publications have received awards. Bennett is a disabled woman scholar working in the tech and academic sectors, and she regularly volunteers to continue raising participation of people systemically excluded from STEM. She welcomes people to check out her website at www.bennettc.com