CS547 Human-Computer Interaction Seminar   (Seminar on People, Computers, and Design)

Fridays 11:30am-12:30pm PT · Gates B3 · Open to the public
Previous | Next
Tobias Gerstenberg
Going beyond the here and now: Counterfactual simulation in human cognition
April 14, 2023

As humans, we spend much of our time going beyond the here and now. We dwell on the past, long for the future, and ponder how things could have turned out differently. The capacity to simulate counterfactual possibilities is an important feat of human cognition. Counterfactuals are critical for how people make causal judgments, how they explain what happened, and how they hold others responsible for their actions. To simulate counterfactuals, we need three key ingredients: a generative mental model of the world, the ability to perform counterfactual interventions on that model, and the capacity to simulate what the consequences of these interventions would have been. I introduce the counterfactual simulation model (CSM) which incorporates these ingredients and applies them to capturing people's intuitive understanding of the physical and psychological world. In the physical domain, the CSM predicts people's causal judgments about a variety of physical scenes, including dynamic collision events, complex situations that involve multiple causes, omissions as causes, and causal responsibility for a system's stability. It also captures the cognitive processes that underlie these judgments as revealed by spontaneous eye-movements. People not only look at what actually happened; they spontaneously simulate whether the outcome in the counterfactual situation would have been different. In the psychological domain, the CSM explains what agent's actions made a difference to the outcome, whether one agent helped or hindered another, and how responsible different agents are for a joint outcome. Together these results demonstrate that much of human thought can be understood as cognitive operations over mental models, and that counterfactual simulation, in particular, plays a critical role in how humans make sense of the world.


Tobias Gerstenberg is an Assistant Professor of Psychology at Stanford University. He leads the Causality in Cognition Lab. The CiCL studies the role of causality in people's understanding of the world, and of each other. Professor Gerstenberg's research is highly interdisciplinary. It combines ideas from philosophy, linguistics, computer science, and the legal sciences to better understand higher-level cognitive phenomena such as causal inferences and moral judgments. The CiCL's research uses a variety of methods that include computational modeling, online experiments, eye-tracking experiments, as well as developmental studies with children. Professor Gerstenberg's work has appeared in top journals including Psychological Review, Journal of Experimental Psychology: General, Psychological Science, Cognitive Psychology, Cognition, and Cognitive Science.