QuizBot

A Dialogue-based Adaptive Learning System for Factual Knowledge

What is QuizBot?

QuizBot is an AI-powered chatbot to help college students review questions through natural-language conversations. Advances in conversational AI have the potential to enable more engaging and effective ways to teach factual knowledge. To investigate this hypothesis, we created QuizBot, a dialogue-based agent that helps students learn factual knowledge in science, safety, and English vocabulary. We evaluated QuizBot with 76 students through two within-subject studies against a flashcard app, the traditional medium for learning factual knowledge. Though both systems used the same algorithm for sequencing materials, QuizBot led to students recognizing (and recalling) over 20% more correct answers than when students used the flashcard app. Using a conversational agent is more time consuming to practice with; but in a second study, of their own volition, students spent 2.6x more time learning with QuizBot than with flashcards and reported preferring it strongly for casual learning. Our results in this second study showed QuizBot yielded improved learning gains over flashcards on recall. Our results suggest that educational chatbot systems may have beneficial use, particularly for learning outside of traditional settings.

Related Paper

QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge [Paper] [Video] [Slides] [BibTeX]
Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L. Murnane, Emma Brunskill, James A. Landay
CHI: ACM Conference on Human Factors in Computing Systems, 2019

Press

Stanford researchers have applied chatbot technology to self-paced learning and significantly improved student recall and retention over traditional flashcard-based learning.
Stanford News - Stanford University