Smart Primer

A Narrative-based Intelligent Tutoring System for Children

What is the idea behind Smart Primer?

The Smart Primer is an interactive, narrative-based tutor that combines some of the best features of both physical- and electronic-based learning methods. The personalized narratives are based on each child’s physical surroundings as well as their current abilities. This system, inspired by Neal Stephenson’s groundbreaking science-fiction novel The Diamond Age, turns a tablet computer into a smart personal tutor.

In the Smart Primer, the narrative is interspersed with interactive problems that are tied directly into the story. The underlying tutoring algorithm will understand the child’s skill level, reactions, and emotions, and use this to give the child the right problems to solve at the right time. These activities are often driven by the location of the child (e.g., in their backyard) or the availability of other objects in their environment (e.g., fruit from their home). We also use NLP-based chatbots to scale up interaction and feedback for more personalized interaction. More importantly, the narrative tutor will leverage constructive learning techniques to build knowledge based on exercises that take place in the physical world, not simply behind a screen. Our initial focus will be on creating stories that help students develop skills in science, computing, mathematics, reading, and writing.

Related paper

Supporting Children's Math Learning with Feedback-Augmented Narrative Technology [Paper] [BibTeX] [Video]
Sherry Ruan, Jiayu He, Rui Ying, Jonathan Burkle, Dunia Hakim, Anna Wang, Yufeng Yin, Lily Zhou, Qianyao Xu, Abdallah AbuHashem, Griffin Dietz, Elizabeth Murnane, Emma Brunskill, James A. Landay
ACM Interaction Design and Children (IDC) conference, 2020

What is the initial demo about?

The application revolves around a story in which the user and an adorable chipmunk, named Tangerine, are the main characters. The two of them are famous detectives in the magical world Diamondoid. From time to time, they are contacted by residents of Diamondoid who are in need of their help. In order to help them, the user needs to solve tasks that requires the use of math, science, and English. To solve the tasks, the user and Tangerine communicate and work together through a chat interface.

Our goal is to eventually build a smart and adaptive system in which the story and tasks adapt to the user’s skill set and preferences.

Poster

The initial version of the Smart Primer system was designed and developed by Sherry Ruan, Dunia Hakim, Yufeng Yin, Anna Wang, and Justin Xu. The poster below presents the key features of the system.