Research Stanford HCI Group

Scaling Peer and Self Assessment

Creative fields like design are burgeoning. So are project-based learning approaches. However, providing feedback and assessment of design and other creative work is extremely time consuming -- this bottleneck is the major capacity constraint for scaling peer assessment. Given that assessment and feedback are central to learning, how might we address this?

This spring, we collaborated with Coursera to launch the first massive-scale class with self and peer assessment. We leveraged the self-assessment materials (like grading rubrics) that I’ve created and refined for my intro HCI class over the past several years. For peer assessment, we built on a technique called calibrated peer assessment where students learn grading rubrics through training examples and then grade peers. In our first experimental class, http://hci-class.org, students anonymously graded 5 of their peers’ assignments -- and then their own. My experience has been that students get a lot out of assessing their own work. And while there’s a bit of gaming the system (which often usefully attune students), there’s a lot of earnest and frank reflection and assessment that I think it tremendously valuable -- and increases students maturity. Students also do remarkably well.

Tech Reports & Talks

Peer & Self Assessment: How & WhyScott R Klemmer. , 2013
Scaling Studio CritiqueScott R Klemmer and Chinmay Kulkarni. MIT CSAIL, 2012
Scaling studio critique: success, bruises, and future directionsScott R Klemmer. Crowdsourcing Personalized Online Education, 2012   VIDEO   SLIDES   TRANSCRIPT
Our experience with self-assessment and peer critique in design educationChinmay Kulkarni, Scott R Klemmer. Tech Report, 2012

Resources

Lecture Videos
Rubrics
Community Site for HCI Instructors
Data Analysis Code (Join mailing list)

People

Scott Klemmer
Chinmay Kulkarni
Kathryn Papadopoulos
Coursera