← Back to Publications
RESEARCH SPOTLIGHT · 2007 · ORIGIN STORY

A Web-Based System Built for Peer Review, Not Retrofitted for It

This paper describes SWoRD: the reciprocal peer review system Cho and Schunn built at the University of Pittsburgh, which was later licensed, renamed, and commercialized as Peerceptiv.

Cho, K., Schunn, C. D. (2007). "Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system." Computers and Education, 48(3), 409–426.

The Question

Large content courses, where writing is critical but rarely feasible to assign, needed a system that could support the full cycle of writing, review, back-review, and rewriting at scale. This paper asks how to design that system so multi-peer review actually produces reliable results despite the normal drawbacks of reciprocal peer review — variation in reviewer motivation and ability chief among them.

The Study

Cho and Schunn describe SWoRD (Scaffolded Writing and Rewriting in the Discipline), the web-based reciprocal peer review system they built at the University of Pittsburgh's Learning Research and Development Center. SWoRD scaffolds the full journal-publication cycle — write, review, back-review, rewrite — as its authentic practice model, and includes algorithms that compute each reviewer's accuracy to counteract variation in reviewer quality.

What They Found

SWoRD's core design — multiple peer reviewers, structured rubrics, and accuracy-tracking algorithms — addressed the practical drawbacks that had limited reciprocal peer review at scale. Introduced in 2002, SWoRD was licensed and renamed Peerceptiv in 2015; it has been used by hundreds of thousands of students since.

What This Means for Workforce Learning

This paper is the direct origin story: every study on this site that references improvements to "Peerceptiv" or its reviewer-accountability algorithms is, at the architecture level, describing features first specified here. When Peerceptiv talks about structured, accountable peer review, it is describing a design lineage with two decades of iteration behind it, not a new product built on general assumptions about feedback.

Christian D. Schunn, PhD
Peerceptiv Chief Learning Scientist

Chris Schunn co-designed SWoRD, the system described in this paper, which was renamed Peerceptiv in 2015 and remains the platform Peerceptiv runs today. He is a Professor of Psychology, Learning Sciences and Policy, and Intelligent Systems at the University of Pittsburgh and a Senior Scientist at the University's Learning Research and Development Center (LRDC), where he has directed research projects backed by more than $80M in federal grants. As Peerceptiv's Chief Learning Scientist, his research directly shapes how the platform structures reviewer prompts, rubrics, and feedback workflows.