The differences between computer- and paper-based tests - the initial research

Is the pen mightier than the mouse?
Ben Backes and James Cowan from CALDER have published a working paper on the differences between computer- and paper-based tests.
 
In 2015, Massachusetts introduced the new PARCC assessment. Districts could choose whether to use the computer or paper versions of the test, and in 2015 and 2016, districts were divided fairly evenly between the two. The authors use this division to compare results for students in Grades 3-8.
Students who took the online version of PARCC scored about 0.10 standard deviations lower in math and about 0.25 standard deviations lower in English language arts (ELA) than students taking the paper version of the test. When students took computer tests again the following year, these differences reduced by about a third for math, and by half for ELA.
 
The study also looked at whether the change to computer tests affected some students disproportionately. There were no differences for math, but for ELA there was more of an effect on students at the bottom of the achievement distribution, English language learners, and special education students.
 
The authors point out that these differences not only have consequences for individual students, but for other decisions based on the data, including teacher and school performance measures, and the analysis of school wide programs.

Views: 102

Reply to This

JOIN SL 2.0

SUBSCRIBE TO

SCHOOL LEADERSHIP 2.0

Feedspot named School Leadership 2.0 one of the "Top 25 Educational Leadership Blogs"

"School Leadership 2.0 is the premier virtual learning community for school leaders from around the globe."

---------------------------

 Our community is a subscription-based paid service ($19.95/year or only $1.99 per month for a trial membership)  that will provide school leaders with outstanding resources. Learn more about membership to this service by clicking one of our links below.

 

Click HERE to subscribe as an individual.

 

Click HERE to learn about group membership (i.e., association, leadership teams)

__________________

CREATE AN EMPLOYER PROFILE AND GET JOB ALERTS AT 

SCHOOLLEADERSHIPJOBS.COM

New Partnership

image0.jpeg

Mentors.net - a Professional Development Resource

Mentors.net was founded in 1995 as a professional development resource for school administrators leading new teacher induction programs. It soon evolved into a destination where both new and student teachers could reflect on their teaching experiences. Now, nearly thirty years later, Mentors.net has taken on a new direction—serving as a platform for beginning teachers, preservice educators, and

other professionals to share their insights and experiences from the early years of teaching, with a focus on integrating artificial intelligence. We invite you to contribute by sharing your experiences in the form of a journal article, story, reflection, or timely tips, especially on how you incorporate AI into your teaching

practice. Submissions may range from a 500-word personal reflection to a 2,000-word article with formal citations.

© 2026   Created by William Brennan and Michael Keany   Powered by

Badges  |  Report an Issue  |  Terms of Service