Raw Data II: Student Achievement Over the Past 20 Years

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.

In my post earlier today about NAEP test score trends, I said I was pessimistic about recent educational reforms because big gains among 9-year-olds mostly seem to wash away by the time students graduate from high school. However, several commenters complained that this was unfair: high school students in 2008 had spent only a few years in the post-NCLB “reform” environment. What we really want to look at are cohort effects. How do kids who have spent their entire lives in the new environment do?

First, some background. In my initial post I used data from the NAEP long-term assessment. This has two big advantages. First, the data goes back further. Second, the long-term test has stayed more stable over time, which makes it a better standard for trend comparisons. In contrast, the main NAEP test gets rewritten every decade or so.

However, the main test still has a pretty good reputation, and it also has the advantage of providing more recent data. We don’t have 2011 scores for high school students yet, but we do have 2011 reading and math scores for 4th and 8th graders. So here are test score improvements on the main test from 1992 through 2011:

As usual, keep in mind the rule of thumb that a 10-point change on NAEP scores is about equal to one grade level.

This only goes through middle school, but it’s obviously more promising than the long-term data I posted earlier. The 4th grade gains in reading are considerably more modest than on the long-term assessment, but they persist through 8th grade. The gains in math are better than on the long-term assessment, and although some of the gains are lost by 8th grade, the dropoff isn’t huge. Note that the 1992 cohort of 8th graders is almost entirely pre-reform, even if you count state reforms that predate NCLB, while the 2011 cohort of 8th graders began first grade in 2003, so these are kids who have spent their entire school lives in post-reform schools. That makes this a pretty good comparison group.
 

Now, there are several caveats here:

  • We still don’t know how high-school students are doing. We’ll need to wait until 2015 before we have a cohort of 12th graders who have spent their entire lives in post-reform schools.
  • The data is from the main NAEP assessment. For longitudinal studies, I think the long-term assessment is probably superior.
  • As usual, you have to decide for yourself if you think scores on standardized tests are really a good measure of student achievement.

Still, caveats aside, this data clearly supports a fairly optimistic view of how our schools are doing. Keep it in mind whenever you read a mournful op-ed about our failing educational system.

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate