More Meaningless Numbers from Virginia Educrats

bogus_numbersby James A. Bacon

In a story that generated front-page headlines, Governor Terry McAuliffe announced yesterday a “significant increase” in the number of Virginia public schools earning accreditation in 2015. The number of fully accredited schools increased by 10 percentage points to 78%.

“Offering every Virginia student a world class education in a public school is at the very foundation of our efforts to build a new Virginia economy,” the governor said. “This year’s strong progress is a reflection of the dedicated work of educators, parents and communities and a clear sign that the reforms we have put into place are working.”

“Getting challenged schools the resources they need to ensure student success is one of the most important steps we can take to improve our Commonwealth’s education system,” said Virginia Secretary of Education Anne Holton. “Every school that earned full accreditation this year is another school that is better preparing its students for a lifetime of success.”

O Frabjous day! Calooh! Callay! Maybe the educational establishment has finally figured out how to turn around Virginia’s ailing public schools! Maybe there is hope for the future!

Or maybe not. The press release was honest enough to acknowledge the following: “The 2014-2015 school year was the first during which students in grades 3-8 were allowed to retake SOL tests in reading, mathematics, science and history. On average, the performance of students on expedited retakes increased pass rates by about four points on each test.”

In other words, any comparison between 2015 results and 2014 results is likening apples to oranges.

What the press release does not tell us is how many schools this adjustment pushed over the minimum accreditation level. (“Students must achieve adjusted pass rates of at least 75 percent on English reading and writing SOL tests, and of at least 70 percent on assessments in mathematics, science and history.”) Four points on a 1-100 scale is not insignificant. Moreover, that four points is an average. It is possible, indeed probable, that the “expedited retakes” proved to be a bigger factor in improving test scores for poorly performing schools, where more students needed to retake the tests, than for strong performers.

Among the crucial data not included in the press release was the number of schools that would have been accredited had the old policy remained in place. The Virginia Department of Education did not provide the data for citizens to conduct their own analysis or draw their own conclusions.

John Butcher has been illuminating VDOE statistical prestidigitations far longer than I. As he has written on his blog, Cranky’s Blog:

The moving target moves; and having moved,
Moves on:  nor all thy piety nor wit
Shall lure it back to give an honest answer
Nor all thy tears wash away the bureaucrats’ obfuscation.

The manipulation of data is insulting. And who suffers the most from this statistical sleight of hand? Children, disproportionately from poor, African-American households, who are consigned to schools with no effective accountability, that’s who. Just another example of how the bureaucratic, statist status quo works to oppress poor people of color in Virginia. If you think there’s such a thing as “institutional racism” in this country, this is it.

Update: Cranky calculates the impact of other “adjustments” VDOE makes to the data for students with limited English proficiency and for students who have recently transferred into a Virginia public school. On the math tests, the adjustments had the felicitous effect of increasing the number of schools achieving the 70% pass rate from 1,519 to 1,627, or six percentage points.