The Jefferson Journal

Chris Braunlich



Beyond SOLs

 

Standards of Learning represented the first step in holding public schools accountable. The next step is "value added assessment" that tracks performance of individual students and teachers.


 

For three years, Governor Mark Warner has disappointed his liberal supporters and confounded conservative adversaries with his strong support of the state Standards of Learning, while advocating for more public charter schools – both creations of his Republican predecessors.

 

But while Virginia has much to be proud of in its demand for educational excellence, the time has come for the Commonwealth to lead the way in taking the next steps toward educational accountability.

 

Nothing better exemplifies this necessity than the recent teachers’ union report claiming that public charter school students perform worse than students in traditional public schools. Of course, those charter students also started lower than those in the public schools. Many had previously been dropouts, drawn back to education by a charter school that better met their needs.

 

What was missing was any analysis of “gain scores,” answering the question: How much did the students' academic performance improve over time?

 

It is a question left unanswered, not only in the teachers’ union report, but also unmeasured in the federal No Child Left Behind Act and the state Standards of Learning program. In fact, nearly every current effort to measure student performance relies on a “snapshot” of that student, and that school, at one particular moment in time. Our current system does not take into account where students begin, or adequately measure gain scores tracking a student’s performance.

 

The problems with that method are several-fold.

 

First, student populations at some schools change dramatically from year to year, particularly where there is a high military or immigrant population. In some schools, a mobility rate of 30 percent is not uncommon. This means that a school’s performance is based on shifting populations that are not there from one year to the next. Different students clearly have different performance levels.

 

Secondly, the reliance on school-wide achievement levels means that schools will, consciously or unconsciously, focus on helping those students most likely to hit the standards. As others have pointed out, our current system is “tantamount to measuring a child’s height with a yardstick but acknowledging growth only when his or her height exceeds 36 inches.” Those well above the “cutoff” are less likely to be challenged because they’ve already hit the mark; those too far below the “cutoff” are less likely to be helped because progress without passing is not measured.

 

Third, the current system cannot measure the impact of education in a single grade. A 5th grade reading examination doesn’t just measure what happened in 5th grade – it measures the cumulative impact of all the good and bad teachers and curriculum that have affected that student in grades K-4. 

 

Finally, state tests cannot measure the quality of instruction by factoring in a student’s or a school’s socio-economic status. The son of two college-educated parents in a wealthy suburban school with an inferior teacher is likely to outperform the son of a single mother on welfare in one of our inner-city schools with an excellent teacher – but it is the substandard teacher who will get the credit for doing a good job.

 

To have a true educational accountability system, we must be able to measure student improvement and the effects of not only outstanding, but also second-rate teachers and curricula. 

 

It’s time for Virginia to move toward a system of “Value-Added Assessment,” using test score data collected over a period of time to measure student performance. Such a system analyzes individual student performance, creates individual benchmarks of expected academic growth by taking into account environmental factors impacting that student’s ability to learn, and measures actual growth in a student’s learning against the expected growth from year to year.

 

Moving to this model would allow educators to measure how much an individual student has learned over a specific period of time. It would allow student data to be linked to specific teachers, thus permitting school systems to measure the effectiveness of each teacher and appropriately reward those who do a good job and sanction those who do not. And it would help policymakers and educators to better evaluate the programs they put in place, eliminating those that do not work while focusing resources on those that do.

 

Many of the components -- notably state standards, tests and curriculum alignments -- are already in place and Virginia is now in the process of creating individual identifiers for each student. The next step is to identify and create a value-added system meeting the needs of Virginia.

 

Virginia led the way in developing nationally recognized academic standards that became the envy of other states. But as the gears shift toward the 2005 state elections, candidates need to outline the next steps for educational accountability and excellence. Supporting a Value-Added model of assessment is step one.

 

-- September 7, 2004

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Chris Braunlich is a former member of the Fairfax County School Board and Vice President of the Thomas Jefferson Institute for Public Policy, the leading non-partisan public policy foundation in Virginia.

 

You can e-mail him here:

c.braunlich@att.net