William Sanders (statistician)

From Wikipedia, the free encyclopedia

William L. Sanders (26 April 1942[1]—16 March 2017) was an American statistician, a senior research fellow with the University of North Carolina at Chapel Hill. He developed the Tennessee Value-Added Assessment System (TVAAS), also known as the Educational Value-Added Assessment System (EVAAS), a method for measuring a teacher's effect on student performance by tracking the progress of students against themselves over the course of their school career with their assignment to various teachers' classes.

Life[]

Sanders was born in 1942 in Shelbyville, Tennessee and received a bachelor of science degree in animal science (1964) and a doctorate in statistics and quantitative genetics (1968) from the University of Tennessee. From 1972 to 2000, Sanders was a statistical consultant for the Institute of Agricultural Research, which is part of the UT system; he also was an adjunct professor in the school's College of Business. Sanders left the university to join the SAS Institute.[2]

In 2015, Sanders was awarded the James Bryant Conant Award.[2]

He died on 16 March 2017 at the age of 74.[3]

Value-added assessment[]

Sanders's primary contributions, however, were in education. In 1982, Sanders happened upon a newspaper article about attempts by then-Governor Lamar Alexander to introduce merit pay for teachers, which raised questions as to the qualifications for merit. He sent a letter to the governor explaining a potential method, and while he did not use it, the idea was revived eight years later by Ned McWherter. The system depends on calculating expected versus actual growth trajectories for students as scored on standardized exams; these "value-added" scores fell into a bell curve.[3] Tennessee began using the system in 1993, and it since has been adopted by a number of other school districts across the United States.[4] Sanders' approach has been used to support the theory that the quality of teachers is central to educational achievement.

The Pennsylvania and New Hampshire Departments of Education sponsor pilots, and the sponsors his value-added work in that state. Battelle for Kids provides interpretation and use trainings for the SAS EVAAS services for the participating districts in Ohio.

“Using mixed model equations, TVAAS uses the covariance matrix from this multivariate, longitudinal data set to evaluate the impact of the educational system on student progress in comparison to national norms, with data reports at the district, school, and teacher levels."[5] The model focuses on academic gains rather than raw achievement scores.

Criticism[]

Dr. Ballou, in Lissitz (Ed.), 2005, "Value Added Models in Education: Theory and Applications," analyzed the TVAAS and determined that value added-assessment of teachers are fallible estimates of teacher contribution to student learning, stating that standard errors of value-added estimates are large. Author thinks that value added models are merely one useful tool that should be used as one of many assessments in a comprehensive system of evaluation.

Researchers from the RAND Corporation studied Dr. Sanders' method and determined that his approach does not satisfactorily account for bias, cautioning that non-educational effects may be attributed by mistake to teachers, with no way of effectively determining the magnitude of the error.[6] Ballou (2002) and Kupermintz (2003) further support this claim, claiming that non-educational factors have a noticeable impact on the evaluation of teachers despite efforts to account for them in the model.[7]

The use of merit pay based on VAM has been discredited in articles by Dan Pink[8] and more generally as a business practice in the Harvard Business Review.[9] The accuracy of VAM for evaluating individual teachers has been further discredited by the Economic Policy Institute[10] and by mathematician John Ewing.[11]

See also[]

References[]

  1. ^ "Dr. William "Bill" Sanders". The Tennessean. 18 March 2017. Retrieved 22 May 2017.
  2. ^ Jump up to: a b Young, Nadja (19 June 2015). "The man behind VAM: Bill Sanders honored for a lifetime of education service". SAS. Retrieved 22 May 2017.
  3. ^ Jump up to: a b Carey, Kevin (19 May 2017). "The Little-Known Statistician Who Taught Us to Measure Teachers". The New York Times. Retrieved 22 May 2017.
  4. ^ Braun, Henry (2005). "Using Student Progress To Evaluate Teachers: A Primer on Value-Added Models" (PDF). ETS.
  5. ^ Goldstein, Jessica; Behuniak, Peter (2005). "Growth Models in Action: Selected Case Studies". Practical Assessment, Research and Evaluation. 10 (11).
  6. ^ Daniel F. McCaffrey, Daniel Koretz, J. R. Lockwood, Laura S. Hamilton (2004). "Evaluating Value-Added Models for Teacher Accountability". RAND.CS1 maint: uses authors parameter (link)
  7. ^ "Contemporary Report" (PDF). Archived from the original (PDF) on 2007-09-27. Retrieved 2007-04-12.
  8. ^ Layton, Lyndsey (15 February 2012). "As teacher merit pay spreads, one noted voice cries, 'It doesn't work'". The Washington Post. Retrieved 22 May 2017.
  9. ^ Bruno S. Frey and Margit Osterloh (Jan–Feb 2012). "Stop Tying Pay to Performance". Harvard Business Review. Retrieved 22 May 2017.CS1 maint: uses authors parameter (link)
  10. ^ Eva L. Baker, Paul E. Barton, Linda Darling-Hammond, Edward Haertel, Helen F. Ladd, Robert L. Linn, Diane Ravitch, Richard Rothstein, Richard J. Shavelson, and Lorrie A. Shepard (29 August 2010). "Problems with the Use of Student Test Scores to Evaluate Teachers" (PDF). EPI Briefing Paper. Archived from the original (PDF) on 8 March 2016. Retrieved 22 May 2017.CS1 maint: uses authors parameter (link)
  11. ^ Ewing, John (May 2011). "Mathematical Intimidation: Driven by the Data" (PDF). Notices of the AMS. Retrieved 22 May 2017.
Retrieved from ""