Paying Teachers for Student Test Scores Damages Schools and Undermines Learning
Subject: K-12 Testing
FairTest Issue: Nov 2009
Independent researchers have found that evaluating and paying teachers for test scores is either damaging or irrelevant to improved learning. Unfortunately, even evidence of harm does not seem to affect the growing popularity of such schemes. Policymakers, including U.S. Education Secretary Arne Duncan, should stop promoting this failed approach. This new FairTest fact sheet summarizes the evidence on why payment for test scores has not and will not improve teaching, learning and schools.
-----
Read the FairTest Fact Sheet in this message or follow the link to read the Fact Sheet on-line with linked footnotes and references. The Fact Sheet is also attached in pdf. format.
Click to view attachment
-----
Paying for higher test scores results in score inflation, not genuine learning. Researchers have extensively documented test score inflation under the widely criticized No Child Left Behind (NCLB) and similar state programs (Koretz, 2009; Madaus, Russell & Higgins, 2009; Nichols & Berliner, 2007). Paying Wall Street executives for short-term monetary results contributed to the financial bubble and its subsequent collapse. Similarly, payment for test scores will intensify the existing trend toward inflating results (the bubble, caused by extensive teaching to the test) without improving real learning (the collapse, visible when students enter college or the workforce unprepared).
Payment for "performance" will exacerbate damage to the curriculum caused by NCLB. Schools add time and effort to the tested subjects of math and reading, then subtract it from other important areas including social studies, science, art, music, and gym. If all teachers are paid for the school's math and reading scores, this will further narrow the curriculum. In Texas, for example, science and history teachers have been forced to teach math and reading. (See McMurrer, 2007; Au, 2007; Morton & Dalton, 2007.)
It is unfair and ineffective to pay teachers for test results often marred by scoring and other errors. Testing companies are reaping huge profits but scrambling to manage the testing explosion triggered by NCLB. This has resulted in increased scoring errors and test construction problems (Rhoades & Madaus, 2003). Human scorers are often low-paid and poorly trained temporary workers who spend a few minutes making decisions with far-reaching effects for students and teachers (Farley, 2009). Students and teachers should not have their fates determined by flawed and unreliable data.
Payment for gains in student scores does not solve the problem of test-induced educational damage. There are too many flaws in "growth" or "value added" mechanisms to trust the results. Researchers at RAND concluded that "the research base is currently insufficient to support the use of [value-added methods] for high-stakes decisions about individual teachers or schools" (McCaffrey, et al., 2005; see also, Bracey, 2007). A National Research Council (2009) evaluation came to the same conclusion.
Payment for test scores may not even to raise student scores. A study in Portugal found that a focus on evaluating individual teacher performance caused a significant decline in student scores on the national exams (Martins, 2009). An extensive payment for scores program in low-income Texas districts failed to produce gains in student scores on the state test (Springer, Podgursky & Lewis, 2009). This is despite the extensive evidence of score inflation from teaching the test.
Most teachers' primary motivation is not high pay. If it were, they would have chosen another profession. Teachers know test scores are a poor barometer of their abilities, so pay for performance damages rather than enhances their sense of professionalism and morale (Whitford & Jones, 2000; Nichols & Berliner, 2007). It can decrease motivation (Ryan and LaGuardia, 1999). Payment for "performance" also has been shown to increase cheating (Pfeffer, 2007).
Paying individual teachers for student scores encourages unhealthy competition. Cooperation among educators is critical to school improvement and student growth, as it is in many fields (Pfeffer, 2007), but paying individual teachers for score gains can reduce cooperation as teachers compete for limited bonuses (MacInnes, 2009). Even paying bonuses to schools can cause divisions among staff and with parents (FairTest Examiner, 1997).
Pay for "performance" causes goal distortion in other occupations in both public and private sectors. For example, when Medicare tried to evaluate providers based on the mortality rates of their open heart surgeries, some refused to operate on the sickest patients. The U.S. General Accounting Office reviewed the system and concluded that it encouraged organizations to focus resources on that which is measured: "Areas that are not highlighted in report cards will be ignored." In part because of its poor track record, payment for results is now rare in most professions. It remains common in real estate and finance (two economic bubble areas), but even there does not produce improved results (Adams, Heywood & Rothstein, 2009).
Overall, research on pay for performance finds that it rests on dubious assumptions and lacks evidence it succeeds, while there is good evidence it often fails. In testimony to the U.S. House of Representatives, Pfeffer (2007) reported that pay for performance systems often "effectively motivate the wrong behavior," increased pay differentiation "lowers performance," and the schemes eat up management time while they "make everybody unhappy."
Secretary Duncan has defended payment for scores requirements in the "Race to the Top" federal fund, claiming it will only be one "significant" part of the overall evaluation of teachers. However, he has proposed no limits on the weight to be given to test scores, nor has he adequately considered the evidence summarized in this fact sheet.
While payment for test-scores must be stopped, improving the quality of teaching is central to genuine school reform. This requires ongoing professional learning and development of a well-designed evaluation system whose primary purpose is to improve teaching, but which would address chronically inadequate teachers. Student learning would be included in evaluations, but test scores would be only one small part of multiple indicators of student learning, which in turn should be one component of teacher (or principal) evaluation.