All job evaluation systems answer the same question for employers: "Are these employees doing what we pay them to do?"
In some sectors, this is an easy enough process. If I'm paying you to sell a certain amount of product, I can run the numbers and see if you sold that much product. Anyone who has worked in some version of retail knows how this goes -- "Did you hit your numbers this week, this month, this year?"
But the tricky thing about employee evaluation systems is that they force employers to answer a question: "What do we pay these people to do?" In fact, employers answer that question whether they mean to or not, and employers have to be careful.
For instance, if you run a catalog call center, a phone bank that takes the orders that customers call in, you might decide to evaluate your employees on how many orders they take per shift. That might seem to make sense. But as some such companies have learned, there's a problem with this evaluation system. One of my many part-time jobs was at just such a call center. The folks who call in are generally older; they may speak slowly or unclearly, and in some cases you are the only human voice they have spoken to all day. But if your evaluations are based on calls-per-hour, then your call center employee is sitting there thinking, as some nice old person tries to chat pleasantly, "Lady, I am not paid to be nice to you. I am paid to take your money and get you off this phone as quickly as possible." The company that I worked for had long since figured out that this was a bad plan, that one of the things you had to pay your employees to do was, in fact, to treat the customer well. And they had to tweak their employee evaluation system to do that.
A good evaluation system is hard to develop for precisely this reason-- because when you create the system, you define the employee's job. You answer the question, "What exactly do we pay you to do, anyway?"
Which brings us to teacher evaluation systems.
You're a taxpayer. What do you think you're paying teachers to do? Maintain a safe environment? Help your child become more confident, more wise, better adjusted, happier? Help your child discover her strengths? Prepare your child to succeed as an adult? Give your child the tools for a successful career, whatever that child might choose? Maintain a personal bank of knowledge and competence that guarantees the teacher is an up-to-date knowledgeable professional? Develop your child into a well-rounded individual? Model how to develop and maintain healthy relationships? Plan, prepare, and evaluate lessons with a wise, professional focus? Support the child's growth? Nurture the child as a special individual? Push the child to learn a wide range of skills and acquire a full body of knowledge? Not waste your child's time? Develop a set of skills and growth that are unique to your child? Plus a whole long list of other things that would make this paragraph too damn long to list?
But the ed reform model reduces that list to just one item.
Get the child to score well on the Big Standardized Test.
Imagine if you were upset about something that happened with your child. She was bullied and nobody did anything about it. She wanted to do have a class to draw in, and nobody would let her. She wanted to go outside and play. The teacher had been cold and unkind to her. She was having trouble with her science experiment and nobody would help her.
You call the school. You schedule a meeting. You sit down with the principal and teacher, express your concern, and they look you in the eye and say, "Look. We appreciate your concern, but we aren't paid to do that. We're paid to make sure your child gets a good test score, and that's it. That's all you pay us to do."
Nobody would be okay with that. Nobody should be okay with that.
Yet, if we have a system that pays teachers for getting good student scores on the BS Tests, what we're saying is, "Never mind the rest of that stuff. We pay you to get good student test scores. That's what we pay you to do." Everything else is extra, unimportant, not really part of the job.
The biggest problem with linking teacher evaluation to student test results is not that it's inaccurate and invalid. The biggest problem is that these VAM-my test-driven systems redefine the job. They say to teachers, "Get in there and get test scores up. That's what we pay you to do. That's all we pay you to do."
The big sell for recruiting teachers was always, "Come touch the future. Come help mold and support young minds. Come help young people find themselves and grasp their future. Come create a love of learning as you hold up young people and help set them on a path to become more fully human, more fully themselves, ready to take their place as adults in the world." If we change that pitch to, "Come help children get better standardized test scores," can we really be surprised that fewer people feel drawn to teaching as a career?
An evaluation system must answer-- cannot help but answer-- the question, "What do you pay me to do?" Students, teachers, the entire education system-- all need a better answer than, "To get good test scores."
Originally posted at Curmudgucation