Evaluating New York Teachers, Perhaps the Numbers Do Lie

A statistical model the school system uses in calculating the effectiveness of teachers.



No one at the Lab Middle School for Collaborative Studies works harder than Stacey Isaacson, a seventh-grade English and social studies teacher. She is out the door of her Queens home by 6:15 a.m., takes the E train into Manhattan and is standing out front when the school doors are unlocked, at 7. Nights, she leaves her classroom at 5:30.

Chang W. Lee/The New York Times

Though her principal praised her work, Stacey Isaacson received a poor ranking in a statistical model used by New York City schools to evaluate teachers.

“She’s very dedicated,” said Tejal Bahtt, a fellow teacher. “She works way harder than I work. Yesterday I punched in at 7:10 and her time card was already there.”

Last year, when Ms. Isaacson was on maternity leave, she came in one full day a week for the entire school year for no pay and taught a peer leadership class.

Her principal, Megan Adams, has given her terrific reviews during the two and a half years Ms. Isaacson has been a teacher. “I know that this year had its moments of challenge — you always handled it with grace and presence,” the principal wrote on May 4, 2009. “You are a wonderful teacher.”

On the first day of this school year, the principal wrote, “I look forward to being in your classroom and seeing all the great work you do with your students,” and signed it with a smiley face.

The Lab School has selective admissions, and Ms. Isaacson’s students have excelled. Her first year teaching, 65 of 66 scored proficient on the state language arts test, meaning they got 3’s or 4’s; only one scored below grade level with a 2. More than two dozen students from her first two years teaching have gone on to Stuyvesant High School or Bronx High School of Science, the city’s most competitive high schools.

“Definitely one of a kind,” said Isabelle St. Clair, now a sophomore at Bard, another selective high school. “I’ve had lots of good teachers, but she stood out — I learned so much from her.”

You would think the Department of Education would want to replicate Ms. Isaacson — who has degrees from the University of Pennsylvania and Columbia — and sprinkle Ms. Isaacsons all over town. Instead, the department’s accountability experts have developed a complex formula to calculate how much academic progress a teacher’s students make in a year — the teacher’s value-added score — and that formula indicates that Ms. Isaacson is one of the city’s worst teachers.

According to the formula, Ms. Isaacson ranks in the 7th percentile among her teaching peers — meaning 93 per cent are better.

This may seem disconnected from reality, but it has real ramifications. Because of her 7th percentile, Ms. Isaacson was told in February that it was virtually certain that she would not be getting tenure this year. “My principal said that given the opportunity, she would advocate for me,” Ms. Isaacson said. “But she said don’t get your hopes up, with a 7th percentile, there wasn’t much she could do.”

That’s not the only problem Ms. Isaacson’s 7th percentile has caused. If the mayor and governor have their way, and layoffs are no longer based on seniority but instead are based on the city’s formulas that scientifically identify good teachers, Ms. Isaacson is pretty sure she’d be cooked.

She may leave anyway. She is 33 and had a successful career in advertising and finance before taking the teaching job, at half the pay.

“I love teaching,” she said. “I love my principal, I feel so lucky to work for her. But the people at the Department of Education — you feel demoralized.”

How could this happen to Ms. Isaacson? It took a lot of hard work by the accountability experts.

Everyone who teaches math or English has received a teacher data report. On the surface the report seems straightforward. Ms. Isaacson’s students had a prior proficiency score of 3.57. Her students were predicted to get a 3.69 — based on the scores of comparable students around the city. Her students actually scored 3.63. So Ms. Isaacson’s value added is 3.63-3.69.

What you would think this means is that Ms. Isaacson’s students averaged 3.57 on the test the year before; they were predicted to average 3.69 this year; they actually averaged 3.63, giving her a value added of 0.06 below zero.

Wrong.

These are not averages. For example, the department defines Ms. Isaacson’s 3.57 prior proficiency as “the average prior year proficiency rating of the students who contribute to a teacher’s value added score.”

Right.

Those 32 variables are plugged into a statistical model that looks like one of those equations that in “Good Will Hunting” only Matt Damon was capable of solving.

 

The calculation for Ms. Isaacson’s 3.69 predicted score is even more daunting. It is based on 32 variables — including whether a student was “retained in grade before pretest year” and whether a student is “new to city in pretest or post-test year.”

The process appears transparent, but it is clear as mud, even for smart lay people like teachers, principals and — I hesitate to say this — journalists.

Ms. Isaacson may have two Ivy League degrees, but she is lost. “I find this impossible to understand,” she said.

In plain English, Ms. Isaacson’s best guess about what the department is trying to tell her is: Even though 65 of her 66 students scored proficient on the state test, more of her 3s should have been 4s.

But that is only a guess.

Moreover, as the city indicates on the data reports, there is a large margin of error. So Ms. Isaacson’s 7th percentile could actually be as low as zero or as high as the 52nd percentile — a score that could have earned her tenure.

Teachers are eligible for tenure in their third year. To qualify, a teacher must be rated “effective” in three categories: instructional practices, including observations by the principal; contribution to the school community; and student achievement, including theteacher data report. Ms. Isaacson was rated effective on the first two.

The past chancellor, Joel I. Kleinimposed new policies to make tenure harder to earn.

In an e-mail, Matthew Mittenthal, a department spokesman said: “We are saying that a teacher’s tenure decision should simply be delayed (not denied) until that teacher has demonstrated effective practice for consecutive years in all three categories. The alternative is what we’ve had in the past — 90-plus percent of teachers who are up for tenure receive it. Do you think journalists deserve lifetime jobs after their third year in the business?”

The view seems to be gaining support.

However, the number of years that it should take to earn tenure does not get to the heart of the problem.

The tougher question, says Ms. Isaacson, is how to create a system that will fairly evaluate teachers, whether it is used to grant tenure or lay off teachers. “I don’t have a problem looking at teachers based on merit,” she said. “Every job I had, I was evaluated based on merit.”

Marya Friedman, a sophomore at Bronx Science, describes Ms. Isaacson as brimming over with merit. “I really liked how she’d incorporate what we were doing in history with what we did in English,” Marya said. “It was much easier to learn” — which, of course, is what great teachers strive for.

 

Views: 175

Reply to This

Replies to This Discussion

I wonder if this model has identified teachers at the opposite end of the spectrum - those who have been identified as weak teachers, but the statistics have found them eligible for tenure. I do not want names, but I think we should know what these equations are capable of inflicting on the teaching profession.

Other thoughts: What if you are assigned a class of people who all earned a four last year? [A distinct possibility in schools like Ms. Isaacson's.] What is your growth target?

How do you calculate helping a "low 3" moving to a borderline 4 (but still coded as a 3)?

If the Board of Ed can refuse tenure to a teacher beginning the fourth year of teaching, is this de facto cancellation of the tenure law? Past practice does include people who have had another year to attain tenure, but these are people who did not quite prove their skills and had been given another chance. Where is the legislation that supports the practice revealed in the article? Remember when just such a Long Island notion was overturned in court?

RSS

JOIN SL 2.0

SUBSCRIBE TO

SCHOOL LEADERSHIP 2.0

School Leadership 2.0 is the premier virtual learning community for school leaders from around the globe.  Our community is a subscription based paid service ($19.95/year or only $1.99 per month for a trial membership)  which will provide school leaders with outstanding resources. Learn more about membership to this service by clicking one our links below.

 

Click HERE to subscribe as an individual.

 

Click HERE to learn about group membership (i.e. association, leadership teams)

__________________

CREATE AN EMPLOYER PROFILE AND GET JOB ALERTS AT 

SCHOOLLEADERSHIPJOBS.COM

FOLLOW SL 2.0

© 2024   Created by William Brennan and Michael Keany   Powered by

Badges  |  Report an Issue  |  Terms of Service