State and federal regulators use a variety of evaluation systems intended to improve teacher quality by 鈥渉olding teacher education accountable鈥 through assessments and ratings or rankings 鈥 of states, institutions, programs and teacher candidates themselves.

A new md传媒国产剧 College study of four leading systems used to evaluate teacher preparation programs has found the systems lack evidence-based policies in their core designs, which questions the validity of methods used to assess tens of thousands of prospective teachers and thousands of college and university programs that prepare them to teach.

鈥淲e found that although these accountability policies demand that teacher education programs make decisions based on evidence, the policies themselves are not evidence-based,鈥 said study lead author Marilyn Cochran-Smith, the Cawthorne Professor of Teacher Education for Urban Schools at md传媒国产剧 College's Lynch School of Education, who presented the findings at the annual meeting of the American Educational Research Association in Washington, D.C.

鈥淲e concluded there is good reason to question their validity as policy instruments that will improve teacher education quality and teacher quality,鈥 said Cochran-Smith, whose study, , was published by the National Education Policy Center.

Cochran-Smith was joined on the study by Lynch School of Education researchers Rebecca Stern, Juan Gabriel S谩nchez, Andrew Miller, Elizabeth Stringer Keefe, M. Beatriz Fern谩ndez, Wen-Chia Chang, Molly Cummings Carney, Stephani Burton, and Megina Baker.

In all, there are more than 2,200 teacher education program providers in the U.S., each reporting to state officials, who in turn report to the U.S. Department of Education. A number of public and privately-developed systems are used to evaluate and report on the programs.

The md传媒国产剧 College team evaluated the U.S. Department of Education鈥檚 annual state and institutional reporting requirements; the accreditation process of the Council for the Accreditation of Educator Preparation (CAEP); the National Council for Teacher Quality鈥檚 (NCTQ)听Teacher Prep Review; and the edTPA, a performance assessment for teacher candidates required for licensure in multiple states.

md传媒国产剧 College Lynch School researchers
A new study of systems used to evaluate teacher preparation programs was completed by the Lynch School team of (back row, L-R) Andrew Miller, Molly Cummings Carney, Wen-Chia Chang, M. Beatriz Fern谩ndez, Elizabeth Stringer Keefe, and Juan Gabriel S谩nchez; (front row, L-R) Stephani Burton, Professor Marilyn Cochran-Smith, Rebecca Stern, and Megina Baker.

鈥淭he four initiatives are governed by different institutions and agencies, including governmental offices, professional associations, and private advocacy organizations,鈥 said Cochran-Smith. 鈥淎ll of them set out standards or evaluation criteria and then see how providers of pre-professional preparation measure up. The intention is eventually to close down preparation programs that don鈥檛 measure up.鈥

But across three of the four initiatives (HEA regulations, CAEP accreditation, and NCTQ鈥檚 reviews), there is only thin evidence to support the claims proponents make about how the assumed policy mechanisms will actually operate to improve programs, the researchers found.

The fourth initiative, edTPA, has more evidentiary support, but widespread implementation and professional acceptance may be challenging to accomplish, they concluded.

In addition, while all four evaluation programs are trying to reduce educational inequality, they wrongly assume that school factors, particularly teachers, are the major source of that inequality. In fact, persistent out-of-school factors play a much greater role.

The researchers say the systems are grounded in 鈥渢hin equity.鈥

鈥溾橳hin equity鈥 refers to the equity goals of the initiatives and policies like the ones we analyzed,鈥 said Cochran-Smith. 鈥淭hey are intended to create equity in students鈥 opportunities to be taught by high-quality teachers who know how to get good results on standardized achievement tests. But they assume that teachers are the primary, or even the sole solution to the equity problem. This viewpoint ignores the fact that teachers account for a relatively limited portion of the overall variance in student achievement, and it does not acknowledge that inequality is rooted in and sustained by much larger, long-standing, and systemic societal inequalities.

Cochran-Smith said the team will expand their analysis in a soon-to-be-published book, folding in other accountability initiatives, and proposing new, evidence-based approaches to improving teacher education quality.

The study earned praise from Sharon Robinson, president and CEO of the American Association of Colleges for Teacher Preparation.

鈥淚t鈥檚 axiomatic that experts in a field are better equipped than outsiders to design interventions that will work,鈥 Robinson wrote on the blog听. 鈥淵et in education, we face a constant barrage of external reform efforts that fail to incorporate professional knowledge and expertise鈥攁nd they just don鈥檛 work.鈥

By Ed Hayward | News & Public Affairs