Bob Schaeffer, the public education director for FairTest. A longtime critic of high-stakes testing, Schaeffer, who lives in Sanibel, has joined forces with the Florida Coalition for Assessment Reform in pressing for changes in the FCAT system. The group has gained attention in Tallahassee lately, even earning a seat on the DOE's advisory panel. Schaeffer talked with reporter Jeff Solochek about how Florida's testing culture might be turning a corner.
JS: How did you get involved with this particular issue, because we know you more on a national scene?
BS: Well, I live in Florida. And I've been connected to FCAR since they were established. I've been to and spoken at their statewide convention and participate on their email list. When I saw the initial wave of coverage ... when the state Department of Education admitted that last year's FCAT had been mis-scored I talked to a number of reporters about that. I was invited to be on a conference call with the FCAR board ... where we worked out the strategy that resulted in the letter.
JS: The idea behind the letter then is to hold their feet to the fire? Or are you looking for something more than that?
BS: It is designed to take advantage of the media and policy maker interest in the FCAT, to use the incident to open up the larger question about the exam's design, administration and use.
JS: Tell people who might not know all the details what these questions are.
BS: From the FairTest perspective, the FCAT is probably the most misused test in the country. The testing industry itself ... warns against using any test as the sole or primary factor to make high stakes judgments about students, teachers, schools, educational systems. Despite that, Florida politicians have chosen consciously to misuse the FCAT for grade promotion and retention, high school graduation, school grades, teacher bonuses and the like. All of which violate the standards of the testing profession. And we see the enhanced focus on FCAT because of the scoring error as an opportunity to explain how Florida misuses the FCAT.
JS: Is there a good use for the FCAT? Is FCAT a good test?
BS: I don't think anybody knows, and that's another problem with the FCAT. Unlike many other tests in which all aspects of the test are transparent - not just the test questions and answers, which belatedly have been made public, but the technical manual, information about how the tests are designed, scored and scaled - nobody has any idea on the FCAT. Nobody being policy makers, in most cases media, independent experts, parents, teachers, how the number of answers a student gets right on the FCAT are translated into an FCAT score, and how the sum of FCAT scores in a school translate into a school grade. Apparently, the formula changes from year to year. Meaning that it's subject to political manipulation.
JS: Do you really think that they are politically manipulating it?
BS: Without the information you can't be certain. But we do know that Florida has been involved in testing gamesmanship. For example with the requirement for adequate yearly progress that has been set for No Child Left Behind. Florida instead of choosing a steadily upward path for progress, has set up a system where stable performance is expected for years and then a sudden jump under some other politician's watch is built into the system.