Over at ISTE Connects, they are continuing the countdown on the Top 10 education technology issues facing the eduworld in 2010. In the latest installment, ISTE’s Hilary Goldmann focuses on the issue of assessment, noting that “we’re looking for better, richer, and more diverse assessment measures. Assessments that provide early feedback in the learning process, not just high-stakes bubble tests in a few content areas that don’t really evaluate the skills students will need. We can do better than this, and we must.”
If one puts an ear to the eduground, one hears multiple discussions on the topic of assessments. Many states are waiting to develop new tools until after the common core standards have been finalized and adopted. Others are working at improving their current measures, with the true leaders adopting new online or computer assisted assessments to provide educators and policymakers alike with a broader and more comprehensive set of data points. And then there are a few voices in the wilderness advocating for the elimination of assessment entirely, believing it is unfair to measure students or teachers on the results of an exam or a collection of tests.
Of course, we are assessing all of our students now. Under NCLB, every state in the union (even you Texas) is working to demonstrate Adequate Yearly Progress, or AYP. Each state sets their own learning standards and each year we evaluate how many students are proficient (according to those standards) compared to the previous year. Those states that show year-on-year gains quickly become our case studies. Those that flatline on proficiency or, heaven forbid, slip, are put on our lists.
In the pursuit of making the AYP success list, many states have been accused of lowering standards in order to show continued gains on the assessments. And some started at a low threshold for proficiency to begin with just so they could have high marks right out of the box a few years ago. As a result, we have a mis-mash of state learning standards.
Don’t believe it? Take a look at some of data released by Gary Phillips of the American Institutes for Research last week at the Quality Counts event. Phillips took a look at state test scores, state academic standards, and comparable international benchmarks. We shouldn’t be surprised to see that those states with the highest AYP scores are those with some of the lowest standards. And those states with the highest standards (and some of the lower proficiency numbers) are the states mostly closely aligned with the international learning standards set forth by TIMSS, PISA, and PIRLS. (And just as interesting, how a state does on eighth grade NAEP seems to align pretty well with how it does in international comparisons.)
So which becomes more important when it comes to student proficiency? Is the emphasis on how many students score high enough on the scale or is it making sure that students are working on a scale that ensures they are academically competitive with their peers, regardless of country?
Common core standards is intended to fix some of this, supposedly giving all 50 states (and DC) one common standard to work toward and, presumably, one common assessment to measure it. But it begs two important issues, one of which Goldmann highlights, the other illuminated by Phillips and others.
First, can one single exam adequately assess the teaching and learning in a classroom, or do we need multi-variable assessments that look at both formative and summative assessment? It it a single state-administered exam, or is it a state exam influenced and shaped by ongoing tests and temperature-taking in the classroom at all points along the learning process?
And second, and perhaps most importantly, how do those assessments stack up outside of our fine union? How do they match up to PISA and PIRLS? Are the offering multiple-choice, constructed-response, extended tasks and project queries? Are they offering on-demand and curriculum embedded tests and tasks? Do they assess both knowledge (recall and analysis) and assessments of performance (demonstration of ability to apply knowledge in practice)? Do they effectively measure whether all students have both the skills and knowledge to succeed outside of a classroom environment?
Ultimately, we are putting an awful lot on the shoulders of “assessment” when we talk about school improvement, student achievement, and the narrowing of the achievement gap. But if we don’t have the right yardstick, we’ll never know exactly how far we’ve come and how far we still need to go. By taking a hard look at the data, as scientists like Phillips have, and building better mousetraps, both in terms of content and the shift away from those bubble sheets, are essential steps forward.
accountability
Turning This Race Into a Relay
A year ago, many words and many more column inches were committed to ensure that any and all realized that education funding coming through the American Recovery and Reinvestment Act (ARRA) was a one-time deal. States were originally discouraged from using State Fiscal Stabilization Fund dollars to pay teachers’ salaries, out of fear that that account will disappear as quickly as it appeared, thus leaving states looking for new funding to pay for essential educational services in two short years.
We may forget it now, but new competitive grant programs — Race to the Top and i3 chief among them — were part of the original ARRA funding. We allocated $650 million to fund efforts to invest through innovation in our local school districts. And we originally set aside $4.35 billion (now down to $4 billion, as $350 million has been pulled out specifically for data systems) to provide a select group of states big dollars to fund big changes in standards, teacher quality, school turnaround, and charters.
Today, the terms and conditions associated with RttT appeared to change. This morning, President Obama announced his intention to seek an additional $1.35 billion in funding for the next generation of Race to the Top. The preview story can be found in The Washington Post here, and Michele McNeil has the after-announcement reporting over at EdWeek here.
Both pre- and post-coverage leaves us with some sketchy details. Apparently, the intent is to provide additional Race funding for states, while also making dollars available to some school districts. The LEA component makes sense, particularly if states like California and New York are unable to put forward a truly competitive RttT application. This way, districts like Long Beach Unified and NYC can be rewarded for both their past efforts and future plans (fulfilling the RttT mission), while providing a path for future school districts to follow.
The state dollars become more interesting. Is the intent to expand programs in worthy states, answering the call from states like Colorado who believe their alloted range of available dollars is too small to manage their ambitious plans? Or is the intent to add another three or four states to the Race, expanding the total number of states and giving some the chance to revise their laws and their applications after the first two batches are released? Eduflack has to believe the intent is the latter. In fact, I wouldn’t at all be surprised if the terms of a Phase 3 Race grant reduced the need to demonstrate “past achievement” and instead provided smaller total grants to those states who have made real changes to be Race compliant and forward thinking.
We’ve heard a lot about Race being the single-largest discretionary program in the history of the U.S. Department of Education. Now, the President will request this additional $1.35 billion in his February budget. And with that request, we should expect to soon see an annual budget line item for Race, with dollars either adding states or expanding programs along the way. Next year, Race will likely be added to ESEA reauthorization (as Reading First was to NCLB , making the policy (and the dollars) part of the federal code for the next five to eight years. And then we’ve gone from a one-time booster shot for innovation toward an annual vaccination against the status quo and the fear of change.
Don’t believe Eduflack? Just take a look at the words of House Education Chairman George Miller, who told EdWeek, “By continuing Race to the Top, the federal government shows it can be a partner in reform and work to uphold the integrity of the program so that these resources are used as intended and help leverage change.” This isn’t an in-and-out engagement as originally believed. We are launching educational nation-building.
And while we anticipate the details and the specifics of this extension (along with waiting with baited breath to see the 30 or so RttT apps that will arrive at Maryland Avenue today, and the 10-12 states that will win this first Race by September), one thing remains certain. As the lifespan of RttT is extended, there will be a far greater emphasis on demonstrating success and tracking return on investment. The mission will not be accomplished just because the money was distributed and we all feel better about ourselves as a result. SEAs and LEAs will need to demonstrate, by preponderance of the evidence, that RttT boosted learning, increased student achievement, closed the achievement gap, and improved the quality and effectiveness of teaching, particularly in historically disadvantaged communities.
By many calculations, Reading First (the previously largest discretionary program in ED history) failed at truly documenting the cause/effect of RF dollars and student test scores. We now need to learn from what worked and didn’t with regard to RF assessment and accountability and build a better mousetrap for Race. Four years from now, we don’t want to be left having spent $6 billion on RttT reforms, but no irrefutable way to measure the true effectiveness of the program. Ultimately, when it comes to RttT assessment, it must be trust … but verify.
The Weingarten Doctrine
For those who remember the early days, Eduflack was founded nearly three years ago to comment on how successfully (or unsuccessfully) we were communicating education and education reform ideas. At the time, NCLB was a hot topic in many circles, Ed in 08 was committed to raise the profile of education issues in national campaigns, and changes in organizational leadership and new constructs of advocacy groups threatened to move education back onto the front pages.
ack to haunt some in the teachers’ unions.
How Valuable Are the Race Fire Drills?
In recent months, we have seen state departments of education and state legislatures scurry to make themselves eligible and better positioned to win a federal Race to the Top grant. From knocking down the firewalls between student performance data and teachers to smoothing the path for charter school expansion to adopting common core standards to just demonstrating a hospitable environment for education reform and change, states have been doing anything and everything to gain a better position for the Race.
Earlier this week, Michigan announced sweeping reforms to put them in line with the federal requirements. California is currently debating similar positions (with what seems like growing concerns). And we seem genuine changes in reform culture in states like Indiana, Rhode Island, Wisconsin, and many others along the way. (Every state, that is, except for the Republic of Texas, which as of yesterday still hasn’t committed to even pursuing RttT, despite the $250K it received from the Gates Foundation to prepare its application.)
But one has to ask, is it another tale of too little, too late? In November, the U.S. Department of Education released a comprehensive scorecard of how RttT applications would be scored, breaking down allotments so specifically that it included everything but throwing out the low score from the Ukrainian judges. Every state is working off the same 500-point scale, building a workplan that aligns as closely with Arne Duncan’s four pillars as humanly (or bureaucratically) possible. We’re working toward extra points for STEM and for charter schools and for demonstrating a general culture of reform. And we’re growing more and more mindful of how those points break down, recognizing, for instance, that STEM and charters are worth virtually the same score as turning around low-performing schools.
Often overlooked in the discussion, though, is the fact that 52 percent of a state’s RttT application is supposed to be based on past accomplishment and achievement. So for all of those states who just recently removed the caps and changed the charter laws, will they only earn half-credit for their plans for the future, or do we recognize them for the intent of their efforts? What about those states, like California, New York, and Wisconsin, that are just now taking down those data firewalls? Are they out of luck when it comes to evaluating their past performance? And will ED reviewers really dock Texas 80 points (nearly 15 percent of the total score) for not signing onto common standards, when Texas’ state standards may already be closely aligned with where the NGA/CCSSO effort is ultimately headed? Is the 52/48 split a hard-and-fast rule, or is it meant as a guiding suggestion to states to shape how they write they apps, with ED officials hoping to see equal focus on what states have done in these areas and what they are planning to do in the future?
If we believe the former, we are looking at a very, very select group of states that are qualified to win RttT in the end. How many states come to the table with real, tangible, and longitudinal successes on all four of the pillars of Race? How many can really talk about their strong work in effective data systems? How many have really invested in meaningful teacher quality efforts, including state-led teacher incentive pay programs? How many are doing what their legislatures and SEAs have now committed them to do in the future (and more importantly, how many can prove it)?
If the projections are true, 80 percent of states will be submitting their Phase One applications later this month. If we are lucky, we’ll have more than four states actually win in Phase One. (that, my friends, is where Eduflack is setting the Phase One over/under) What will happen to those states that either are not called for oral defenses in March or fail to wow their dissertation panels? Do those states go back to the drawing board, and try to turn around a winning app in 30-60 days, or do they lick their wounds, move on, and say they never really wanted the grants in the first place?
Only time will tell. Regardless, Race has been effective for the enormous influence it has had on changing state laws and policies without doling out a single dollar to support the changes. We have already changed the culture of public education in the last 12 years, at least in terms of regulation and legislation. If a state fails to win the Race, they are unlikely to go back and reinstitute the firewalls, re-restrict charters, or pull out of the common core standards movement. Maybe that was the intent all along …
Jockeying for Race’s Post Position
Yesterday, the U.S. Department of Education released the list of all states that have indicated that they will file Phase One applications under Race to the Top. Each of these states hopes to submit a comprehensive application that highlights both their successes to date and their plans for the future on areas such as academic standards, assessments, data systems, teacher and principal quality, school turnaround, charter schools, and STEM, to name the highlights. And they each hope to be awarded a “big cash prize” before we get too deep into the spring of 2010 and before the merriment of commencement commences.
Cart Awaiting a Horse
During World War II, many harbors in Hawaii were blocked by sunken warships, one important channel in particular. After the war, engineers puzzled over how to move them out of way. As they found themselves stumped, someone said, I know a captain who has a reputation as a good problem solver. Lets invite him in.
They brought the captain to an overlook where, standing among the important brass, he could see the masts of vessels protruding from the water. As he stared at them, someone nearby heard him muttering, Mother Mother the garden. The image that came to him was of his mother breaking large clumps of sod into smaller ones, which suggested his solution: Don’t try to move the ships. Break them into pieces and leave them there–a solution that worked.
Which is to say that if we find ourselves stumped over education, could we consider a different viewpoint?
The title above hints at a shift. Recently I happened across two reports, one on the ongoing work on national standards, and the other on the international education conference in Helsinki earlier this fall. The reports presented exactly opposite views on how to get quality education. The Finns hosting the conference, as is widely acknowledged, get the best educational results in the world. Two features of their system stood out for me. They 1) insist that teachers know their subject matter, and 2) they allow them great latitude in designing what they personally will teach.
How unusual! Find someone who knows and ask him to do what he knows. What an innovative model! One wonders what would happen to the entire American economy if such an insight were widely accepted instead of having the state micro-manage everything from the top down. The US model in contrast 1) presumes that teachers dont know their subject matter. Once accepting that as inevitable, the second step follows: 2) spoon-feed them every detail they must teach.
Its clear that the Finn model works and, as best we can tell, the US model doesn’t. The conclusion is obvious. Do the US model more intensively! Bring into education more people who know even less about teaching, and specify in even more detail what they must teach. Exert more control of the process with less confidence in and freedom for teachers to teach what they know.
I sympathize with policy-makers who dont know what to do with their big hammer, the billions they’re anxious to spend. They don’t know what, among their myriad of options, to spend it on that will make the most difference. A possible corner is at least to define what students need to know in the subjects most commonly taught.
Sensible as it may sound, even this has its holdouts. Alaska and Texas want no part of it. Texas, I assume, is independent enough to believe that their own people know better what their children should learn, but Alaska (my home state) is a different matter. The knowledge useful for living in many of its remote communities and even larger cities can diverge greatly from what one needs to know in the continental US; climate, weather, geology, environment, wildlife, fish, transportation, Native heritage, and energy, for instance. The concerns of a Boston or St. Louis are far off the mark, hinting further that a varied and changing world could soon make the current knowledge disseminated today
in any city moot even there.
But let’s say the macro-plan has its way and we could standardize what students need to know, what then?
To me this is the cart waiting for a horse, a cart we wouldn’t need if we just had a horse. What curriculum do you want to tow along? Ask the Finns, who say that the curriculum is what a teacher who knows the subject is ready to teach. But even settling that, we still need the horse:How do we get students to learn what is either in the teachers mind or, lacking confidence in their mind, in the national standards?
How? That we even have to ask the question is my concern. If we have any doubt about how to do this, then its premature to define standards nationally or require particular knowledge in teachers. The horse is what moves everything else–to know that you can teach students whatever you want to teach them each, always, and every time. Do this with a lot of learning (a good start is whatever the teacher wants to teach.”). After much of that, look around and inquire, Is there anything essential we haven’t covered? Let teachers teach what they want to for eleven and a half years and spend the last semester on lacunae. These are likely to appear much less significant once you already have a child saturated with usable knowledge, but if something is both missing and important, cover it then.
First, though, do the big chunks, the stuff good teachers already know. Stay out of the way while they do it and dont micro-manage.
(John Jensen is a licensed clinical psychologist and author of The Silver Bullet Easy Learning System: How to Change Classrooms Fast and Energize Students for Success (Xlibris, 2008), which he will send free as an e-book to anyone requesting it. He can be reached at jjensen@gci.net. This post represents the opinions of Dr. Jensen only.)
The Race Officially Begins … Now
At 9 p.m. this evening, the starting gun for the Race to the Top officially started. While many states are already laps into their applications (and many may even be running in the right direction), the U.S. Department of Education officially released the RFP, along with some interesting insights as to how applications will be scored moments ago.
we are now clear on distance, terrain, and other Race conditions. The gun has officially sounded …
Race-ing to Teacher Quality
Last week, Eduflack opined over at Education Week on the need to differentiate between incentivizing good teachers and incentivizing good teaching. Essentially, we need to make sure that any incentives are not just given as a thank you to teachers, but are used to identify, catalog, and share the best practices that have made their teaching so effective. The full piece can be found here.
New Governors in the Race
Undoubtedly, much of the next few days will be spent dissecting yesterday’s off-year elections and their greater meaning for healthcare reform, the 2010 congressional races, and the 2012 presidential campaigns. What does it mean for Republicans to take back the Virginia governor’s seat? How painful will the Democrats’ gubernatorial loss in New Jersey be? Why was the NYC mayor’s race closer than most expected? These are all questions that will (and already have) been raised in the past 12 hours.
In Search of 21st Century Joe Clarks
When I’m flipping through the cable stations late at night, unable to sleep because something or another has my mind going a thousand miles an hour, there are a number of movies for which I will always stop and watch. Braveheart, Thank You For Smoking, the original All the King’s Men, Bull Durham, Tin Cup, Roadhouse, 10 Things I Hate About You, and She’s All That tops among them.
