24 February 2010

Instructional Rounds in Education

Elizabeth City, Richard Elmore, Sarah Fiarman and Lee Teital

Summary by Tom Crumrine

The opening of the book:


Pierce Middle School is stuck. Despite the best efforts of its leadership and teaching staff, Pierce’s results on the statewide test have leveled off, or slightly declined, after two years of more or less steady improvement. Pierce’s staff feels the urgency of the situation. There is no question about their commitment to improved student learning. they feel they are working at the limit of their current knowledge and skill. The school district’s leadership is equally concerned, since they were relying on Pierce to serve as a model for their system-wide improvement strategy. Now it’s not clear what they will do. Maybe it’s just a temporary glitch in the test scores. But maybe it’s something more fundamental. Pierce’s leadership team and the district leadership team huddle in a conference room at the central office trying to figure out what to do next.”

Quotes from Introduction

What are rounds?

* Repeatedly, district and school practitioners tell us that one of the greatest barriers to school improvement is the lack of an agreed-upon definition of what high-quality instruction looks like.

* The rounds process is and explicit practice that is designed to bring discussions of instruction directly into the process of school improvement. By practice we mean something quite specific. We mean a set of protocols and processes for observing, analyzing, discussing, and understanding instruction that can be used improve student learning at scale.

They talk further about the idea that this comes from the idea of rounds in medicine. Rounds where everyone learns.

* Unfortunately, the practice of walkthroughs has become corrupted in many ways by confounding it with the supervision and evaluation of teachers.

* This kind of practice is both antithetical to the purposes of instructional rounds and profoundly anti-professional.

* The idea behind instructional rounds is that everyone involved is working on their practice, everyone is obliged to be knowledgeable about the common task of instructional improvement, and everyone’s practice should be subject to scrutiny, critique and improvement.

Chapter 1

First Principle: Increases in student learning occur only as a consequence of improvement in the level of content, teachers’ knowledge and skill, and student engagement. (24)

Second Principle: If you change any single element of the instructional core, you have to change the other two to affect student learning. (25)

Third Principle: If you can’t see it in the core, it’s not there. (27)

Does it really happen? It needs to be imbedded in the reality of the school. Presentations don’t do it. Looking at what is actually happen is what needs to be done.

Fourth Principle: The task predicts performance. (30)

It isn’t the curriculum. If students practice memorizing they get good at memorizing. If students practice analysis they get good at analysis. If a player practices free-throws they get good at free throws.

Fifth Principle: The real accountability system is in the tasks that students are asked to do. (31)

This is not that hard to do. We just don’t do it enough. The example that worked fairly well is the work of Feb. 2009 where the high school looked at what kinds of exams they give at mid-year time. Sure there are lots of constraints that go into giving mid-year exams but in general the tests asked more low level questions than high level question. (Following the seventh principle that will come later let’s not jump to an evaluation of this. Let’s talk about what we would like to see in mid-year exams and go from there.) This type of process can be repeated if we decide to make time to do it.

Sixth Principle: We learn to do the work by doing the work, not by telling other people to do the work, not by having done the work at some time in the past, and not by hiring experts who can act as proxies for our knowledge about how to do the work. (33)

There is a lot to learn from outside research. My friend cardiologist Ben Lowenstein regularly reads journal articles after his kids have gone to bed. But he also goes to conferences where he sees people performing best practice work and every single day—every single day—his decisions are examined and questioned by his fellow cardiologists, by nurses, etc. This last part is the cultural part that does not exist in education.

Seventh Principle: Description before analysis, analysis before prediction, prediction before evaluation. (34 and 35)

Their seventh principle outlines a common them in rounds discussions. Do not jump right from observation to evaluation. The community needs to come up with what they even want to observe when they do their rounds. After observation lots of conversation needs to happen about what the group would like to be seeing.

21 February 2010

Alignment and Frequency of Assessment of Competency Understanding

Competencies at their basis come down to a goal, an assessment and a plan to get to the goal. A lot of work has been done in recent years on the first step--establishing the goal. Different groups will be ready at different times but the logical next step is to examine assessments. If your group is ready to examine assessments these are 2 simple activities that could help.

Inspired by the work of
Larry Ainsworth.

If you look at the link above and scroll to page 70 and 71 you will see two activities that check common assessments for alignment to Power Standards (our word is competencies and I will use it from here forward) and for frequency of assessment of competencies.

Activity 1 Alignment
This is a check for whether or not current assessments align to the competencies. Teachers could bring some assessments and go through this activity. I would suggest that the groups would be small and used to working with one another. This is not a "gotcha" activity. The idea is to see where we are now and what we might want to do to improve.
  1. How many of our assessment items align to the competencies? Which ones?
  2. How many of our assessment items do not align to the competencies? Which ones?
  3. Do our assessment items directly match the "unwrapped" concepts and skills of the competencies?
  4. Do our assessment items math the level of rigor required by particular "unwrapped" competency skills, such as evaluate or analyze?
  5. Do our assessment items use the same terms that appear in the standards as opposed to more student-friendly wording (i.e., identify rather than label)?
  6. Do our assessment items align with or resemble the formatting of our district and state assessments so the such formats will be familiar to students?
  7. What does this tell us? Are our assessment items matched to our intended instructional purposes (the targeted competencies)?
  8. What do we need to do next in this regard? Which items do we keep? Which items do we need to replace or modify so that they do align with our competencies?
Activity 2 Frequency
Again teachers could look at the assessments that they currently give and go through these questions.
  1. How many of our assessment items match each competency?
  2. Are certain competencies underrepresented? Which ones?
  3. Are certain competencies overrepresented? Which ones?
  4. Are we trying to address too many competencies in this one assessment?
  5. What does this tell us? Do we need to redistribute our assessment items so that the appropriate number of competencies are more equally represented?
  6. What do we need to do next in this regard? Which items do we keep as they are? Which items do we need to replace or modify so that there is a better balance between the actual number of items and each of the targeted competencies?

Trying to Put it All Together--Again

4:45 am brainstorming about District in Need of Improvement

The keys remain for me:

  • Focus. We need a laser like focus on student learning.
  • Coordination of the focus. Individuals currently do a pretty good job at focus. The district does an OK job. This needs to change to the district doing an excellent job.
  • The Extra Department. Currently we have Special Education for students with 504 plans or IEP. What about an Department of Extra Services. This would be a fully functioning and organized department just like Special Education but it would be for students that need extra help but are not in Special Education or English Language Learning.
  • Eliminate the grades concept from our thinking at the high school. Make high school about completing the requirements not about progressing through grade 9, 10, 11, 12. Make being a 5th year OK--this will be right for some students.
  • Hire "right match" people. Make sure new hires know what they are getting into. Lots of sharing, lots of collaboration, lots of openness. Very little of the closed classroom door environment.
  • Leadership. Allow principals to spend some time each day focused on learning.
  • More teacher leaders. In order for principals to spend more time on learning everyone will have to do a little bit more.
  • Duties at HS--First and second year teachers do not have duties. Their duty is to visit other classrooms and watch what veteran teachers do.
Just some ideas--no permanent suggestions.