05 August 2009

Bullying

Interesting program on NPR's Here and Now program today. Click to get the link.

The program on bullying began with the story of Karl a sixth grader who killed himself after a year of relentless bullying. They interviewed his mother and she was clearly a very strong woman who took the road of not only forgiving the bullies but dedicating the rest of her life to not only helping the victims but to helping the bullies.

The reason here and now focused on bullying today was because the American Pediatric Association just came out with a new report on bullying. Doctors are encouraged to ask about the school environment--not only in the classroom, but in the lunch room, hallways, etc. The later tend to be the places that bullying actual occurs according to the study.

I haven't studied bullies too much because it doesn't come up too often in in my teaching. Although it does happen and this story will help me be more vigilant in looking for it. I had a particularly nasty case this year where a student regularly made fun of a student with Asperger's syndrome.

The big take away for me is how schools have worked to solve bullying. There are 3 participants in a bullying situation. The victim, the bully and the bystander. Schools that have conquered bullying focus on getting the bystanders as a group to create a culture in the school where the bullies are seen as the outcasts.

30 July 2009

Challenges 1 and 2

Help!! I need lesson plans for the first week of school and have no clue what the curriculum is or how to create a lesson plan that supports the district philosophy. Where do I go? Who do I see?

Well to begin I would venture to say that the district philosophy is to ensure that students know what the big picture is and what they need to do to understand the material. A lesson plan that supports this philosophy would have students engaged in a variety of instructional methods. Some direct instruction, some hands on, some individual, some in groups. The teacher would frequently check if the instruction was working and take corrective actions when necessary. Remember what Chris Demers said—we need to teach more like art teachers and coaches—with corrective action coming immediately not delayed till a test.

To find what the curriculum is teachers, even veteran teachers, should consult the teachers in the building who have gone before them. Lesson planning alone should be avoided. There is someone in your building who has taught chemistry before and someone who has taught second grade for 25 years. My mentor didn’t tell me what to do but she did provide every single activity that she had used the previous year. That meant that I began my teaching with activities that were created after 16 years of teaching experience. Why would we want to do it any other way? She sat with me and explained how she had used each one and made suggestions for how I might use them. She provided samples of the notes she had given and let me know about possible pitfalls I might encounter. When I had difficulty I went to her and said—this didn’t work…what did I do wrong. And I would go into her room and watch her teach something that I had never taught before. I hope this is how it will work for you.

I’ve noticed that after lunch, my students are dozing off in class… What can I do to keep them engaged?

My high school students do this because they often consume lunches consisting of ketchup packets and energy drinks loaded with sugar. I’m not kidding by the way, I can’t tell you how many boys come in and tell me that they were in a ketchup packet eating contest at lunch. This inevitably leads to a crash at some point.

Research on high school students tells us that we should never go more that 20 minutes on one activity. Even in AP Biology where we think the kids might be able to take longer—go for 20 minutes only. At the younger grades the time goes down accordingly. This approach also makes sure that you are varying your teaching style and approach during the class or day.

Rick Wormeli, a leading speaker and writer on assessment and instruction, cites research showing that tiredness is often caused by dehydration. Seems silly but it is really important to allow water breaks often during class. At the high school level if I see a sleeping or nodding student I make them get up and go get a drink. The walk wakes them up and it alerts me that I may have gone on too long with my talking.

Finally, don’t be offended by a child who is nodding off—unless they do it all the time. Use it as a sign that tells you—if this kid can’t even stay awake then I bet the other kids aren’t super engaged either. Use it as a critique of yourself and say, “Why aren’t the kids engaged with what we are doing right now?” You can use simple techniques like popsicle sticks to make sure everyone is listening. Write down every student’s name on a popsicle stick and pull them out of a can when asking questions. Dylan Wiliam has shown that this simple approach can increase engagement from a handful of students to nearly everyone in the class.

29 July 2009

Arne Duncan on Ed. Reform

I was reading through Secretary of Education Arne Duncan's speeches on education reform. I got tenure after two years and didn't have to do too much to earn it so I read the one on tenure and unions first. This caught my eye.

I linked to all of the speeches below. The over riding theme is that we have to face out tough problems and to do that we are going to have to make some changes. Duncan squarely keeps the focus on children and that is definitely where it needs to be.

Take a read for yourself and let me know what you think.

Collaboration and Communication

This is a section from the “synthesis” paper I have been working on. It is a first draft and I would love comments and suggestions.

Collaboration and Communication
When we had our first child my wife was in labor for 12 hours. During the 10 hours of that that we were in the hospital we must have seen 15 or 20 people. There was one wonderful nurse, Heather, who was assigned to work with my wife and I. But there were also other key people involved in the birth. Dr. Heidi, our obstetrician was there, of course and there were many other nurses and specialists.

If we compare the day to education Heather the nurse was like the classroom teacher and Dr. Heidi was the principal. The other nurses were like other teachers in the building. The people who drew blood were the specialists. The main difference in how they worked and how a school works is how they worked together. When Dr. Heidi would come in Heather wasn’t scared—she was excited. She would ask questions and make sure that she was doing all that she could for my wife and I. In turn, Dr. Heidi didn’t shout demands or give orders, she conferred with Heather and made suggestions about what might work in given situations. When my wife requested an epidural Heather, Dr. Heidi my wife and I all talked about the positives and negatives. They even suggested an alternative that we tried first. It wound up not working but we were glad we had tried everything before going to the drugs. (Once we went to the drugs my wife was quite happy.)

When our baby was born Heather stayed with us until the next nurse came on. Before leaving to go home she talked at great length with the new nurse and told her everything about us and our baby. The baby was five weeks early but was otherwise fine, vital signs, etc. Only then did she leave us. Since the baby was five weeks early a special nurse was called in. This nurse took a look at our child and concluded that our baby didn’t need extra help so she didn’t need to stay.

The analogies to education are obvious but the key thing we can learn from the medical profession is how they communicate profusely and how they collaborate with the interest of the patient foremost in their minds. As teachers when we collaborate (if we collaborate) it too often becomes a game of who is the better teacher. This thinking needs to go away. The vast majority of teachers are good, just in different ways. We need to lean on the strengths of other teachers to improve in the areas where they are a little stronger.

A few years ago someone told me how much work they had to do over the summer because they were teaching a new course. I asked them if anyone else in the department had ever taught it. They replied that about 6 other teachers had taught the course. It was clear from the rest of our conversation that the teacher wasn’t going to get much help from the other teachers on planning the course. Why? Imagine two dentists working in adjacent rooms. One knows a new tooth whitening technique, the other does not. Would the first dentist tell the second dentist to read about the technique to figure it out themselves? Of course not. So why do we have to behave this way in education.

Someone once told me that a new teacher was hired who had previously taught in Japan. She was told to come up with a lesson plan for a particular unit and said she couldn’t do it. When asked why she explained that she had never planned a lesson by herself—they just don’t do it that way in Japan. Doctors and nurses have learned that their collective knowledge is much more useful when there is a great deal of sharing and communicating. As teachers we need to work in the same way.

Learning

I have been musing about a post on learning--that the focus of education needs to be on learning. It keeps getting longer but the basic pieces are:

  • Learning must be the focus of everything that everyone does.
  • Hiring must be driven by a need to get the right people on the bus.
  • Leaders must ensure that the focus of the school is learning
  • Teachers must ensure that they are focusing on the most important learnings every day.
  • Collaboration--teaching should not be an individual activity. Teaching should be an activity that is done collectively similar to how medical professionals work as a team to make you better.
  • Special education is one tool to help students but there must be other tools that are equally robust to help students.
I've been trying to make it post length but it keeps getting longer. I'm thinking that the six things listed above might be a sort of synthesis for what schools and districts need to do to improve.

28 July 2009

Harlem Children's Zone

On the Talk of the Nation today the program focused on "What Works." This whole week they have been focusing on seemingly "intractable" problems that have been solved in certain places.

Their guest today was CEO of the Harlem Children's Zone, Geoffrey Canada. I heard about Canada sometime last summer and I have a ton of respect for his dedication to poor students in Harlem.

Earlier this year Paul Tough put out a book called "Whatever It Takes," that chronicles Canada's nearly 20 years of working with the Harlem Children's Zone. I recommend it but if all you have is 1/2 an hour consider downloading the talk of the nation program from today. It will be 1/2 an hour well spent.

Some big points about the Harlem Children's Zone and Canada:
  • They do everything at once--it isn't just about being poor. They have partnerships with hospitals, obesity clinics, diabetes clinics, drug and alcohol treatment places, block watchtes, etc. They knew the research and the science and they just did it all at once.
  • The first kids to go through the program are currently in 5th grade. They began the program before they were even born. There is currently no gap between their achievement and the achievement of their peers.
  • A second group who were behind in grade 6 are now in college. There is no gap for math and a slight gap for English Language Arts.
  • Baby College is for 0-3 education. There is nothing special about this. Canada himself explains that 0-3 eduction has been done for decades--in the middle class. He is just taking what works there and educating poor parents about the methods.
  • Why is 0-3 important. By age three, with no intervention, children who are poor know 800 fewer words than middle and upper class children. The gap continues from there.
Secretary of Education Arne Duncan has launched a plan to replicate the HCZ approach in 20 big cities. The funding is big upfront but if you can break the cycle of poverty--poor parents raising poor children who don't finish school and then raise more poor children--the payoff will be great in the end.

Canada uses himself as an example. He was the first person in his family to go to college. But for his kids it was obvious that they would go to college--and they have. For his grandkids there won't even be the slightest question of whether they will go on to college. Like middle class families all over the country--the choice of not going to college won't be a choice anymore.

So why am I so excited about a program that works in Harlem--where poverty rates were in the 90 percents? If Canada and his team can turn it around for thousands of students in Harlem then districts with smaller numbers of students who are poor certainly have something to learn from him.

29 June 2009

Bow Data Day

Just completed an awesome day of work with the Bow School District. We had about 25 people from the high school, middle school and elementary school looking at data all day.

They said they were in the novice category in terms of data but I found out early that they were being to hard on themselves. They asked great questions and showed the same kind of insight that I have seen with so many teachers with whom I have had the pleasure to work.

Highlights for me included the incredible dedication of the teachers and the hard work done.

As we move to our second day together we will focus on:
  • Are we asking the right questions?
  • Are the questions big enough?
  • Can we really get to conclusions? Or even inferences?
  • What is really going on?

Looking forward to it.

19 June 2009

Grading and Reporting at CHS

This got a little longer than I anticipated. The introduction explains some of my thinking and the research section on page two includes quotes and summaries from leading researchers on assessment and grading.

Introduction

  • This weekend I tried to think back to why I began doing 1-5 grading in the first place. It actually had nothing to do with percent grades. I knew from the outset that the conversion would cause problems. My purpose was to clearly communicate to students exactly where they were on a learning continuum.
  • I was convinced by Bob Marzano that 5-9 categories were about the most anyone could reliably use to judge students.
  • Rick Stiggins and Anne Davies convinced me that assessment should be FOR learning. That it should not communicate and end point but that it should let a student know where they are and what they can do to go to the next level.
  • Tom Guskey convinced me that I really couldn’t reliably sort students into the 101 categories available on the 0-100 scale. (And I certainly couldn’t sort them into the 1001 categories available on the 0.0-100 scale.)
  • Grant Wiggins made me reconsider averages. Why, he asked, would we give a student the average when they could do it at the end of a course?
  • Dylan Wiliam gave me the example of the driver’s license—no matter how many times you fail—we all get the same driver’s license once we finally pass.

So putting this all together I began to use a system where I scored each part of each assignment using the 1-5 scale. I stressed early and often that even if you had a 1 you were still a good person—we are all at the beginning at some point in our lives. I stopped giving zeros and gave incompletes. I would say to students that I couldn’t give them a score until I had that piece of work. I stopped talking about percent grades at all—the only thing I would talk about with students was 1, 2, 3, 4 or 5.

It seemed to work. Conversations with students transitioned from being about their grade to being about what they can to improve their understanding of a specific topic. The only time it didn’t work was for any of the 8 reporting periods when I was limited to giving students only a 2 digit grade to summarize their performance. Which is where I was 4 years ago and where I am today…

So…

Here is an attempt to compile the thoughts of leading researchers on grading. First of all I think it is important to remember that all experts recommend a systematic approach to rethinking grading. They are all pretty similar so I will use the steps that Tom Guskey and Jane Bailey advise. (The first 5 would go in order. Six through 9 give information about steps 1-5.)

  1. Purpose—what is the purpose of grades?
  2. Define the impetus for change—why are we re-examining our grading and reporting system?
  3. Exploring the history of grading and reporting—what is the history of grading?
  4. Laying a foundation for change—what is the research that surrounds grading?
  5. Building a Grading and Reporting System
  6. Grading and Reporting Methods I: Letter grades, percentage grades, and other categorical grading
  7. Grading and Reporting Methods II: Standards-based, pass/fail, mastery grading, and narratives
  8. Grading and reporting for students with special needs
  9. Special problems in grading and reporting

Marzano recommends the following order:

Phase 1—have a vanguard team of teachers experiment with competency based assessment and record keeping.
Phase 2—identify the competencies and the software that will be used.
Phase 3—implement the system in stages.

Research
Anne Davies
Dr. Davies does not mention grading scales in her works or presentations. She does strongly and continuously stress that a change in grading should be a change from “assessment of learning,” to “assessment FOR learning.” Her take is that assessment is changing from something that happens to students to something that is done to help students.

“Research shows that when students are involved in the learning process—learning to articulate what they have learned and what they still need to work on—achievement improves.”[1]

Ken O’Connor
“Impreciseness is the main point of those who argue for letter grades rather than percentage grades; they believe that dividing student achievement into a limited number of categories is all that we can ever hope to do with any pretense of real meaning. According to this argument, using a 101 point scale gives a false sense of precision and, therefore, detracts from the main purpose of grades—meaningful communication of student achievement.

This argument has a great deal of merit, especially for elementary and middle schools, where grades are not involved in high stakes decisions, except pass/fail. However, where grades are involved in high stakes decisions about students’ educational future—such as college entrance, graduate school acceptance, and employment opportunities, numbers may be preferable to letters because there are more scale points available.”[2]

O’Connor then illustrates an example of a student who gets all 89s and gets a B and one who gets all 90s gets an A. The 5 point scale of A-F would amplify differences between students that really aren’t that great. BUT O’Connor is not against a 5 point system. He goes on to say,

“If all the guidelines and principles described in chapters 1-8 [Nearly the entire book] are applied then letter grades based on teachers’ professional judgments using a detailed descriptive scale will produce the best grades. But if teachers crunch numbers to arrive at grades, especially in high school and college, then percentage grades are probably fairer, and therefore better, than letter grades.”[3]

Again, the second sentence here might seem to be a rejection of a 5 point system. But, go back and read the first sentence again. What O’Connor advocates throughout the book, and when he presents, is for teachers to use grades, professional judgment, conversations with students, and multiple measures to determine grades. He is the man who told me about the following simple way of explaining the 5 point scale.

5=Wow!
4=Great!
3=Got it!
2=Nearly there!
1=Oops!

O’Connor would look at the 2 students described above and using professional judgment determine whether all 89s should merit the designation of A.

Guskey
“Letter grades offer a brief description of students’ achievement and level of performance, along with some idea of the adequacy of that performance (Payne, 1974). Because most parents experienced letter grades during their school years, they also have a general sense of what letter grades mean. For this reason, parents often prefer letter grades to newer, less traditional reporting methods (Libit, 1999).

Despite their simplicity, however, letter grades also have their shortcomings. First and probably most important, their use requires the combination of lots of different forms of evidence into a single symbol (Stiggins, 2001). As described in Chapter Three, many teachers combine product, process, and progress evidence in a single grade. This makes the grade a confusing hodgepodge that’s impossible to interpret, rather than a meaningful summary of students’ achievement and performance (Brookhart, 1991; Cross and Frary, 1996).

Second, despite educators’ best efforts; many parents interpret letter grades in strictly norm-referenced terms. Probably because the letter grades they received as students reflected their standing in comparison to classmates, parents frequently assume the same is true for their children. To them, a C doesn’t represent achievement at the third level of a five point scale, similar to a middle level belt in a karate class. Instead, a C means “average” or “in the middle of the class.”

A third shortcoming of letter grades is that the cutoffs between grade categories are always arbitrary and difficult to justify. If the teacher decides that the scored for a grade of B will range from 80 to 89, for example, the student with a score of 80 will receive the same grade as the student with a score of 89, even though there is a nine-point difference in their scores. But the student with a score of 79—a one point difference—receives a grade of C. Why? Because the teacher set the cutoff for a B grade at 80. Although cutoffs are absolutely necessary in any multilevel grading method, where they are set is always arbitrary.

Finally, letter grades lack the richness of other, more detailed reporting methods, such as standards-based grading or narratives. Although they offer a brief description of adequacy of students’ achievement and performance, letter grades provide no information that can be used to identify students’ unique accomplishments, their particular learning strengths, or their specific areas of weakness.”[4]

Guskey goes on to say, “letter grades should always be based on clearly stated learning criteria, not on norm-referenced criteria.”

Guskey and Bailey
The seriousness of arguments over plus and minus grades contrasts sharply with the simplicity of the issue involved. Basically, the issue comes down to whether is is better to have a 5-category grade system (A, B, C, D, and F), or a 12 category system (A, A-, B+, B, B-, and so on0. But if more categories are better, one might ask, “Why stop at 12?” There’s nothing sacred or particularly special about using 12 categories. Instead, we might consider a scale similar to the one used to express grade point average: 0.0-4.0.”[5]

This would equal 41 categories if you stick to just tenths place. Or you could go on to percents and get to 101 categories. Or even more if you go to percents and decimals. 92.34 for example.

Guskey and Bailey go on to say, “Research on rating scales shows that increasing the number of rating categories from 4 to just 6 generally lowers both the reliability and validity of the measures (Chang, 1993, 1994). Other studies indicate that scaled of 5 to possibly 9 categories are about as many as any qualified judge can reliable distinguish (Hargis, 1990, p. 14). Moreover, as the number of potential grades or grade categories increases, especially beyond 5 or 6, the reliability of grade assignments decreases. This means that the chance of two equally competent judges looking at the same collection of evidence and coming up with exactly the same grade is drastically reduced.”

Guskey and Bailey’s Recommendation
“Although to our knowledge no research evidence to date confirms that more affirming grade-category labels reduce stigma attached to low grades, we remain optimistic that this may be true. Certainly the connotation of Novice or Beginning is far less negative than that of Failing….

At the more advanced grade levels, we also believe that it is much more advantageous to assign a grade of I or Incomplete to students’ work and expect additional effort than it is to assign a letter grade of F (see the discussion of “Grades as Punishments” in Chapter 3).”[6]

Marzano
Marzano first writes a book on grading theory and only reluctantly gets to conversions about 7/8s of the way in. From having seen him talk it is clear that in his mind converting scores to anything is of little use. But I have also seen him say that grades in their traditional sense will probably always be necessary in grades 10-12 at least.

In essence Marzano explains that giving a score for each of the measurement topics (competencies) in a class would be preferable. But if a “district or school…wishes to use the traditional A, B, C, D, and F grading protocol,” it would need “a translation, such as the following:

3.00-4.00=A
2.50-2.99=B
2.00-2.49=C
1.50-1.99=D
Below 1.50=F”[7]

“Summary and Conclusions
Various Techniques can be use for computing final scores for topics and translating these scores to grades. Computer software that is suited to the system described in this book has three characteristics. First, the software should allow teachers to easily enter multiple scores for an assessment. Second, it should provide for the most accurate estimate of a student’s final score for each topic. Third, it should provide graphs depicting student progress.”[8]

Stiggins
Rick Stiggins and Anne Davies go hand in hand when they talk about Assessment FOR Learning. He wrote the original paper where he began always writing the for in all caps. They both focus most of their work on the idea that assessment (to sit beside) should be something that helps a student learn. In terms of conversions Stiggins suggests a “Decision Rule.”

“[If} at least 50% of the ratings are 5s and the rest are 4s, the grade is an A, [if] at least 75% of the ratings are 4s or better and the other 25% are not lower than 3, then the grade is a B, and [if] 40% of the ratings are 3s or better and the other 60% are not lower than two then the [grade] is a C.”[9]


“What about the situation in which a student receives a B, but it’s a high B or a low B? Over the course of an entire year, the difference will not be significant in terms of mastery, and mastery is what grades are based on, not averages. This isn’t being dismissive, but the reality is that the difference in learning (mastery) between the high and low versions of one particular grade is not that much. In larger grading scales, for example, the difference between a B and a B+ is just a few points. How exact can we be when identifying a student’s true mastery of something? Does a 0.01 (1 percent) difference in a grade-point average really mean a discernable, significant difference in mastery? No. It’s splitting hairs.

There are some teachers who disagree with this. They claim that there are a large number of mastery points wrapped into each percentage point due to multiple and influential assessments over a long period of time, and that the difference of one percentage point can describe mastery or lack of mastery of a significant amount of material. If this is the case, then whittling grades down to their exact and relative values (offering 2.75s for example) may be necessary. Each time we are tempted to do this however, let’s remember how elusive declarative mastery is, as well as how subjective we are in the micro-moment of grading each product from each student, and how we make it even more subjective when we aggregate a variety of data for a summative grade. And let’s wonder whether having done this, even justifiably, will have any lasting impact ten years down the road.”[11]

“One caution: If we primarily use a 4-point scale, many students and their parents will equate the highest numerical value (4.0) [or 5 in our case] with an A,…They will wonder why we just don’t write A, B, C, D and F if that’s what they really are.”[12]

Thanks for reading—if you made it this far.

Tom Crumrine
[1] Research of Black and Wiliam 1998 and Stiggins 2001 reported in Conferencing and Reporting by Gregory, Cameron and Davies.
[2] How to Grade for Learning—Ken O’Connor. Page 200.
[3] How to Grade for Learning—Ken O’Connor. Page 200.
[4] How’s My Kid Doing?-Tom Guskey. Pages 45-46.
[5] Developing Grading and Reporting Systems for Student Learning. Tom Guskey and Jane Bailey. Page 70.
[6] Developing Grading and Reporting Systems for Student Learning. Tom Guskey and Jane Bailey. Page 77.
[7] Classroom Assessment and Grading that Work—Robert J. Marzano. Page 122.
[8] Classroom Assessment and Grading that Work—Robert J. Marzano. Page 124.
[9] Fair Isn’t Always Equal—Rick Wormeli. Page 154. Wormeli quotes Stiggins here.
[10] Fair Isn’t Always Equal—Rick Wormeli. Page 154.
[11] Fair Isn’t Always Equal—Rick Wormeli. Page 154-155.
[12] Fair Isn’t Always Equal—Rick Wormeli. Page 157.

Cell phones in class

  • Mr. Crumrine’s Electronic Device Experiment
    Semester Two
    2008-2009 School Year
    Chemistry and Its Applications and Anatomy and Physiology Classes


    There has been much discussion this year about electronic devices and their place in the Concord High School community. While some would limit or outlaw electronic devices I come down firmly on the other side. Electronic devices are powerful tools that can connect us to each other and the work. The iPod touch, to highlight one, has thousands of educational applications. Some of them are as simple as the built in calculator while others provide students with interactive x-rays of the human body.

    Electronic devices can be used improperly—by both students and adults. I become pretty upset when I am giving a presentation and see people tapping away on their email accounts. And I really don’t like it when someone is ostensibly talking to me but in reality looking at their BlackBerry the whole time. But both students and adults can use these powerful tools in responsible ways. When I was in high school teachers had to teach us that our graphing calculators were appropriate for use in certain ways. In math class—OK. Playing tetris in English—not OK. We can do the same kind of teaching with electronic devices.

    During the second semester of this year my students and I came up with the following plan. We talked first about the value of electronic devices and then we talked about ways they could be used improperly.

    Here is the plan:


    Why would a student be allowed to use a cell phone/electronic device?

    ¨ Effective communication.
    ¨ Active self directed learner.

    In order to be successful after high school students need to know how to use modern technological tools. These include cell phones and other pocket electronic devices.

    The use of these tools however must be done in an appropriate way. Just as it would not be OK for an adult to text while a colleague is explaining something to them—it is not OK for a student to do the same.

    What do we do?
    • Use the calculator on your phone—OK at appropriate times.
    • Use the agenda feature—OK at appropriate times.
    • No texting at any time—because could disturb others outside of our class.

    Please ask for permission to:
    --use the calculator feature.
    --use the agenda feature in the last 5 minutes of class.

    In certain cases, with permission, you may be allowed to:
    --play games—work must be done.
    --listen to music—work must be done.
    --use the internet—you must use it for something related to class.

    Penalties
    • First offense—teacher takes cell phone—student gets it at end of class.
    • Second offense—teacher takes device—student gets it at end of school day.
    • Third offense—teacher takes device and turns it in to administration.


    I agree to this revised cell phone policy for our classroom only.

    Print Name:_______________________


    Sign Name:________________________

Reflections

The plan worked extremely well with the Anatomy and Physiology group.

  • I warned one student one time about improper use.
  • Nine or ten students had iPod touches (iPods touch?). Several of them used the anatomy flash card applications that are available for free or $0.99. One of them purchased a ten dollar application which was basically a digital textbook. They said they found it very helpful.
  • During our end of the year project several students used text messaging in an appropriate way to communicate with partners. An example is a group where 3 people were dissecting a cat and one person was in the library researching cat dissection.

The plan worked better than I expected with Chemistry and Its Applications
In a very cute and funny way students would always ask if they could use the calculator functions on their phones. I found this to be effective and it saved me money because I usually buy about 10 calculators per year with my own money.

  • A higher percentage of students in ChemApps had iPod touches when compared with Anatomy. But they did not take advantage of flash cards or other applications to my knowledge.
  • One notable exception was a student who had, on his own, downloaded a ten dollar spreadsheet application. We were doing a lab where the students had to take the temperature of a substance every 30 seconds. He asked if he could put the data in his phone. Not only did he input the data but he was able to quickly create a graph when he was done. While other students took about ten-15 minutes to create the graph he was able to immediately start answering the post lab questions. The most important part of this lab was not making but interpreting the graph so this was a plus.
  • There were several first offense violations during the semester (10) but students surrendered their phones for the period and I did not see repeat offenses except for the next bullet.
  • I encountered major issues with 2 students. They did not follow the cell phone policy at all even though they had signed the sheet. They would not surrender their phones when asked and used them pretty much whenever they wanted. I should have done a better job working with administration with these two students. I will say that these two students were the same ones who did not follow any of the other rules of our classroom. They walked out of class without asking, swore at me and other students, used racial slurs, and sometimes screamed. I don’t think any cell phone policy would cure them of their other ills.

Quick Conclusion:

I would be willing to work hard on a cell phone/electronic device policy that emphasizes proper use of these powerful tools. For our students these are the tools that they have used for communication since they first learned to communicate. Teaching proper use will not be easy but I would rather work on that than tell students they can never use the computer that is right there in their pocket.

28 March 2009

The Challenges of Mission Reform at Concord High School


Introduction[CSD1]
Since 2003 Concord High School[1] has been involved in the process of becoming a mission driven school. While framed by a new organization, their accrediting body NEASC, it is the same work that has been espoused by many organizations in recent decades. In researching this paper I found three binders in the shelves of the district office that were from the University of Dayton. They were published in 1991 and explained a complete plan to become a mission driven school. Many of the buzz words have changed but the basic process of examining a mission, and creating a plan for action that derives from that mission are the same.

So this summary of the work of Concord High School tells some of the recent history of the school and focuses on the problems that occur in bringing theory to practice. In this iteration of mission work our main guiding documents were the Understanding by Design documents specifically the recent book Schooling by Design by Grant Wiggins and Jay McTighe. The Concord School District has had a long history working with the Understanding by Design process and calls itself a UbD district. There are many branches of district teams that use UbD thinking to guide their work.

History
We have compiled the history of the last 5 years in a 73 page document but here are some highlights of the work done at Concord High School. In the years from 2003-2007 time was spent on building consensus. Malcom Gladwell, author of The Tipping Point, might say that we were in that holding pattern waiting for the tipping point to tip. This time was spent in philosophical discussion mainly focused on building consensus for change. At Concord High School there was little impetus to change because it was already such a good high school. Low dropout rate, high student and teacher satisfaction, lots of students going to good colleges and happy parents in the town.

In the case of Concord High School the work from 2003-2007 came together with two other important factors to bring us to our tipping point--the point where philosophical discussions end and the creation of a product and a program begins. A plan had been developed to guide work during the 2007-2008 school year when school leaders were informed that the school was being placed on warning by their accrediting institution NEASC. This warning status meant that they had to reformulate the plan during the 2007 summer to be much more aggressive in its goals. In addition to the strong suggestions from the accrediting institution the State of New Hampshire also was requiring that all high schools create course competencies that needed to be implemented in the 2008-2009 school year. Neither of these were much of a surprise but it meant that the high school now had little choice in what it needed to do. The time for discussion was over. 2007-2008 would be a year of products.

In the summer of 2007 teachers, administrators and the superintendent met and designed the CHS Plan. This plan clearly outlines the flow from very big district goals down to individual courses. This plan is based on the district’s continued work with Understanding by Design and is an adaptation of graphics found in Schooling by Design and the UbD professional development workbook. The CHS Plan served as a road map for the work that was done at CHS this year.

2007-2008—A Busy Year
Teaching is somewhat like putting out a newspaper every day. News writers might hope for more time to edit a story and more time to do research but the fact is that the newspaper has to come out every day. Writers do their best job and then turn in what they have at the deadline. It is the same for teachers. A common request is more time to work on curriculum and school planning. But the fact is that there is never enough time and the students keep coming in that door. Teachers do everything they can to be ready but at 7:45 they have to go to work—they have hit their deadline. This need to both run the school and partake in two big school changes was a constant theme of the work during the year. Teachers and school leaders constantly had to remain mindful of what the theory in the books said and what was possible for someone who also had to teach 140 students.

To lead the process principal Gene Connolly formed a Steering Committee in the summer of 2007. This group would meet weekly all year and guide the process. They were a one year task force with 4 specific goals.
Define the goals of the mission and express them as graduation expectations.
Create rubrics to measure the graduation expectations.
Pilot the use of the graduation expectations for each student.
Create competencies for each course.

The work began by asking all teachers one question, “What do you want students to know and be able to do when they walk across the graduation stage?” From this list the steering committee was able to compile one list that was divided into two types of expectations. Those were the Habits of Mind that were derived from the existing district goals and the Graduation Expectations that delineated specific academic goals for graduates.

Examples:
Habit of Mind:
Graduation Expectation:

The design was that the Graduation Expectations would be measured for each individual student during many points in their high school career. And that the Habits of Mind would me measured not for individuals but for groups of students.

The main thrust of the 2007-2008 work was in making rubrics to measure the Graduation Expectations and in implementing the use of the Graduation Expectations in classes.

The most successful step that the steering committee took was in its use and organization of the one all day professional day that the district does have. On this day in early October the steering committee organized a professional day that was attended by 2/3 of the faculty. (Faculty that could not attend had made commitments long before the day was planned.) The day was organized to define the graduation expectations and create rubrics to measure them. The participants were organized in mixed groups according to teaching specialty and years of experience. Two groups were assigned to work on each expectation and rubric. The group on technology for example wrote a goal statement for technology and then created a rubric for it. This was a very successful professional development day and by the end of it the faculty had created the expectation statements and the rubrics that would be used for the remainder of the year. Many faculty members expressed the sentiment that it was one of the most powerful professional days that they had ever attended.

The steering committee collected these rubrics, edited them and then presented them to staff. The second expectation on critical thinking was presented to staff in October. And the remaining expectations on oral communication, listening, reading and technology were presented to the staff in December. At each presentation members of the steering committee explained how these rubrics fit into the CHS plan. They also provided real examples of how these expectations could be used successfully in class.

Challenges
Schooling by Design is a wonderful book that takes the thinking of the UbD books to a school reform program. CHS will continue to work with the program described in the book and has already planned a summer retreat to continue to work with Grant Wiggins on the implementation of the CHS Plan over the next few years. This year has also been a year of learning about what can and cannot work at our particular school. With 150 teachers, 2000 students and a deadline of March 1 to complete the work—challenges inevitably arise.

Impetus for Change:
CHS had been discussing the philosophical basis for change for 4 years. While this pace was too slow in our eyes and especially in the eyes of your accrediting body it is important to spend time at the beginning of the process determining what the issue is. Wiggins and McTighe describe this in their book but it can easily be glossed over or a phase that is rushed through. It truly is the foundation for success though. No one ever drives by a construction site and marvels at the beautiful foundation but it is the most important part to any building. This is the same for mission reform. The work done at the beginning, upon which all other work is based, is the most important and least glamorous of all the work that is done.

Product:
At some point philosophical discussions need to end and the creation of a product needs to begin. Once CHS did move from our overly long foundation period it was critically important to keep everyone focused on creating a product during the year. This meant sometimes cutting off interesting philosophical discussion to bring a meeting group back to the task of working on the product at hand. This was particularly difficult at the beginning of the year…

Continual Change and Improvement:
There might never be a final product. Culturally we can become used to working on something and creating a final product. A product that is “done.” Mission reform is not like that. At CHS we used the example of how teachers teach. Every teacher starts with a product in their first year and builds upon it in each successive year of their teaching. The first time I taught biology I taught a unit on reptiles because that was one of the chapters in the book. I found a National Geographic that was a 90 minute show on reptiles, 15 worksheets and a note set from a different book. In subsequent years I first improved this unit and then realized that I should really be teaching reptiles within the bigger context of adaptations. Each year the presentation and information improved. The same approach is needed in this work. The rubrics to measure the graduation expectations this year were not perfect. The rubric for critical thinking was so well written that most people—students and adults—had trouble understanding what it meant. So in the next year we will work on using everyone friendly language in the rubrics.

Big Goals:
We constantly asked teachers to think about what they wanted students to know when they walked across the graduation stage. By continually coming back to this we kept the focus on what they really wanted to have as goals. We often said that if they were working on something that did not feel like it should be a graduation expectation…









[1] I will personify Concord High School in this paper to avoid long awkward phrases like, “the faculty at Concord High School,” etc.

[CSD1]Chris—take a quick look at this. It is a very rough first go. I will edit the writing more in later drafts. I am mainly interested in your thoughts on 1) structure, 2) questions that you have as an outside reader. I welcome anything you have to say.

20 February 2009

Rethinking Midyear and Final Exams
by
Tom Crumrine


If high schools need to be better then high schools need to change. Here is one story…

Introduction
New Hampshire has recently begun a statewide initiative to implement competencies in all high schools. This competency movement means that course credit will no longer be determined by seat time but by the attainment of specific learning goals. This means a change in how high school happens and how high school works. This study explains one example of how high schools might work differently in the future.

At a recent conference I attended Doug Reeves presented the idea that exams might come earlier and then there would be time for students to work on what they have not yet learned. Here is what I tried:

Based on Reeves’s work I decided to try using my summative midyear in some kind of formative way. At Concord High School exams are given the last week of January. This year I gave my students their midyear the week before we left for the December Holidays. Over the break I scored the sections of the test. I gave them a score on each of the major topics that we had covered so far. This resulted, not in one grade, but in nine for the test.

When we returned from the holiday break we were left with 2 weeks of school before the official exam time. With the test results I had identified who needed more help and in which areas. The class was then able to self select into two major categories. First, those students who needed little to no help and second, those students who needed help in several of the categories.

In some ways I was most concerned about the first group of students. What would they do? How will I make sure that they are not bored? How will I make sure their time is not wasted? In the end I decided that the students who needed little to know help would study atoms and nuclear chemistry in greater depth. Specifically, the students were given an article on the radioactive poisoning of the Russian spy Alexander Litvenienko, an internet exploration on nuclear submarines and more in depth study of isotopes than we had previously undertaken. All of these activities tied in with the competencies of the glass but they were more in the good to know category than in the must know category.

With the second group of students I began to think of ways to work on what they must know. I had four ninety minute classes before the exam so I considered how I would use each one.

For the first I returned the exams to all of the students and asked them to look at the areas where they had needs. My focus always was on what they could do to improve their understanding NOT on what they could do to improve their grade.

For the second day I organized the room into six stations. Each station was dedicated to one or two of the competencies that students had to show that they understood. Using an approach advocated by Fred Jones, I had posters on each table that showed the step by step approach to the more involved problems like how to write electron configurations. On the other tables I had books and information that directed students to read and improve their knowledge.

On the third day, darn this isn’t meant to sound like Genesis, we had similar activities that were meant to increase student understanding in each area. For the next 3 days we worked on this

13 February 2009

Mid Year Experiment

Early Midyear Exams
Middle of the night draft
By Tom Crumrine


In November I attended a conference and Douglas Reeves suggested giving midyears early, providing corrective instruction and giving the midyear again. A sysnopsis is found here:



So, I decided to try the experiment myself…

Introduction
The idea was to give the midyear at an earlier point so I decided to go with the logical pre-Christmas pre-exam. I have always wondered why we give first semester exams after a 2 week holiday so I just gave them early.

Upon our return to class in January I did the following things:


  • Over the holidays I “graded” the exams by highlighting areas where students could add more information.

  • On the first day back I gave students the exams and asked them to provide more information in the highlighted areas.

  • When I got the test back I marked the scored versus the standards.

  • With the scores v. the standards I was able to develop a plan to educate groups of students.

  • In the two weeks after the holidays and before exams I provided corrective instruction

When it came time to take the exam I created a test that tested the same standards but with different questions. If students had already scored a 5 on a particular measurement topic they did not have to respond to the new question. So some students had to do all 9 questions and some had to do only 1. (All students completed a common part of the exam that assessed basic science skills—calculation of density, metric conversions, lab safety, etc.)

The Results
Figure 1: Items 1-9 are the measurement topics. The numbers at the bottom are the averages of all student scores. The test dates were exactly 1 month apart with a 2 week holiday break at the beginning of the month and four 90 minute classes of corrective instruction prior to exam week.

Reflection
Obviously I was excited about the graph and the fact that the average for all measurement topics went up. But there are both positives and concerns with this approach.

Concerns
We spent four 90 minute periods on the corrective part. I will argue later that this is not wasted time but we did not go on to new material.
The students who did well the first time around actually did go on to new material but they were self directed as I spent most of the time working with the students who needed more help. The students worked on an extension of the atomic structure unit where they investigated isotopes by looking at the poisoning death of Russian agent Alexandre Litvenienko. The students that were good at being active self directed learners told me that they enjoyed this project and they were glad that they got to do it. But those students that were not good at self directed learning did not get much out of this extension project.
I scored both tests. I tried very hard to eliminate any bias that would come from doing this by not looking at the December scores when scoring the January test and by creating specific rubrics for each question—but the fact remains…

Positives
The corrective instruction took some time but all student scores went up. The scores were based on understanding of the topic so the understanding of my students increased with the extra two weeks of instruction. The research backs up depth over breadth but as a teacher who learned science in a different era—the one of breadth over depth with the memorization of tons of factoids—it feels like I’m doing something wrong.
A couple of students asked if they could forgo the extra project and help other students. I granted this request and the results were great. Seeing one student teach another how to describe the model of the atom is the kind of scene that makes you nearly tear up.
Students loved the fact that each test was essentially customized to them. Once they got over the newness of the fact that they only had to answer certain questions they really liked the approach. This also was the “reward” for those students who did well the first time around.

Conclusion
While I have concerns the positives do outweigh them in my mind. In order for high school to change we must change some things about high school. This is one experiment that will be worth repeating.

27 November 2008

homogeneity and class size

I was speaking with a fellow educator the other day about class sizes and homogeneity. Some thoughts I shared with him....

Class size reduction is an area of thought close to my heart. From my summers working with smaller numbers I have seen that it can have a great effect on my ability to keep in touch with each individual student. Recent studies on the effect of class size reduction do seem to bear this out. In the table below you see the research of three groups[1]. They all compare the increase in learning (in months) to the cost. (It is difficult to measure cost for the second one—thus the ?.)

Interventions
  1. Class size reduction from 30-20. 3 month increase in learning in a year at an estimated cost of $30,000.
  2. Increase in teacher knowlege from 50th percentile to 94th percentile. 1.5 month increase in learning at a cost of ?.
  3. Effective formative assessment. 6-9 months increase in learning per year at an estimated cost of $3000 per year.

Your second point about heterogeneity is one that interests me as well. I went to a school with all homogeneous classes so I don’t have the perspective of learning in a heterogeneous classroom. I do appreciate many aspects of homogeneity and think that combining it with reduced class sizes in specific classes might be the way to go. If 20% of students are failing English 9 then it would seem that one of the possible steps might be to take action by reducing class size to 20-22.

Later in the day I happened to be calling Grant Wiggins to set up a web conference and he talked about the idea whereby competencies might actually lead to “smart” homogeneity. He cautioned that he supports heterogeneity just maybe not in all cases. If I were to extrapolate his thinking I would say that at times homogeneity is the right thing to do and at times heterogeneity is the right thing to do. I know from many of his books and speeches that he is against mindless devotion to any one educational system. He always counsels that as professionals we must thoughtfully decide what is best for students.

My own view is that smart homogeneity is a good idea but one that cannot be done easily. It requires everyone to understand the subtle (all too subtle) differences between homogeneity and tracking. Poorly done homogeneity is more damaging to students than poorly done heterogeneity. That is too sweeping but I feel that there is some truth to it. I support the use of good formative assessment to teach a heterogeneous group in a one room school house style. With good formative assessment you find out who needs what and teach accordingly. Then in the next unit you find out who needs what and teach accordingly. The homogeneous groups within the class are fluid.

On Dec. 3rd I will talk about the third row of the table which is the area where we can take action right now. That said I greatly encourage a push in the community to educate other community member and the school board to the fact that education is an investment NOT an expense. States chose to get into the business of education long ago because they knew it was the right thing to do—even in tough economic times it is important to remember that the best path to future prosperity lies in educating the citizenry.

I had this quote from Dylan Wiliam in another piece I wrote but will add it here as a way of closing:

“If you achieve at a higher level, you live longer, are healthier, and earn more money…In addition, people who earn more money pay more taxes, are less likely to depend on Medicaid or welfare, and are less likely to be in prison. It has been calculated that if a student who drops out of high school would stay to graduate, the benefit to society would be $209,000 (Leve, Belfield, Muenning, & Rousse, 2007). This sum is made up of $139,000 in extra tax revenue, $40,500 savings in public health cost, $26,600 savings in law-enforcement and prison costs and $3000 in welfare savings. Eric Hanushek (2004), a leading economist of education in the United States, has calculated that if we could raise each student’s achievement by one standard deviation (equivalent to raising a student from the 50th to the 84th percentile), over 30 years, the economy would grow by and additional 10%, and just the additional taxes being paid by everyone would more than pay for the whole of K-12 education.”

1. [1] Jepsen and Rivkin (2002)
2. Hill Rowan and Ball (2005
3. Wiliam, Harrison and Black (2004)

Homework

Prompted by reading the latest English Journal from November 2008 some thoughts on homework.


1. My students usually don't do it. The ones who I think "need" to do it are the ones who definitely don't do it.
2. The only clear effect I have seen is a negative effect on grades. This is from when I used to grade homework.
3. Now that I use a policy of "getting homework done" I have found that I still don't see the kids who need to do homework still don't do it.
4. When I gave students choices of penalties for not doing homework they still did not adhere to turning the homework in--my ultimate goal. In this case I gave them 3 choices 1) turn the homework in the next morning with no penalty, 2) I call home and then they turn the homework in, 3) stay after school and get the homework done. I had 3 of the 10 students stay after and 2 of the students turn it in the next day. This rate of 50% doing it in the end is the same as I have always found, no matter what penalty I use.

Interesting ideas from the articles:
  1. Choice of homework. Offer students a choice of what they want to do. For example teach a lesson and during the last 10 minutes have them choose what homework they would like to do to prove that they understand the material. Using this approach my wife suggested some scaffolding where we would show examples of effective student work the next day. I plan to try this approach next week and will report on how it goes.
  2. It isn't the homework but the right homework. It is really important to give the "right" homework so that it is effective for the stated goals. I have been thinking about this over the years but just as I have been more intentional about the right assessments I need to be more intentional about the right kinds of homework.

08 November 2008

Responses to Assessment Conference

Responses:

I loved reading those. The one that most hit home to me was 1-5 (or 1-7) grading/assessment system, rather than percentages. I just could not agree more that percentages alone mean absolutely nothing -- this is clearly a big thing that AP and IB get right.

I also think the emphasis on progress reports is huge --- while teaching, I found this to be the most draining (in terms of both energy and time) aspect of the job, but it's also the way to make the biggest difference. Reading your stuff really makes me long to be back in the classroom.

Another one:
Wow, I had the same thought as [the writer above] as I was reading (about wanting to be back in the classroom). I actually was afraid that he would walk into the office tomorrow and tell [his boss] he was done...

Really interesting stuff and I think the fact that you are posting these things (and I'm assuming making that available to other teachers) is absolutely an incredible way to communicate the stuff you took away from the conference to the staff. So much resonates.

I would definitely encourage you to not be shy about getting this in front of teachers. You know how busy people are. Send them the link 3 times or find some other way to do it. It is important.

Averaging and Zeroes

http://www.teachertube.com/view_video.php?viewkey=dbd43d54b1307129474f

This is a clip of Dr. Douglas Reeves speaking to a Canadian audience about what he calls "toxic" grading practices. Reeves is the author of more than 25 books and countless articles on education.

In the clip Reeves talks about zeroes and averaging. We showed this clip to our high school faculty and there were wide ranging responses:
  • Students deserve the average because this helps differentiate the steady performing student from the student that does poorly all the time but well at the end.
  • Students are a sum of all of their performances so the average is the correct score for them.
  • Zeroes are an essential part of grading.
  • I want students to see zeroes and I want them to be calculated in the grade.

Here I want to clarify and expand upon some of what Dr. Reeves was getting at. First in the case of the average.

While in the clip he states provocatively that all averaging must go, what he and other researchers have been preaching for the past decade is to end a mindless devotion to the average as the only way of evaluating students. In fact the average might be the right score for a given student. I, along with Reeves and other researchers, am arguing that the average is not the best evaluation for all students.

It comes back as always to a conversation about standards. Is our goal to get them to the standard (in our parlance competency)? If we work hard as teachers and students work hard at learning and understanding and they make it to the standard what should the grade represent? Why should it be the average in this case? If everyone can meet the standard at the end but then we average scores it not only hurts students but it hurts us. The scores are a poor representation of how we operated as teachers. Grading is always a subjective process. As professionals we strive to minimize the subjectivity but we cannot eliminate it. As professionally trained practitioners we should allow ourselves to award students the score, the evaluation, that most appropriately matches their ability.

As far as zeroes I have posted on this many times but take one more example.

  • 100-40=A
  • 39-30=B
  • 29-20=C
  • 19-10=D
  • 9-0=F

When you present this example people say that is ridiculous! But this system is as mathematically unsound as the system where the top four categories are 10 or 11 points and the last category is 59 points. So this is the first argument against zeroes--it is simply mathematically unsound.

The second argument is that it does not increase motivation. And has been shown by Dr. Reeves to have a role in whether struggling students stay in school or leave. Zeroes motivate only one type of student--good ones, ones like teachers used to be when they were in the classroom. The students that we worry about the most are not motivated to do work by receiving a zero. To the contrary they are encouraged to give up because when zeros mount the combination of their extra mathematical weight and the increase in a feeling of hopelessness cause students to shut down.

I feel strongly that zeroes should not be used and the average should not be used in all cases. That said, if a teacher still wants to use zeroes and averages as the only way to go I would ask them to continue that practice only after reflecting on exactly why they want to do it that way. As professionals we will always evaluate in different ways--the question is: Is the way you reach the evaluation of a student the best representation of what they can do?

02 November 2008

Now What?

OK--so I went to this great conference--see previous post from Nov. 1--now what do I do?

The conference on assessment either confirmed some ideas that I was trying to work on in my teaching or reminded me that there are things that I need to do better on.

Confirmed
  • Zeroes--Doug Reeves calls assigning zeroes toxic. I now have more confidence than ever to continue not assigning zeroes.
  • Averaging only--I will continue to look at progress and the most recent evidence to compute student scores. This is made more difficult by an electronic grade book that only averages but I will go back to paper if I have to.
  • Formative assessment--the most important thing to focus on.

Reminded

  • Assess means to "sit beside." I need to work on giving even more timely feedback to my students. I will work on making contact with each student at least once during a 90 minute period. During this contact I will try to really ascertain whether they are getting it or not.
  • Randomization. Student participation needs to be random. This lets kids know that they can be called on at any time so they stay more involved. I will finally buy the Popsicle sticks that I have been meaning to get, and put each students name on one of them. This is how I will draw their names randomly.
  • Hands down except to ask a question. No one can raise their hands. I will pull the Popsicle stick and call on them.
  • Pass on a question. I have always allowed students a pass. But I will change this policy so that my response will be, "OK, but I'll come back to you at the end." This means that they need to stay engaged and listening to the others because I will come back to them and say, "What did you think was the best answer of those three and why?"
  • Non-fiction writing. I knew that writing was important but I did not know of its profound effect on all subject areas. Thank you Doug Reeves for this one! Even in physics and math (and science) an increase in non-fiction writing about the subject increases student scores. I do a lot of non-fiction writing but I will improve upon what I do and make it more systematic. The first thing I am going to do is to have students write about the most important thing that they learned in our class during the first semester. They will post these on the wall outside of our room. We will do this on Monday. A second thing that I would like to work on is a blog of student work. This may begin as a paper newsletter but I hope I will be able to morph it into a publication at some point.
  • Graphing of student performance. I do a little of this now but I need to improve what I do and make it, again, more systematic. I will create a one page sheet for each competency and begin having students graph their performance.

School Wide

  • At the Beyond ABC conference in 2006 we were told that one thing that we should change immediately is progress reports. If they include a number they are not progress reports. Reports with a number are fine by the way--they just aren't progress reports. I will work harder than ever to finally make real progress reports a reality again at Concord High School. I have great respect for the progress report committee of last year (I have to my wife was on it) but their findings are in opposition to the research. I feel that we do not need to discuss this one. A leader should simply explain the following: 1. We give students an achievement report every day through our online system Parent Connect, 2. This means that we do not need to print off a special "paper" achievement report at a given time, 3. What we do need is an official day where teachers are encouraged to sit beside students and discuss progress. NOT the grade, but progress. How is the student doing in relation to meeting the competencies? How is the student doing in relation to the Habits of Mind?, 4. We value this progress conversation so much that we are setting aside 4 days per year and we want you to use these days to sit and converse with students about how they are doing.
  • 101 point grading system. I will work to continue to educate teachers, students and parents about the fallacy of the reliability of the 101 point system. If the AP board thinks that 5 levels are OK then we don't need to continue to do 101.
  • 1-5 scale. I will work to continue to educate people on the logic and the reduced subjectivity of the 1-5 scale.

I should have this all accomplished by the end of the week. Maybe 2 weeks.

01 November 2008

Ahead of the Curve Conference Report

Teaching is the most cognitively difficult thing I have ever done in my life. Compared to classroom teaching, running a university is easy.

-Dylan Wiliam—Interim President University of London, and author of more than 250 books and articles on education.

Last week I was honored to be sent to a conference called Ahead of the Curve. This conference brought together many of the best minds and greatest researchers in the field of education. The list: Tom Guskey, Bob Marzano, Anne Davies, Stephen White, Dylan Wiliam, Ken O’Connor and Rick Stiggins presented on a wide range of assessment issues. From nearly 20 hours of presentations and conversations with colleagues from around the country I have culled the top 13 things that I have learned or had reinforced for me as a result of this experience. All 13 are based on, not one or two studies but dozens and in cases hundreds of researched studies. The 13 items do not represent fringe ideas or controversial issues—they are as close as we get in this business to accepted ideas.

Top 13 (It is Halloween Weekend) and they are in no particular order
1. Whatever the test, the scores should mean the same thing.
2. Never rely on a single assessment to determine a student score.
3. Graphing results of student performance. Has a big effect size. Need to be doing this.
4. Explaining what stays and what does not is critical.
5. Standards were created in part to reject the bell curve. If we are doing standards we should not see a bell curve at the end.
6. Format doesn’t matter.
7. Impact of the Jills.
8. Feedback should be like PE and band and sports.
9. Dropout prevention.
10. The myth of the 101 point system.
11. Progress Reports.
12. Teachers work differently, students work harder.
13. Minute by minute corrections.

From Bob Marzano
1. Whatever the test, the scores should mean the same thing.
When a student takes a test in any area they should know that the score in one class means the same thing as a score in another class. This means that an A in one class should mean the same thing as an A in another class. Or for our world—we should agree that 3 means competent and 2 means nearly there no matter what the class. Even though I have been a leading advocate of a point system with fewer categories I would even settle for A, B, C, D and F as long as we refocused it to have a standards based meaning rather than a norm based meaning.

2. Never rely on a single assessment to determine a student score.
Statistics show that even the very best single classroom assessment cannot measure a student’s true ability accurately. It will give a score but fairly simple statistics show that the student’s true score (true ability) can be plus or minus 15 percentage points of that value. To combat this teachers need to base a student grade on many pieces of evidence.

3. Graphing results of student performance. Has a big effect size. Need to be doing this.
Students need to be creating graphs of their learning. The research shows that this has an incredible effect on student learning. So much so that Marzano said that if we aren’t doing it we should start immediately.



From Doug Reeves
4. Explaining what stays and what does not is critical.
It is crucial to explain to teachers, students and parents what will not change. For example in our current work—teacher autonomy will not change, it never will, it can’t. The competencies will be the same and the assessments will be common but how you teach the material will be up to you. This is an area I am going to improve upon as we move forward with our work together.

5. Standards were created in part to reject the bell curve. If we are doing standards we should not see a bell curve at the end.
Benjamin Bloom said, “There is nothing sacred about the normal curve. It is the distribution most appropriate to chance and random activity. Education is a purposeful activity, and we seek to have students learn what we have to teach. If we are effective in our instruction, the distribution of achievement should be very different from a normal curve. In fact we may even insist that our educational efforts have been unsuccessful to the extent that the distribution of achievement approximates the normal distribution.” I won’t pretend to think that I can better Bloom’s quote but I will add that it is from 1981.

6. Format doesn’t matter.
Doug Reeves actually did a study on this. He looked at plans that he deemed ugly and plans that he deemed pretty. (He is a great researcher so he did have parameters but this is about how he explained it.) Do not focus on creating a beautiful binder that sits on a shelf. Focus on the work and creating something that will work in class and with students. The simple competency template, for example, was just a guide—it works for some it does not for others—awesome. Some folks are using the traditional UbD template, others are coming up with something new—do what works for you within the bounds of goal, assessment, learning plan.

7. Impact of the Jills.
“Jill” is the awesome teacher in the classroom next door. More than any other person (like an assessment coordinator, for example) this teacher leader is the key person and the most influential person on practice. We need to go out and see the good things that other teachers are doing. In our district we are lucky to have many of these—find them and go see what they are doing. And aspire to become more of one yourself. Corollary to Impact of the Jills: We have learned from copious studies and the experience right in front of our faces that students need to learn by doing. Teachers need to learn by doing as well. Seeing what Jill is doing and then trying it out is good practice.

8. Feedback should be like PE and band and sports.
The goalie in a soccer game comes too far out of the net and the opposing team kicks the ball in a loop over his head for an easy score. In order to correct this, the coach makes a note with a red pen in an improvement journal and when the season is over lets the goalie know that he should only come that far out of the goal in certain situations. Sound right? NO. Give lots of accurate and useful feedback—feedback that students can use to correct what they are doing right now. Think about how much feedback an orchestra conductor or a PE teacher give while a lesson is going on. It isn’t always easy but we need to try to emulate these examples in other areas of teaching too.

9. Dropout prevention. Again these aren’t random suggestions they are research based statements from Doug Reeves. He said that these are the things that he would do immediately to combat dropouts.
Literacy—double time—everyone gets double the literacy time—reading is that statistically important
Time management assignment notebook—need to teach all students what they need to do organizationally to be successful.
Immediate intervention—before failure
Engagement—extracurricular policy
o 3-4 is the ideal—this is the range of extras that have a positive effect on learning.
o Need to work on kids who have zero
o Evidence says that if they are more engaged they have better attendance and
o Private schools are always in extracurriculars even when students are not doing well.
o There are consequences but the consequences are not removing them from extras.
Price of freedom is proficiency
Homework may not be about home
Outlaw zeroes--
Early final exam—do early final exams
o Give exam 2 weeks early. Those who are competent are done.
o Those who are not stay and work more.
o A district that did this went to 90% passing.
Credit recovery—ID reason for F and figure out what to do.

10. The myth of the 101 point system.
We have been fooling ourselves. With the advent of calculators and then computers and then computer grading programs teachers moved from A, B, C grading to percentage grading. While crunching numbers into an average does yield a percentage it clouds what the student actually knows and provides little information about what, specifically, needs to be done to improve. It is not a reliable measure. While one teacher may claim to be able to tell the difference, with her students, between a 71 and a 72, there is no way that separate teachers evaluating independently would ever come to this fine of a separation. Corollary myth—the public expects percentages (parents, colleges, students). In truth parents already clamor for and colleges love AP classes which in their end result award one of 5 categories. (The International Baccalaureate offers 7.) If a student takes a practice AP test and scores a 3 they know in very specific terms what they need to work on to move up to the 4 category. This type of conversation can happened with percentages—it is just not as easy. Why make communication harder for students?

From Ken O’Connor
11. Progress Reports.
A report with a grade is an achievement report not a progress report. At the high school Parent Connect now allows parents and students to see a daily achievement report. The need for us to print out one more at a specific point in time is now zero. The high school now has no official progress report and in light of competencies and the needs of students it would be good if one was reincorporated. Since the students now have constant access to their achievement level what is needed more than ever is a conversation about progress. Ok Sweta, you see that you have a C. Let’s talk about what that means and what we can do together to improve that grade over the next few weeks. Especially with competencies it might be appropriate to say, “A C is a perfect place to be right now—your progress thus far in the course is on target. We will of course work together to improve your understanding and thus your grade but right now you are progressing wonderfully.” Alternatively a conversation might happen this way, “Vesper, you have a C and at this point in the year that is evidence that you aren’t making sufficient progress. Let’s talk about what we can do together to improve your understanding.

From Anne Davies
12. Teachers work differently, students work harder.
The person who is tired and busy is the person who has done the learning. Teachers will continue to tire themselves outside of class but in class they should be the ones who are guiding not relearning the material they already know. Students should be stuck, confused and challenged—this is when they learn. One teacher that we heard about has a sign in their class that says, “Stuck? Good. It was worth coming in today.” There are many ways of doing this but the big idea is to put the onus on students to demonstrate what they can do.

From Dylan Wiliam
13. Minute by minute corrections.
There are many solutions that we as educators have tried. Most of those solutions have been superficial and easy to implement—the problem is they have not worked. Wiliam says that now is the time to get down to the difficult solutions. The number one effect on student learning is the teacher that they have. The number one strategy that affects learning is formative assessment. Formative assessment means assessing students on a minute by minute or second by second basis so that one can make changes in a nimble an effective way.

One more from Dylan Wiliam
Education is not an expense, it is an investment.
“If you achieve at a higher level, you live longer, are healthier, and earn more money…In addition, people who earn more money pay more taxes, are less likely to depend on Medicaid or welfare, and are less likely to be in prison. It has been calculated that if a student who dropes out of high school would stay to graduate, the benefit to society would be $209,000 (Leve, Belfield, Muenning, & Rousse, 2007). This sum is made up of $139,000 in extra tax revenue, $40,500 savings in public health cost, $26,600 savings in law-enforcement and prison costs and $3000 in welfare savings. Eric Hanushek (2004), a leading economist of education in the United States, has calculated that if we could raise each student’s achievement by one standard deviation (equivalent to raising a student from the 50th to the 84th percentile), over 30 years, the economy would grow by and additional 10%, and just the additional taxes being paid by everyone would more than pay for the whole of K-12 education.”


Want to learn more?

A little bit of everyone
Ahead of the Curve—edited by Doug Reeves—this book has a chapter written by each of the people I mentioned.

Bob Marzano
What Works in Schools
School Leadership that Works


Doug Reeves
Making Standards Work
The Learning Leader: How to Focus School Improvement for Better Results
Many articles online and in Educational Leadership


Tom Guskey
How’s My Kid Doing?
Designing Grading and Reporting Systems

Many articles available online and in Educational Leadership

Dylan Wiliam
Inside the Black Box—Phi Delta Kappan 1998 (Let me know and I’ll make you a copy.) This is the study that began the modern push for formative assessment.

Ken O’Connor
How to Grade for Learning

Anne Davies
Making Classroom Assessment Work

05 October 2008

More on zeros

After a post on not using zeros in grading a reader questioned:

Just wondering if you've made any inroads with the administration or other teachers on this topic--particularly with regard to the after school policy.

Nearly 3 years after bringing the research on zeros to teachers there has a been a very good response to the idea. I wouldn't say that there has been a halt to the use of zeros but teachers are more conscious of why they might still give them.

The biggest progress has been made in the area of grading behavior. Teachers have quickly understood that there can be a difference between grading behavior and grading achievement v. a standard. The idea of not grading behavior or at least making it a separate grade has gained a lot of traction.

As far as the idea of a unified policy on staying after school for not turning in work--there is little progress. We are working so much on the things that come before a grading policy that we can all agree on that we won't be at this point for a while.

28 September 2008

McCain on Education

John McCain believes American education must be worthy of the promise we make to our children and ourselves. He understands that we are a nation committed to equal opportunity, and there is no equal opportunity without equal access to excellent education.


From: http://www.johnmccain.com/Informing/issues/19ce50b5-daa8-4795-b92d-92bd0d985bca.htm


Again as in the last post, everything in grey or black is from the site. The comments in green are mine.


No Child Left Behind has focused our attention on the realities of how students perform against a common standard. John McCain believes that we can no longer accept low standards for some students and high standards for others. In this age of honest reporting, we finally see what is happening to students who were previously invisible. While that is progress all its own, it compels us to seek and find solutions to the dismal facts before us.


I agree with this. As Collins says, "we must confront the brutal reality." I am more concerned by what the site goes on to say.


There is no shortage of federal programs targeted at early child care and preschool. State and federal funding for early childhood care and education programs is over $25 billion each year. The list of programs includes Head Start, Title I preschool programs, Early Head Start, Even Start, the Individuals With Disabilities Education Act, Early Reading First, the Social Services Block Grant, the Child Care and Development Block Grant, and Temporary Assistance for Needy Families. There is much to be achieved by leveraging and better coordinating these programs to increase availability of high quality programs. When used effectively this approach has had a tremendous impact on the wellbeing and educational outcomes of children.


Read--no more money for early childhood education. While coordination will absolutely improve these programs what is needed is a cultural change in the education of 0-3 year old children. It does not seem like this is what McCain is talking about.


State-level preschool and early care programs have created greater access for very young children whose families could not otherwise afford high quality programs. Several states such as Minnesota have launched new, high quality pre-K programs with a commitment to study their outcomes. Estimates are that 70-85 percent of children from low-income families have access to early care and/or preschool, and that nearly 90 percent of children younger than five with employed mothers are in a regular child care arrangement. However, due to complicated formulas and budgetary constraints, not every low-income child is getting access to high quality care and education on a consistent basis. Federal dollars can do far more to broaden access to high quality programs.



I agee with some parts of this but there are also some questionable ideas. Seventy - 85 % have access to early care? 1) If true it can't be the kind of educational early care that will affect learning, 2) 90% in regular child care--I have no doubt--but since their is no correlation with scores or achievement it can't be working.