Ongoing doubts about Reading Recovery

This is the hub of the site and the place to post queries, start discussions and join in the conversation!
Post Reply
User avatar
Debbie_Hepplewhite
Posts: 2500
Joined: Sat May 23, 2015 4:42 pm

Ongoing doubts about Reading Recovery

Post by Debbie_Hepplewhite »

The article from 2006 was flagged up on Twitter only recently.

Are Reading Recovery personnel masters at fudging the RR methodology and, it has to be said, the actual results that can be obtained from use of the Reading Recovery programme? See here:

https://www.edreform.com/edspresso-shot ... y-salvato/
“R” STANDS FOR READING RAT RACE (NANCY SALVATO)

October 27, 2006

In the Summer of 2001 Dame Marie Clay, creator of the New Zealand based Reading Recovery program, and her entourage came to the Rayburn House Office Building in Washington, DC, to speak with House Education Committee Staffer Bob Sweet. Her purpose was to ascertain whether Reading Recovery would be eligible for Reading First funding once the bill was passed. Bob explained to Ms. Clay that explicit, systematic phonics instruction had to be included in any program eligible for RF funding because it was one of the necessary key components of reading instruction that had been established through decades of carefully conducted quantitative research. These findings had been validated in the Report of the National Reading Panel in 2000 and were now going to become an essential part of the Reading First Law. He pleaded with Ms. Clay to use her extensive network of teacher training programs all over the US to help in the implementation of the RF program. He encouraged her to provide the leadership within the RR family to make the modifications necessary, and thus make RR eligible for RF funding consideration.


With a stare as cold as ice, Marie Clay replied that RR would not be making any changes to their program; however, Mr. Sweet could be certain a new description of its components would be written in such a way as to bring it into compliance with the RF law. Momentarily dumbfounded, he maintained that Reading Recovery could not be eligible for RF funding without modification, and his initial estimation then still stands today.
I have checked with Bob Sweet to ensure that this piece by Nancy Salvato is accurate and he has confirmed that it is.

Further, it was noted in England in 2006 when Sir Jim Rose's recommendation for systematic phonics was accepted by the, then, government - and the Searchlights multi-cueing reading strategies (akin to the multi-cueing word-guessing strategies of Reading Recovery) was replaced by the Simple View of Reading model, that teachers were being given contradictory guidance because the government was still funding and promoting Reading Recovery through its 'Every Child a Reader' initiative.

Which guidance were teachers expected to follow? The Systematic Synthetic Phonics teaching principles with no multi-cueing reading strategies or the mixed methods, multi-cueing reading strategies approach of Reading Recovery? I took this up with Ed Balls, Secretary of Education at that time, and he insisted that promoting RR was valid because 'it works'.

But how well does 'it work' and does 'it work' for every child? These are the fundamental questions that are raised about RR over and again not only by teachers but also by researchers as a consequence of their close scrutiny of reports on Reading Recovery's results casting doubts.

In England's context, I have asked a 'National Leader' for Reading Recovery where I can find the literature to describe the changes to Reading Recovery which are claimed and implied by RR personnel in England in light of Sir Jim Rose's recommendations being adopted by the government. I got simply nowhere with my inquiry.
User avatar
Debbie_Hepplewhite
Posts: 2500
Joined: Sat May 23, 2015 4:42 pm

Re: Ongoing doubts about Reading Recovery

Post by Debbie_Hepplewhite »

Serious questions were recently raised, yet again, about the validity of yet another new study of Reading Recovery via an educational forum:
According to a report published in Education Week, a new study of Reading Recovery has found that the program had a significant positive impact on students' reading achievement (see http://mobile.edweek.org/c.jsp?cid=2592 ... id%3D57345).

..........................’s comment on the study was as follows:

Let me just point our a few fatal but common flaws in this study:

1. The study relies on the Observational Survey (OS) as a measure.

2. The OS is not a validated or reliable measure. Claims it is reliable and valid depend on equating consecutive levels of reading as equivalent. Even then, the results are not good. Studies using the OS then give credit to a single level of improvement as a real gain even though the reliability and validity of the OS requires us to treat one level gained as no actual gain. They want to have their cake and eat it too.

3. Children in RR get regular practice taking the OS. Children in the control group do not.

4. RR is, to a great extent, repeated practice in the methodology of the OS. RR lessons very much mirror an OS administration. RR is, in this respect, a massive exercise in teaching to the (very bad) test.

5. The OS is a subjective measure of reading. As such, great care must be taken to assure that OS administrators are blind to whether the child is from the experimental or control group. No such efforts were made. Trained RR teachers gave the OS, and knew the students to be in either the control or experimental group. This alone invalidates the entire study and makes it worthless.

6. The control group gets no consistent, validated intervention from trained teachers. It's like comparing a new cancer treatment to aroma therapy then claiming the results prove your treatment is valid. We have no idea what those other children were or weren't getting. The whole design is rigged.

Propose this study as an assignment in an undergraduate research methods class in any respectable psychology department and you would get a middling grade with lots of comments in red ink. Propose it at the end of the course and you should expect to fail. Do it in education and you get headlines.
In response to the issues raised about the validity of the RR study and the validity of the OS measure itself, this led to the suggestion:
Is it not time we all agreed that:

· Clay’s Observational Survey is not a valid or reliable measure to use for the evaluation of RR, for all the reasons that ............... points out.

· There is no point in comparing the effectiveness of RR versus a standard classroom program, probably based on the same ineffective approach as RR and providing no alternative effective intervention.

· If one really wants to look at the effectiveness of RR versus the effectiveness of interventions based on the systematic and explicit teaching of the various skills required for reading (phonemic awareness, phonics, vocabulary, fluency and comprehension), which in our current state of knowledge is really the only useful thing to do, one needs to set up a study looking specifically at a comparison between these two approaches. Unfortunately this is probably not possible, since RR programs would probably not agree to be involved in such a study.

One would therefore need to look at alternative strategies for collecting this kind of data. Perhaps by monitoring trends on NAPLAN results for schools implementing a whole language plus RR approach versus schools implementing a program based on systematic explicit teaching of synthetic phonics.
It seems that whilst questions continue to be raised about the efficacy of the expensive Reading Recovery programme, no amount of challenges and raising awareness of worries regarding its practices makes a jot of difference.
Dick Schutz

Re: Ongoing doubts about Reading Recovery

Post by Dick Schutz »

Ironically, Reading Recovery is still thriving in the US and the legislation that was enacted failed in both intent and execution.
Post Reply