Listen: At a Loss for Words
0:00

An MPR News Presents broadcast of the APM Reports education documentary “At a Loss for Words - What's wrong with how schools teach reading.” A look at how a flawed idea is teaching millions of kids to be poor readers.

[Program begins with news segment]

Awarded:

2019 EWA National Award for Education Reporting, finalist in Public Service (Smaller Newsroom) category

2020 The Gracie Allen Award, Reporter / Correspondent / Host [Radio – Nationally Syndicated Non-Commercial] category

Transcripts

text | pdf |

[MUSIC PLAYING] SPEAKER: The power that we are going to learn today, it's called picture power.

STUDENTS: Picture power.

EMILY HANFORD: There's a theory about reading that's deeply embedded in elementary school teaching practices.

SPEAKER: She said, if you don't know the word, just look at the first letter. Is it the fox or the bear?

EMILY HANFORD: This theory was disproven decades ago by cognitive scientists but it continues to be taught.

SPEAKER: They would get to an unfamiliar word, they would look at the beginning of the word then guess the rest of it.

EMILY HANFORD: When kids are taught this way, it's more difficult for many of them to learn to read.

SPEAKER: It was so hard to ever get them to slow down and sound a word out because they had had this experience of reading as being easy.

SPEAKER: The minute you ask them just to pay attention to the first letter look at the picture look at the context, you're drawing their attention away from the very thing that they need to read the word or to remember the word.

EMILY HANFORD: Coming up, an APM Reports documentary, At A Loss For Words, What's Wrong with how Schools Teach Reading? From American Public Media. First, this news.

LAKSHMI SINGH: Live from NPR News in Washington, I'm Lakshmi Singh. The FBI is searching the suburban Detroit home of the president of the United Auto Workers as part of a broader investigation of union corruption. Spokeswoman Maria Schneider confirms agents had entered a home in Canton Township today but did not confirm that it was that of Gary Jones. The UAW argues the search is unnecessary because it had been cooperating with the federal investigation. Agents have also searched the California home of UAW's former President Dennis Williams as well as the Union's Michigan retreat.

Americans in Puerto Rico and the US Virgin Islands are getting ready for a tropical storm that could reach hurricane strength by the time it reaches them. Forecasters predict Dorian could grow to category 3 status as it nears a US mainland later. The Trump administration is planning to redirect more than $155 million in federal money away from emergency efforts as the major storm bears down on Puerto Rico and other areas.

NPR's Franko Ordóñez reports the administration wants to use the money to help with enforcement of immigration policy at the Southern US border.

FRANKO ORDONEZ: The Trump administration says the border surge has overstretched their resources. Officials claim they need the extra money to address the lack of detention space for new migrants, particularly single adults showing up at the border. They argue the money is left over from previous years and won't impact current recovery efforts in Puerto Rico. President Trump yesterday signed an emergency declaration promising additional federal aid for the recovery.

But Democrats are slamming the decision as wrongheaded and cruel as Tropical Storm Dorian speeds towards Puerto Rico and Florida. Those FEMA funds help communities clean up and rebuild after disasters. Franco Ordonez, NPR News, Washington.

LAKSHMI SINGH: Democratic presidential candidates have a final shot at making it to the debate stage in Houston next month if they have not yet made the cut. NPR'S Jessica Taylor says those trailing have until the end of today to qualify.

JESSICA TAYLOR: The Democratic National Committee doubled the benchmarks from June and July, requiring candidates to register at least 2% in four national or early state polls and reach 130,000 unique donors. So far, 10 candidates have hit both marks, including Joe Biden, Kamala Harris, Bernie Sanders, and Elizabeth Warren. That means the candidate field will be cut in half and there will be just one debate next month, unless another candidate qualifies today.

Then the candidates will be split across two nights. Billionaire activist Tom Steyer needs just one more qualifying poll in order to make the stage next month in Houston. Hawaii Congresswoman Tulsi Gabbard needs two more polls. Jessica Taylor, NPR News, Washington.

FRANKO ORDONEZ: At last check on Wall Street, the Dow was up nearly 200 points. This is MPR News.

SPEAKER: Support for news comes from C3.ai. C3.ai software enables organizations to use artificial intelligence at enterprise scale, solving previously unsolvable business problems. Learn more at C3.ai.

STEVEN JOHN: For NPR News, I'm Steven John. The National Weather Service has confirmed storms that hit Malacca earlier this week produced a pair of tornadoes. A Weather Service survey crew determined one tornado Southeast of Malacca Monday spun along a two-mile path and had an estimated peak winds of 90 miles an hour. That tornado was rated EF1. Another weaker tornado hit North of town and ran for nearly four miles with 80 mile per hour winds.

No injuries were reported, although there were some outbuildings, and vehicles damaged in the storm. The city of St. Paul is hosting a community discussion at City Hall this evening. It's the first since Mayor Melvin Carter held his budget address earlier this month. Nina Moini has more.

NINA MOINI: The city says the event will include an overview of Mayor Carter's proposed budget. After that, council members will join small tables by each ward to listen and discuss city priorities. The mayor says the city is facing a $17 million budget gap next year. He's proposed an increase of 4.85% to the city's general fund levy. Housing, mental health, and fixing city streets were among the mayor's top concerns. City council members must pass the budget by the end of the year. City Hall is located two blocks from the green line in downtown St. Paul. Nina Moini, NPR News.

STEVEN JOHN: The Minnesota State Patrol and agencies from three other states will be looking to stop aggressive drivers along Interstate 94 during the Labor Day holiday period. Troopers from Minnesota, Wisconsin, North Dakota, and Montana plan to focus on drivers who tailgate, speed, and violate lane change, and hands-free laws. The agencies also are looking for distracted drivers. Sunny to partly cloudy for Minnesota today, 60s to mid 70s for highs. The time now is 12:06.

SPEAKER: Support comes from Maplewood Toyota. From the Prius All-Wheel Drive to Camry and Highlander, you can find the hybrid that's right for you during the national clearance event. You can visit Maplewood Toyota today online at maplewoodtoyota.com.

[MUSIC PLAYING]

STEVEN JOHN: Welcome to MPR News Presents. I'm Steven John. It's back to school season, and this week we're airing a three-part series of new documentaries from our APM Reports documentary unit. Today's is called At a Loss for Words, What's Wrong with how Schools Teach Reading?

EMILY HANFORD: From American Public Media, this is an APM Reports documentary. Molly Woodworth was a kid who seemed to do well at everything, good grades in the gifted and talented program. But she had a secret.

MOLLY WOODWORTH: I fooled everyone.

EMILY HANFORD: Molly couldn't read very well.

MOLLY WOODWORTH: I was totally lost. There was no rhyme or reason to reading for me. When a teacher would dictate a word and say, tell me how you think you can spell it, I sat there with my mouth open while other kids gave spellings. And I thought, how do they-- how do they even know where to begin? You know, I was totally-- it didn't make sense to me.

EMILY HANFORD: Her classmates just seemed to know how to read but Molly didn't and she says no one ever taught her, so she did the best she could.

MOLLY WOODWORTH: I came up with my own way to read.

[MUSIC PLAYING]

EMILY HANFORD: Number one, memorize lots of words. So you would read along and there would just be some percentage of the words you just had memorized?

MOLLY WOODWORTH: Yeah, and I didn't know that then, but I had really, really good memory.

EMILY HANFORD: She says words were like pictures to her. When she came across one she didn't have in her visual memory, she'd look at the first letter and come up with a word that seemed to make sense. Reading was kind of like a game of 20 questions. What word could this be? Most of the time, Molly could get the gist of what she was reading, but getting through text took forever.

MOLLY WOODWORTH: I hated reading because it was taxing. My brain hurt by the end of it. And I'd get through a chapter and it was like, ugh, I was done, you know? I wasn't excited to learn. I didn't want to do any more. It took all the wind out of my sail to get to that point.

EMILY HANFORD: It was clear to her that other kids could read faster and better, but she had no idea how they did it. If she was called on to read out loud in class, she'd say she had a stomachache and go to the nurse. It all worked well enough to keep her on the honors track through high school. Molly's reading problems didn't really catch up with her until it was time to take college entrance exams.

MOLLY WOODWORTH: I couldn't get through the ACT. Someone in the gifted and talented program couldn't get through the test. And it wasn't-- again, it wasn't because I was not intelligent. It was because I could not get through the reading fast enough. My tools were too slow.

EMILY HANFORD: I'll tell you what happened with Molly in the ACT at the end of this program. But for now, we're going to fast forward about a decade. Molly gets married. She has a little girl.

CLAIRE WOODWORTH: Hi.

EMILY HANFORD: That's Molly's daughter Claire playing with my recording equipment.

CLAIRE WOODWORTH: It's really loud.

EMILY HANFORD: It's loud, I know. I should probably turn it down. Claire's in first grade. Learning to read has been hard for her. So once a week, Molly brings Claire to a reading center.

SPEAKER: All right, tell me the sounds in clap.

CLAIRE WOODWORTH: C, l, uh, p. Clap.

EMILY HANFORD: Claire is working on phonemic awareness. That's the understanding that spoken words are made up of individual sounds or phonemes.

SPEAKER: What's trip without the rr.

CLAIRE WOODWORTH: T, ih, p. Tip.

SPEAKER: You are so good at that.

EMILY HANFORD: Claire first came to this reading center before she started kindergarten. Her mom wanted to make sure she got off to a good start in reading.

MOLLY WOODWORTH: And I felt really comfortable with where she was at going into kindergarten. You know, she had a good base. There was no, like, alarming signs. You know, she was on track.

EMILY HANFORD: But alarm bells started going off when Molly saw how Claire was being taught to read in school. One day, Molly was volunteering in Claire's classroom. The class was reading a book and the teacher was telling the kids to practice the strategies that good readers use.

MOLLY WOODWORTH: And she said, if you don't know the word, just look at this picture up here. There was a fox and a bear in the picture and the word was bear. And she said, so look at the first letter. OK, it's a B. What sounds with B? Is it the fox or the bear?

EMILY HANFORD: Molly was stunned.

MOLLY WOODWORTH: I thought, oh, my, god, those are my strategies. Those are the things I taught myself to look like a good reader, not the things that good readers do. And I didn't know what good readers do, but I knew it wasn't that.

EMILY HANFORD: Things didn't get better as kindergarten went on. Claire would get books that had words like sailboat and butterfly, big words she didn't know how to read yet. But there was a picture and she was supposed to look at the first letter and guess.

MOLLY WOODWORTH: And it just continued. I would see these things they were doing, my little dirty secrets and they were being taught. These kids are being taught to look like good readers. My survival techniques, that was their bag of tricks.

EMILY HANFORD: Molly went to Claire's teacher and said she was concerned about the way kids were being taught. The teacher said she was teaching reading the way the curriculum told her to.

[MUSIC PLAYING]

From APM Reports, this is At a Loss for Words, What's Wrong with how Schools Teach Reading? I'm Emily Hanford. The way Claire Woodworth was taught to read is rooted in an idea about reading that was debunked decades ago by cognitive scientists, yet this idea remains deeply embedded in teaching practices and curriculum materials that are commonly used in elementary schools.

As a result, in classrooms across the country, children are being taught to read the way that poor readers read. In other words, the strategies that people with weak reading skills use to get by are the very strategies that many beginning readers are taught in school. This makes it harder for many kids to learn to read. And children who don't get off to a good start in reading find it difficult to ever master the process.

This can lead to a downward spiral where behavior, vocabulary, knowledge, and other cognitive skills are eventually affected by slow reading development. A disproportionate number of poor readers become high school dropouts. In the United States, 1/3 of fourth graders can't read on a basic level. Most students are still not proficient readers by the time they finish high school.

This hour, I'm going to show you how a disproven idea about how people read is part of the problem and how it is still widespread in curriculum materials that school districts spend hundreds of millions of dollars of taxpayer money on. We're going to begin with the idea itself. For that, we need a little history. People have been arguing for centuries about how children should be taught to read. There are basically two perspectives. One view is that kids need to focus first on sounds and letters.

SPEAKER: McGuffey's Eclectic Primer, lesson 1.

EMILY HANFORD: The sounds and letters approach, also known as phonics, was popularized in the 1800s with the McGuffey readers. This is from a McGuffey audio book I found on YouTube.

SPEAKER: C, ur, t. A rat. A cat.

EMILY HANFORD: The other view is that children shouldn't focus on sounds and letters. They should focus instead on whole words.

SPEAKER: This is Dick and Jane reading level 2.

EMILY HANFORD: The whole-word approach was perhaps best embodied in the Dick and Jane books that first appeared in the 1930s. This is a guy who grew up with Dick and Jane reading one of the books on YouTube.

SPEAKER: Come here, Dick. Come and see Puff.

EMILY HANFORD: The Dick and Jane books rely on lots of repetition and pictures to support the meaning of the text.

SPEAKER: See puff play. See puff jump. See puff jump and play.

EMILY HANFORD: In the whole-word approach, the idea is that learning to read is a visual memory process. See words enough and you eventually store them in your memory as visual images. With phonics, the idea is that children learn to read words by sounding them out.

[MUSIC PLAYING]

Reading instruction was basically a series of pendulum swings between whole word and phonics until the late 1960s when a new idea came along. The basic theory was first presented in 1967 at the American Educational Research Association Conference in New York. There's no audio of the event, but here's what happened. An education professor named Ken Goodman presented a paper called "Reading, a Psycholinguistic Guessing Game."

In the paper, Goodman rejected the idea that reading is a precise process that involves exact or detailed perception of letters or words. Instead, he argued that as people read, they guess the words using various kinds of information or cues. He grouped these cues into three categories. One cue for figuring out a word is what kind of word would work. For example, is it a noun or a verb? Goodman called these syntactic cues.

SPEAKER: The man rode his--

EMILY HANFORD: The missing word must be a noun. Maybe it's bicycle or motorcycle or horse. Another cue for figuring out a word is to look at the meaning of the sentence. What word would make sense here?

SPEAKER: The cowboy rode his--

EMILY HANFORD: Ah, a cowboy rides a horse or maybe the word is pony. Goodman called these semantic cues. A third cue to figure out a word is to look at the letters. Goodman called those graphic or graphophonemic cues.

SPEAKER: The cowboy rode his--

EMILY HANFORD: Oh, the word begins with P. It's probably pony. Goodman proposed that as people become better readers, they rely less and less on graphic cues. Instead, they use context to predict the words and just sample from the letters to confirm their predictions. This was a new idea about how people read. It helped form the theoretical basis of an approach to teaching reading known as whole language.

In whole language, learning to read is not about memorizing words as in the whole-word approach and it isn't about sounding out words as in phonics. Reading is coming up with words that make sense, using what came to be known among educators as the three cueing system. For Goodman, accurate word recognition was not necessarily the goal of reading. The goal is to comprehend text. If the sentences are making sense, the reader must be getting the words right or right enough.

SPEAKER: I wish I had a garden [INAUDIBLE] here is some flower seeds.

EMILY HANFORD: This recording of a boy reading was part of a BBC Radio program about Goodman's work produced in 1986.

SPEAKER: Plant them in your ground, said frog.

EMILY HANFORD: What the boy reads is not exactly what the text says. As here's the announcer explaining to the radio audience.

SPEAKER: What the book said was, "here are some flower seeds. Plant them in the ground."

SPEAKER: Here is some flower seed. Plant them in your ground.

EMILY HANFORD: When the boy read is instead of are and your instead of the, he made a couple of miscues. That's what Ken Goodman called them. Here he is in the BBC program.

KEN GOODMAN: And a miscue is, very simply, some place where something unexpected happens in oral reading where what the reader does isn't what we expected the reader to do. That's a miscue. By no means is the goal to produce miscue-free reading.

YETTA GOODMAN: In fact, I keep saying that--

EMILY HANFORD: That's Ken's wife Yetta Goodman. They work together.

YETTA GOODMAN: --in my teaching I want to help kids produce more higher quality miscues.

EMILY HANFORD: A high quality miscue is one that makes sense, where the meaning of the sentence is preserved, even if the exact words are not read.

YETTA GOODMAN: And what we have to let the reader know is it's perfectly all right when you come to words you don't know. We all do that in our reading. And what we do with it, we have a lot of strategies as adults, legitimate strategies. We can skip it. We can read back. We can keep reading.

EMILY HANFORD: The Goodmans traveled all over the world in the 1970s and 80s, talking to educators about their theory of how people read. One person they met was a developmental psychologist from New Zealand.

MARIE CLAY: My name is Marie Clay and--

EMILY HANFORD: Marie Clay created a reading intervention program for struggling first graders called reading recovery. It became one of the most widely used reading intervention programs in the world. This interview is from a video tribute to Clay produced after she died.

[MUSIC PLAYING]

MARIE CLAY: The work that I do is not just practical work. The work that I do is founded on pretty strong theory.

EMILY HANFORD: Clay's theory also relied on cueing. Her cues became widely known among teachers as MSV. M for using meaning to figure out what a word is. S for using sentence structure. And V for using visual information, that is the letters in the word. In the queuing theory of how reading works, when a child comes to a word she doesn't know, the teacher encourages her to think of a word that makes sense and asks, does it look right? Does it sound right?

If a word checks out on the basis of those questions, the child is getting it. She's on the path to skilled reading.

[MUSIC PLAYING]

Marie Clay and Ken and Yetta Goodman were trying to understand what goes on in people's minds as they read. They couldn't actually get inside anyone's head, so they observed people as they read out loud. The theories they developed were good guesses based on what it seems like people are doing when they read. But it turns out skilled reading doesn't quite work the way they thought. Laboratory for the Neurodevelopment of Reading and Language, that's your lab?

SPEAKER: Yes

EMILY HANFORD: OK. Hi. I'm at the University of Maryland to visit a reading lab. I don't know quite what I was expecting, but this wasn't it. There's no fancy equipment, no lab techs working on experiments. It's just an office with a couple of desks, an old couch, and a graduate student's bike up against the wall.

DONALD BOLGER: This is our kind of humble facilities.

EMILY HANFORD: That's Donald Bolger, also known as DJ. He studies how reading works in the brain.

DONALD BOLGER: We have testing rooms upstairs we might go--

EMILY HANFORD: We're going upstairs in a bit to watch a demonstration of one of DJ's experiments. But first, I want to give you some background.

[MUSIC PLAYING]

Over the past 50 years or so, scientists in labs and classrooms all over the world have done thousands of studies about how skilled reading works and how people learn to do it. Something they were especially interested in early on is whether skilled readers use context to read words or whether they rely on the letters in the words. A couple of graduate students at the University of Michigan thought the context idea made sense.

It seemed likely that as people get better at reading, they would rely more on their knowledge of vocabulary and language structure to recognize words and wouldn't need to pay as much attention to the letters. In 1975, graduate students Keith Stanovich and Richard West set out to see if this was the case in their lab. They recruited readers of various ages and abilities and gave them a series of word reading tasks. What they discovered surprised them. It was the less skilled readers who were more dependent on context for word recognition.

The skilled readers were able to recognize words without relying on context at all. Other researchers have done similar experiments and it turns out the ability to read words in isolation instantly and accurately is the hallmark of being a skilled reader. This is now one of the most well-replicated findings in all of reading research. In addition, experiments show skilled readers do not read words as visual images.

Instead, they very quickly recognize a word as a sequence of letters. That's how a reader knows the difference between house and horse, for example. To better understand how all this works, we're going back to the reading lab at the University of Maryland. We're heading up to one of the testing rooms Professor DJ Bolger mentioned earlier to see a demonstration of an experiment he first did when he was a graduate student.

[CHATTER]

Two of DJ's students have volunteered to be the guinea pigs for today's demonstration. We climb to the top floor of the building and enter a small room with low ceilings and no windows. There are two cubicles set up with computers. It feels like a tiny call center in an attic. Student Alyssa Cole runs through the experiment first.

DONALD BOLGER: Alyssa, you can start and hit number one.

EMILY HANFORD: Alyssa is going to learn how to read some English words that are spelled using Korean letters. These are simple words like bud and duck. But Alyssa doesn't know how to read words spelled with Korean letters, so she's kind of like a typical kindergartner. She knows the meaning and pronunciation of these words, but she doesn't know how to read them. She's going to be taught using an approach that calls her attention to how the sounds in each word are represented by letters.

SPEAKER: Buh, uh, d. Bud.

EMILY HANFORD: As each sound in the word is articulated, the Korean letter that represents that sound is highlighted on the computer screen. Alyssa is learning in what DJ Bolger called the phonics condition. The other student Hannah Wiseman is learning the same words in a different way. DJ called it the holistic condition.

SPEAKER: Bud. Duck. Kin.

EMILY HANFORD: Hannah is seeing the whole word as it's read. There's no sounding out, no highlights on the screen that help Hannah understand how each sound is represented by letters. This is the whole-word method, the Dick and Jane approach.

HANNAH WISEMAN: That was so hard.

[CHUCKLING]

Oh, my god.

EMILY HANFORD: When DJ first did this experiment in the early 2000's, there was already lots of research that showed phonics is more effective than whole word for teaching people to read. What DJ wanted to know is why.

[MUSIC PLAYING]

In the real experiment, college students were trained and tested four times over four days. The students who were taught whole word did better than the phonics students at first. They were able to memorize some of the words and do better on the tests. But by day 4, the students who learned in the phonics condition were doing better. Not only were they better at reading the words they'd been taught, they were better at reading words they'd never seen before. The big news of the experiment came when DJ and his colleagues got a peek inside the brains of their subjects using functional magnetic resonance imaging or fMRI.

DONALD BOLGER: We wanted to kind of get an inside glimpse of what these brains would look like in these two different learning methods. And I was expecting that those with holistic learning method would look almost like your run-of-the-mill dyslexic in that many children with dyslexia learn to memorize lots of whole words but they actually don't tend to activate the areas of the brain that are associated with phonology and pronunciation.

EMILY HANFORD: And this is exactly what he found. His experiment and other studies show that people who are taught phonics learn better because focusing on letters and sounds increases activity in the area of the brain that is best wired for reading. So if you teach people through whole-word method, you're teaching them to read like a dyslexic reads?

DONALD BOLGER: That is correct.

EMILY HANFORD: However, just because a student is taught to read with the whole-word method doesn't mean he'll end up stuck reading words that way. In DJ's study, about half the students in the whole-word group were able to get beyond memorizing words. They figured out the relationships between the sounds and the letters. But half the students in the whole-word group weren't able to teach themselves to read. That's in contrast to the phonics group where everyone learned to read.

DONALD BOLGER: Phonics worked for everybody, for all of the participants in the phonics group. They were uniformly doing well.

EMILY HANFORD: What does all of this have to do with the idea of using context to read? After all, in DJ's study, the students were reading isolated words. Wouldn't putting those words in the context of a sentence help? Well, think about it. If you're a beginning reader and you don't know any of the words in a sentence, context isn't going to help you much. If you already know how to read a lot of words, it's a different story. Even expert readers need context in some cases. Take a word like match.

DAVID KILPATRICK: We can't even know what match means unless it's in context because it can mean a competition, it could mean something you light a fire with, it could mean two things that look alike or are the same.

EMILY HANFORD: This is David Kilpatrick. He's a psychology professor at SUNY Cortland in Upstate New York and the author of a book about preventing reading difficulties.

DAVID KILPATRICK: We need context for comprehension for understanding. Nobody questions that. But the confusion is that when you see the word match, the word match jumps out at you. You don't need context to figure out that that's the word match. You need context to figure out the meaning.

EMILY HANFORD: If you're a skilled reader, you know the word match instantly, whether that word is by itself or in a sentence. In fact, your brain has gotten so good at reading words, that you process the word match faster than you process a picture of a match. You know tens of thousands of words instantly on sight. How did you learn to do that?

[MUSIC PLAYING]

It happens through a process called orthographic mapping. Orthographic mapping occurs when you attend to the letters in a written word and link the word's pronunciation with its sequence of letters. Orthographic mapping requires an awareness of the speech sounds in words and an understanding of how those sounds are represented by letters. In other words, you got to have phonics skills. Here's David Kilpatrick.

DAVID KILPATRICK: It's really sequential. First, you develop a mastery of the code and then that allows you to become better at the orthographic mapping process. So once you are good at phonics, you teach yourself new words that get anchored in your long term memory.

EMILY HANFORD: By the time a typically developing reader gets to about second grade, he needs just a few exposures to a word through both its pronunciation and its spelling. And bam, the word is orthographically mapped to his memory. He doesn't recognize that word because he's memorized it as a visual image. He recognizes it because at some point, he successfully sounded it out. The more words he maps to his memory like this, the more he can focus on the meaning of what he's reading.

He's not using his brainpower to identify words. He's using his brainpower to comprehend what he's reading. That child is a skilled reader. What's the process for people who are not skilled readers?

DAVID KILPATRICK: They only sample from the letters because they're not good at sounding them out and they use context.

EMILY HANFORD: This is David Kilpatrick again.

DAVID KILPATRICK: So the three-cueing system is the way poor readers read.

EMILY HANFORD: And if teachers use the three-cueing system to teach reading, they're not just teaching kids the habits of poor readers. David Kilpatrick says they are actually impeding the orthographic mapping process.

DAVID KILPATRICK: So the minute you ask them just to pay attention to the first letter or look at the picture, look at the context, you're drawing their attention away from the very thing that they need to interact with in order for them to either read the word or to remember the word.

[MUSIC PLAYING]

EMILY HANFORD: Some kids realize pretty quickly that sounding out a word is the most efficient and reliable way to know what it is. They don't necessarily need to be taught this. They figure it out. Those kids tend to have good phonological skills. It's not difficult for them to understand the ways that sounds and letters work. But if this doesn't come easily to you, say you're Molly Woodworth who we met at the beginning of the program, if you're Molly and the sounds and letters thing just doesn't make sense and no one teaches it to you, you're going to come up with a bunch of other strategies to try to get by.

Reading for you is kind of like being a detective. You're hunting everywhere for clues. Now consider a kid who's in the middle, OK phonological skills, not great. Maybe he could eventually figure out reading on his own. But then along comes his teacher who tells him, being a good reader is like being a detective. You need to search for clues and develop a bunch of strategies to solve all those tricky words.

In the United States today, this is how many children are being taught to read. According to David Kilpatrick, the three-cueing system is ubiquitous in American schools.

[MUSIC PLAYING]

Coming up after the break, we're going to find out what three-cueing looks like in the classroom, why schools are still teaching it, and how it harms children. You're listening to At a Loss for Words from APM Reports. There's more at our website apmreports.org. You can find an annotated version of this story with links to articles about the cognitive science research. Support for APM Reports comes from the Spencer Foundation and Lumina Foundation. Back in a moment. This is APM American Public Media.

STEVEN JOHN: You're listening to this new documentary on MPR News Presents. Programming on Minnesota Public Radio is supported by Michigan Technological University. Congratulating Professor Jean Pruneau, recipient of the 2019 Michigan Tech research award. Online at mtu.edu.

EMILY HANFORD: Welcome back. I'm Emily Hanford and this is At a Loss for Words, a documentary from APM Reports. We're going to Manhattan now to meet Erica Meltzer. Until a few years ago, she was an SAT tutor. This was $400-an-hour tutoring kids who went to schools considered among the best in New York City. Erica was startled by the way some of her students read.

ERICA MELTZER: They would get to an unfamiliar word, they would look at the beginning of the word and then they would just sort of guess for the rest of it.

EMILY HANFORD: They wouldn't even try to sound it out.

ERICA MELTZER: They would just plug in a word that looked like the word that was there and it wouldn't occur to them that they were misreading the word.

EMILY HANFORD: These were not students with diagnosed learning disabilities. She says it was hard to raise their test scores.

ERICA MELTZER: And I was like, what is this?

EMILY HANFORD: Erica started searching online and came across an article about the three-cueing system. It was written by a cognitive psychologist named Marilyn Adams. The article describes how the three-cueing system conflicts with what researchers have figured out about reading.

[MUSIC PLAYING]

How Marilyn came to write this article has an interesting back story. In 1991, Marilyn had written a book summarizing the research on how children learn to read. One big takeaway from the book is that becoming a skilled reader of English requires knowledge of sound spelling correspondences. Another big takeaway is that many kids were not being taught this in school. Soon after the book was published, Marilyn was describing her findings to a group of teachers and state education officials in Sacramento, California. She was sensing discomfort and confusion in the room.

MARYLIN ADAMS: And I just stopped and said, what is it that I'm missing? What is it that we need to talk about?

EMILY HANFORD: A woman raised her hand and asked, what does this have to do with the three-cueing system? Marilyn didn't know what the three-cueing system was.

MARYLIN ADAMS: I think I blew all of their fuses that I did not since this was so fundamental to being an elementary reading teacher.

EMILY HANFORD: The teachers explained the three-cueing system to her. They said readers use meaning, sentence structure, and visual cues to read. Marilyn thought this made perfect sense. We absolutely use all of those things to comprehend what we're reading. But Marilyn soon figured out the disconnect. Teachers understood these cues as the way readers identify words. In their minds, it was a reason not to do much phonics instruction.

MARYLIN ADAMS: The most important thing was for the children to understand and enjoy the text. And from that understanding and joy of reading, the words on the page would just pop out at them.

EMILY HANFORD: She would explain to teachers at every opportunity that explicitly teaching children about sound spelling correspondence is essential to ensure all kids get off to a good start in reading. But she got tons of pushback.

MARYLIN ADAMS: They didn't want to teach phonics.

EMILY HANFORD: They told her phonics instruction kills the joy of reading.

[MUSIC PLAYING]

In the 1990s, there was a big national fight going on about how kids should be taught to read. On one side, phonics. On the other side, the whole language approach rooted in the queuing theory. Marilyn Adams wrote her article about encountering the three-cueing system in 1998. She hoped the article would help put the idea to rest. The scientific research on reading was gaining traction at this point. A National Reading Panel report commissioned by Congress came out in 2000.

It documented overwhelming evidence that phonics instruction enhances children's success in learning to read. Many whole language supporters eventually accepted the weight of the scientific evidence about the importance of phonics instruction. They started adding phonics and renamed their approach balanced literacy, but they didn't get rid of the three-cueing system. It's not hard to find classrooms where children are taught cueing.

SPEAKER: The power that we are going to learn today, it's called picture power. Can we say picture power?

STUDENTS: Picture power.

SPEAKER: And I'm going to put--

EMILY HANFORD: This is a video posted on a website for teachers. It's a kindergarten class in Oakland, California. The lesson is part of the units of study for teaching reading series, more commonly known as reader's workshop. Here's the teacher describing the goal of the lesson.

SPEAKER: The learning goal would be that the children were able to use a picture to figure out an unknown word or that they would be able to use the picture and a first sound to determine an unknown word in their book. In the garden.

EMILY HANFORD: That's the book the class is reading. On each page, there's a picture of something you might find in a garden. The sentence on every page is the same except for the last word.

TEACHER AND STUDENTS: Look at the caterpillar.

EMILY HANFORD: The kids have been taught to memorize the words look, at, and the. Challenge is getting the last word in the sentence. The lesson plan tells the teacher to cover up the word with a sticky note. The wiggly kindergarteners come to a page with a picture of a butterfly.

STUDENTS: Butterfly.

SPEAKER: Some friends are thinking--

EMILY HANFORD: The teacher tells the kids she's guessing the word is going to be butterfly. She uncovers the word.

SPEAKER: Look at that, it starts with the buh, buh, buh. So let's read it together.

TEACHER AND STUDENTS: Look at the butterfly.

EMILY HANFORD: As you can hear, this lesson includes some attention to sounds and letters. In fact, the lesson plan says this lesson teaches phonics. But the students were not taught to sound out words in this lesson. They were taught the cueing system. The author of the lesson Lucy Calkins refers often to cueing in her published work. Cueing is foundational to another approach to teaching reading known as Fountas and Pinnell literacy. Irene Fountas and Gay Su Pinnell are education professors who have written many books for teachers, including a bestseller called Guided Reading.

They also sell a reading assessment system to schools that uses what are called leveled books. Children start with predictable books like In The Garden and they move up levels as they're able to read the words. But many of the words in those books-- butterfly, caterpillar-- those are words beginning readers haven't been taught to sound out yet. One purpose of the books is to teach kids that when they get to a word they don't know, they can use context to figure it out.

Teacher Margaret Goldberg remembers a moment when she realized what a problem this was. A first grader named Rodney came to a page with a picture of a girl licking an ice cream cone and a dog licking a bone. The text said--

MARGARET GOLDBERG: My little dog likes to eat with me.

EMILY HANFORD: But Rodney said--

MARGARET GOLDBERG: My dog likes to lick his bone.

EMILY HANFORD: Rodney breezed right through it, unaware that he hadn't read the sentence on the page.

MARGARET GOLDBERG: And that's one of the things that I started noticing with the students is that when they were given texts that they couldn't read, they would just make it up. And a lot of times, the making it up looked close enough to the book that a teacher could think, oh, they had just miscued on a word.

EMILY HANFORD: Margaret Goldberg is a literacy coach in Oakland, California. She was hired a few years ago to teach something called LLI. That stands for Leveled Literacy Intervention. It's a Fountas and Pinnell approach to help struggling readers and it teaches cueing. Around the same time, Margaret went to a training in a program that uses a different approach. The program is called Systematic Instruction in Phonological Awareness, Phonics, and Sight Words, otherwise known as SIPPS.

MARGARET GOLDBERG: And so I started teaching some groups with systematic instruction. And some groups, I was still doing LLI because I felt like I had been hired to do it. It was my responsibility to provide the instruction I was hired to give.

EMILY HANFORD: She began to notice differences in her two groups of students.

MARGARET GOLDBERG: Not just in their abilities to read but in the way that they approach their reading.

EMILY HANFORD: Margaret and a colleague recorded students talking about reading. This is Margaret's colleague interviewing two first graders.

SPEAKER: What makes you good readers?

EMILY HANFORD: Here's Mia who was in Margaret's SIPPS group learning phonics.

MIA: Looking at the words and sounding them out.

EMILY HANFORD: Mia's friend Jabriya was taught some phonics. She was also taught cueing. What makes Jabriya a good reader?

JABRIYA: I look at the pictures and I read it.

[MUSIC PLAYING]

EMILY HANFORD: There is a pre-reading stage where children identify words based on visual features and context. A child who knows the word stop on a stop sign, for example. But the cognitive science shows that teachers need to be moving kids away from relying on context. Margaret Goldberg didn't know this yet. What she knew is that the kids in her SIPPS phonics group were being taught that when you get to a word you don't know, you sound it out.

The kids in her LLI group were being taught that when you get to a word you don't know, you have lots of strategies. You can sound it out. You can also check the first letter, look at the picture, think of a word that makes sense and make a good guess. It was clear to Margaret after just a few months that her SIPPS phonics students were doing better. So she stopped teaching LLI and the cueing that goes with it just couldn't do it anymore.

MARGARET GOLDBERG: And I think one of the things that I still struggle with is a lot of guilt. It was a few months that I did it and I did lasting damage to these kids. So the kids that I had in LLI, it was so hard to ever get them to stop looking at a picture to guess what a word would be. It was so hard to ever get them to slow down and sound a word out because they had had this experience of reading as being easy. They had had the experience of knowing that you predict what you're going to read before you read it.

[MUSIC PLAYING]

EMILY HANFORD: Learning to read is not easy for many kids. That's one of the big takeaways from decades of scientific research. We're not born wired to read. But through connecting the pronunciation and meaning of words with their spelling, we rewire our brains a bit. Margaret Goldberg soon discovered this cognitive science research. She hadn't learned about this research in her teacher preparation or on the job. Once she knew about it, she wanted her colleagues to know about it too.

[CHATTER]

MARGARET GOLDBERG: OK.

EMILY HANFORD: For the past two years, Margaret and another literacy coach Lonnie Mednick have been leading a grant-funded pilot project to improve reading achievement in Oakland. Nearly half the district's third graders are below grade level in reading. Margaret and Lonnie want to raise questions about how kids in Oakland are being taught to read. They meet every couple of weeks with literacy coaches from the 10 elementary schools in the pilot project. Today, the coaches watch a video.

SPEAKER: The power that we are going to learn today, it's called picture power. Can we say picture power?

STUDENTS: Picture power.

EMILY HANFORD: It's the video you heard of the kindergarten class. Lonnie Mednick says the point of watching this video is not to criticize the teacher.

LONNIE MEDNICK: So this teacher meant well and it seemed like she believed that this was a lesson that would ensure her students would be on the road towards reading.

EMILY HANFORD: Lonnie wants the coaches to consider the beliefs about reading that would lead to the creation of a lesson like picture power. The coaches see right away that the lesson was designed to get kids to use context. But coach Soraya [INAUDIBLE] Brooks says until this pilot, she thought cueing was fine, as long as kids were also getting some phonics instruction.

COACH: At first, I didn't see the problem if you were teaching phonics, right? And I thought it would be OK. And then I realized that it one negates the other.

EMILY HANFORD: In other words, cueing sends the message to kids that they don't need to sound out words. They can use other strategies instead. But the scientific research is clear, developing good sound spelling knowledge is critical for figuring out unknown words and eventually storing them in your memory. Now that the coaches in the Oakland pilot project know about this research, they're in an uncomfortable position. Their jobs include observing and giving feedback to teachers who deliver the picture power lesson. Margaret Goldberg lays out the situation they're in.

MARGARET GOLDBERG: This is a district-adopted curriculum.

SPEAKER: Right.

MARGARET GOLDBERG: She was teaching a lesson that she was told to teach, so she has in writing something that is telling her that this is the right thing to do. And that makes this conversation a little bit more tricky because it's not like we're asking a teacher to stop teaching something that she pulled off of Pinterest. We're having a conversation about the core curriculum adopted by our district. So what do we do?

EMILY HANFORD: No one in the room has a good answer to this question. What they're doing instead is trying to show the district there's a better way to teach reading. Schools in the pilot project use grant money to buy new materials that steer clear of the three-cueing idea. Two charter school networks in Oakland are working on similar projects to move their schools away from cueing. Here's what it looks like in one first grade classroom at a charter school in Oakland called Achieve Academy.

ANDREA RUIZ: Here we go. Ready? Isaac, ready?

EMILY HANFORD: Three students are sitting at a kidney-shaped table with their teacher Andrea Ruiz.

ANDREA RUIZ: S, k, ip. Blend.

STUDENTS: Skip.

ANDREA RUIZ: Good. I'm going to say the sounds, OK, Isaac? You'll blend them together. S, k, in. Blend.

STUDENTS: Skin.

EMILY HANFORD: This lesson is from the SIPPS phonics program you heard Margaret Goldberg talking about earlier. Explicit phonics is one part of the reading instruction. There are also vocabulary lessons.

ANDREA RUIZ: Let's think about what chameleons' prey are.

STUDENTS: They're bugs. Bugs and--

ANDREA RUIZ: Do you remember?

EMILY HANFORD: The first graders are now gathered on a rug at the front of the classroom talking about a book Ms. Ruiz read out loud to them. One of the words in the book was prey, P-R-E-Y.

ANDREA RUIZ: What animals are a chameleon's prey? Or we can also ask, what animals do chameleons hunt for food?

EMILY HANFORD: The kids turn and talk to each other.

STUDENT: A chameleon's prey are a bugs and insects and other chameleons and mice and birds. That's it.

EMILY HANFORD: Other vocabulary words these first graders have learned are posted on cards around the classroom. They include wander, persevere, squint, and scrumptious. The kids aren't expected to be able to read those words yet. The idea is to build their oral vocabulary so that when they can read those words, they know what the words mean. This comes straight from the scientific research, which shows that reading comprehension is the product of two things.

First, a child needs to be able to sound out a word. Second, the child needs to know the meaning of the word she just sounded out. So in a first grade classroom that's following the research, you want to see explicit phonics instruction and also lessons that build oral vocabulary and background knowledge. And you want to see kids practicing what they've been taught.

BELINDA: I want to meet them at the gate.

EMILY HANFORD: This is Belinda and she's reading what's known as a decodable book. Almost all the words in this book contain spelling patterns Belinda has been taught in her phonics lessons. There are some common words she's learned to memorize as sight words because they don't fit the spelling pattern she's been taught, words like is and have.

BELINDA: I am a farm here.

STEVEN: A farmer.

BELINDA: Farmer here.

EMILY HANFORD: The boy you heard is Steven, another first grader. He's Belinda's reading buddy. His job is to help her if she misses a word or gets stuck. But that doesn't happen much because Belinda's been taught how to read these words. Are you looking at the pictures when you read?

BELINDA: No.

EMILY HANFORD: No, she says. Belinda doesn't need the pictures to read the words. Pictures are great to look at and talk about and they can help a child comprehend the meaning of a story. Context, including a picture if there is one, helps us understand what we're reading all the time. But if a child is being taught to use context to identify words, she is being taught to read the way that poor readers read.

[MUSIC PLAYING]

In the long running debates about how to teach reading, the fight has mostly been about whether to teach phonics. That fight is pretty much over. You'd be hard pressed to find a school today that doesn't do some kind of phonics instruction. The question is, what else do schools teach? The reading instruction you just heard in Oakland is not distinctive because there is phonics instruction. It's distinctive because there isn't any cueing.

ANDREA RUIZ: The only strategy I teach my kids is, is it a sight word? Is it a sound-out word?

EMILY HANFORD: This is the first grade teacher just heard, Andrea Ruiz.

ANDREA RUIZ: And all of these other strategies are teaching them to guess. They're not teaching them to look at the entire word.

EMILY HANFORD: This is a big change in Andrea's approach to teaching. When she started, she knew nothing about how kids learn to read. It was a relief when she came to Oakland and the curriculum spelled out that kids use meaning, structure, and visual cues to figure out words.

ANDREA RUIZ: Because I came from not having anything, I was like, oh, there's a way we should teach this.

EMILY HANFORD: I heard this from other educators. Cueing was appealing because they didn't know what else to do.

STACEY CHERNY: When I got into the classroom and someone told me to use this practice, I didn't question it.

EMILY HANFORD: Stacey Cherny is a former teacher who's now principal of an elementary school in Pennsylvania. She says many teachers aren't taught what they need to know about the structure of the English language to be able to teach phonics well. Phonics can be intimidating. Three-cueing isn't.

STACEY CHERNY: So a lot of times, I think that these practices have popped up because teachers don't have the background knowledge and it's, oh, yeah, I can do that. That's easy. I'll implement that.

EMILY HANFORD: Another reason cueing holds on is that it seems to work for some children. But researchers estimate there's a percentage of kids-- maybe around 40%-- who will learn to read no matter how they're taught. Kids who learn to read with cueing are succeeding in spite of the instruction, not because of it. That's according to David Kilpatrick, the author of the book about preventing reading difficulties. We heard from him in the first part of the program.

DAVID KILPATRICK: We have to get rid of ideas about reading that are faulty because those ideas result in practices that make it harder for children to learn to read.

EMILY HANFORD: Margaret Goldberg, who's working on the pilot project in Oakland, thinks it's time for all schools to take a close look at everything they use to teach reading.

MARGARET GOLDBERG: We should look through the materials and search for evidence of cueing. And if it's there, don't touch it. Don't let it get near our kids. Don't let it get near our classrooms or teachers.

EMILY HANFORD: Margaret wants the Oakland schools to get rid of all instructional materials that include cueing. I reached out to the superintendent's office to ask about this. A spokesperson said in a statement that there's not yet enough evidence from the pilot project to make curriculum changes for the entire district. The district remains committed to the curriculum materials it has invested in. Oakland's situation is no different from many other school districts across the country that have invested millions of dollars in materials that include three cueing. Here's Margaret Goldberg again.

MARGARET GOLDBERG: It feels like everyone's trusting somebody else to have done their due diligence. So classroom teachers are trusting that the materials that they're being handed will work. And the people who purchase the materials are trusting if they were on the market, that they will work. So we're all trusting. And it's a system that is broken.

EMILY HANFORD: I wanted to talk to the authors of the curriculum materials I mentioned in this story. Lucy Corkins, Irene Fountas, and Gay Su Pinnell. I wanted to know what they make of the cognitive science and I wanted to give them a chance to explain the ideas behind their work. I wrote to them and asked for interviews but they all declined. Their publisher Heinemann said in a statement that every product Heinemann sells is informed by extensive research. I also asked for an interview with Ken Goodman, the education professor who laid out the three-cueing theory in that guessing game paper more than 50 years ago. He said yes.

KEN GOODMAN: Good morning.

EMILY HANFORD: Hi. I visited Ken and his wife Yetta at their home in Tucson, Arizona. Nice to meet you.

YETTA GOODMAN: I'm Yetta and Ken just--

EMILY HANFORD: Ken is 91 but he's still working. Just finished a new edition of one of his books. I wanted to know what he makes of the cognitive science research. He told me he thinks cognitive scientists focus too much on word recognition.

KEN GOODMAN: Word recognition is a preoccupation. I don't teach word recognition. I teach people to make sense of language. And learning the words is incidental to that.

EMILY HANFORD: He brings up the example of a child who comes to the word horse and says pony instead.

KEN GOODMAN: Well, that is a beautiful example of the fact that it's not the word that's important. It's the meaning.

EMILY HANFORD: He says a child will still understand the meaning of the story because horse and pony are the same concept. I press him on this. Can I just stop you on pony and horse because they're not exactly the same thing though. A pony isn't quite the same thing as a horse.

YETTA GOODMAN: But in a kid's story--

KEN GOODMAN: In the context--

YETTA GOODMAN: --they could be.

EMILY HANFORD: That's Yetta Goodman. But don't you want to make sure that the child is there learning how to read understands p, ony, that says pony and something else says horse?

KEN GOODMAN: The purpose is not to learn words. The purpose is to make sense.

EMILY HANFORD: As far as I know, no one in the scientific community disputes the idea that the purpose of reading is to make sense of text.

[MUSIC PLAYING]

The question is, how does a little kid get there? I ended up talking with the Goodmans for nearly four hours and we could never quite agree on the terms of the debate. They rejected the idea that you can make a distinction between skilled readers and unskilled readers. They don't like the value judgment that implies. They said dyslexia does not exist, despite lots of evidence that it does. And they said the three-cueing theory is based on years of observational research.

In their view, three cueing isn't invalid. It's drawn from a different kind of evidence than what scientists collect in their labs.

KEN GOODMAN: My science is different.

EMILY HANFORD: In case you missed it, he said, my science is different.

[MUSIC PLAYING]

The idea that there are different kinds of evidence that lead to different conclusions about how reading works is one reason people continue to disagree about how children should be taught to read. It's important for educators to understand that three cueing is based on theory and observational research. It's not based on controlled scientific experiments or fMRI brain scanning. The cognitive science does not provide all the answers about how to teach children to read.

But on the question of how skilled readers read words, scientists have amassed a huge body of evidence. Many educators remain unaware of this evidence.

CLAIRE WOODWORTH: Oh, like that?

SPEAKER: All right, are you ready? OK, remember, we're playing for the guessing monster sticker.

EMILY HANFORD: We're back at the tutoring center with first grader Claire Woodworth. Guessing words is such a problem among the kids who come here for reading help, that they earn stickers if they sound out all the words they don't know.

CLAIRE WOODWORTH: Polly flew over the h, houses. She s, r, a, p--

EMILY HANFORD: Claire's mom Molly came to this same tutoring center when she was in high school and couldn't get through the ACT. She learned some basic things about how to sound out words and she was able to raise her score enough to be eligible for a college honors program. Molly says she's still not a very good reader. She tears up when she talks about it. She's grateful her daughter Claire is learning a different way.

MOLLY WOODWORTH: What's in your pocket?

CLAIRE WOODWORTH: Guessing monster sticker.

EMILY HANFORD: Claire earned her sticker today. She takes it out of her pocket and reads what it says.

CLAIRE WOODWORTH: This is guessing--

EMILY HANFORD: Claire's sticker says she slayed the guessing monster.

CLAIRE WOODWORTH: I slay the guessing monsters.

[MUSIC PLAYING]

EMILY HANFORD: You've been listening to an APM Reports documentary, At a Loss for Words. It was produced by me Emily Hanford and edited by Catherine Winter. Research and production assistance from John Hernandez. Our associate producer is Alex Baumhardt. Web editors are Dave Mann and Andy Kruse. The final mix was by Chris Julin and Craig Thorson. Fact checking by Betsy Towner Levine. The APM Reports team includes Sasha Aslanian, Shelly Langford, executive editor Stephen Smith, and editor in chief Chris Worthington.

If you go to our website apmreports.org, you can find an annotated version of this story with links to research and further reading. You can also find our podcast Educate where we have more documentaries about how children learn to read. Support for APM Reports comes from the Spencer Foundation and Lumina Foundation. This is APM, American Public Media.

STEVEN JOHN: And that is the third of a three-part series of new documentaries from APM Reports airing this week on MPR News Presents as teachers and students head back to school.

This Story Appears in the Following Collections

Views and opinions expressed in the content do not represent the opinions of APMG. APMG is not responsible for objectionable content and language represented on the site. Please use the "Contact Us" button if you'd like to report a piece of content. Thank you.

Transcriptions provided are machine generated, and while APMG makes the best effort for accuracy, mistakes will happen. Please excuse these errors and use the "Contact Us" button if you'd like to report an error. Thank you.

< path d="M23.5-64c0 0.1 0 0.1 0 0.2 -0.1 0.1-0.1 0.1-0.2 0.1 -0.1 0.1-0.1 0.3-0.1 0.4 -0.2 0.1 0 0.2 0 0.3 0 0 0 0.1 0 0.2 0 0.1 0 0.3 0.1 0.4 0.1 0.2 0.3 0.4 0.4 0.5 0.2 0.1 0.4 0.6 0.6 0.6 0.2 0 0.4-0.1 0.5-0.1 0.2 0 0.4 0 0.6-0.1 0.2-0.1 0.1-0.3 0.3-0.5 0.1-0.1 0.3 0 0.4-0.1 0.2-0.1 0.3-0.3 0.4-0.5 0-0.1 0-0.1 0-0.2 0-0.1 0.1-0.2 0.1-0.3 0-0.1-0.1-0.1-0.1-0.2 0-0.1 0-0.2 0-0.3 0-0.2 0-0.4-0.1-0.5 -0.4-0.7-1.2-0.9-2-0.8 -0.2 0-0.3 0.1-0.4 0.2 -0.2 0.1-0.1 0.2-0.3 0.2 -0.1 0-0.2 0.1-0.2 0.2C23.5-64 23.5-64.1 23.5-64 23.5-64 23.5-64 23.5-64"/>