Prior Knowledge, Or He Isn't Going to Pick on the Baseball Study

  • 14 March, 2020
  • 33 Comments

Teacher question:

You wrote recently that it was a good idea to teach comprehension skills, but our school district says we shouldn’t, that it’s prior knowledge that matters. Do you know the baseball study? Have you read Natalie Wexler’s research? It is really difficult to trust research when everyone tells us something different.

Shanahan response: 

I feel your pain.

There are research results and there are interpretations of research results. What research has been done, what these studies have found, and whether these studies were any good shouldn’t be points of disagreement. But interpretations of what a study means or what actions you should take based on it are going to lead to different claims and I’m sure that is confusing. 

That’s why I go to great pains to distinguish whether I’m reporting research findings or making claims based upon them. When I do the latter, I try to explain my reasoning so readers can determine whether they think my position is sound.

A few of my own rules for research interpretation:

(1)   Always distinguish research results and opinions.

(2)   Don’t make claims on the basis of a few studies (it’s okay to use a study as an example as long as it’s an example of more than itself).

(3)   Don’t prescribe instruction unless research has found it has benefited learners (no matter how tantalizing the theories and correlations may be, don’t trust them until they have been tried).

So, what I can tell you about prior knowledge? Prior knowledge refers to the knowledge readers have in their heads prior to reading a text. There is a substantial and extensive body of research going back to Bartlett’s 1932 study that reveals that readers use their knowledge to understand text. Case closed on that (and that is not an opinion).

But what does this mean for reading instruction? That’s where interpretation begins to intrude.

One conclusion that many of us draw from the research is that it’s a good idea for kids to know a lot. The more knowledge and experience they can bring to texts (or life) the better. Instructional practices consistent with this would include providing high quality teaching in social studies, science, and the arts. Some schools – in their efforts to improve reading neglect those subjects and I think this body of research suggests that to not be a good idea.

Another conclusion that seems consistent is that we should make sure the texts we use to teach reading are meaty. Why waste time? If kids are reading, why not expose them to high quality literature and informational texts. Following up later on these readings to ensure that this valuable content is retained seems like a good idea (and this makes sense for the earlier mentioned social studies and science texts as well).

Media is another potential avenue to knowledge, and that means encouraging Carmen Sandiego and Bill Nye the Science Guy rather than Angry Birds.

Yep, there are a lot of things one could do to increase kids’ knowledge, and that, presumably, in the long run could help to make kids better readers. Not many arguments there.

But then we get to the baseball study that you mention. This is a cool study (Recht & Leslie, 1988), that was nicely done. The researchers had 7th and 8th graders read a text about a baseball game. They divided the students into four groups: good readers who were high or low in baseball knowledge, and poor readers who were high or low in baseball knowledge. They found that reading ability contributed less to comprehension success than the students’ levels of knowledge about baseball. Good readers with high prior knowledge did no better than poor readers with high prior knowledge when it came to reading comprehension. But it doesn't prove what a lot of people seem to think it does.

It's a provocative study alright. But it’s a one off. There aren’t other studies with this kind of finding (lots of studies show the importance of knowledge, but no other one pits reading up against knowledge in this way – interesting that this has not been replicated in more than 30 years). Not only is it the solitary study on this, it was conducted with only a single text and that one designed to be used in a research study. Kind of hard to generalize very far from that in my opinion, though obviously there are people who think this is the definitive empirical evidence on this issue (such as whoever is making policy in your district).

Would I stop teaching reading or reduce the amount of reading instruction or end reading strategy instruction because of the baseball study? Nope, I wouldn’t, but if there were an accumulation of such findings, I could be so persuaded. (Recht and Leslie themselves didn’t draw this conclusion either, though in what amounts to an afterword they speculated on what it might say about the value of comprehension strategy instruction—which, of course, they didn’t actually study--it was speculation, not a finding).

One interesting thing about this study that isn’t discussed is that the students weren’t grouped on the basis of comprehension strategy use but on reading ability. If the study results can be interpreted (and this part is entirely interpretation) to mean that comprehension strategies shouldn’t be taught, then likewise this study should lead us to reject any other kind of reading instruction (such as decoding, vocabulary, increased amounts of reading, etc.). I’m not willing to go there myself.

Knowing the importance of prior knowledge, I’d likely do what Recht and Leslie actually recommended in their study – instigating students to use their knowledge when reading. Though I would do this in a science or social studies class where I’m trying to maximize their knowledge.

Respectfully, that isn’t what I’d do in a reading class.

Here my goal isn’t to ensure immediate comprehension of today’s text, but to make kids successful independent readers. That’s where strategies come in. If I’m always providing kids with the appropriate background knowledge to understand each text used for instruction, then how do students ever learn to take on a text on their own? And, what can they do to take on texts for which they don’t already have a bunch of relevant knowledge?

I’m not satisfied with the claim (and this is a claim, not a research finding) that readers can’t understand texts unless they have a lot of background knowledge. If that were true, we could never negotiate cultural boundaries or go beyond our very limited life experiences.

Cyndie and I have spent the past couple of years reading classical works of physics, biology, economics, philosophy of science, communications, political science, philosophy and history – works that we clearly have insufficient background for. But you know what? We’re able to make sense of them, albeit not as easily as we can take on a crime noir story of Dashiell Hammett or Anne Tyler’s latest novel.

That’s where strategies come in. They let readers in on the secret that if you are intentional and strategic you can make sense of texts, even if you lack the background for them. That’s why some smart people embrace reading as a “vaccine against populism, racism, and nationalism” (Mario Vargas Llosa, 2010); reading is more than finding information in texts that agrees with what we think we already know. It allows us to break the bonds of experience, superceding what we know. 

There are literally hundreds of studies showing that teaching certain strategies improves reading comprehension, so, despite any claims to the contrary, I do encourage the teaching of such strategies. However, for the most part these studies are brief. They show the value of strategies, but they don’t make the case that strategy instruction alone is the way to go or that we should invest lots of time in strategy teaching.

Given the great emphasis on knowledge as the source of reading comprehension, there is one strategy I’d really like to see emphasized more.

That is teaching students not to believe too deeply in their prior knowledge. You see, research not only shows that knowledge contributes to comprehension, but to miscomprehension as well (a research result, not an opinion). Readers need to be more open to what authors have to say without allowing current “knowledge” to dominate the process.

Show me a reader (or listener) who views communication and learning as being mainly about applying one’s knowledge, and I’ll show you unbridled egotism and unnecessary misinterpretation. Self-skeptical reading is the opposite of knowledge-dominated reading and we ought to make certain that kids both know a lot and that they are not entirely self-satisfied in their knowledge.

Comments

See what others have to say about this topic.

Sandy Backlund Mar 14, 2020 04:52 PM

I believe that background knowledge is helpful in teaching students to learn to read. When they've had enough experience integrating the word solving witih their background knowledge, predicting and confirming, they connect the two. They gain confidence and their own springboard for reading to learn. .

Laura King Mar 14, 2020 05:24 PM

Your last paragraph resonates with me. I introduce teachers to Tony Stead's work on reading and analyzing non-fiction (RAN) and the use of his RAN graphic organizer. This definitely addresses the need for students to examine their misconceptions.

I appreciate your discussion of interpretation of research. I do struggle when teachers blame students' prior knowledge for reading struggles...and they overdo an "activity" that exposes the content ... rather than believing that working through the text will give knowledge.

I will always remember my cooperating sixth grade teacher when I student taught years ago. We read so many challenging texts with her class - and it was a working class, rural community; in fact, she was the teacher that 'got the tough kids,' and they were. She would say... "I can't always give them the experience, but I can give them a book, and we're going to get knee deep in the muck of it." We did close reading of passages, tracked inferences at the word, sentence, passage level, and learned to answer text-dependent questions. She made her overheads of challenging paragraphs, and we dug in to ensure comprehension. She taught me NEVER to think a group of students couldn't tackle books outside their knowledge base. When we read A Tale of Two Cities (adapted/sixth grade readability), I can still hear her saying to them... you know nothing about France in the 1800s, but this book will take you there. She was all about teaching how to tackle texts of different genres, many outside their experience.

Thank you, as always. You push deep thinking of professionals!

Nancy Mar 14, 2020 05:25 PM

Something to consider: Often authors BUILD background into a text. If we want students to read closely, we won't front load too much. We want them to read carefully to get the information themselves. What's the point of reading if the teacher is doing so much of the work for them?

Luke Swift Mar 14, 2020 05:34 PM

Fascinating read as always.

I'd be really interested to read some of the studies you refer to in the penultimate paragraph about knowledge contributing to miscomprehension. Could you possibly provide some titles of the research?

And do you have any suggestions regarding how to foster self-skeptical reading? Would you recommend teacher modelling and think-alouds?

Thanks in advance.

Timothy E Shanahan Mar 14, 2020 06:00 PM

Nancy--

Indeed, we can overdo (and often overdo) prior knowledge emphasis. In many of the studies it took no more than providing a topic to readers to marshal their prior knowledge. Too many teachers think prior knowledge refers to the information in the text itself (so their prior knowledge preparation seems aimed at telling them what the text said). Yesterday I spoke with an educator who had a fine understanding of this. She suggested that if she were teaching the science of tsunami's she might show the students a brief video of a tsunami so the kids would have some idea of what it was, and this would be their preparation for taking on a text that was to explain how tsunami's form in terms of weather processes and their biological effects (but she would not use such a video if the point of the article/chapter was simply to explain what a tsunami was).

thanks.

Joan Sedita Mar 14, 2020 06:15 PM

Tim, I can't thank you enough for writing on this topic! E.D. Hirsch started the Core Knowledge Foundation in 1986 based on this claim that background knowledge is essential in supporting reading comprehension. He attempted to identify and promote a "core" set of knowledge that students need to learn at each grade level. It's a nice concept to think that someone, or even a group of content experts, can determine exactly what knowledge across many subjects students need to learn at each grade. However, it's just not practical. And as you note in your post, in real life we often have to read text for which we have minimal or no knowledge. Hirsh's 2006 book The Knowledge Deficit promoted the notion that background knowledge is THE reason why students can't comprehend. Daniel Willingham later made a similar claim in several articles, including a 2014 Teacher College article "Can Reading Comprehension be Taught?" which begins with this line: "In this commentary we suggest that reading comprehension strategy instruction does not actually improve general?purpose comprehension skills. Rather, this strategy represents a bag of tricks that are useful and worth teaching, but that that are quickly learned and require minimal practice." I use the word "claim" because as you noted above, interpretations of one or two studies is not the same as findings that might be concluded from a meta-analysis of multiple, replicable studies that are valid and reliable. Willingham himself acknowledges this when he says "in this commentary we suggest..." It always bothered me that he felt comfortable to use such rhetorical language about comprehension strategy instruction "...represents a bag of tricks." He also claims that comprehension strategies are "quickly learned and require minimal practice." I have been teaching comprehension strategies to students, especially those who struggle with reading, for over 35 years. This includes teaching them some of the close reading strategies that they must be taught in order to unpack complex and challenging text. While a few "high flyer" students can quickly pick up on a strategy and apply it independently, the vast majority of the students I have worked with need a lot of explicit instruction and guided practice before they are able to independently apply them to text across all subjects. I have also trained thousands of teachers, including subject area teachers, how to provide this instruction so it is embedded in their content teaching. And the feedback I hear from them is the same.... it's hard work for both the students and the teacher.

N. Wexler's new book is just an extension of Hirsch's and Willingham's claim. However, she goes a step further and claims that teaching comprehension strategies is not necessary. She cites the "baseball study" and refers to Hirsch and Willingham's claims, but rather than admitting that the premise of her book is an interpretation, in interviews and articles promoting the book she often claims that research backs this interpretation. This is why teachers such as the one who posed the question at the start of your post are confused. Since the publication of the book, I have had numerous educators contact me and ask if it's true that research says comprehension strategy instruction is not useful. So again thank you for addressing this issue in your post.

In my work, I try to explain to teachers that assuming students are already fluent readers, there are several components that support reading comprehension: vocabulary knowledge, background knowledge, knowledge of text structures, and meta-cognition/comprehension strategies. No one of these components is THE answer to improving comprehension.... teachers need to provide instruction for all of them using real text from different subject areas.

Timothy E Shanahan Mar 14, 2020 06:16 PM

Luke--

Most of the research on this problem has focused on science reading, mainly physics, where readers' conception of the world contradict the information to be presented in the texts (though I know of at least one study in which primary grade kids allow their background information to overwhelm a text's meaning even with more typical texts). Studies on that kind of thing discourage attempts to focus readers on their prior knowledge (making hypotheses and such), since these tend to reinforce the misconceptions. Better to launch right in on the texts. There are decades of research now on what are called refutation texts in which the misconceptions are addressed directly in the text (and that is great for teaching science but doesn't encourage an independent skeptical reader.

One thing that I have used (but I have no research on this) is Five Questions--something my dear friend, Dorsey Hammond, taught me: In preparing kids to read, instead of emphasizing what the students know about a topic, focus their attention on what they want to know and what questions they have about the topic. Then they read the topic with the purpose of answering 5 questions:

1. Which of my questions did the text answer?
2. Which of my questions didn't the text answer?
3. What did I learn from the text I wasn't looking for?
4. What surprised me?
5. What else would I like to know?

Question number 4 is the key here, because information that violates our expectations is what we find surprising (and that means it is not consistent with our prior knowledge). That's where the learning can take place. A reader who gets used to reading with a sense of surprise will be less likely to allow their prior knowledge to overwhelm a text.

thanks.

Timothy E Shanahan Mar 14, 2020 06:27 PM

Joan-

Good hearing from you. I've come to think of productive reading comprehension instruction as including three foci:

1. Comprehension strategy teaching (including teaching students both to use what they know, but not to allow that to overrun their understanding of the what the author wrote)

2. Knowledge of the world (using the texts used in reading instruction to increase student knowledge of their social and natural worlds -- which obviously includes literature)

3. Written language (including vocabulary, morphology, syntax, cohesion, discourse structure -- along with things like learning to make sense of the relationships between prose and graphic elements)

Those are the key things that I would try to teach now if I had my own classroom again. Of course, teaching these includes both explicit explanation by the teacher along with opportunities for the kids to practice them and extend them through supervised reading. Reading folks have hit #1 too hard at times, now it looks to me like the prior knowledge contingent is overdoing it on #2. With exception of vocabulary, i think Item #3 is particularly neglected and has been for a long time (despite strong research supporting such teaching--and except with the youngest kids and second language learners the idea that you can teach oral language in ways that improve reading comprehension is an unproven claim).

thanks.

tim



Shyla Kinhal Mar 14, 2020 06:37 PM

Hello! Can you clarify the difference between these strategies and the skills that you refer to in the ACT study that do not lead to stronger readers? Thank you!

Joan Sedita Mar 14, 2020 07:34 PM

Thanks Tim for reacting to my post.... I think we are aligned in our thinking about this. And, you are so right in pointing out that teaching text structure is often neglected. It has several sub-components, including those you just mentioned. Text structure starts at the simples level of developing syntactic awareness which helps kiddos unpack long, complex sentence when reading but it also helps them write longer sentences. Activities such as sentence combining have long been found to be helpful for this across all grade levels. I also think teaching them to be aware of what I call "patterns of organization" (e.g., description, sequence, cause/effect, etc.) that can be found within a paragraph and combined across multiple paragraphs, along with the transition words and phrases that signal these patterns. And finally, it is helpful to teach how to recognize the similarities and differences of larger text structures, such as how the body of information text, vs argument, vs narrative is developed --- this improves both their comprehension and writing.

John Young Mar 14, 2020 08:07 PM

Thanks
A great blog. I have asked a few times on Twitter if the Baseball study had been replicated and didn’t get a response.
Great advice here.

Harriett Mar 14, 2020 08:13 PM

The tsunami example is a good one. My district refers to this approach as "Creating Curiosity for New Content." And with our access to YouTube, it's very easy. And effective.

Ann Mar 14, 2020 08:24 PM

As an early childhood literacy instructor, I have to thank you for pointing out that what is true for beginning readers is often different from what is true for more experienced readers. You said, “ With exception of vocabulary, I think item #3 is particularly neglected and has been for a long time (despite strong research supporting such teaching--and except with the youngest kids and second language learners the idea that you can teach oral language in ways that improve reading comprehension is an unproven claim).”
The development of language, the vessel for background knowledge, is difficult to quantify. DIBELS, Istation, etc. do little to help primary teachers understand the impact of low language on children’s problem solving, metacognition, social negotiation, or literacy development. Background knowledge also impacts motivation. Many six year old boys would work hard to read about T-Rex and understand all the information. But a book about becoming a ballerina, not so much.

Timothy Shanahan Mar 15, 2020 12:23 AM

Shyla—
The comprehension skills that are often taught (but make no difference) tend to be question types... main idea, drawing conclusions, key details, etc.

I think the strategies like self questioning or visualizing are actions that help readers to pay attention to the information, to think about it, to spend more time with the text... the supposed skills don’t appear to do anything for the reader.

Thanks

Tim

Timothy Shanahan Mar 15, 2020 12:31 AM

Harriet and Ann—

I agree that prior knowledge has some motivational value but know of no research supporting that view. The best explanations of prior knowledge link it to memory but there are others as well that make some sense. I hope to write about that sometime in the future.

Dan Willingham Mar 15, 2020 08:42 PM

A couple of people emailed me, saying "Tim's doubting the baseball study!" or similar. I've been very occupied w/ putting courses online so I haven't read Tim's blog until just now....but actually I don't think he and I are far apart.

First, Tim notes that background knowledge influences how students put together texts, and that that is settled science. His comment on Recht & Leslie is that it hasn't been replicated...and it's true that it hasn't been directly replicated, although a couple of other labs have done something similar--pitted more general skill vs. knowledge, e.g.,

Hall, V. C., & Edmondson, B. (1992). Relative importance of aptitude and prior domain knowledge on immediate and delayed posttests. Journal of Educational Psychology, 84(2), 219.

Schneider, W., Körkel, J., & Weinert, F. E. (1989). Domain-specific knowledge and memory performance: A comparison of high-and low-aptitude children. Journal of educational psychology, 81(3), 306.

What I take to be Tim's point in this blog is what this all means for practitioners. If you have background knowledge, are you good to go, with nothing else. Here again, I actually think Tim and I are quite close.

1) One set of skills to teach readers are reading comprehension strategies, of the sort evaluated by the National REading Panel. There's no question that such instruction is beneficial--the literature is enormous and convincing. What I've emphasized is that there's not evidence that extended practice with such strategies helps. (I've suggested the literature indicates as little as two weeks might be enough, but I've also so said you'd probably want to do this two-week stint in three successive grades. If memory serves, Tim thought two weeks was too lean, and suggested six was more appropriate.)

2) ALTOGETHER DIFFERENT in my view is instruction in how to *work* with texts, to do the sort of tasks, mostly academic, that differentiate the sort of tasks we ask students to do in academic contexts. This is in addition to (not instead of) the strategies aimed to help with comprehension of the text, which #1 above is about. There is a good literature here showing gains, though inevitably not as rich as for #1, in part because it becomes fragmented as you get subject-specific goals. I don't know if the question of practice has been evaluated for these sorts of texts....I suspect there would be practice effects, but again, I don't know.

We might also ask "is there experimental evidence, not just correlational evidence of knowledge on reading comprehension?" In other words has someone tried to teach kids some new knowledge and then show that they read on that topic with better comprehension? I don't have time to refresh my memory on this (maybe someone can help me) but my memory is that a few people have tried and failed. If I'm right, that matches similar efforts in memory and problem-solving, tasks for which you also see sizable knowledge effects. The probable reason is that for knowledge to be helped it needs to be really integrated with other long-term memory representations....the strength and inter-connectedness of representations you get in the course of a one-hour experiment isn't going to do it.

Roxanne R. Mar 15, 2020 10:35 PM

I thoroughly enjoyed reading your article! I would love to know your perspective on how curriculum companies are building topical units of study and then testing students’ comprehension/writing on that same topic. Are we really just assessing background knowledge because of the knowledge-base students now have from what they read during the unit of study?

Petra Schatz Mar 16, 2020 03:52 AM

Tim,
Part of why we are pushing hard on the importance of knowledge in Hawaii is because Wonders pushes pretty relentlessly on comprehension strategy instruction, every single story , all year long - all seven years - and often the strategy is a poor match for the story. The themes and topics are pretty loosely connected making the job of building knowledge that much harder.
Sometimes teachers and practitioners don’t have time to sift through the nuance of such an argument, so when you say the baseball study hasn’t been replicated - you communicate - perhaps unwittingly - let us go back to an exclusive and relentless focus on strategy.

Tim Shanahan Mar 16, 2020 04:48 PM

Petra
I definitely do not think that strategies are the only thing to teach with regard to reading comprehension and there definitely should be a lot of attention to both how to make sense of written language and building world knowledge.

Thanks

Tim

Natalie Wexler Mar 16, 2020 08:17 PM

I plan to write at greater length about this topic in the near future, but since I've seen my name mentioned here a couple of times--including in the question that is used to kick off this blog post--I'd like to say a few words. I'm not going to wade into whether the baseball study has been exactly replicated or not, but I've seen the results from one of the studies Dan Willingham mentions, Schneider, Körkel, and Wiener (1989). That study was done in Germany, with kids in 3rd, 5th, and 7th grade, and the topic was soccer: after being tested on both general reading comprehension and knowledge of soccer, the kids were divided into groups as in the baseball study. Each student then heard and read a story on a young player's experiences in a soccer game. They were then tested 15 minutes later with a cloze version of the test with 20 blanks. (I'm basing this description on information from Dylan Wiliam, a well-respected education scholar.) Admittedly, I haven't seen the study itself--and admittedly, it's not BASEBALL--but it seems pretty similar! And the results were similar too: the kids with high knowledge of soccer and "low" reading ability did much better on the cloze test than the "high" readers with low knowledge of soccer (16.4 vs 11.1 points). There is of course other evidence to support the idea that building knowledge is crucial to creating good all-around readers, which I'll address in another venue as soon as possible.

There are a number of other points that have been made here that I intend to respond to later, but for now I would just say this: Everyone seems to agree that background knowledge is helpful to comprehension, and that there is evidence to support SOME kinds of strategy instruction. The disagreement seems to center on whether schools should continue to teach "reading comprehension strategies" in isolation from the content areas.

First, as Tim acknowledges, a lot of the reading comprehension instruction that schools currently spend time on -- finding the main idea and details, drawing conclusions, etc. -- doesn't actually have evidence behind it. Basal readers are largely organized around those supposed skills, not the handful of strategies for which the National Reading Panel found evidence. Generally, publishers and educators don't seem to draw much of a distinction between comprehension "skills" and "strategies" and the former predominate. So if we say schools should "teach reading comprehension strategies," the result will be many hours spent on "skills" for which there is no evidence. And as for the strategies for which the NRP did find evidence (visualizing, self-questioning): they will only work if readers have enough background knowledge to be able to make sense of the text at least at a superficial level. You won't be able to answer the questions you're asking yourself or to "visualize" if you can't make head or tail of the text.

Second, I'm not arguing that kids shouldn't be taught how to unpack complex sentences, to think about the structure of a text, etc. Background knowledge is only part of the comprehension equation; kids also need to become familiar with the conventions of complex written language, which differs significantly from those of spoken language. But I don't think long-term instruction in comprehension strategies, in isolation from teaching content, is the best way to get kids familiar with the conventions of written text. Rather, I would say that teachers of history, science, literature, etc., should incorporate these techniques--having kids ask questions about their understanding, etc.--as part of their teaching of CONTENT. And what's really powerful is to teach kids to use the conventions of written language in their own writing, using a method like The Writing Revolution. Once they learn to do that, they're much better able to understand the conventions of written language when they encounter them in their independent reading.

Harriett Mar 17, 2020 01:24 AM

When I was trained in my single subject credential program for English and social studies, I took a class on "reading in the content areas". When I became a high school English teacher, there was never a shortage of complaints from us English teachers that reading wasn't being taught in the content areas. Now, if we call it "comprehension in the content areas" rather than reading, that might have more sway. Yes, the students can decode "From each according to their abilities; to each according to their needs", but what does that actually mean?

Mark Jennings Mar 17, 2020 03:31 AM

Great thoughts that are much needed in our polarizing world.

TerryLynn Zempel Mar 25, 2020 09:42 PM

One aspect of reading comprehension that scholars don't seem willing to discuss is motivation. Strategies seem meaningless without the internal desire to know the material. Too many of our students lack this type of motivation, and empirical studies run in laboratory settings with 'students' who are very motivated to be part of the study don't really help me in the classroom with a majority of students who are not motivated to understand the material they are being taught. I listened to your seminar ("How to Plan Effective Literacy Instruction") today, and the comment I have about independent work in a classroom being less effective than teacher-led instruction is "Of course!" There is a human being vying for the child's attention when the instruction is led by a teacher. If cameras were in my classroom and researchers with clipboards observing my students during their activities, whether independent, or teacher-led, you can bet the buy-in for ALL activities would be much higher than without all the hype, attention, and cameras. I have very little time or patience for research in best practices; the best thing we can do for our kids (other than hire competent teachers) is reduce class size. That said, I found your remarks in the seminar more truthful and fact-based (regarding what actually happens with students) than most researchers I have ever studied.

Mat Jun 17, 2020 06:45 AM

I'm quite confused whose version of the science of reading and its claims regarding knowledge and comprehension we should go with.

First in this blog post, if my understanding of your point is correct, you were saying that the baseball study is a one off and we shouldn't generalize from it. Also, you said that we should focus on brief strategy instruction and encourage students to tackle texts even if they have limited background knowledge as they can build it by reading the text.

But in your Science of Reading (https://shanahanonliteracy.com/upload/publications/228/pdf/Science-of-Reading-2020.pdf) article you quote Cervetti & Hiebert who said "...In these studies that have examined these different contributions to comprehension, knowledge is the most important contributor." Then on p.13 you cite the very same baseball study that you warned us about in this blog. You wrote "The study showed that prior knowledge of a topic has a greater impact on reading comprehension than general reading ability." Then on p.14 you say that a teacher's time is best spent teaching vocabulary and knowledge. So knowledge seems like it is of great importance.

Then, if we look at another article about the Science of Reading, we find the very same reference to the baseball study. This time, it is the 2020 updated version of Teaching Reading is Rocket Science by Louisa Moates (https://www.aft.org/sites/default/files/moats.pdf). On page 14 of Moat's article, she says " Ironically, while background knowledge can be gained from reading, it is also true that those who already know more about a topic make better inferences and retain meanings better than those who know little about it." Moates reference Hirsch's (2016) book Why Knowledge Matters and an oft-cited article by D.T. Willingham 'The Usefulnesss of Brief Instruction in Comprehension Strategies' (https://www.aft.org/sites/default/files/periodicals/CogSci.pdf).

Almasi & Hart in the book 'Best Practices in Literacy Instruction' (p.225) say that many who struggle to comprehend struggle to do so regardless of whether they have content knowledge. They go on to say that those who argue in favor of the content of knowledge position are often long on rhetoric and short on empirical evidence.

So is there enough evidence or is the issue of knowledge and the science of reading more about rhetoric at this stage?





Anna Caveney Jul 27, 2020 08:35 AM

You have reminded me of a moment of insight I had while observing at a preschool I was considering for my daughter. It was a farm-based Montessori in Yorkshire England that encouraged children to spend as much time as possible outside. They had a large cloakroom for the children to put on their waterproof outerwear and the obligatory wellies. I witnessed as a teacher provided nonintrusive supportive companionship as she assisted other children while a little boy struggled to figure out how to put his wellies on by himself. It took around 30 agonizing minutes for that child to get his wellies on, and even then I think he had them on the wrong feet. But I was in awe, not of him, but of the teacher, because she didn't hurry him or fuss at him or take the wellies from him and put them on his feet. Because she had her eye on the real goal, not the apparent goal. She wanted to teach all of the children how to master the tasks in their life and he was clearly at work. Getting ready to go outside wasn't wasted time while he 'missed out' on whatever he could have been learning outside, it was an opportunity for productive struggle.
It is easy for us to get confused and think the goal of a reading class is for the student to comprehend the text of the day, but that isn't our goal. Our goal is for the student to increase their ability to decode and comprehend text in the rest of their lives. Today's text, for all its charm, is mostly an exercise program for their reading skill. We need to optimize text selection for increase in skill in comprehension, not opportunity to enact comprehension without improvement. The goal isn't to understand the baseball text, it is to struggle productively with the baseball text.
I wish there had been a follow up to see if those who clearly struggled to comprehend showed any improvement in their skillset or if they, when compared to a similar group without the difficulty comprehending, upon meeting a similar challenge did better, for having had that struggle. Which struggles are productive and which are demotivating? Which are both? Can a teacher use a challenging or frustrating text as an opportunity to model ways to achieve partial success or informative failure. Too many children and adults think getting the right answer is more valuable than learning from having gotten the wrong answer. I wish confidence in pursuit of productive struggle for my students, not pursuit of ease.

Erin Levins Jul 05, 2023 12:42 AM

I also have a question about the baseball study. I saw in another article that this was part of the paragraph read:
“Churniak swings and hits a slow bouncing ball toward the shortstop. Haley comes in, fields it, and throws to first, but too late. Churniak is on first with a single, Johnson stayed on third. The next batter is Whitcomb, the Cougars’ left-fielder.”

For 7th and 8th graders, this doesn’t seem like a challenging passage. The names would be challenging for my dyslexic soon-to-be 5th grader but she’d be otherwise able to read it. Obviously, I haven’t seen the whole passage and I don’t know if it was leveled in anyway to match what would be found on reading comprehension assessments for 7th and 8th graders. But this little blip makes me wonder if part of the result of reading ability having no impact simply came from the fact that the passage was simple enough that no one struggled to read it, which left background knowledge as the only thing to distinguish the kids.

Also, while the passage is presented as a narrative piece, one of the comprehension tasks was to re-enact the half inning of baseball with physical pieces, which seems to heavily reinforce the need for background knowledge to be successful at the comprehension task. It doesn’t seem like they asked many questions related to the narration that didn’t seem directly related to a baseball game. I have a feeling that a passage like, Casey at Bat, which focuses lengthily on one at bat, wouldn’t be as affected by overall baseball knowledge.

Timothy Shanahan Jul 13, 2023 07:14 PM

Eric--

Your analysis of the study is a wise one. Indeed, it appears likely that one of the problems here is that that passage was relatively easy for these students, which only allowed background knowledge differences to affect the outcomes. Part of the reason for this is that they excluded all students whose reading was below the 30th %ile. If that hadn't been done, I expect reading would have mattered.

Mark Seidenberg has also shown that given the small sample size, etc., the study did not actually result in a statistically significant difference between reading and knowledge effects.

Knowledge matters in reading, but being able to read is likely the most important issue in reading comprehension.

tim

Cherone Small Aug 14, 2023 05:39 PM

It allows us to break the bonds of experience, superceding what we know.
I love this statement and it describes what I feel is the ultimate purpose of reading. Whether the text is Fiction or Non-Fiction prior knowledge and what we learn afterwards helps to make the text interesting and more connections can be made with our young readers.

Dan Oct 25, 2023 05:04 PM

It is massive to understand the difference between making claims based on research vs what you initially interpret.

Joseph C Schultz Oct 25, 2023 08:25 PM

This is a great article. I think it's part of human nature to overreact to one case and immediately think it must be universal. This is a great example of why its important to look at the whole body of research surrounding a topic and not merely accept the first thing we're told. So many people are misled by poorly conducted or even intentionally misleading research because they treat one study as ultimate proof and confuse interpretation with results.

Joseph C Schultz Oct 25, 2023 08:25 PM

This is a great article. I think it's part of human nature to overreact to one case and immediately think it must be universal. This is a great example of why its important to look at the whole body of research surrounding a topic and not merely accept the first thing we're told. So many people are misled by poorly conducted or even intentionally misleading research because they treat one study as ultimate proof and confuse interpretation with results.

Hope Oct 31, 2023 10:46 PM

I greatly appreciate Shanahan's take on the baseball experiment. I must say, I am guilty of reading it and taking it as the truth. Although it may not be wrong in its findings, assuming that it applies to everyone and believing it to be the "end all be all," is whats more dangerous. There needs to be more research done on this topic, I would be very interested in the findings

Timothy Shanahan Nov 01, 2023 01:52 PM

Hope--
I don't want to mislead. Both before and after the publication of the baseball study, there have been a number of studies showing the importance of knowledge in reading comprehension. It does matter if you know stuff and that you be able to make connections between what you know and what you are reading. The idea that reading comprehension depends more upon what you know than your ability to read (the apparent finding of the baseball study) is silly, but that doesn't mean that knowledge doesn't matter. We, in schools, need to focus both on making certain that students can read and that they know a lot about their social and natural worlds.

tim

What Are your thoughts?

Leave me a comment and I would like to have a discussion with you!

Comment *
Name*
Email*
Website
Comments

Prior Knowledge, Or He Isn't Going to Pick on the Baseball Study

33 comments

One of the world’s premier literacy educators.

He studies reading and writing across all ages and abilities. Feel free to contact him.