{"id":2295,"date":"2025-10-14T07:17:23","date_gmt":"2025-10-14T15:17:23","guid":{"rendered":"https:\/\/backseatlinguist.com\/blog\/?p=2295"},"modified":"2025-10-14T11:49:10","modified_gmt":"2025-10-14T19:49:10","slug":"individual-state-naep-scores-arent-evidence-of-anything","status":"publish","type":"post","link":"http:\/\/backseatlinguist.com\/blog\/individual-state-naep-scores-arent-evidence-of-anything\/","title":{"rendered":"Individual State NAEP Scores Aren’t Evidence For Anything"},"content":{"rendered":"

Two more letters<\/a> appeared in the 10\/12\/25 print edition of The Wall Street Journal<\/em> on the topic of phonics and California. One of them was in direct response to my letter<\/a>.<\/p>\n

Gift link: https:\/\/www.wsj.com\/opinion\/phonics-is-a-train-wreck-switch-conductors-california-indiana-7db01588?st=S3zaVc&reflink=desktopwebshare_permalink<\/a>
\n[see also image]<\/p>\n

Both letters illustrate why individual state NAEP scores should not be used as evidence for anything in determining reading policy.<\/p>\n

Mr. Mennick’s letter states that California won’t be successful in implementing (more) phonics, in part because they aren’t also doing 3rd-grade retention. Mr. Jones claims that Indiana has been successful in implementing phonics, but also mentions their use of additional teacher training, increased funding for “early screening,” and more “target[ed] interventions.”<\/p>\n

The problem here is obvious: How do we know which of these many approaches is causing reading scores to rise\u2014or, in the case of California, failing to rise?<\/p>\n

The answer can only be determined by conducting proper experiments, where we control these variables to see what is causal and what is merely correlational. In fact, that’s been done already for systematic phonics, as I pointed out in my letter to the Journal.<\/p>\n

I understand that politicians love simplistic comparisons, and a state’s NAEP score gives them that easy-to-explain sound bite. But that’s the opposite of science, as I would hope the “science of reading” advocates would know.<\/p>\n

 <\/p>\n

\"\"<\/a>

Screenshot<\/p><\/div>\n\n","protected":false},"excerpt":{"rendered":"

Two more letters appeared in the 10\/12\/25 print edition of The Wall Street Journal on the topic of phonics and California. One of them was in direct response to my letter. Gift link: https:\/\/www.wsj.com\/opinion\/phonics-is-a-train-wreck-switch-conductors-california-indiana-7db01588?st=S3zaVc&reflink=desktopwebshare_permalink [see also image] Both letters illustrate why individual state NAEP scores should not be used as evidence for anything in determining […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/posts\/2295"}],"collection":[{"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/comments?post=2295"}],"version-history":[{"count":3,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/posts\/2295\/revisions"}],"predecessor-version":[{"id":2299,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/posts\/2295\/revisions\/2299"}],"wp:attachment":[{"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/media?parent=2295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/categories?post=2295"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/backseatlinguist.com\/blog\/wp-json\/wp\/v2\/tags?post=2295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}