{"id":13199,"date":"2024-10-08T13:42:41","date_gmt":"2024-10-08T13:42:41","guid":{"rendered":"https:\/\/wifamily.news\/?p=13199"},"modified":"2024-10-08T14:02:03","modified_gmt":"2024-10-08T14:02:03","slug":"gaming-the-system-wisconsins-forward-exam-scores-now-useless","status":"publish","type":"post","link":"https:\/\/wifamily.news\/?p=13199","title":{"rendered":"Gaming the System: Wisconsin\u2019s Forward Exam Scores Now Useless"},"content":{"rendered":"

This post originally appeared at https:\/\/will-law.org\/gaming-the-system-wisconsins-forward-exam-scores-now-useless\/<\/a><\/p>\n

\n
\n
\n
\n
Today, Wisconsin\u2019s DPI released the 2023-24 Forward Exam scores for schools across Wisconsin.\u00a0 In the past, WILL has referred to these scores\u2013and the report card built from them\u2013as creating a \u201cLake Wobegone\u201d effect where everyone is above average.\u00a0 But the changes made to the report card this year make the previous version of report cards seem like the pinnacle of accountability.\u00a0 In this blog post, we will compare the new report card to the old and highlight how DPI\u2019s unilateral power to make changes to the state\u2019s school accountability system must be checked.<\/p>\n

What has Changed?<\/strong><\/p>\n

We wrote about<\/a> some of this in a previously when the changes DPI was planning first became public. In a closed-door meeting that required the signing of a non-disclosure agreement to get into, DPI altered both the labels for categories of Forward Exam achievement and the cut points for those categories.\u00a0 The new labels are perhaps meant to be less \u201ctriggering\u201d for kids, but they are also far less informative for parents. \u201cBelow Basic\u201d is now \u201cDeveloping.\u201d <\/span>\u201cBasic\u201d is now \u201cApproaching.\u201d <\/span>\u201cProficient\u201d is now \u201cMeeting.\u201d And <\/span>\u201cAdvanced,\u201d mercifully, will remain the same.\u00a0 <\/span>But far more insidious than changing the names of the categories were changes to what \u201cproficiency\u201d itself means. DPI took it upon itself to alter proficiency standards that have been in place in Wisconsin since 2012.\u00a0 The new bar was expected to be lower, and that clearly has proven to be the case based on results released today.<\/p>\n

Implications of Changes<\/strong><\/p>\n

Wisconsin\u2019s Forward Exam scores were useful in part because they were tied to the national standards of the National Assessment of Educational Progress (NAEP).\u00a0 The NAEP is taken in schools around the country and provided a useful proficiency benchmark for education policy wonks to compare Wisconsin to the rest of the nation.\u00a0 Now, the Forward Exam will no longer be useful in making such an assessment.<\/p>\n

A second problem is that changing the proficiency standards breaks the long-term trend of student performance in Wisconsin schools.\u00a0 No longer can we assess how students are doing relative to their counterparts from more than a decade ago. Indeed, the WiseDash website<\/a> now includes the disclaimer, \u201cIn 2023-2024, the standards for ELA and Mathematics were changed, as a result you will not see results for 2023-2024 in the trends graph for Forward in these two subjects.\u201d DPI may have gotten tired of being dinged for decades of high spending that has produced low proficiency, but the answer is not to change the standard of judgement.<\/p>\n

The final problem is that changing proficiency levels will have an impact on the rating of schools and school districts on the state report card.\u00a0 We were already in a situation where districts like Milwaukee with proficiency rates in ELA of around 15% were being rated as 3 stars, or \u201cMeets Expectations.\u201d\u00a0 What is likely to happen now is that very few districts at all will be less than three stars.\u00a0 This robs parents of an important tool for assessing how well schools are performing when they\u2019re evaluating where to send their kids.<\/p>\n

Results: Statewide Proficiency<\/strong><\/p>\n

The figure below shows the trend in ELA proficiency on the Forward Exam over the past five years (note that the 2019-20 school year is missing because testing didn\u2019t take place).\u00a0 The trend until this year is relatively clear-a large dip during COVID followed by gradual improvement.\u00a0 Yet the state had yet to reach the proficiency levels of 40% that we observed prior to the pandemic. Until this year, that is.\u00a0 Proficiency shot up by more than 10% in ELA in just one year thanks to the changes DPI implemented.<\/p>\n

\"\"<\/p>\n

The changes in math are very similar, as shown below.\u00a0 The increase thanks to DPI\u2019s changes was even greater, shooting up more than 12% between 2022 and 2023.<\/p>\n

\"\"<\/p>\n

\u00a0<\/p>\n

Of course, we know that this is not the case.\u00a0 But quantifying exactly what change has occurred (up or down) is now nearly impossible. And districts will no doubt tout their dramatically improved proficiency, ignoring the changes.<\/p>\n

Changes in Proficiency within Districts<\/strong><\/p>\n

The figure below shows the shift in proficiency between 2022 and 2023 for the largest twenty districts in the state.\u00a0 As of this writing, DPI has not put out the Excel files yet that include every district, so each of these was manually calculated via Wisedash. The average district among the top twenty saw an increase in proficiency of about 11.4%.\u00a0 It is possible that districts like Oshkosh that saw a more sizeable increase have actually seen a meaningful increase in student performance.\u00a0 By the same token, it is possible that districts on the lower end like Milwaukee may have seen a decline in student outcomes.\u00a0 But the reality is that we will never know, and that is a problem.<\/p>\n

Table 1. Proficiency Shift, ELA 2022-23
\n\"\"<\/strong><\/p>\n

Conclusion<\/strong><\/p>\n

DPI has proven that it cannot function as a trustworthy administrator of school accountability in the state. Even Governor Evers, who was Superintendent when the link to NAEP was put in place, has said<\/a> \u201cI don\u2019t think we should be lowering (the standards).\u201d The legislature should move to reverse these changes so that school performance can be compared over time, pre- and post- COVID closures.\u00a0 Moving forward, the legislature should require than any changes to the accountability system in the state be put through the required rule-making process.\u00a0 It is vital that Forward Exam scores be a tool to inform parents, taxpayers, and policymakers about how Wisconsin schools are doing.\u00a0 Only by reversing what DPI has done here can that remain the case.<\/p>\n

\u00a0<\/p>\n

\u00a0<\/p>\n<\/div><\/div>\n<\/p><\/div>\n<\/p><\/div>\n

\n
\n
\n
\"Will<\/div>\n
\n

Will Flanders, PHD<\/h4>\n

Research Director<\/p>\n

\n

Flanders@will-law.org<\/p>\n<\/div><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n

The post Gaming the System: Wisconsin\u2019s Forward Exam Scores Now Useless<\/a> appeared first on Wisconsin Institute for Law & Liberty<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

This post originally appeared at https:\/\/will-law.org\/gaming-the-system-wisconsins-forward-exam-scores-now-useless\/ Today, Wisconsin\u2019s DPI released the 2023-24 Forward Exam scores…<\/p>\n","protected":false},"author":84,"featured_media":13201,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-13199","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-will"],"_links":{"self":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/13199","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/users\/84"}],"replies":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=13199"}],"version-history":[{"count":3,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/13199\/revisions"}],"predecessor-version":[{"id":13205,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/13199\/revisions\/13205"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/media\/13201"}],"wp:attachment":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=13199"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=13199"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=13199"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}