{"id":7220,"date":"2023-11-20T14:39:13","date_gmt":"2023-11-20T15:39:13","guid":{"rendered":"https:\/\/wifamily.news\/?p=7220"},"modified":"2023-11-20T15:59:51","modified_gmt":"2023-11-20T15:59:51","slug":"wisconsins-school-report-cards-are-broken-heres-how-to-fix-them","status":"publish","type":"post","link":"https:\/\/wifamily.news\/?p=7220","title":{"rendered":"Wisconsin\u2019s School Report Cards Are Broken-Here\u2019s How to Fix Them"},"content":{"rendered":"

This post originally appeared at https:\/\/will-law.org\/wisconsins-school-report-cards-are-broken-heres-how-to-fix-them\/<\/a><\/p>\n

\n
\n
\n
\n
\n

By Will Flanders, PhD, and Noah Diekemper\u00a0<\/strong><\/h3>\n

Annually, when Wisconsin\u2019s new school report cards are released, we learn that Wisconsin\u2019s schools must all be located in Lake Wobegone, where everyone is above average. School districts like Beloit (14.1% proficiency in reading) and Milwaukee (11.5% proficiency in math) are somehow not judged to be deserving of a ranking in the lowest category on the report card.\u00a0 This year, Milwaukee even managed to reach the middle category of \u201cMeets Expectations.\u201d\u00a0<\/span>\u00a0<\/span><\/p>\n

There are a number of reasons that this seems to happen every year. Each school and school district receives an overall score on a 100 point scale. \u2013 Those scores are then put into accountability rating categories at certain cut points.\u00a0 DPI has the power to set these cut points.\u00a0 The cut points from <\/span>this year\u2019s report card<\/span><\/a> are reproduced in Table 1 below. <\/span>\u00a0<\/span><\/p>\n

Table 1. DPI Report Card Categories<\/span><\/b><\/p>\n

\"\"<\/p>\n

As recently as the 2020-21 school year, DPI\u00a0 <\/span>moved the cut points<\/span><\/a> for each rating, which had the effect of moving some districts up in their rating despite not showing any measurable improvement.<\/span>\u00a0<\/span><\/p>\n

But the reality is that the chief cause of this phenomenon is state law that requires us to not judge school districts on a level playing field. In districts with more low-income students, student proficiency is weighted less highly than it is in districts with fewer low-income students. Instead, student growth is weighted more highly in high poverty districts. There are <\/span>other components<\/span><\/a> that go into the report card score as well that include outcomes for target groups and graduation metrics, but only between growth and achievement are weights varied in this way.\u00a0<\/span>\u00a0<\/span><\/p>\n

It is important to note that student growth is a vital factor to consider when evaluating school performance.\u00a0 Though there is a great deal of complexity in how growth is calculated, in it\u2019s simplest terms, it is a measure of the extent to which students have <\/span>improved their performance<\/span><\/a> from one year to the next on the state test for their grade level.\u00a0 The justification for weighing growth more heavily in districts with more low-income students is in recognition of the reality that these students are often behind academically and need to be \u201ccaught up.\u201d\u00a0\u00a0\u00a0<\/span>\u00a0<\/span><\/p>\n

The change in the weight given to growth on the report card is quite dramatic. \u00a0Table 2 pulls in information from a <\/span>DPI Calculator<\/span>, and shows the change in the weight of growth and proficiency as we go from a district with 5% low-income students to one with 100% low-income students. In a district like Milwaukee with more than 82% low-income students, proficiency barely matters for their overall score at all.<\/span>\u00a0<\/span><\/p>\n

Table 2. Growth\/Proficiency Weights Based on % of Low-Income Students<\/span><\/b>\u00a0<\/span><\/p>\n

\"\"<\/p>\n

The biggest problem with this system is it makes comparability of report card performance across school districts nearly impossible.\u00a0 While it is laudable that some districts are doing quite well helping students catch up, there is little utility in that for parents in trying to assess whether a school district (or private school in the choice program) is right for their kids.\u00a0<\/span>\u00a0<\/span><\/p>\n

Fortunately, the fix for this is quite straightforward: rework the formula so that the weightings of these factors don\u2019t vary between school districts.\u00a0 We have created a tool below that illustrates the change in Forward Exam results that would happen in each district as the weighting of achievement and growth varies.<\/span>\u00a0<\/span><\/p>\n

In addition to the original DPI score labeled \u201cDPI\u2019s Score,\u201d we present two sets of cut points: one is the same cut points as the current report card. This is labeled as \u201cTraditional Cut Points.\u201d \u00a0The other, labeled as \u201cNormalized Cut Points,\u201d can be thought of as like a professor who grades performance on a curve using an assumption of a normal distribution of grades. \u00a0To see why this is important, consider the distribution of the current report card ratings below in Figure 1.<\/span>\u00a0<\/span><\/p>\n

Figure 1. Distribution of 2023-24 District Report Card Ratings (Traditional Cut Points)<\/span><\/b>\u00a0<\/span><\/p>\n

\"\"<\/p>\n

The vast majority of districts are ranked as \u201cMeets Expectations\u201d or above, and no districts are ranked as \u201cFails to Meet Expectations.\u201d \u00a0Figure 2 shows a hypothetical distribution of district-wide report card ratings after they are normalized along a more traditional curve\u2014with more districts appropriately placed in the more extreme categories. <\/span>\u00a0<\/span><\/p>\n

Figure 2. Distribution of 2023-24 District Report Card Ratings (Normalized Cut Points)<\/span><\/b>\u00a0<\/span><\/p>\n

\"\"<\/p>\n

Note that the cut points would change every year under a normed system based on school and district performance around the state. <\/span>A debate can be had on where is the best place to put the <\/span>cut points<\/span>.<\/span> \u00a0<\/span>Th<\/span>e most important thing is <\/span>cro<\/span>ss-district comparability<\/span>. <\/span><\/span>\u00a0<\/span><\/p>\n<\/div><\/div>\n

\n
\n
\"USE<\/a><\/object><\/div>\n

var divElement = document.getElementById(‘viz1700494945160’); var vizElement = divElement.getElementsByTagName(‘object’)[0]; if ( divElement.offsetWidth > 800 ) { vizElement.style.width=’1000px’;vizElement.style.height=’527px’;} else if ( divElement.offsetWidth > 500 ) { vizElement.style.width=’1000px’;vizElement.style.height=’527px’;} else { vizElement.style.width=’100%’;vizElement.style.height=’1327px’;} var scriptElement = document.createElement(‘script’); scriptElement.src = ‘https:\/\/public.tableau.com\/javascripts\/api\/viz_v1.js’; vizElement.parentNode.insertBefore(scriptElement, vizElement); <\/p><\/div>\n<\/p><\/div>\n

\n
\n

Moving to a system that weighs achievement more heavily would shift districts with extremely low proficiency into lower categories, which would likely seem intuitively appropriate to most people.\u00a0 On the other hand, weighting growth heavily may harm the outcome for districts with extremely high proficiency but less room for student growth.\u00a0 The right answer is likely somewhere in between.\u00a0<\/span>\u00a0<\/span><\/p>\n

Wisconsin\u2019s report card scores have been rendered all but useless in making comparisons between districts by weighting variation. \u00a0The intentions behind this system were good in rewarding districts with more challenging students, but its clear there was an overcorrection. \u00a0It\u2019s time we craft a report card that is a level playing field across the board and can be useful to parents and policymakers. <\/span>\u00a0<\/span><\/p>\n<\/div><\/div>\n<\/p><\/div>\n

\n
\n
\"Will<\/div>\n
\n

Will Flanders, PHD<\/h4>\n

Research Director<\/p>\n

\n

Flanders@will-law.org<\/p>\n<\/div><\/div>\n<\/p><\/div>\n

\n
\"Noah<\/div>\n
\n

Noah Diekemper<\/h4>\n

Senior Research Analyst<\/p>\n

\n

noah@will-law.org<\/p>\n<\/div><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n

The post Wisconsin\u2019s School Report Cards Are Broken-Here\u2019s How to Fix Them<\/a> appeared first on Wisconsin Institute for Law & Liberty<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

This post originally appeared at https:\/\/will-law.org\/wisconsins-school-report-cards-are-broken-heres-how-to-fix-them\/ By Will Flanders, PhD, and Noah Diekemper\u00a0 Annually, when…<\/p>\n","protected":false},"author":12,"featured_media":7222,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-7220","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-will"],"_links":{"self":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/7220","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=7220"}],"version-history":[{"count":3,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/7220\/revisions"}],"predecessor-version":[{"id":7228,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/posts\/7220\/revisions\/7228"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=\/wp\/v2\/media\/7222"}],"wp:attachment":[{"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=7220"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=7220"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wifamily.news\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=7220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}