{"id":7052,"date":"2024-08-29T02:00:24","date_gmt":"2024-08-29T06:00:24","guid":{"rendered":"https:\/\/www.humrro.org\/corpsite\/?p=7052"},"modified":"2024-08-29T10:38:42","modified_gmt":"2024-08-29T14:38:42","slug":"measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must","status":"publish","type":"post","link":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/","title":{"rendered":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must"},"content":{"rendered":"<p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-1\"><h3 class=\"fusion-responsive-typography-calculated\" style=\"--fontsize: 18; line-height: 1.5;\" data-fontsize=\"18\" data-lineheight=\"27px\">Anyone who has ever taken a test when the stakes are high\u2014to get a job, promotion or certification, to graduate from high school, to enter college or the military, or to become a citizen\u2014understands the importance of accurate test scores.<\/h3>\n<p>We tend to trust the test is well-designed to meet its intended purpose and the associated scores reflect the target knowledge, skills, and abilities. Such scores have a tremendous impact on our lives and our children\u2019s lives, so we often assume that the care given to producing them is commensurate with their potential consequences. How well-placed is that trust? Simply put, mistakes can and do happen. How do we minimize the chance mistakes will occur? In our experience, rigorous quality assurance (QA) at every step of the score generation process is the essential element.<\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-bottom:45px;width:100%;\"><div class=\"fusion-separator-border sep-shadow\" style=\"background:radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-webkit-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-moz-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-o-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-fa-align-center\"><i class=\"fb-icon-element-1 fb-icon-element fontawesome-icon fa-tasks fas circle-yes icon-hover-animation-pulsate\" style=\"font-size:28.16px;line-height:54.32px;height:56.32px;width:56.32px;border-width:1px;border-radius:50% 50% 50% 50%;margin-bottom:25px;\"><\/i><\/div><style>i.fb-icon-element.fontawesome-icon.fb-icon-element-1{ color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fb-icon-element.fontawesome-icon.fb-icon-element-1:hover { color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fontawesome-icon.fb-icon-element-1.icon-hover-animation-pulsate:after {-webkit-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);-moz-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);box-shadow: 0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);}<\/style><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-1 fusion-sep-none fusion-title-center fusion-title-text fusion-title-size-two\" style=\"margin-top:0px;margin-right:0px;margin-bottom:31px;margin-left:0px;\"><h2 class=\"title-heading-center fusion-responsive-typography-calculated\" style=\"margin:0;color:#009cd7;--fontSize:24;line-height:1.5;\">Getting QA Right\u2014It\u2019s Not a Simple Process<\/h2><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-2 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-2\"><p>High-stakes educational assessments generate a variety of scores, including total or \u201craw scores,\u201d normative or relative performance scores, and a host of \u201cderived\u201d scores known as scale scores. From these, additional reporting information such as level of performance or proficiency and distance to the \u201cpassing standard\u201d are also generated. Even ignoring whether the students\u2019 scores are correctly coded, scanned, or rated (e.g., for essay items), generating these scores is extremely complicated.<\/p>\n<p>Generating test scores involves much more than simply summing item-level responses (raw scores). In most cases, there are a host of rules to ensure item responses are valid and the summation process is accurate (including metrics like attemptedness checks, timing rules, and subsection processing). Once the item responses are deemed \u201cvalid\u201d, an underlying measurement or statistical model is typically used to transform these responses into derived scores like percentiles or scaled scores. Measurement models may require the estimation of several item parameters (characteristics of the test questions), potentially addressing item difficulty, discrimination (how well the item separates higher- from lower-ability students), and even how readily the correct response might be guessed by a student.<\/p>\n<p>To add even more complexity, items worth more than one point have multiple difficulty parameters that are estimated based on the performance of a large sample of students using complex maximum-likelihood statistics. The parameters are then linked to the item, and in conjunction with students\u2019 scores, are used to estimate performance (typically via a derived scaled score). There are many more steps before a student receives a score report, but the point we are making is that<i> generating student scores is a complex endeavor\u2014for even the simplest assessment program reporting total or raw scores\u2014and most programs are vastly more complicated than that.<\/i><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-3 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-3 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-bottom:45px;width:100%;\"><div class=\"fusion-separator-border sep-shadow\" style=\"background:radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-webkit-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-moz-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-o-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-fa-align-center\"><i class=\"fb-icon-element-2 fb-icon-element fontawesome-icon fa-handshake fas circle-yes icon-hover-animation-pulsate\" style=\"font-size:28.16px;line-height:54.32px;height:56.32px;width:56.32px;border-width:1px;border-radius:50% 50% 50% 50%;margin-bottom:25px;\"><\/i><\/div><style>i.fb-icon-element.fontawesome-icon.fb-icon-element-2{ color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fb-icon-element.fontawesome-icon.fb-icon-element-2:hover { color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fontawesome-icon.fb-icon-element-2.icon-hover-animation-pulsate:after {-webkit-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);-moz-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);box-shadow: 0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);}<\/style><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-2 fusion-sep-none fusion-title-center fusion-title-text fusion-title-size-two\" style=\"margin-top:0px;margin-right:0px;margin-bottom:31px;margin-left:0px;\"><h2 class=\"title-heading-center fusion-responsive-typography-calculated\" style=\"margin:0;color:#009cd7;--fontSize:24;line-height:1.5;\">Building Trust in Scores Through Decades of QA Experience<\/h2><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-4 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-3\"><p>In the mid-1990s, HumRRO contracted with a state to implement a research agenda for their newly launched assessment program. Our work centered on investigating the reliability, validity, fairness, utility, and consequences of the new assessment and the associated accountability system. To be clear, we were not hired to conduct QA, though that quickly became a key focus once a scoring error was discovered (and the testing vendor\u2019s contract was terminated). At that point, the state asked HumRRO to complete operational psychometric processing to generate students\u2019 scores. We did so, but all the while the dangerous and very real possibility of making a processing error loomed large in our minds.<\/p>\n<p>To navigate this challenge, we relied on our experience with high-stakes, high-visibility tests like the Armed Services Vocational Aptitude Battery (ASVAB) and professional certification tests to guide our thinking. We first adopted the bedrock practice of having everything related to processing done twice, by teams working entirely independently (later comparing and resolving any differences that emerged during processing). We knew that anyone could\u2014and some eventually would\u2014make some sort of processing error or mistake. We reasoned that the odds of two completely independent teams making exactly the same error at exactly the same time were suitably astronomical.<\/p>\n<p>Even so, our relief was palpable when the state contracted with a new testing vendor, making us no longer solely responsible for psychometric processing. Importantly,<i> the state decided instead to institute a formal third-party independent replication step for psychometric processing in the late 1990s<\/i>. HumRRO has conducted psychometric processing for this state ever since. Perhaps counterintuitively, it has been extremely rare for our results and the testing vendor\u2019s results to match perfectly after initial data processing during that time. Often, there is some processing rule that must be clarified, or an issue arises that is resolved differently by each team, leading to small differences in student scores. This is often a learning process, because these issues are bought to the state for consideration and resolution, improving the transparency of the process and giving the state more control of decisions that impact their students and educators. Other times, the discrepancies stemmed from simple human error or different interpretations of the processing steps or rules by different individuals. But the critical bottom line is this: <i>such discrepancies were identified and mitigated before they could negatively impact students\u2019 lives.<\/i><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-4 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-5 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-bottom:45px;width:100%;\"><div class=\"fusion-separator-border sep-shadow\" style=\"background:radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-webkit-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-moz-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-o-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-fa-align-center\"><i class=\"fb-icon-element-3 fb-icon-element fontawesome-icon fa-forward fas circle-yes icon-hover-animation-pulsate\" style=\"font-size:28.16px;line-height:54.32px;height:56.32px;width:56.32px;border-width:1px;border-radius:50% 50% 50% 50%;margin-bottom:25px;\"><\/i><\/div><style>i.fb-icon-element.fontawesome-icon.fb-icon-element-3{ color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fb-icon-element.fontawesome-icon.fb-icon-element-3:hover { color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fontawesome-icon.fb-icon-element-3.icon-hover-animation-pulsate:after {-webkit-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);-moz-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);box-shadow: 0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);}<\/style><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-3 fusion-sep-none fusion-title-center fusion-title-text fusion-title-size-two\" style=\"margin-top:0px;margin-right:0px;margin-bottom:31px;margin-left:0px;\"><h2 class=\"title-heading-center fusion-responsive-typography-calculated\" style=\"margin:0;color:#009cd7;--fontSize:24;line-height:1.5;\">HumRRO\u2019s QA Work Today<\/h2><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-6 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-4\"><p>HumRRO\u2019s role as the go-to QA partner for states has grown considerably. While it would be gratifying to attribute that growth entirely to the quality of our work, it was facilitated by states discovering numerous psychometric processing errors as they were forced to scale up their assessment programs to comply with federal legislation, beginning with the <i>No Child Left Behind Act<\/i> and then followed by the<i> Every Student Succeeds Act.<\/i> Psychometric staff were stretched thin as states doubled or tripled the numbers and simultaneously increased the complexity of tests they gave each year. It may not be surprising that errors ensued. Some of these errors were well-publicized while others were quietly corrected, but states had no choice but to recognize the value of rigorous QA for psychometric processing. We were fortunate to have processes in place to help states ensure that their students\u2019 scores were correct.<\/p>\n<p>Today, HumRRO replicates psychometric processing for several state education agencies, either under direct contract or as a sub-contractor to a testing contractor. We are proud that we can replicate, in real time, the psychometric processing of nearly every major testing company in the United States. Because we are an independent, nonprofit organization, we do so without an agenda biased toward any particular outcome. QA must be done in real time, objectively and accurately. Replication that occurs after operational processing can only discover errors already made. Replication in real time can ensure that processing mistakes never get the chance to become errors on score reports.<\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-5 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-7 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-bottom:45px;width:100%;\"><div class=\"fusion-separator-border sep-shadow\" style=\"background:radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-webkit-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-moz-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-o-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-fa-align-center\"><i class=\"fb-icon-element-4 fb-icon-element fontawesome-icon fa-sitemap fas circle-yes icon-hover-animation-pulsate\" style=\"font-size:28.16px;line-height:54.32px;height:56.32px;width:56.32px;border-width:1px;border-radius:50% 50% 50% 50%;margin-bottom:25px;\"><\/i><\/div><style>i.fb-icon-element.fontawesome-icon.fb-icon-element-4{ color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fb-icon-element.fontawesome-icon.fb-icon-element-4:hover { color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fontawesome-icon.fb-icon-element-4.icon-hover-animation-pulsate:after {-webkit-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);-moz-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);box-shadow: 0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);}<\/style><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-4 fusion-sep-none fusion-title-center fusion-title-text fusion-title-size-two\" style=\"margin-top:0px;margin-right:0px;margin-bottom:31px;margin-left:0px;\"><h2 class=\"title-heading-center fusion-responsive-typography-calculated\" style=\"margin:0;color:#009cd7;--fontSize:24;line-height:1.5;\">Extending QA to Accountability Systems<\/h2><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-8 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-5\"><p>We are also proud of our work with states in providing quality assurance for their accountability systems. These systems use students\u2019 test scores and other information to generate school and district level data and accountability classifications, which are then used to aid and support schools that are struggling the most. These systems often rely on traditional student scores and classifications, growth indices, graduation rates, absenteeism, college\/career readiness indicators, student group performance, English language development among non-native speakers, alternate assessment scores for students with the most severe cognitive disabilities, and other state-specific indicators. States vary greatly in their approach to accountability, and generating a school-level classification is always very complex. A mistake at this level could lead to schools not getting the help they need, or to undeserved scrutiny for better-performing schools.<\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-6 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-9 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-bottom:45px;width:100%;\"><div class=\"fusion-separator-border sep-shadow\" style=\"background:radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-webkit-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-moz-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);background:-o-radial-gradient(ellipse at 50% -50% , #e0dede 0px, rgba(255, 255, 255, 0) 80%) repeat scroll 0 0 rgba(0, 0, 0, 0);\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-fa-align-center\"><i class=\"fb-icon-element-5 fb-icon-element fontawesome-icon fa-rocket fas circle-yes icon-hover-animation-pulsate\" style=\"font-size:28.16px;line-height:54.32px;height:56.32px;width:56.32px;border-width:1px;border-radius:50% 50% 50% 50%;margin-bottom:25px;\"><\/i><\/div><style>i.fb-icon-element.fontawesome-icon.fb-icon-element-5{ color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fb-icon-element.fontawesome-icon.fb-icon-element-5:hover { color: #ffffff; background-color: #009cd7; border-color: #009cd7;}i.fontawesome-icon.fb-icon-element-5.icon-hover-animation-pulsate:after {-webkit-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);-moz-box-shadow:0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);box-shadow: 0 0 0 2px rgba(255,255,255,0.1), 0 0 10px 10px #009cd7, 0 0 0 10px rgba(255,255,255,0.5);}<\/style><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-5 fusion-sep-none fusion-title-center fusion-title-text fusion-title-size-two\" style=\"margin-top:0px;margin-right:0px;margin-bottom:31px;margin-left:0px;\"><h2 class=\"title-heading-center fusion-responsive-typography-calculated\" style=\"margin:0;color:#009cd7;--fontSize:24;line-height:1.5;\">Looking Toward the Future<\/h2><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-10 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-6\"><p>Educational assessment has recently come under fire for its perceived role in perpetuating cultural stereotypes and maintaining opportunity gaps for traditionally under-represented groups. In response, many colleges have changed their admissions policies to be \u201ctest optional\u201d (though this trend may have reached its zenith). Educational assessments have also been scrutinized for over-promising the extent to which scores may be interpreted and used. States must test students in reading and math in grades 3-8 and high school according to the federal <i>Every Student Succeeds Act<\/i>, and while most of those tests are end-of-year summative tests, they are often \u201cshoe-horned\u201d into service to inform instruction as well. These and other similar criticisms erode the public\u2019s confidence in otherwise highly effective and useful educational tools. These concerns could be compounded if more attention were given to the idea that the scores could simply be wrong.<\/p>\n<p>Assessment plays a vital role in effective instruction and learning. Test scores are used for myriad purposes, and most of those purposes have important consequences for someone: Educators, parents, and students all trust the information they are given to make vital educational decisions. Our QA quality processes should be rigorous enough to merit that trust. Independent replication is one of the strongest methods of QA for psychometric processing and should be standard practice for any assessment program.<\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-7 fusion-parallax-none border-radius-10 post-contact-card nonhundred-percent-fullwidth non-hundred-percent-height-scrolling lazyload\" style=\"background-color: #003E74;background-position: center center;background-repeat: no-repeat;padding-top:50px;padding-right:30px;padding-bottom:50px;padding-left:30px;margin-bottom: 65px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#eae9e9;border-style:solid;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;\" data-bg=\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2026\/03\/updated-blue-background.jpg\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-11 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:0px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-builder-row fusion-builder-row-inner fusion-row\"><div class=\"fusion-layout-column fusion_builder_column_inner fusion-builder-nested-column-0 fusion_builder_column_inner_1_3 1_3 fusion-one-third fusion-column-first fusion-no-small-visibility\" style=\"width:33.333333333333%;width:calc(33.333333333333% - ( ( 4% ) * 0.33333333333333 ) );margin-right: 4%;margin-top:0px;margin-bottom:0px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"imageframe-align-center\"><span class=\" fusion-imageframe imageframe-dropshadow imageframe-1 hover-type-none\" style=\"border-radius:50%;-webkit-box-shadow: 3px 3px 7px rgba(0,0,0,0.3);box-shadow: 3px 3px 7px rgba(0,0,0,0.3);max-width:170px;\"><a class=\"fusion-no-lightbox\" href=\"https:\/\/www.humrro.org\/corpsite\/profile\/art-thacker\/\" target=\"_self\" aria-label=\"Art Thacker &#8211; Principal Scientist\"><img decoding=\"async\" width=\"350\" height=\"350\" alt=\"Art Thacker - Chief Scientist\" src=\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/02\/art-thacker.jpg\" data-orig-src=\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/02\/art-thacker.jpg\" class=\"lazyload img-responsive wp-image-4129\" srcset=\"data:image\/svg+xml,%3Csvg%20xmlns%3D%27http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%27%20width%3D%27350%27%20height%3D%27350%27%20viewBox%3D%270%200%20350%20350%27%3E%3Crect%20width%3D%27350%27%20height%3D%27350%27%20fill-opacity%3D%220%22%2F%3E%3C%2Fsvg%3E\" data-srcset=\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/02\/art-thacker-200x200.jpg 200w, https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/02\/art-thacker.jpg 350w\" data-sizes=\"auto\" data-orig-sizes=\"(max-width: 768px) 100vw, 350px\" \/><\/a><\/span><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column_inner fusion-builder-nested-column-1 fusion_builder_column_inner_2_3 2_3 fusion-two-third fusion-column-last\" style=\"width:66.666666666667%;width:calc(66.666666666667% - ( ( 4% ) * 0.66666666666667 ) );margin-top:0px;margin-bottom:0px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-blend-mode: overlay;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-7\"><p style=\"color: #96c121;\"><strong>For more information, contact:<\/strong><\/p>\n<h2 style=\"color: #ffffff; font-weight: 600; margin: 0;\">Art Thacker<\/h2>\n<h3 style=\"color: #ffffff; margin-top: 0;\"><em>Chief Scientist<\/em><\/h3>\n<\/div><div class=\"fusion-alignleft\"><style>.fusion-body .fusion-button.button-1 .fusion-button-text{color:#ffffff;text-transform:none;}.fusion-body .fusion-button.button-1{border-color:#ffffff;border-radius:25px 25px 25px 25px;background:#4c9c2e;}.fusion-body .fusion-button.button-1 i,.fusion-body .fusion-button.button-1:hover .fusion-button-text,.fusion-body .fusion-button.button-1:hover i,.fusion-body .fusion-button.button-1:focus .fusion-button-text,.fusion-body .fusion-button.button-1:focus i,.fusion-body .fusion-button.button-1:active .fusion-button-text,.fusion-body .fusion-button.button-1:active i{color:#ffffff;}.fusion-body .fusion-button.button-1:hover,.fusion-body .fusion-button.button-1:active,.fusion-body .fusion-button.button-1:focus{border-color:#ffffff;background:#96c121;}<\/style><a class=\"fusion-button button-flat button-medium button-custom button-1 fusion-button-default-span fusion-button-default-type\" target=\"_self\" href=\"https:\/\/www.humrro.org\/corpsite\/profile\/art-thacker\/\"><span class=\"fusion-button-text\">Contact Art<\/span><i class=\"fa-angle-right fas button-icon-right\" aria-hidden=\"true\"><\/i><\/a><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":3,"featured_media":7055,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[],"class_list":["post-7052","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\" \/>\n<meta property=\"og:site_name\" content=\"HumRRO\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/pages\/Human-Resources-Research-Organization-HumRRO\/161583990533313\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-29T06:00:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-29T14:38:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"vc\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@HumRROorg\" \/>\n<meta name=\"twitter:site\" content=\"@HumRROorg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"vc\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\"},\"author\":{\"name\":\"vc\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#\/schema\/person\/85497948b41818a3043ac94a7af08853\"},\"headline\":\"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must\",\"datePublished\":\"2024-08-29T06:00:24+00:00\",\"dateModified\":\"2024-08-29T14:38:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\"},\"wordCount\":4532,\"publisher\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg\",\"articleSection\":[\"HumRRO Blogs\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\",\"url\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\",\"name\":\"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO\",\"isPartOf\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg\",\"datePublished\":\"2024-08-29T06:00:24+00:00\",\"dateModified\":\"2024-08-29T14:38:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage\",\"url\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg\",\"contentUrl\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg\",\"width\":1200,\"height\":628,\"caption\":\"Laptop with various 3d chart graphics floating in front of the screen\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.humrro.org\/corpsite\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#website\",\"url\":\"https:\/\/www.humrro.org\/corpsite\/\",\"name\":\"HumRRO\",\"description\":\"The Human Resources Research Organization\",\"publisher\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.humrro.org\/corpsite\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#organization\",\"name\":\"The Human Resources Research Organization (HumRRO)\",\"url\":\"https:\/\/www.humrro.org\/corpsite\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/03\/humrro-logo.png\",\"contentUrl\":\"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/03\/humrro-logo.png\",\"width\":250,\"height\":64,\"caption\":\"The Human Resources Research Organization (HumRRO)\"},\"image\":{\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/www.facebook.com\/pages\/Human-Resources-Research-Organization-HumRRO\/161583990533313\",\"https:\/\/x.com\/HumRROorg\",\"http:\/\/www.linkedin.com\/company\/40615\",\"http:\/\/www.youtube.com\/user\/humrro\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.humrro.org\/corpsite\/#\/schema\/person\/85497948b41818a3043ac94a7af08853\",\"name\":\"vc\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g\",\"caption\":\"vc\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/","og_locale":"en_US","og_type":"article","og_title":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO","og_url":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/","og_site_name":"HumRRO","article_publisher":"http:\/\/www.facebook.com\/pages\/Human-Resources-Research-Organization-HumRRO\/161583990533313","article_published_time":"2024-08-29T06:00:24+00:00","article_modified_time":"2024-08-29T14:38:42+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg","type":"image\/jpeg"}],"author":"vc","twitter_card":"summary_large_image","twitter_creator":"@HumRROorg","twitter_site":"@HumRROorg","twitter_misc":{"Written by":"vc","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#article","isPartOf":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/"},"author":{"name":"vc","@id":"https:\/\/www.humrro.org\/corpsite\/#\/schema\/person\/85497948b41818a3043ac94a7af08853"},"headline":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must","datePublished":"2024-08-29T06:00:24+00:00","dateModified":"2024-08-29T14:38:42+00:00","mainEntityOfPage":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/"},"wordCount":4532,"publisher":{"@id":"https:\/\/www.humrro.org\/corpsite\/#organization"},"image":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage"},"thumbnailUrl":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg","articleSection":["HumRRO Blogs"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/","url":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/","name":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must | HumRRO","isPartOf":{"@id":"https:\/\/www.humrro.org\/corpsite\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage"},"image":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage"},"thumbnailUrl":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg","datePublished":"2024-08-29T06:00:24+00:00","dateModified":"2024-08-29T14:38:42+00:00","breadcrumb":{"@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#primaryimage","url":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg","contentUrl":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2024\/08\/0824_Blog_QA_1200x628_Final.jpg","width":1200,"height":628,"caption":"Laptop with various 3d chart graphics floating in front of the screen"},{"@type":"BreadcrumbList","@id":"https:\/\/www.humrro.org\/corpsite\/blog\/measure-twice-cut-once-for-high-stakes-education-assessments-rigorous-quality-assurance-is-a-must\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.humrro.org\/corpsite\/"},{"@type":"ListItem","position":2,"name":"Measure Twice, Cut Once: For High-Stakes Education Assessments, Rigorous Quality Assurance Is a Must"}]},{"@type":"WebSite","@id":"https:\/\/www.humrro.org\/corpsite\/#website","url":"https:\/\/www.humrro.org\/corpsite\/","name":"HumRRO","description":"The Human Resources Research Organization","publisher":{"@id":"https:\/\/www.humrro.org\/corpsite\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.humrro.org\/corpsite\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.humrro.org\/corpsite\/#organization","name":"The Human Resources Research Organization (HumRRO)","url":"https:\/\/www.humrro.org\/corpsite\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.humrro.org\/corpsite\/#\/schema\/logo\/image\/","url":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/03\/humrro-logo.png","contentUrl":"https:\/\/www.humrro.org\/corpsite\/wp-content\/uploads\/2019\/03\/humrro-logo.png","width":250,"height":64,"caption":"The Human Resources Research Organization (HumRRO)"},"image":{"@id":"https:\/\/www.humrro.org\/corpsite\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/pages\/Human-Resources-Research-Organization-HumRRO\/161583990533313","https:\/\/x.com\/HumRROorg","http:\/\/www.linkedin.com\/company\/40615","http:\/\/www.youtube.com\/user\/humrro"]},{"@type":"Person","@id":"https:\/\/www.humrro.org\/corpsite\/#\/schema\/person\/85497948b41818a3043ac94a7af08853","name":"vc","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ef13e96210781d95d76b050ce5bce53bc436cc7d0e8767ba6d7e399150629986?s=96&d=mm&r=g","caption":"vc"}}]}},"_links":{"self":[{"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/posts\/7052","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/comments?post=7052"}],"version-history":[{"count":7,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/posts\/7052\/revisions"}],"predecessor-version":[{"id":7060,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/posts\/7052\/revisions\/7060"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/media\/7055"}],"wp:attachment":[{"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/media?parent=7052"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/categories?post=7052"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.humrro.org\/corpsite\/wp-json\/wp\/v2\/tags?post=7052"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}