The Smarter Balanced Assessment Consortium is using a crowd-sourcing element in its work to set the achievement cut scores on its tests.
- Smarter Balanced is inviting anyone who's interested—you don't have to be a teacher or even work in education—to register to participate in the "standard-setting" process. The deadline for registrations is Sept. 19.
- they'll go through a brief training, and they'll get acquainted with the consortium's "achievement level descriptors," which describe what student performance should look like at each of the four levels of the Smarter Balanced test ("thorough," "adequate," "partial," or "minimal" understanding of the content). Then they'll start reviewing test questions, arranged in order of difficulty.
- Then the next step of the standard-setting process begins: A panel of 500 experts, chosen by Smarter Balanced states, takes over.
- Higher education representatives will have a role in this process
- Smarter Balanced embedded some NAEP and PISA items in its field tests, so it can see how students' performance on those assessment items compares with their performance on consortium-designed items.
- About 60 of the 500 expert panelists will then examine all the recommended cut scores in both subjects to make sure the system makes sense from grade to grade.