Hubbard offers a set of questions that everyone in educational reform and accountability ought to be considering when designing institutional feedback mechanisms – but usually aren’t:
What are you trying to measure? What is the real meaning of the alleged ‘intangible’?Why do you care? What are the decisions that arise from this goal?How much do you know now? What ranges or probabilities represent your uncertainty about this? (What degree of uncertainty is tolerable?)What is the value of the information? What are the consequences of being wrong and the chance of being wrong?Which information would confirm or eliminate different possibilities?How do you conduct the measurement to account for various types of avoidable but common errors?