Worked Example
A percentile indicates how a score compares with a reference group; it is not the percentage of test questions answered correctly.
What does an intelligence score measure—and what does it not tell us about a person?
Without notes, write one idea you already know that might connect to Intelligence & Psychological Measurement. Then write one question the lesson should help you answer.
What does an intelligence score measure—and what does it not tell us about a person?
intelligence · construct · cognitive ability · standardized test · norm · percentile · reliability · validity · standardization · score interpretation
Intelligence tests provide information about performance on defined cognitive tasks under standardized conditions. A score is not an entire person, does not measure every human capability, and must be interpreted within the instrument’s reliability, validity, reference group, language demands, and purpose.
Students receive an introductory overview of general cognitive ability alongside more specific abilities such as verbal, spatial, quantitative, processing, and memory-related performance. The course does not treat one model as a complete definition of human ability.
Evaluate: “An IQ score tells you how smart a person is.”
Students replace the statement with precise measurement language and identify what the score cannot establish by itself.
Compare repeated scores from two fictional tests. One produces consistent scores across occasions; another fluctuates widely. Identify which appears more reliable, then explain why reliability alone does not establish validity.
Calibrate this claim: “One observation about Intelligence & Psychological Measurement tells us everything important about a person.”
Build a Claim → Measure → Evidence → Alternative Explanation → Limitation → Conclusion map for Intelligence & Psychological Measurement.
A percentile indicates how a score compares with a reference group; it is not the percentage of test questions answered correctly.
Evaluate a fictional test being used with students whose language background differs from the population used during test development. Ask what the test measures, whether language demands affect performance, whether the use has validation evidence, and what conclusion would be too strong.
Students learn that psychological tests have sometimes been used with inappropriate generalization, inequitable assumptions, or discriminatory policy. The lesson is neither “testing is useless” nor “scores perfectly reveal ability.” Responsible use requires evidence, fairness, and fit between tool and purpose.
Write a 400–600 word measurement audit of a fictional cognitive assessment using construct definition, reliability, validity, norm group, context, and limits.
Does the semester question use a construct requiring a standardized measure? If so, what reliability and validity evidence would be needed for the intended interpretation?
Why can a consistent score still fail to measure what a researcher claims it measures?