Role of Test Motivation in Intelligence Testing

Posted: 7 May 2011

See all articles by Angela Duckworth

Angela Duckworth

University of Pennsylvania - Department of Psychology

Patrick D. Quinn

affiliation not provided to SSRN

Donald Lynam

Purdue University

Magda Stouthamer-Loeber

affiliation not provided to SSRN

Date Written: May 7, 2011

Abstract

Intelligence tests are widely assumed to measure maximal intellectual performance, and predictive associations between intelligence quotient (IQ) scores and later-life outcomes are typically interpreted as unbiased estimates of the effect of intellectual ability on academic, professional, and social life outcomes. The current investigation critically examines these assumptions and finds evidence against both. First, we examined whether motivation is less than maximal on intelligence tests administered in the context of low-stakes research situations. Specifically, we completed a meta-analysis of random-assignment experiments testing the effects of material incentives on intelligence-test performance on a collective 2,008 participants. Incentives increased IQ scores by an average of 0.64 SD, with larger effects for individuals with lower baseline IQ scores. Second, we tested whether individual differences in motivation during IQ testing can spuriously inflate the predictive validity of intelligence for life outcomes. Trained observers rated test motivation among 251 adolescent boys completing intelligence tests using a 15-min “thin-slice” video sample. IQ score predicted life outcomes, including academic performance in adolescence and criminal convictions, employment, and years of education in early adulthood. After adjusting for the influence of test motivation, however, the predictive validity of intelligence for life outcomes was significantly diminished, particularly for nonacademic outcomes. Collectively, our findings suggest that, under low-stakes research conditions, some individuals try harder than others, and, in this context, test motivation can act as a third-variable confound that inflates estimates of the predictive validity of intelligence for life outcomes.

Suggested Citation

Duckworth, Angela and Quinn, Patrick D. and Lynam, Donald and Stouthamer-Loeber, Magda, Role of Test Motivation in Intelligence Testing (May 7, 2011). Available at SSRN: https://ssrn.com/abstract=1834136

Angela Duckworth (Contact Author)

University of Pennsylvania - Department of Psychology ( email )

3815 Walnut Street
Philadelphia, PA 19104-6196
United States

Patrick D. Quinn

affiliation not provided to SSRN ( email )

Donald Lynam

Purdue University ( email )

610 Purdue Mall
West Lafayette, IN 47907
United States

Magda Stouthamer-Loeber

affiliation not provided to SSRN ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
475
PlumX Metrics