How do I determine if a questionaire I want to use has 'good psychometric properties'? (Jessica, United Kingdom)
Thursday, December 9, 2010 at 2:28PM
Jeremy Taylor in Alpha, Stats Make Me Cry Guy Question, covariance, cronbach's alpha, measurement, reliability, survey


Thanks for the great question, Jessica! Typically, when the term psychometrics is used in the context of survey research, it is in reference to a survey instrument's reliability. The most common statistic used to determine a survey instrument's reliability is Cronbach's alpha. Cronbach's alpha is a statistic that evaluates how much individual survey items covariate with one another to predict a single construct. In English, that means it is a test how much a group of survey questions measures the construct they are intended to represent.
As an example, if an assessment of depressive symptoms contains 10 items, a Cronbach's alpha for those 10 items is a measure of how well the group of those 10 items (as a whole) represents a respondent's level of depressive symptoms . If you've not yet collected data, the best way to determine an instruments psychometrics is to review previous studies that have used the survey and calculate what the average Cronbach's alpha was among them. Cronbach's alpha typically ranges from 0 to 1 (although negative numbers are possible, they are usually meaningless), with values closer to one indicating stronger reliability. There is no official value that indicates strong reliability, but a review of the literature does show some general conventions on the topic.
Commonly, a Cronbach's alpha in the range of .70 to .79 is considered adequate, a value in the range of .80 to .89 is considered good, and a Cronbach's alpha in the range of .90 to .99 is considered excellent (an alpha of 1.00 is most likely an error or an indication that something is wrong with your data). Another test of reliability includes test-retest reliability (which uses a correlation to test for agreement between two measures of the same construct). If you've already collected your data, the statistic can generally be easily obtained using any statistical program (such as SPSS or SAS). I hope that was helpful and please keep the questions coming!

Article originally appeared on Stats Make Me Cry (http://www.statsmakemecry.com/).
See website for complete article licensing information.