Next Upcoming Google+ Hangout: Tuesday, August 27 @ 7PM (CST) - To Participate CLICK HERE

Search For Topics/Content
« What are residuals in regression? How we can find residuals? (Raja, location unknown) | Main | 3 DV and 2 IV. I also have (possibly) up to 5 covariates (demographic info, eg. age, education, ethnicity, etc.); Only 1 group. So what's the best test? (Bren) »
Thursday
Dec092010

How do I determine if a questionaire I want to use has 'good psychometric properties'? (Jessica, United Kingdom)


Thanks for the great question, Jessica! Typically, when the term psychometrics is used in the context of survey research, it is in reference to a survey instrument's reliability. The most common statistic used to determine a survey instrument's reliability is Cronbach's alpha. Cronbach's alpha is a statistic that evaluates how much individual survey items covariate with one another to predict a single construct. In English, that means it is a test how much a group of survey questions measures the construct they are intended to represent.
As an example, if an assessment of depressive symptoms contains 10 items, a Cronbach's alpha for those 10 items is a measure of how well the group of those 10 items (as a whole) represents a respondent's level of depressive symptoms . If you've not yet collected data, the best way to determine an instruments psychometrics is to review previous studies that have used the survey and calculate what the average Cronbach's alpha was among them. Cronbach's alpha typically ranges from 0 to 1 (although negative numbers are possible, they are usually meaningless), with values closer to one indicating stronger reliability. There is no official value that indicates strong reliability, but a review of the literature does show some general conventions on the topic.
Commonly, a Cronbach's alpha in the range of .70 to .79 is considered adequate, a value in the range of .80 to .89 is considered good, and a Cronbach's alpha in the range of .90 to .99 is considered excellent (an alpha of 1.00 is most likely an error or an indication that something is wrong with your data). Another test of reliability includes test-retest reliability (which uses a correlation to test for agreement between two measures of the same construct). If you've already collected your data, the statistic can generally be easily obtained using any statistical program (such as SPSS or SAS). I hope that was helpful and please keep the questions coming!

References (1)

References allow you to track sources for this article, as well as articles that were written in response to this article.

Reader Comments (2)

Thanks...that was exactly what we needed!

December 10, 2010 | Unregistered CommenterJessica

No problem! I'm glad I could be helpful!

December 10, 2010 | Registered CommenterJeremy Taylor

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>