AERA Online Paper Repository Viewer

Continuing Paper Access to AERA Annual Meetings
and other Conventions

  
InformationContents
Owner: Leifeng Xiao
Owner Email: Leifeng@link.cuhk.edu.hk
Paper Title: Using Coefficient Alpha in Large-Scale Surveys With Likert Scales and Non-Normal Distributions (Poster 28)
Session Title: Measurement Theory and Application 2
Paper Type: Poster Presentation
Presentation Date: 4/13/2023
Presentation Location: Chicago, IL
Descriptors: Measurement
Methodology: Quantitative
Author(s): Leifeng Xiao, Chinese University of Hong Kong; Luyang Guo, Chinese University of Hong Kong; Dan Wang, The Chinese University of Hong Kong; Kit-Tai Hau, Chinese University of Hong Kong
Unit: Division D - Measurement and Research Methodology
Abstract: We compared alpha and recently proposed potential competitors (ordinal alpha, omega total, omega RT, omega h, GLB, and coefficient H) when they were used with non-normal continuous and discrete data. Results showed that for continuous data, estimation bias was large only when non-normality was severe, and non-normality was a problem with weak items. For Likert scales, other than omega h, most indices were acceptable with non-normal data, and four or more scale points were better. For exponentially distributed data, omega RT was quite robust for all distributions, and bias was generally larger for the binomial-beta distribution. An examination with large-scale surveys suggested that non-normality was not a critical issue as most of the actual items were at worst moderately non-normal.
DOI: https://doi.org/10.3102/2011658