Reliability and validity of the Attitudes Toward Seeking Professional Psychological Help Scale-Short Form
Introduction
Large-scale epidemiological studies have found robust correlates of mental healthcare use, such as female gender, younger age, divorced or separated relationship status, and diagnoses of mood, substance use and anxiety disorders (Parslow and Jorm, 2000, Kessler et al., 2005, Wang et al., 2005, Elhai et al., 2006a). However, less is known about the association between treatment attitudes and treatment use. Studying this association is important, because attitudes toward treatment have the potential to be mutable, in facilitating individuals' access to treatment (Bhugra and Hicks, 2004).
Numerous studies have examined attitudes toward using mental healthcare. The few studies examining associations between treatment attitudes and actual treatment use have revealed statistically significant positive associations, using samples of college students (Fischer and Farina, 1995, Cohen, 1999, Mackenzie et al., 2004), local community residents (Mackenzie et al., 2004), and the general population (Lin and Parikh, 1999). Among those studies reporting effect sizes, treatment attitudes have typically yielded at least “medium” effects (i.e., r > 0.30), which is consistent with the broader literature demonstrating substantial consistency between attitudes and behavior (Crano and Prislin, 2006). However, it should be noted that most of the above studies queried lifetime treatment use, but not recent treatment use or utilization intensity (i.e., visit counts), potentially neglecting interesting relationships with treatment attitudes.
Only one standardized instrument assessing mental health treatment attitudes has been both psychometrically examined and used in a sizeable number of studies, the Attitudes Toward Seeking Professional Psychological Help Scale (ATSPPH) (Fischer and Turner, 1970), and a subsequent modernized short form (ATSPPH-SF) (Fischer and Farina, 1995). Numerous studies have documented psychometric support for the ATSPPH (reviewed in Fischer and Farina, 1995), and more recently for the ATSPPH-SF (Fischer and Farina, 1995, Komiya et al., 2000, Constantine, 2002, Vogel et al., 2005). The only similar measures are rarely used in research. Furthermore, with the exception of the Willingness to Seek Help Questionnaire (Cohen, 1999), similar instruments assess constructs that are not focused on global treatment attitudes, including the Stigma Scale for Receiving Psychological Help (Komiya et al., 2000), and Thoughts About Psychotherapy Survey (Kushner and Sher, 1989). Finally, the original ATSPPH was modified by Mackenzie et al. (2004) and labeled the Inventory of Attitudes Toward Seeking Mental Health Services, but still lacks brevity (24 items), and is overshadowed by the number of studies using the ATSPPH-SF.
In fact, several important problems exist with treatment attitude instruments. First, little psychometric data are available for these measures. Second, the sparse psychometric data typically do not validate treatment attitudes against behaviorally-specific measures of mental healthcare use, and such measures are crucial in accurately inquiring about treatment use (Elhai et al., 2005). Third, while on a conceptual basis unfavorable treatment attitudes may be better explained by mental health problems (e.g., depression's hopelessness and pessimism), studies have rarely assessed whether the treatment attitude construct is redundant with psychopathology, yielding conflicting findings (Komiya et al., 2000, Vogel et al., 2005, Wrigley et al., 2005). Fourth, such instruments are often developed and validated exclusively with college students, possibly limiting generalizability. Thus, while the treatment attitude construct is important in mental health services research, we do not know how precise relevant assessment instruments are.
The aim of the present investigation was to test the reliability and validity of the ATSPPH-SF, the most relevant and widely used contemporary assessment of mental health treatment attitudes. We examined internal consistency, construct and criterion validity, replicating previous research with this instrument (Fischer and Farina, 1995, Komiya et al., 2000, Constantine, 2002, Vogel et al., 2005). We extended previous work by including a) behaviorally-specific items to accurately inquire about recent mental healthcare use and utilization intensity in testing the scale's criterion validity, and b) an examination of factor structure. We expected to find high reliability for the ATSPPH-SF, adequate construct validity, and positive associations with recent mental healthcare use.
We chose to test this instrument in two separate populations of individuals. First, we implemented a college student sample, since this population was used in developing the ATSPPH-SF (Fischer and Farina, 1995), and in studies using the instrument (Komiya et al., 2000, Vogel et al., 2005). Furthermore, college students have been extensively studied in predicting mental healthcare use, representing a population often having significant treatment needs (Oliver et al., 1999). However, given concerns that mental health treatment attitude instruments lack psychometric data from more representative community samples, we chose to additionally include a sample of healthcare users. Specifically, we sampled primary care medical patients, a population previously studied for mental healthcare use correlates (Simon et al., 1994, Elhai et al., 2006b), representing individuals who are not necessarily seeking mental healthcare but have sought professional medical assistance.
Section snippets
College students
Three hundred introductory college course students (201 women or 67.0%, 98 men or 32.7%, one not indicating gender or 0.3%) served as participants. These students were at least age 18, attending a medium-sized state university in the Midwestern United States. Participants were recruited from their university's multi-department research pool for research or extra credit, through a password-protected website listing available university-specific studies for electronic sign-up. Recruitment
Analysis
ATSPPH-SF items requiring reverse-scoring were coded as such. For the few missing item responses discovered, we conducted series mean replacements within each sample. There was no substantial skewness (> 1.0) or kurtosis (> 1.0) in the distribution of ATSPPH-SF scores.
For the college student and medical patient samples, we calculated the ATSPPH-SF's internal consistency and associations with demographic variables. We assessed the scale's construct validity by examining relationships with items
Discussion
We found support for the ATSPPH-SF's reliability and validity, in both samples of college students and medical patients. Internal consistency was similar to that previously found with college students (Fischer and Farina, 1995, Komiya et al., 2000, Constantine, 2002). Consistent with previous research on the ATSPPH and its short-form, we found that among college students scale scores were associated with female gender (Fischer and Turner, 1970, Komiya et al., 2000). Also confirming previous
Acknowledgments
This study was funded in part by a Research Catalyst Award to the first author, from the Office of Research and Graduate Education, The University of South Dakota. We thank Todd B. Kashdan, Ph.D., and Zak L. Tormala, Ph.D., for providing comments on an earlier draft of this paper.
References (33)
- et al.
Mental health service use among American Red Cross disaster workers responding to the September 11, 2001 U.S. terrorist attacks
Psychiatry Research
(2006) - et al.
Sociodemographic, clinical, and attitudinal characteristics of the untreated depressed in Ontario
Journal of Affective Disorders
(1999) - et al.
Comparison of self-reported and medical record health care utilization measures
Journal of Clinical Epidemiology
(1996) - et al.
Design of mental health benefits: still unequal after all these years
Health Affairs
(2003) - et al.
Effect of an educational pamphlet on help-seeking attitudes for depression among British South Asian women
Psychiatric Services
(2004) Measuring the willingness to seek help
Journal of Social Service Research
(1999)Predictors of satisfaction with counseling: racial and ethnic minority clients' attitudes toward counseling and ratings of their counselors' general and multicultural competence
Journal of Counseling Psychology
(2002)- et al.
Attitudes and persuasion
Annual Review of Psychology
(2006) - et al.
Which patients talk about stressful events and social problems to the general practitioner?
Psychological Medicine
(1998) - et al.
Health service use predictors among trauma survivors: a critical review
Psychological Services
(2005)
Gender- and trauma-related predictors of use of mental health treatment services among primary care patients
Psychiatric Services
Evaluating the use of exploratory factor analysis in psychological research
Psychological Methods
Attitudes toward seeking professional psychological help: a shortened form and considerations for research
Journal of College Student Development
Orientations to seeking professional help: development and research utility of an attitude scale
Journal of Consulting and Clinical Psychology
Regression analyses of counts and rates: Poisson, overdispersed Poisson, and negative binomial models
Psychological Bulletin
Marginal models for zero inflated clustered data
Statistical Modelling
Cited by (179)
The role of income and emotional engagement in the efficacy of a brief help-seeking video intervention for essential workers
2024, Journal of Psychiatric Research
- 1
Dr. Schweinle is now affiliated with the Department of Psychology, Boise State University, Idaho, USA.