Research paperSocial anxiety questionnaire (SAQ): Development and preliminary validation
Introduction
Social anxiety refers to fear of social situations due to concerns about being scrutinised, judged or embarrassed, including anxiety over social interactions, with excessive levels considered to constitute a disorder, called social anxiety disorder (SAD) in the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5; American Psychiatric Association, 2013). With the prevalence of SAD (see Heimberg et al., 2000, Kessler et al., 2005, Stein et al., 2017), and both theoretical and empirical interest in social anxiety growing, there is a need for measures of social anxiety that are brief and can be used more practically while assessing the construct comprehensively.
A review of currently available and used measures of social anxiety, for instance, the Liebowitz Social Anxiety Scale (LSAS; Liebowitz, 1987), the Social Phobia Weekly Summary Scale (SPWSS; Clark et al., 2003), the Social Interaction Phobia Scale (Carleton et al., 2009, Reilly et al., 2012), the Social Interaction Anxiety Scale (SIAS) and the Social Phobia Scale (SPS; Mattick and Clarke, 1998), the Social Cognitions Questionnaire (SCQ; Wells et al., 1993), and the Social Phobia Inventory (SPIN; Connor et al., 2000, Carleton et al., 2010), revealed some issues to be resolved. First and foremost, there exists no Polish language reliable and valid self-report measures of social anxiety. For instance, researchers in Poland have used either a translated version of the LSAS without empirical validation (c.f., Dabkowska, 2007, Dabkowska, 2008) or modified version of the STAI (State-Trait Anxiety Inventory; Spielberger et al., 1983; c.f., Karas, 2005) as a measure of social anxiety. The development of appropriate, valid, and reliable assessment tool of social anxiety is necessary for further studies (e.g., in Poland, research on social anxiety are still relatively rare, probably due to the insufficient availability of valid measures). Moreover, considering the nature of social anxiety (APA, 2013; see also Bögels et al., 2010, Heimberg et al., 2014b), the assessment should not only include the shared features of fear, avoidance, and anxiety, which have been reflected by most measures (c.f., Carleton et al., 2009, Connor et al., 2000, Liebowitz, 1987, Mattick and Clarke, 1998), but also unique features of social anxiety, such as specific cognitive-affective, physiological, attitudinal, behavioural, and attention performance processes should be addressed. Few current assessment instruments of social anxiety capture cognitive schemas, but they are however only narrowed down to the facet (c.f., Wells et al., 1993). Thus, the measures available for the assessment of social anxiety are often limited to avoidance ratings or thoughts and feelings and do not fully cover the breadth of social phobia domains. In contrast, indeed the six-item SPWSS (Clark et al., 2003,2006) comprises ratings of social anxiety, avoidance, self-focused attention, anticipatory processing and post-event rumination, nevertheless the scale was developed without empirical validation and psychometric evaluation. To address the above-existed issues; including the multidimensionality of SAD (Clark, 2001; see also Heimberg et al., 2014a, Heimberg et al., 2014b), and, importantly, a need for theoretically and psychometrically sound measures of social anxiety in Poland; a new instrument that captures specific cognitive-affective, physiological, attitudinal, and attention performance processes related to social anxiety was proposed and developed. An access to theoretically and psychometrically valid assessment instruments is important to conduct research and provide quality patient care.
The newly developed instrument, called the Social Anxiety Questionnaire (SAQ), draws upon one of the most prominent, well-studied, and fruitful models providing an evidence-based way to conceptualize and treat SAD – Clark and Wells, 1995, Clark, 2001) cognitive model of social anxiety. The model, unique in the synthesis of the writings of earlier theorists (e.g., Beck et al., 1985, Heimberg and Barlow, 1988, Leary, 1983), is largely focused on the maintaining processes of SAD and attempts to explain why individuals with social phobia fail to benefit from the naturalistic exposure that is provided by their everyday interactions with other people. The four maintenance processes that are highlighted in the model are: (1) increased self-focused attention and a linked decrease in observation of other people and their responses (detailed monitoring and observation of oneself); (2) use of misleading internal information (images and feelings) to make excessively negative inferences about how one appears to others (generate a negative view of the self as a social object); (3) extensive use of overt and covert safety-seeking behaviours to prevent or minimize the feared social catastrophes (e.g., attempts to avoid being the centre of attention, avoiding eye contact, self-monitoring, not talking about oneself); and (4) problematic pre- and post-event processing (i.e., engaging in negatively biased anticipatory processing before entering feared social situations and prolonged, negatively biased, post-event processing). These processes are accompanied by marked arousal and fear. Persons with SAD are particularly concerned about somatic and cognitive symptoms of anxiety (e.g., tremor, sweating, feeling hot in the face, and mental blanks) that they think could be observed by others (Clark, 2001; see also Heimberg et al., 2014b). Because of the perceived significance of the symptoms, they are often hypervigilant and interpret such symptoms as signs of impending or actual failure to meet their desired standards of social interactions. Additionally, the hypervigilance and a variety of safety behaviours often increase the visibility and the subjective intensity of the somatic and cognitive symptoms, driving the vicious cycle (for more details, see Clark and Wells, 1995, Clark, 2001).
Evidence supporting the Clark and Wells’ model has been found in research conducted in child, adolescent, and adult populations, using both correlational and experimental designs (c.f., Clark, 2001, Clark, 2004). Each specific aspect of the model has received substantial empirical support. For example, studies have shown that socially anxious individuals display higher levels of self-focused attention (Hodson et al., 2008, Miers et al., 2013, Pineles and Mineka, 2005, Rapee and Abbott, 2007, Spurr and Stopa, 2002), evaluate social events more negatively (Alfano et al., 2006, Inderbitzen-Nolan et al., 2007, Norton and Hope, 2001, Stopa and Clark, 2000), report negative self-related thoughts (Dodge et al., 1988, Ranta et al., 2014) and negative observer-perspective images of self in social situations (Hackmann et al., 1998, Wells et al., 1998). Furthermore, individuals with high levels of social anxiety reported using a greater number of safety behaviours, more frequently, and in a greater number of situations than those with low levels of social anxiety (Hodson et al., 2008, McManus et al., 2008). Holding negative self-images in mind during social situations has been shown to generate higher levels of fear and anxiety, stronger beliefs that one's anxiety symptoms are visible, and reduced ratings of subjective performance in social-evaluative situations (Hirsch et al., 2003, Spurr and Stopa, 2003). There is also a substantial body of empirical evidence demonstrating that SAD individuals engage in self-focused cognition prior, during, and following social situations, generating a cycle of dysfunctional thinking that contributes to the maintenance of social anxiety (for review, see Norton and Abbott, 2016). The findings provide support for all specific aspects of the Clark-Wells model underscoring the multidimensionality of SAD, which constitutes the theoretical foundation for a novel measure of social anxiety symptoms.
The current research aimed to, firstly, develop the Social Anxiety Questionnaire (SAQ), as a new measure of social anxiety symptoms that beyond assessing anxiety, avoidance, and distress, reflects negative social cognitions, safety behaviours, self-focused attention, and pre- and post-event processing – as posited by Clark and Wells, 1995, Clark, 2001) model of SAD; and secondly, validate the SAQ in Polish samples. Moreover, the additional goal was to create a questionnaire, which captures all of the factors and is not being overly long. A questionnaire length is one of the important factors in determining response burden manifested in lower response rate, reduced completion, and reduced data quality (Rolstad et al., 2011). Overall, using four samples recruited from clinical and nonclinical settings, the present research set out to assess the psychometric properties of the SAQ as a novel measure of social anxiety symptoms. Two studies were conducted to verify and replicate the hypothesized factor structure of the SAQ (Study 1 and Study 2). Thereafter, internal consistency, test re-test reliability, and convergent and discriminant validity were assessed (see Study 2, 3, and 4). This sequence of psychometric evaluations is intended to provide an initial assessment of the SAQ, while recognizing that additional validation will be a required future research direction.
Section snippets
2.1.1. Item generation
There were four steps to develop the items of the pilot version of Social Anxiety Questionnaire (SAQ), which are described as follows.
Concept definition:
First, the DSM-5 (American Psychiatric Association, 2013) definition of Social Anxiety Disorder, Clark and Wells, 1995, Clark, 2001) cognitive model, existing measures, and empirical literature discussing social anxiety were reviewed to provide the definition and to generate items. Considering the cognitive, emotional, physiological, and
Study 2: validation
The aim of the study was to replicate the five-factor structure and test the validity and reliability of the SAQ. Several constructs related to SAD were used to pre-validate the SAQ. Research has indicated a positive relationship between social anxiety and self-focused rumination (e.g., Brozovich et al., 2015, Modini and Abbott, 2017; for a review, see also Penney and Abbott, 2014), and loneliness (e.g., Lim et al., 2016, Meltzer et al., 2013; for review and meta-analysis, see also Teo et al.,
Study 3: further validation
This study aimed to assess stability of the SAQ over time (test-retest reliability), and examine validity in terms of the relationships of the SAQ with the Big Five personality traits: extraversion (i.e., ease in social interactions, preference for being in groups, tendency to be active, talkativeness); neuroticism (i.e., vulnerability to the experience of unpleasant emotions, difficulty in coping with stress), which is the opposite of emotional stability; openness to experience (i.e.,
Study 4: clinical samples
Finally, to provide additional support for the validity of the SAQ, it was tested whether the SAQ has the ability to differentiate between social anxiety and major depressive disorders in the predicted direction. Specifically, it was expected adults with SAD relative to the participants with the current clinical diagnosis of depression to report higher levels of social anxiety, as measured by the newly developed measure. Looking at the overlap between major depression and SAD (Heimberg et al.,
General discussion
This paper reports the development and preliminary validation of the Social Anxiety Questionnaire (SAQ) that derives from a strong theoretical framework – a cognitive model of social anxiety established by Clark and Wells, 1995, Clark, 2001) and the criteria for SAD included in DSM-V (APA, 2013). The sequence of psychometric evaluations provided an initial assessment of the SAQ across nonclinical and clinical samples. The four studies have provided promising evidence to support the SAQ as a
Conflicts of interest
No conflicts of interest to declare.
Author contributions
The author confirms being the sole contributor of this work and approved it for publication.
Funding source
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The author wishes to thank all participants. Professors Anna M. Zalewska and Hanna Przybyła-Basista, Dr Ewa Wojtyna, Dr Damian Grabowski, and two anonymous reviewers are acknowledged for their valuable suggestions, recommendations, and encouragement.
References (78)
- et al.
The validity of the hospital anxiety and depression scale. An updated literature review
J. Psychosom. Res.
(2002) - et al.
SPINning factors: factor analytic evaluation of the social phobia inventory in clinical and nonclinical undergraduate samples
J. Anxiety Disord.
(2010) Developing new treatments: On the interplay between theories, experimental science and clinical innovation
Behav. Res. Ther.
(2004)Assessing the adequacy of structural equation models: Golden rules and editorial policies
Pers. Individ. Dif.
(2007)- et al.
A very brief measure of the Big-Five personality domains
J. Res. Pers.
(2003) - et al.
Psychosocial treatments for social phobia
Psychosom. J. Consult. Liaison Psychiatry
(1988) - et al.
A cognitive-behavioral model of social anxiety disorder
- et al.
Trends in the prevalence of social phobia in the United States: A synthetic cohort analysis of changes over four decades
Eur. Psychiatry
(2000) - et al.
Self-images play a causal role in social phobia
Behav. Res. Ther.
(2003) Confirmatory Factor Analysis,
Self-esteem, dependency, self-efficacy and self-criticism in social anxiety disorder
Compr. Psychiatry
Subjective versus objective behavioral ratings following two analogue tasks: A comparison of socially phobic and non-anxious adolescents
J. Anxiety Disord.
Impact of early adolescent anxiety disorders on self-esteem development from adolescence to young adulthood
J. Adolesc. Health
Development and validation of measures of social phobia scrutiny fear and social interaction anxiety
Behav. Res. Ther.
Why social anxiety persists: An experimental investigation of the role of safety behaviours as a maintaining factor
J. Behav. Ther. Exp. Psychiatry
Negative rumination in social anxiety: a randomised trial investigating the effects of a brief intervention on cognitive processes before, during and after a social situation
J. Behav. Ther. Exp. Psychiatry
Clarifying the dispositional basis of social anxiety: a hierarchical perspective
Pers. Individ. Dif.
Kernels of truth or distorted perceptions: Self and observer ratings of social anxiety and performance
Behav. Ther.
Response burden and questionnaire length: Is shorter better? A review and meta-analysis
Value Health
Self-focused attention in social phobia and social anxiety
Clin. Psychol. Rev.
The observer perspective: Effects on social anxiety and performance
Behav. Res. Ther.
Understanding the limitations of global fit assessment in structural equation modeling
Pers. Individ. Dif.
Social phobia and interpretation of social events
Behav. Res. Ther.
The role of social isolation in social anxiety disorder: A systematic review and meta-analysis
J. Anxiety Disord.
Modelling relationships between cognitive variables during and following public speaking in participants with social phobia
Behav. Res. Ther.
How do I look with my minds eye: Perspective taking in social phobic imagery
Behav. Res. Ther.
Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-5)
Cognitive correlates of social phobia among children and adolescents
J. Abnorm. Child Psychol.
Rumination Questionnaire
Stud. Psychol.
Anxiety Disorders and Phobias: A Cognitive Perspective
Social anxiety disorder: Questions and answers for the DSM-V
Depress. Anxiety
Confirmatory Factor Analysis for Applied Research
The effect of rumination and reappraisal on social anxiety symptoms during cognitive-behavioral therapy for social anxiety disorder
J. Clin. Psychol.
Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming
Factor analytic models: Viewing the structure of an assessment instrument from three perspectives
J. Pers. Assess.
Refining and validating the social interaction anxiety scale and the social phobia scale
Depress. Anxiety
Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology
Psychol. Assess.
A cognitive perspective on social phobia
Cognitive therapy versus fluoxetine in generalized social phobia: A randomized placebo-controlled trial
J. Consult. Clin. Psychol.
Cited by (7)
Documenting the late positive potential towards self-imagery within social anxiety
2022, Psychiatry Research - NeuroimagingCitation Excerpt :Finally, based on the Combined Cognitive Biases Hypothesis and research suggesting that AP loads attentional resources and exacerbates anxiety, it is expected that the blunting effect will be intensified within the AP condition relative to Distraction. The Social Anxiety Questionnaire (SAQ; [citation redacted for blind review]; Łakuta, 2018) is a 10-item scale measuring symptoms of social anxiety. Participants rated how much each statement (e.g., “During social interactions, it is often hard for me to stop thinking about what I have just said and how it sounds to others.”)
Independent Psychometric Evaluation and Predictive Utility of The Social Anxiety Questionnaire
2022, Psychiatric QuarterlyMultiple-group path analysis between the Overexcitability, Creative Style, and Cognitive Representation Efficiency throughsamples of university students
2021, Journal of the Faculty of Education, Alexandria UniversitySleeping Habits Amongst Riyadh Children: A Cross-Sectional and Validation Study
2020, Research Square