Music performance anxiety: development and validation of the Portuguese music performance anxiety scale

Several studies have developed and validated specific scales to understand, identify and confirm research hypotheses associated with music performance anxiety (MPA). These scales mostly assess behavioral, cognitive, and physiological factors. There is currently no original MPA assessment tool for higher music education in Continental Portuguese, which suggests a research gap. The aim of this study was to determine if the Portuguese Music Performance Anxiety Scale (PoMPAS), developed for this research, is a valid and reliable measure of MPA for the context of higher education in Portugal. The total sample was N = 414 (166 male, 245 female, and three without gender identification). The development of this scale was based on a three-dimensional model (behavioral, cognitive, and physiological), following the theoretical models of Salmon (1990) and Osborne and Kenny (2005). Confirmatory factor analysis of the PoMPAS suggested a good fit in a three-dimensional model with 27 items. The internal consistency values proved appropriate, showing good Cronbach’s alphas (between α = 0.81 and α = 0.90). The McDonald’s Omega also demonstrated good consistency (between ω = 0.81 and ω = 0.90). The PoMPAS is a reliable tool to measure the impact of MPA, with good psychometric qualities, specifically for the Portuguese higher music education context.

Frontiers in Psychology 02 frontiersin.orgvariables, psychophysiological symptoms, gender, performance experience and age, and institutional culture.
As suggested by recent research, the higher education context evidences a high prevalence of MPA, ranging between 16% (Paliaukiene et al., 2018), 39% (Zarza et al., 2016b), 75.1% (Bannai et al., 2016) and 83.1% (Miller and Chesky, 2004).Although the results of these four studies cannot be generalized and the studies took place in different countries (Lithuania, Spain, Japan and the United States, respectively), these percentages are a warning sign for educational institutions because, if left unaddressed, MPA levels may tend to transfer to the professional sphere and even cause career dropout (Orejudo et al., 2018;Wang and Yang, 2024).A systematic review by Fernholz et al. (2019) analyzed 43 studies and stated that the prevalence in the professional context ranges from 16.5 to 60%.The comparison between prevalences suggests that MPA levels are higher among music students in higher education than among professional musicians.
According to Barlow's theory (Barlow, 2000), the development of anxiety disorders is characterized by three types of vulnerabilities: (1) generalized biological vulnerability, which suggests that the development of anxiety is connected to a genetic contribution; (2) generalized psychological vulnerability, indicating that early experiences, under specific conditions, contribute to the development of psychological vulnerabilities and predisposition to a negative state in general; and (3) specific psychological vulnerability, where anxiety is associated with early learning experiences that occurred in some life circumstances, such as in a social assessment, which may increase the perception of threat or danger.
Supported by Barlow's theory, Kenny (2011) highlights three subtypes of MPA: (i) MPA as focal anxiety, in which there is no generalized social anxiety; (ii) MPA that co-occurs alongside with other manifestations of social anxiety; and (iii) MPA that co-occurs with panic and depression.These perspectives suggest that MPA may be linked to an intersection between the individual's developmental history (which may be more or less impactful in the case of focal MPA and more severe in the third subtype) and specific psychosocial conditions (such as performance requirements, technical and musical preparation, public exposure or competitiveness).Acknowledging this intersection, several researchers (Kreutz et al., 2008;Ginsborg et al., 2009) have recommended preventive health programs for musicians, designed to increase the quality of musical performance and students' health and well-being.Nonetheless, according to research (Papageorgi et al., 2010;Zarza et al., 2016a;Casanova et al., 2018), an understanding of the context of the performance situation (e.g., playing solo or in a group, the performance environment, competition) is required to recognize and prevent MPA.Hence, the development of reliable psychometric instruments can contribute to identify contextual specificities of MPA.

Psychometric instruments of MPA
Several studies have applied and/or developed and validated inventories and scales to understand, identify and confirm hypotheses associated with MPA, as regards behavioral, cognitive, and physiological responses.However, none of the instruments presented below analyze or evaluate the context of the performance situation, consequently limiting the understanding of MPA in varied contexts.
The inventories commonly used in studies addressing MPA include: (i) the Music Performance Anxiety Scale (MPAS, Wolfe, 1989): 55 items addressing adaptive and maladaptive anxiety, MPA, cognitive and emotional components; (ii) the Music Performance Anxiety Questionnaire (MPAQ, Lehrer et al., 1990): 32 items concerning coping with anxiety, judgmental thoughts about performance, worrying about the impact of anxiety on performance, and concerns with the reaction of others, oneself and the audience; (iii) the Performance Anxiety Questionnaire (PAQ, Fehm and Schmidt, 2006): 20 items related to cognitive and somatic feelings and two additional qualitative items about coping strategies and performance anxiety feelings; (iv) the Kenny Music Performance Anxiety Inventory (K-MPAI, Kenny, 2009): 40 items regarding proximal somatic anxiety and worries about performance, worry/dread (negative cognitions) focused on self/other scrutiny, depression/hopelessness (psychological vulnerability), parental empathy, memory, generational transmission of anxiety, anxious apprehension and biological vulnerability; (v) the Performance Anxiety Scale for Music Students (PASMS, Cırakoğlu and Şentürk, 2013): 24 items associated with MPA, such as fear of stage, avoidance and symptoms; (vi) the Music Performance Anxiety Scale (MPAS, Sheriff and Yoong, 2015): 58 items about causes/situational factors, temporal occurrence, cognitive, affective, behavioral and somatic manifestations, and autonomic arousal; and (vii) the Mazzarolo Music Performance Anxiety Scale (M-MPAS, Mazzarolo and Schubert, 2022): 5 items to measure the global frequency and intensity of MPA episodes and their negative impact (aversion to future music performances).
Among the instruments presented above, the K-MPAI, which presents good psychometric properties, has been broadly translated and validated for other languages, including Continental Portuguese (Dias et al., 2022) and Brazilian Portuguese (Rocha et al., 2011), with a Cronbach's alpha coefficient of α = 0.91 and α = 0.957, respectively.The four factors and 30 items of the Continental Portuguese version were extracted through an exploratory factor analysis.Nevertheless, it was not developed and designed for the Portuguese context.
It is noteworthy that Trigo (2015), in his research on the translation and validation of the MPAI-A into Portuguese -an inventory designed for samples of adolescent music students developed by Osborne and Kenny (2005), detected weaknesses concerning the principal component analysis (scale items), requiring further research.This weakness may be associated with problems in adapting this inventory to Portuguese.A scale validation study for other languages is relevant but does not take into account a contextual understanding of the specific environment (Hofmann et al., 2010;Kirmayer, 2014a,b;Rocha Zaidhaft and Ortega, 2021).Thus, there is currently no specific MPA assessment tool developed for the context of higher music education in Portugal, which suggests a significant research gap.
This research aimed to determine if the Portuguese Music Performance Anxiety Scale (PoMPAS) -in Portuguese: "Escala Portuguesa de Avaliação da Ansiedade na Performance Musical (EPAAPM)" -is a valid and reliable measure for the context of higher music education in Portugal, based on theoretical models (Salmon, 1990;Osborne and Kenny, 2005) that highlight behavioral, cognitive, and physiological dimensions.In this study, we aimed to add and evaluate the contextual factor of the performance situation, such as the formalities associated with performance, or the contexts of competitions or orchestral auditions, and the physiological symptoms experienced before and during the performance.The research question that supports this research is: Can an inventory specifically designed for the Portuguese context adequately assess the impact of MPA in Portuguese higher music education?To answer this question, the research involved designing a scale for this context that assesses the behavioral, cognitive, and physiological responses, adding items that can also measure the impact of the performance situation and its associated physiological dimensions.

Participants and sample characteristics
Seven hundred and three students from public and private higher education institutions (universities and polytechnic schools) participated in this study.Participants were invited through institutional emails, personally by the first author of this research, and via social networks such as Instagram, Facebook, and WhatsApp, in order to reach a wide and diverse range of participants and institutions.
The criteria for participation in this study were: (1) being enrolled in a higher education institution in Portugal and currently attending bachelor, master or PhD courses, and (2) answering all the items in both questionnaires.The higher education system in Portugal includes two main types of institutions: universities and polytechnic institutes.The universities can offer bachelor, master and PhD courses, while the polytechnic institutes usually offer only bachelor and master courses.
Although 703 students participated, we only considered valid the fully answered questionnaires.Thus, the total sample was N = 414 (Table 1).Of these, 166 were male (40.1%), 245 were female (59.2%), and three did not want to identify their gender (0.7%).
The ages ranged from 18 to 60 (M = 23.78;SD = 6.46).We established a priori the need for a sample with an absolute minimum of 400, as it simultaneously agreed with Comrey and Lee's guidelines (Comrey and Lee, 1992) and Nunnally's (1978) criterion of a subject-to-item ratio of 10:1 (at least 10 participants per item).

Procedure
Two instruments were developed for this study.

Sociodemographic questionnaire
A sociodemographic questionnaire was created to collect participant data (Table 1) such as age, gender, institution, graduation, and instrument.

Portuguese music performance anxiety scale
Prior to developing the PoMPAS, we conducted a qualitative study (Barros et al., 2024), which supported the formulation of the initial questions (bank of items) associated with the context of Portuguese higher education music students, identifying latent MPA-related perceptions about symptoms and contextual factors.Thus, we planned, a priori, a scale with four main factors: (1) behavioral/emotional, (2) cognitive, (3) physiological/somatic, and (4) the context of the performance situation (new factor).In addition, some of the K-MPAI's items (Kenny, 2009) were adapted as models for strengthening the creation of the bank of items of the new scale.
Separate sessions of thinking-aloud discussion, with music students (eight), music researchers (two) and psychology researchers (two), following Van Someren et al. (1994), were undertaken to verify the semantic content and assessing its appropriateness.
The preliminary version of the PoMPAS included 40 items.A Likert scale with five response options was used, with scores from 1 (I completely disagree) to 5 (I completely agree).
The sociodemographic questionnaire and the scale were available online via the LimeSurvey interface at https://forms.ua.pt/, from December 2021 to September 2022, with the ID 488167.

Ethical consideration
We provided an informed consent form to each participant, informing about the purpose of the study and that they could withdraw at any time and without any consequences, and that all responses would be confidential and anonymous.This research furthermore complied with the General Data Protection Regulation (GDPR) of the European Union and was approved by the Ethics and Deontology Board of University of Aveiro (Certificate 02-CED/2020).

Data analysis
Descriptive analysis was undertaken to describe the participants' sociodemographic characteristics (mean, frequency and percentages -Table 1).To analyze the factor structure of the PoMPAS, a psychometric study was carried out through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).The Solomon method was used to split the total sample into equivalent subsamples for exploratory and confirmatory factor analysis (Lorenzo-Seva, 2022).

Exploratory factor analysis
The sample adequacy and factorability were assessed using the Sample Adequacy Index: Kaiser-Meyer-Olkin (KMO -> 0.70) and the significance of Bartlett's test of sphericity.The extraction method used was Weighted Least Squares Mean and Variance Adjusted (RDWLS) (Asparouhov and Muthén, 2010) with oblique rotation using Robust Promin (Lorenzo-Seva and Ferrando, 2019).To determine the most appropriate number of factors, Parallel Analysis techniques with random permutation of observed data were employed (Timmerman and Lorenzo-Seva, 2011).Standardized factor loadings ≥0.30 were considered relevant for item retention in the model.After each item exclusion, a new factor analysis was conducted following the same procedures until the structure contained only items with factor loadings above the established threshold (≥ 0.30).The stability of factors was assessed using the H index (Ferrando and Lorenzo-Seva, 2018).The H index evaluates how well a set of items represents a common factor (Ferrando and Lorenzo-Seva, 2018).H values range from 0 to 1. High H values (> 0.80) suggest a well-defined latent variable that is more likely to be stable across different studies.Low H values suggest a poorly defined latent variable that is likely to be unstable across different studies (Ferrando and Lorenzo-Seva, 2018).

Confirmatory factor analysis
The Diagonally Weighted Least Squares (DWLS) estimator with robust standard error calculation was used due to the ordinal nature of the Likert scale measurement (DiStefano and Morgan, 2014).The adequacy of the estimated model was evaluated using the chi-square (χ2), degrees of freedom (df), and the χ2/df ratio, along with fit indices such as Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Standard Root Mean Square Residual (SRMR).The χ2/df ratio should be less than five or preferably less than three, RMSEA values should be less than 0.08, and CFI and TLI values should preferably be >0.95.The Standard Root Mean Square Residual (SRMR) should be <0.08 (Hu and Bentler, 1999).
Internal consistency was assessed using Cronbach's Alpha and McDonald's Omega.Additionally, as evidence of score accuracy, the Average Variance Extracted (AVE) was calculated as a measure of the amount of variance captured by a construct relative to the amount of variance due to measurement error.Cronbach's alpha and McDonald's omega were calculated for Exploratory and Confirmatory analysis.Values ≥0.70 were considered adequate.
Exploratory Factor Analyses were conducted using FACTOR software version 12.04.05(Ferrando and Lorenzo-Seva, 2017).Confirmatory Factor Analyses and internal consistency analysis, via Cronbach's Alpha and McDonald's Omega, were performed using JASP software (version 0.18.03).

Exploratory factor analysis
An exploratory factor analysis was carried out on the preliminary 40-item PoMPAS.Regarding the sample, a ratio of five respondents per estimated item was obtained (Watkins, 2018).The dataset was initially analyzed to detect inconsistent values related to participants' responses to the instrument's items.No inconsistencies or missing data were detected.Table 2 provides a univariate descriptive analysis for the 40 items of the PoMPAS.

Discussion
This research aimed to determine if the Portuguese Music Performance Anxiety Scale (PoMPAS) -in Portuguese: "Escala Portuguesa de Avaliação da Ansiedade na Performance Musical (EPAAPM)" -is a valid and reliable measure for the context of higher music education in Portugal.
The interpretation process began by conducting EFA with the number of factors identified, as well as assessing the KMO and Bartlett's sphericity indices (Lloret-Segura et al., 2014;Watkins, 2018;Rogers, 2022).Current guidelines with recommendations for conducting EFA describe the superior performance of parallel analysis in ordinal data compared to other factor extraction techniques (Schreiber, 2021;Rogers, 2022).Therefore, for the current study, we opted to use Parallel Analysis, which indicated the extraction of two factors.In this sense, we tested the structure regarding the feasibility of three factors.Considering both the conceptual relationship of the items and the factor loading in each obtained factor, the three-factor model has good psychometric properties.
Additionally, the exploratory model demonstrated a good fit based on satisfactory fit indices.
Following the exploratory factor analysis (EFA) outlined previously, a confirmatory factor analysis (CFA) was conducted to further validate the factorial structure of the PoMPAS.The CFA aimed to confirm the fit of the three-factor model (BEF -F1, CPF -F2, and CF -F3), as identified in the EFA.After excluding item #38, the confirmatory factor analysis showed adequate fit indices in the multifactorial solution of three firstorder factors.Furthermore, the CFA demonstrated that a model with three dimensions was justified in theory and practice.It is worth mentioning that, in a complex model (i.e., with various parameters to be estimated), the χ2 result was not considered as a criterion for discarding the model (Kyriazos, 2018).The reliability, assessed using both Cronbach's alpha and McDonald's omega, was satisfactory across exploratory and confirmatory analyses.Notably, McDonald's omega is highlighted as a preferred index over Cronbach's alpha due to its consideration of the individual importance of each item within the construct, as determined by their factor loadings (McNeish, 2018;Schreiber, 2021).
Comparing the PoMPAS with the seven MPA scales described above highlights both similarities and differences.While the PoMPAS assesses behavioral/emotional, contextual/physiological, and cognitive dimensions associated with MPA, the MPAS (Wolfe, 1989) measures MPA through cognitive and emotional components, seeking to understand adaptive and maladaptive anxiety.The MPAQ (Lehrer et al., 1990) emphasizes coping strategies, judgmental attitudes/thoughts about performance, concern about the impact of anxiety and worry about the reaction of others, oneself and the audience.Fehm and Schmidt's (2006) PAQ, on the other hand, assesses cognitive and somatic feelings and seeks to understand feelings of performance anxiety and coping strategies.The K-MPAI (Kenny, 2009) assesses proximal somatic anxiety and performance worries, negative cognitions, psychological vulnerability, parental empathy, memory, generational transmission of anxiety, apprehension and biological vulnerability.The PASMS (Cırakoğlu and Şentürk, 2013) measures stage fright, avoidance and symptoms of MPA.The MPAS (Sheriff and Yoong, 2015) evaluates the frequency and intensity of situational factors, occurrence, and cognitive, affective, behavioral and somatic manifestations.The M-MPAS (Mazzarolo and Schubert, 2022) assesses MPA's global frequency and intensity and the negative impact on future music performances.
After checking the differences between the scales, we can verify that each has specific assets for measuring MPA.However, none of the instruments shown takes into account the context of the performance situation, a crucial factor that limits the understanding of MPA, particularly in higher education, the primary focus of this research.
Authors such as Papageorgi et al. (2010), Zarza et al. (2016a), andCasanova et al. (2018) have highlighted the influence of the performance situation context on MPA levels.This factor, which is often overlooked, is a key strength of this study.By addressing this influence, the study not only enhances our understanding of MPA but also contributes to the development of more effective MPA measurement tools.
The PoMPAS is designed to understand, confirm, and identify the global characteristics of students' MPA in that context.Moreover, the PoMPAS scale stands out due to its emphasis on assessing MPA "before" and "during" performance, setting it apart from other scales.This perspective has been mentioned by music students in the Portuguese context (Barros et al., 2024), highlighting that the psychophysiological sensations of MPA are predominantly experienced "before" and "during" (and to a lesser extent, "after") the performance.This insight opens avenues for developing tailored strategies to alleviate MPA in these specific moments, while considering the unique profile of each student.The PoMPAS may have a positive impact in this field since it broadens the understanding and assessment of MPA and, consequently, addresses limitations of other scales.
According to Rocha Zaidhaft and Ortega (2021), the cultural context has become increasingly relevant for health actions.Kirmayer (2014a,b) highlights that cultural contexts are diverse, encompassing not only spatial but also temporal and historical dimensions within a society.The cultural context plays a crucial role in shaping knowledge and identity, providing significance and direction to human life, and, as a result, affecting aspects related to mental health such as anxiety and depression.This implies that the context has an impact not only on how MPA is experienced but also on how it is perceived and addressed by higher music education institutions.
Barros' systematic review (Barros et al., 2022) showed that both the contextual factor of the performance situation and the behavioral factor are predictors of MPA.However, in this study, the contextual dimension was associated with the physiological factor (CPF) and the behavioral dimension was associated with the emotional factor (BEF) for better adjustment indices, suggesting two new variables to consider in future research.Furthermore, these variables can also support decision-making to implement specific interventions involving music students.
This study has some limitations that can be addressed by future research.Since the PoMPAS (Appendix 1) is a self-report questionnaire, its limitations are inherent to the type of instrument itself (it only assesses MPA globally).The sample in this study was convenience-based, which hinders generalizations.Furthermore, other questionnaires that could test convergent and divergent validity were not applied, which may be the main shortcoming of this study.Thus, we suggest that future studies include this validation with different scales, seeking to identify possible weaknesses.Despite this, the PoMPAS has proven to be a reliable tool with good psychometric qualities, developed and validated to measure MPA in the context of higher music education in Portugal.

TABLE 1
Characterization of participants by age, gender, institution, degree, and instrument (N = 414).
Table 3 presents the factorial model of the PoMPAS.

TABLE 2
Univariate descriptive analysis for the items of the PoMPAS.

TABLE 3
Exploratory factor analysis results.

TABLE 4
Confirmatory factor analysis results.