Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 22 December 2020
Sec. Mood Disorders
This article is part of the Research Topic Impact of the Coronavirus Pandemic (COVID-19) on Mood Disorders and Suicide View all 41 articles

Comparing the Impact of COVID-19-Related Social Distancing on Mood and Psychiatric Indicators in Sexual and Gender Minority (SGM) and Non-SGM Individuals

  • 1Department of Psychology, University of Michigan, Ann Arbor, MI, United States
  • 2Department of Psychology, Brandeis University, Waltham, MA, United States
  • 3Department of Psychology and Neuroscience, Boston College, Chestnut Hill, MA, United States
  • 4Division of Sleep Medicine, Harvard Medical School, Boston, MA, United States
  • 5Department of Neurobiology and Behavior, Center for the Neurobiology of Learning and Memory, University of California, Irvine, Irvine, CA, United States
  • 6Department of Neurology at Harvard Medical School, BIDMC, Boston, MA, United States
  • 7Department of Psychology, University of Notre Dame, Notre Dame, IN, United States
  • 8Department of Psychiatry, Harvard Medical School, Boston, MA, United States
  • 9Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, MA, United States

Empirical evidence demonstrates mental health disparities between sexual and gender minority individuals (SGM) compared with cisgender heterosexual individuals. SGM individuals report elevated rates of emotional distress, symptoms related to mood and anxiety disorders, self-harm, and suicidal ideation and behavior. Social support is inversely related to psychiatric symptoms, regardless of SGM status. The COVID-19 pandemic—with its associated limited social interactions—represents an unprecedented period of acute distress with potential reductions in accessibility of social support, which might be of particular concern for SGM individuals' mental well-being. In the present study, we explored the extent to which potential changes in mental health outcomes (depressive symptoms, worry, perceived stress, positive and negative affect) throughout the duration of the pandemic were related to differences in perceptions of social support and engagement in virtual social activity, as a function of SGM status. Utilizing a large sample of US adults (N = 1,014; 18% reported SGM status), we assessed psychiatric symptoms, perceptions of social isolation, and amount of time spent socializing virtually at 3 time windows during the pandemic (between March 21 and May 21). Although SGM individuals reported greater levels of depression compared with non-SGM individuals at all 3 time points, there was no interaction between time and SGM status. Across all participants, mental health outcomes improved across time. Perceived social isolation was associated with poorer mental health outcomes. Further, time spent engaging in virtual socialization was associated with reduced depression, but only for those in self-reported quarantine. We discuss these results in terms of the nature of our sample and its impact on the generalizability of these findings to other SGM samples as well as directions for future research aimed at understanding potential health disparities in the face of the COVID-19 pandemic.

Introduction

The Coronavirus Disease 2019 (COVID-19) pandemic is unprecedented in most of our lifetimes and has had far reaching effects worldwide. At the time of this publication, we are only beginning to grasp the full extent of this international public health crisis. With this unique time in human history comes the realization that we have little understanding of the differential impact of large-scale public health measures being implemented. While there has necessarily been focus on the physical health implications of the pandemic, it is becoming increasingly clear that there are important mental health repercussions that are only beginning to be understood (1). Worse mental health outcomes have been reported as a direct function of COVID-19 infection [e.g., (2)] as well as due to indirect distress related to the pandemic [e.g. (3, 4)]. Apart from the general distress related to the COVID-19 virus itself and potential morbidity, psychosocial disruptions and alienation resultant from measures designed to contain the spread of the disease hold the potential to further compromise mental health through curtailed opportunities to engage in social activities. Further, these deleterious effects might not universally affect all persons in equal magnitude.

Sexual and gender minority (SGM) individuals—those reporting sexual orientation and gender identity other than heterosexual and cisgender—represent one population likely to be disproportionately impacted by COVID-19 and public health responses to the disease. SGM individuals typically experience higher rates of poverty (5), housing instability (6), food insecurity (7), lack of healthcare insurance (8), and employment within industries negatively affected by and with higher infection potential (9) compared with their cisgender heterosexual counterparts. Independent of the COVID-19 pandemic, a robust literature documents psychosocial health disparities between SGM and cisgender heterosexual individuals. When compared with cisgender heterosexual individuals, SGM persons demonstrate higher prevalence of mood and anxiety disorders, suicidal ideation and behavior, as well as problematic substance use (1019). Further, psychosocial health disparities observed among SGM populations exert a synergistic effect in the ways in which they compromise SGM well-being (20, 21). These health disparities are largely driven by minority stress processes (2224); sexual and gender minority-based stressors operate in direct and indirect ways to compromise well-being (25, 26). Stigma and discrimination against SGM individuals, especially for those with intersecting marginalized identities, have contributed to barriers in accessing healthcare, employment, and other socioeconomic resources. The global public health response to the COVID-19 pandemic might potentiate psychosocial threats to mental health among SGM individuals (8).

Social support promotes well-being. Conversely, social isolation compromises health (27). Perceived social support attenuates the impact of stressful life events on psychological distress (2831) and is negatively associated with depressive symptoms specifically (3235), as well as psychiatric distress more generally (6). Empirical evidence further documents the importance of social support for SGM individuals' mental health. Perceptions of support from family and friends are negatively associated with mental health (3639) outcomes. Social support not only directly impacts mental health, but also indirectly through engagement in effective behavioral coping mechanisms (40, 41).

However, SGM individuals experience greater social isolation and less social support than their cisgender heterosexual peers (42, 43). The importance of social support for SGM individuals' health is reflected in an explicit focus on facilitating supportive relationships in evidence-based treatment of SGM individuals' psychosocial health (4446). Emerging literature further highlights the importance of social support for navigating COVID-19-related distress. For example, in one study (3), adults in Egypt reported seeking increased support from friends and family members in response to the pandemic. Additionally, data from Italian adults in high- and low-contagion regions demonstrates the buffering effects of both in-person and virtual social support on psychiatric distress symptoms (47). Facing increased social exclusion and marginalization at a population level alongside worse group-based mental health outcomes, resultant from minority stress, when compared with cisgender heterosexual individuals, it is possible that social restrictions aimed at containing the spread of COVID-19 might disproportionately compromise the mental health of SGM individuals.

The goal of the current study was to compare the impact of (1) nationwide business closures and stay-at-home orders at the onset of the United States response to the COVID-19 pandemic, (2) perceptions of social isolation and time spent engaging in virtual socializing activities, and (3) the interrelatedness of these variables on ratings of mood, depressive symptoms, worry, and perceived stress between SGM and cisgender heterosexual individuals. As preregistered at https://osf.io/kg6bu, we hypothesized that SGM individuals will report increased symptoms of psychiatric distress at the start of the assessment period when compared with cisgender heterosexual individuals. Further, we predict that the disparity would become exacerbated over the course of the assessment period. We also hypothesize that perceptions of social isolation will be positively associated with, and reports of time spent socializing virtually will be negatively associated with, mental health outcomes across time, and that this relationship will be stronger for SGM individuals (i.e., social support will be more impactful for SGM persons than cisgender heterosexual individuals).

Methods

Participants

As part of a larger, ongoing study exploring the mental health repercussions of the COVID-19 pandemic and response measures, online recruitment for this report began on March 20, 2020. During the course of the recruitment period, N = 1,930 participants completed the online informed consent and were enrolled in the study. Of this initial recruitment, N = 1,462 completed the initial demographic survey, which was required before daily surveys began. Of this total sample, n = 1,171 reported cis-gender identity and heterosexual sexual orientation and n = 291 reported SGM status (19.9% of total sample). As the time course of the spread and response measures to COVID-19 differed by country, here we only included participants in our study from the United States (cisgender heterosexual n = 833; SGM n = 181) to minimize the variability in timelines. All English-speaking adults 18+ from anywhere in the world were eligible for the study, regardless of pre-existing mental health or medical conditions. Only study personnel were ineligible for participation. Recruitment relied primarily on contact with previous participants, dissemination through professional networks, social media, and word of mouth. The age of participants in this sample ranged from 18 to 90 years old (M = 36.7, SD = 16.0). See Table 1 for additional demographics. Compensation for participation was in the form of raffle entries for gift cards. The Boston College Institutional Review Board approved all consent and assessment procedures.

TABLE 1
www.frontiersin.org

Table 1. Demographics of SGM and non-SGM samples.

Assessment Materials

Demographic Survey

Immediately after consenting, participants were sent an initial demographic survey. Completion of this survey was required before receiving any further assessments. Participants self-reported natal sex, current gender identity, sexual orientation, race/ethnicity, age, socioeconomic status, marital status, military status, education level, number of dependents, and whether or not they had ever received a previous diagnosis of a serious mental health and medical condition. Congruent with the previous literature documenting higher psychiatric disorder prevalence among SGM compared with non-SGM populations, 51% of the SGM sample reported being previously diagnosed with a serious mental health condition compared with 26% of the non-SGM sample. However, there were high rates of missingness in the dichotomous previous mental health diagnosis variable. Fifty-two percentage of SGM and 49% of non-SGM persons did not provide information on previous mental health disorder diagnoses. The demographic survey questions used for all participants can be found here: https://bit.ly/BC-DEMOS.

Daily Survey

After completion of the Demographic Survey, participants were immediately enrolled to begin receiving daily assessment surveys. Two versions of our daily survey were utilized throughout the duration of the assessment period: a Short Version and a Full Version. The Short Version was created to reduce participant burden during the longitudinal study design. Relevant to this report, the Short Survey included questions of subjective experience of stress, time spent virtually socializing, and perception of being under quarantine. The question on subjective experience of stress was reported on a 7-point Likert scale, time spent virtually socializing, and perception of being under quarantine was a binary “yes/no” response. All questions within the Short Version of the survey were optional and participants were asked to respond to any that they were able to, given their time and energy on the day it was received.

The Full Version of the survey included all questions from the Short Version, as well as measures of mood using the Positive and Negative Affect Schedule (48), subjective experience of worry related to COVID-19, subjective perception of social isolation, and symptoms of depression using a modified version of the Patient Health Questionnaire-9 [PHQ-9; (49)] that omitted the question assessing suicidality. The questions on perception of social isolation and COVID-related worry questions (assessing domains of individual health, family/friend health, community health, national health, financial impact) were reported on 7-point Likert scales. To assess overall worry we created a Worry Composite by summing the responses to all worry questions. The PANAS metrics of positive and negative affect were scored as recommended. The eight remaining PHQ-9 questions were summed as a modified depression score (referred to as “depression” in the results). Most questions within the Full Version were required in order for the form to be submitted, but participation was always optional each day it was received.

Participants were instructed not to try to make up surveys on days that they missed. A view of the Full Version survey questions (that also contains all questions of the Short Version) can be found here: https://bit.ly/BC-FullVersion.

Study Design

Data collection procedures are discussed in detail in our pre-registration (https://osf.io/kg6bu). Briefly, enrollment in this study opened on March 20, 2020. After participants completed the online consent form, they received the Demographic Survey. After completion of the demographic survey, they were then enrolled to receive the Daily Surveys for the duration of the assessment period. Participants received either the Short or Full Version of the daily survey each day of the assessment period (until May 20) following their enrollment. To establish a baseline of mental wellbeing, participants received the Full Survey for the first three days following completion of the demographics. The Full Survey was then sent randomly 2 days/week, with the Short Survey sent the remaining 5 days/week. As such, the questions of subjective experience of stress, time spent virtually socializing, and perception of being under quarantine were administered every day of the assessment period, while collection of PANAS positive scale, PANAS negative scale, COVID-related worry questions, subjective social isolation, and the modified PHQ-9 scale occurred twice a week. Although this study is part of a larger study that includes additional planned follow-up assessments, the daily survey data collection ended on May 20, 2020 for all participants. See Figure 1 for a schematic of the study timeline.

FIGURE 1
www.frontiersin.org

Figure 1. Schematic of study timeline. Enrollment for study began on March 20, 2020. Daily surveys were collected from March 21, 2020 to May 20, 2020. For analyses, we separated the timeline into three separate time bins. Early Time bin (T1) = March 21st–April 3rd; Middle Time bin (T2) = April 14th–April 27th; Late Time bin = May 7th–May 20th.

Data Analysis

As described in our pre-registration (https://osf.io/kg6bu), to test our hypotheses, we averaged across all responses for each participant in each time bin (early: March 21st–April 3rd; middle; April 14th–April 27th; late: May 7th–May 20th) for each dependent variable. These time bins were used to create periods of equal duration that were equidistant apart throughout the daily assessment period. The averaged variables were analyzed with linear mixed models with a random intercept for the subject. Each dependent variable of interest was analyzed in a separate model with SGM status and time bin as categorical predictors (Model 1). Average responses to self-reported social isolation and time spent virtual socializing within each time bin were then calculated and added to the models to determine the impact of perceived social isolation (Model 2) and virtual socialization (Model 3) on the relationship between SGM status and time for each metric of mental well-being. For Model 4, responses to each dependent variable of interest were analyzed separately across days that participants reported being under quarantine and days that they were not (ignoring time bin), making quarantine and SGM status categorical predictors for the model. Further, time spent virtually socializing was added to the model to determine the differential impact of socializing virtually on our metrics of mental well-being for participants that reported being under quarantine and those that were not.

Because there was a notable difference in the distribution of age across the SGM and non-SGM groups, all models included age as a covariate. This is particularly important in light of previous analyses on this dataset that determined strong effects of age on most of the reported dependent variables (see https://osf.io/tb4qv). Main effects of age are reported here, but discussed elsewhere (Cunningham et al., in revision). Further, for all models using virtual socialization, the amount of time that participants spent virtually socializing was log (base 2) transformed before being entered into regression models. This reflects the expectation that this variable is more likely to have a logarithmic than linear relationship to mood outcomes—i.e., there will be a benefit of socializing and contact with people, but there will be diminishing returns to the benefit of this variable as the amount increases. This also reduces issues with skew and outliers. Log transformation reduced skew from 4.00 to −0.05 and kurtosis from 30.41 to −0.94. Analyses were conducted in R. Mixed models were conducted with the lme4 (50), lmerTest (51), and afex packages. Jamovi (jamovi.org) and the GAMLj module in jamovi were used to make figures. The data and code used for this analysis is publicly available on Open Science Framework (OSF): https://osf.io/ur27h/.

Results

Supplementary Table 1 shows correlations among all examined variables.

Model 1: Effects of SGM and Time

Coefficients and inferential statistics for the SGM × Time model are shown for all DVs in Table 2. These outcomes are also visualized in Figure 2. To briefly summarize, there was a main effect of Time on negative affect, depression, stress, and worry such that each of these metrics decreased over the course of the three assessment windows (all p's <0.016). There was also a main effect of SGM on depression (p < 0.001), but the SGM and non-SGM cohorts did not differ on reports of affect, stress, or worry. There were no significant interactions between SGM status and time across all three assessment windows. For subjective experience of stress, however, there was a trend toward an overall SGM × Time interaction (p = 0.089) which became significant when focusing on comparisons between the early and middle time bin (p = 0.028). While non-SGM participants showed a reduction in stress between the early and middle time bin, SGM participants showed no such stress reduction; SGM participants did, however, show a reduction in stress between the middle and late time bins, such that by the late time bin, there were no group differences in stress (p = 0.111).

TABLE 2
www.frontiersin.org

Table 2. Model 1 regression results.

FIGURE 2
www.frontiersin.org

Figure 2. Changes in mood and psychiatric indicators across time and groups (Model 1). Error bars show 95% confidence intervals. Depression was consistently elevated across all three time points for SGM compared to non-SGM. Stress, on the other hand, was differentially affected early on (p = 0.028), such that non-SGM reported decreased stress from early to mid, and SGM didn't report a reduction in stress until the late time point.

When examining the measures of social interaction and isolation as dependent variables to first understand how these variables changed across groups and time, a main effect of Time was observed for both variables (p's <0.001), with both variables generally decreasing over time. There were no effects of SGM status or SGM × Time interaction (Figure 3).

FIGURE 3
www.frontiersin.org

Figure 3. Changes in social engagement and reported feelings of isolation across time and groups (Models 2 and 3). Error bars show 95% confidence intervals. SGM and non-SGM reported similar patterns of progressively decreasing engagement in virtual socializing across the three time points, corresponding to reduced feelings of isolation specifically at the final time point.

Model 2: Effects of SGM, Time, and Social Isolation

Coefficients and inferential statistics for the SGM × Time × Social Isolation model are shown in Table 3 and visualized in Supplementary Figure 1. Across all participants, there was a main effect of social isolation such that greater perception of being socially isolated was associated with decreased PANAS positive scale scores and increased PANAS negative, depression, stress, and worry (all p < 0.001). There were no significant SGM × Isolation or three-way SGM × Time × Social Isolation interactions for any of the dependent variables of interest. There was a significant Time × Isolation interaction on negative affect and depression, such that the effect of social isolation on these variables was greater in the earlier time bins compared to the late time bin (May 7 - May 20).

TABLE 3
www.frontiersin.org

Table 3. Model 2 regression results.

Model 3: Effects of SGM, Time, and Virtual Socialization

Coefficients and inferential statistics for the SGM × Time × Virtual Socialization model are shown in Table 4. There was no main effect of virtual socialization on any metric nor any interactions with virtual socialization. This model did, however, reveal a main effect of Time on PANAS negative, stress, depression (all p < 0.001) and worry (p < 0.05), with the former two measures showing reductions in these negative mental health consequences between the early and the middle time bin, and with all of those measures showing reductions when comparing the early to the late time bin.

TABLE 4
www.frontiersin.org

Table 4. Model 3 regression results.

Model 4: Effects of SGM, Virtual Socialization, and Reported Quarantine

Coefficients and inferential statistics for the SGM × Virtual Socialization × Quarantine model are shown in Table 5. This model showed a main effect of SGM status on depression (greater depression in those with SGM status). Depression also showed a Quarantine × Virtual Socialization interaction, with Virtual Socialization having a greater reduction on depression in those who reported being quarantined (Figure 4). In this model, a significant effect of Virtual Socialization was revealed on PANAS positive, with increased socialization associated with greater positive affect. This effect may have been significant here but not in Model 3 either because time is removed as a factor in this model or because quarantine is added.

TABLE 5
www.frontiersin.org

Table 5. Model 4 regression results.

FIGURE 4
www.frontiersin.org

Figure 4. Effects of minutes spent socializing virtually and quarantine on positive affect and depression symptomology (Model 4). Minutes spent socializing virtually is log2 transformed (see text) and then mean centered (i.e., 0 represents the mean of the log transformed minutes across all observations). Shading around the lines show the 95% confidence interval.

While there were no main effects of SGM status for any worry variables, exploratory analyses revealed an SGM × Virtual Socialization interaction for financial worry, whereby those with SGM status who socialized more reported more financial worry (see Supplementary Table 2).

Multiple Comparisons Correction

The multiple models, predictors, and DVs employed in our analysis raise potential multiple comparisons concerns. The main pattern in our results was that there were few significant differences between SGM and cisgender heterosexual participants. That these differences remained non-significant across most DVs and modeling choices with no correction actually gives more confidence in the robustness of this finding (with a strict multiple comparisons correction, non-significant results would be more likely to be due to low power). In addition, the differences that were found, such as greater depression for SGM participants and effects of Time, were generally consistent across models.

Nevertheless, to bolster the interpretation of significant results, we applied the Benjamini and Hochberg (52) false discovery rate (FDR) correction across all F-tests in our four main models and five main dependent variables (PANAS positive, PANAS negative, PHQ-9, stress, and the worry scale). Exploratory analyses (e.g., of each separate worry question) were not included in this correction, nor was the effect of age, since this was included simply as a control variable that had already been tested in previous work (Cunningham et al., in revision). This resulted in 126 p-values being submitted to the correction algorithm.

The FDR-corrected alpha was ~0.009; in other words, any uncorrected p < 0.009 remained significant after FDR correction. As a result, 3 of the 25 effects that were significant in the uncorrected results became non-significant with FDR correction: the Time * Isolation interaction for PHQ-9 in Model 2, the Time effect for the worry scale in Model 1, and the Time effect for the worry scale in Model 3. Notably, all significant effects that included SGM status remained significant after correction.

Discussion

The goal of the current study was to investigate changes in mental health outcomes during the initial stages of the US response to the COVID-19 pandemic to determine the extent to which they differed as a function of SGM status. In addition, we sought to explore how perceptions of social isolation and virtual socialization were related to changes in mental health outcomes. Our results suggest few differences in how mental health outcomes changed over time for SGM and cisgender heterosexual persons. Consistent with our initial hypothesis, we found that SGM participants reported greater depression symptoms than cisgender heterosexual individuals across the entirety of the study. However, the rate of change of depression and other mental health outcomes did not differ by SGM status, which was inconsistent with our initial hypotheses. Additionally, though decreased social connectedness and increased time spent engaging in virtual socializing were associated with better mental health, there were no differences by SGM status, again contrary to our hypotheses. These results begin to shed light on potential ways in which the current global pandemic affect mental health among different populations, and must be appreciated with specific reference to the nature of these data. Given that empirical investigations of the mental health impact of COVID-19 are in their infancy, we focus on qualifying our findings, with important directions for future research aimed at holistically understanding mental health vulnerabilities related to the current global pandemic. We believe that these qualifications are particularly noteworthy since these data reflect a non-representative convenience sample of U.S. adults.

When compared with cisgender heterosexual participants, the SGM sample in this study reported significantly younger age. Previous research highlights the particular vulnerabilities faced by older SGM persons to loneliness and social isolation as they age (5356). Even greater limitations to social connections and increased isolation as a result of the COVID-19 pandemic might impact older SGM adults more so than those represented within our sample. Older SGM individuals are more likely to live alone and lack potential family support systems when compared with their cisgender heterosexual peers (57). Additionally, specific barriers to accessing social support may be potentiated among older SGM individuals (57). Therefore, while these results suggest that the detrimental impact of the pandemic response, and the buffering role that social connectedness and (virtual) activity play, differs little across SGM status, we must qualify this finding by highlighting that these results pertain to younger-to-middle-aged SGM adults.

The majority of our SGM sample reported bisexual orientation (~70%), female sex (85%), and cisgender identity (94%). However, despite a robust literature documenting worse health outcomes among bisexual individuals when compared with heterosexual and lesbian/gay individuals (5862), we found few differences based on SGM status. Nonetheless, bisexual identity is not the driver of mental health disparities per se. Instead, previous studies indicate that individuals who report bisexual identity experience greater levels of bi-negativity from both the heterosexual and lesbian/gay communities [e.g., (5862)]. Minority stress drives mental health disparities. Without measuring experiences/perceptions of bi-negative discrimination or stigma, we are unable to quantify the extent to which such a variable might be related to our findings. For instance, previous research suggests that for bisexual women, the gender of their romantic partner differentially relates to mental health outcomes (58). Approximately half of our SGM participants (55%) reported being involved in romantic relationships. Because we did not collect information on gender identity or sexual orientation of romantic partners, we were unable to explore the potential impact of these variables on our findings. Therefore, it is important to remember the majority bisexual, cisgender representation of our SGM sample when interpreting these results as they likely do not reflect the impact of the social support related to the COVID-19 pandemic across all SGM subgroups.

The majority of our sample reported cisgender identity, and so it is important to note that these findings may be better considered to represent differences between groups as a function of sexual orientation. We utilized an overarching SGM group to maintain fidelity with our preregistered analysis plan. Empirical evidence documents worse psychiatric outcomes for transgender and gender nonconforming individuals when compared with their cisgender counterparts (6365). It is imperative that future research with greater representation of non-cisgender participants be conducted. Finally, our sample was well educated (>80% with at least a college degree), employed (79%), and mostly non-Hispanic (93%) and white (81%). The epidemiology of psychopathology is stratified according to sexual orientation and race/ethnicity, wherein Hispanic and Black LGB persons experience unalike prevalence of psychiatric disorders when compared with their non-Hispanic white counterparts (19). Socioeconomic status is also inversely associated with mental health outcomes [e.g., (66)]. When considered together, these sample characteristics help us qualify to whom our findings apply. Bearing these qualifications in mind, our results demonstrate that (1) SGM individuals, even those who might belong to social groups with relatively greater psychosocial privilege, nonetheless report worse mental health symptoms when compared with cisgender heterosexual individuals; (2) across the initial phase of the U.S. pandemic response, participants—regardless of sexual orientation and gender identity—experienced decrements in their reported mental health; and (3) social connectedness and maintaining social activities, even in virtual formats, can help buffer against the negative mental health in the face repercussions of the global COVID-9 pandemic.

Limitations

There are some notable limitations to our study here. First, the data collected here is likely just a snapshot of the impact of the “first wave” of the COVID-19 pandemic in the United States. Even with the start of our data collection beginning in mid-March as cases in the US were initially on the rise and stay-at-home orders were being first introduced, as our measures largely showed improvement over time, it is likely that the uncertainty surrounding the spread of the disease and the severity of its health impact were already taking a substantial toll on mental health and well-being at the start of assessment [for further details see (Cunningham et al., in revision)]. As the pandemic continues to persist and have social and economic impacts, it is possible that the sustained impacts of COVID-19 may begin to again deteriorate mental well-being, and that the chronicity of these stressors may differentially impact different groups. Further, the lack of pre-COVID data limits our capacity to determine if the reported effects would have been the same regardless of the pandemic. We recognize that the current report approaches our question from a biomedical framework, focusing on psychological constructs abstracted from an individual's lived experience and societal factors that may have contributed to them. Our metrics likely do not capture the full extent of potential mental health disparities SGM individuals may be experiencing during this pandemic, nor do we intend to marginalize such experiences. Our use of a binary “yes/no” response to inquire about whether participants were under quarantine at the time of the assessment. Participants reported a number of different interpretations of this question (e.g., medically ordered quarantine vs. extreme social distancing). As such, this question best describes participants' perception of whether or not they were “under quarantine.” Further work should explore the differential impact of these different types of isolation and more specifically separate individuals that remained socially active and participants that were socially isolated, whether it was self-imposed or not.

Both sexual and gender minority populations evidence higher prevalence of various forms of psychosocial dysfunction when compared with cisgender heterosexual populations. Given the emerging nature of this literature specifically related to the potential impact of the COVID-19 pandemic on mental health, we felt it important to include gender minority persons within our analyses to avoid erasure of this marginalized population. It is noteworthy that due to the particularly minor representation of gender minority individuals within these data (n = 8 transgender participants) we were (1) unable to stratify our analyses by sexual vs. gender minority status and (2) advise caution in the extent to which these conclusions pertain specifically to gender minority persons. Though both sexual and gender minority individuals face psychiatric disparities of a similar nature, grounded in minority stress processes related to their marginalized identities, we reiterate our belief that future studies that better represent the diversity within SGM populations must be pursued to more accurately profile the ways in which the global pandemic might differentially impact already marginalized populations. While we have discussed how the idiosyncratic characteristics of this sample are likely to impact the generalizability of our results, it is important to highlight that these data represent a convenience sample that was limited to individuals that we could reasonably reach using online recruitment techniques. While this work begins to shed light on the potential impact of the COVID-19 pandemic, we want to underscore the importance of replication and expansion of these findings using more representative data.

Conclusion

The current global COVID-19 pandemic represents an unprecedented period of distress with substantial upheaval to individual's regular lives. Health responses designed to contain the spread of the disease might compromise mental well-being for individuals, with potentially disproportionate impact on marginalized populations who already experience increased psychiatric prevalence. The findings of the current study reveal the buffering effect of social support on preserving individuals' mental health. Although SGM individuals report greater symptoms of depression when compared with their cisgender heterosexual peers, the change of mental health outcomes over time was independent of SGM status. These findings begin to characterize the important mental health effect of the COVID-19 pandemic, and highlight the importance of increasing research aimed at understanding this effect among less homogeneous samples.

Data Availability Statement

The original contributions presented in the study are publicly available. This data can be found here: https://osf.io/ur27h/.

Ethics Statement

The studies involving human participants were reviewed and approved by Boston College Institutional Review Board. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

TC and EK conceived and designed the study. TC conducted data gathering. TC, EF, and EK devised the analysis plan and performed statistical analyses. CR-S, EF, RB, SK, MG, EK, JP, and TC drafted and revised the manuscript. All authors contributed to the article and approved the submitted version.

Funding

TC, RB, MG, and EF would like to thank their NIH T32 funding sources for supporting their work and ongoing training. TC, RB, and MG are currently funded by the Research Training Program in Sleep, Circadian and Respiratory Neurobiology (NIH T32 HL007901) through the Division of Sleep Medicine at Harvard Medical School and Brigham & Women's Hospital. EF is currently funded by NIH NRSA T32 NS007292 through Brandeis University. Additional funding for the project was provided by Boston College.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2020.590318/full#supplementary-material

References

1. World Health Organization. Mental Health and Psychosocial Considerations During the COVID-19 Outbreak. World Health Organization (2020).

Google Scholar

2. Zhang J, Lu H, Zeng H, Zhang S, Du Q, Jiang T, et al. The differential psychological distress of populations affected by the COVID-19 pandemic. Brain. (2020) 49–50. doi: 10.1016/j.bbi.2020.04.031

PubMed Abstract | CrossRef Full Text | Google Scholar

3. El-Zoghby SM, Soltan EM, Salama HM. Impact of the COVID-19 pandemic on mental health and social support among Adult Egyptians. J Comm Health. (2020) 45:689–95. doi: 10.1007/s10900-020-00853-5

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Mazza C, Ricci E, Biondi S, Colasanti M, Ferracuti S, Napoli C, et al. A Nationwide survey of psychological distress among Italian people during the COVID-19 pandemic: immediate psychological responses and associated factors. Int J Environ Res Public Health. (2020) 17:3165. doi: 10.3390/ijerph17093165

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Badgett ML, Choi SK, Wilson BD. LGBT Poverty in the United States. Los Angeles, CA: The Williams Institute and American Foundation for Suicide (2019).

Google Scholar

6. Choi SK, Wilson BD, Shelton J, Gates GJ. Serving Our Youth 2015: The Needs and Experiences of Lesbian, Gay, Bisexual, Transgender, and Questioning Youth Experiencing Homelessness. (2015). Available online at: https://escholarship.org/uc/item/1pd9886n (accessed September 22, 2020).

Google Scholar

7. Brown TNT, Romero AP, Gates GJ. Food Insecurity and SNAP Participation in the LGBT Community. (2016). Available online at: https://escholarship.org/uc/item/6f84z0m9 (accessed September 22, 2020).

Google Scholar

8. Salerno JP, Williams ND, Gattamorta KA. LGBTQ populations: Psychologically vulnerable communities in the COVID-19 pandemic. Psychol Trauma Theory Res Pract Policy. (2020) 12:S239–42. doi: 10.1037/tra0000837

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Human Rights Campaign Foundation. The Lives and Livelihoods of Many in the LGBTQ Community are at Risk Amidst COVID-19 Crisis (2020).

Google Scholar

10. Cochran SD, Ackerman D, Mays VM, Ross MW. Prevalence of non-medical drug use and dependence among homosexually active men and women in the US population. Addiction. (2004) 99:989–98. doi: 10.1111/j.1360-0443.2004.00759.x

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Cochran SD, Mays VM. Estimating prevalence of mental and substance-using disorders among lesbians and gay men from existing national health data. In: Omoto AM, Kurtzman HS, editors. Contemporary Perspectives on Lesbian, Gay, and Bisexual Psychology. Sexual Orientation and Mental Health: Examining Identity and Development in Lesbian, Gay, and Bisexual People. Washington, DC: American Psychological Association (2006). p. 143–65.

Google Scholar

12. Drabble L, Midanik LT, Trocki K. Reports of alcohol consumption and alcohol-related problems among homosexual, bisexual and heterosexual respondents: Results from the 2000 National Alcohol Survey. J Stud Alcohol. (2005) 66:111–20. doi: 10.15288/jsa.2005.66.111

CrossRef Full Text | Google Scholar

13. Eaton NR. Trans-diagnostic psychopathology factors and sexual minority mental health: evidence of disparities and associations with minority stressors. Psychol Sex Orient Gender Diver. (2014) 1:244–54. doi: 10.1037/sgd0000048

CrossRef Full Text | Google Scholar

14. Gonzales G, Przedworski J, Henning-Smith C. Comparison of health and health risk factors between lesbian, gay, and bisexual adults and heterosexual adults in the United States: results from the National Health Interview Survey. JAMA Int Med. (2016) 176:1344–51. doi: 10.1001/jamainternmed.2016.3432

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Green KE, Feinstein BA. Substance Use in Lesbian, Gay, and Bisexual Populations: an update on empirical research and implications for treatment. Psychol Addict Behav. (2012) 26:265–78. doi: 10.1037/a0025424

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Jun H-J, Webb-Morgan M, Felner JK, Wisdom JP, Haley SJ, Austin SB, et al. Sexual orientation and gender identity disparities in substance use disorders during young adulthood in a United States longitudinal cohort. Drug Alcohol Depend. (2019) 205:107619. doi: 10.1016/j.drugalcdep.2019.107619

PubMed Abstract | CrossRef Full Text | Google Scholar

17. King M, Semlyen J, Tai SS, Killaspy H, Osborn D, Popelyuk D, et al. A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry. (2008) 8:70. doi: 10.1186/1471-244X-8-70

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Krueger EA, Fish JN, Upchurch DM. Sexual orientation disparities in substance use: investigating social stress mechanisms in a national sample. Am J Prev Med. (2020) 58:59–68. doi: 10.1016/j.amepre.2019.08.034

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Rodriguez-Seijas C, Eaton NR, Pachankis JE. Prevalence of psychiatric disorders at the intersection of race and sexual orientation: results from the National Epidemiologic Survey of Alcohol and Related Conditions-III. J Consult Clin Psychol. (2019) 87:321–31. doi: 10.1037/ccp0000377

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Pachankis JE. A Transdiagnostic minority stress treatment approach for gay and bisexual men's syndemic health conditions. Arch Sex Behav. (2015) 44:1843–60. doi: 10.1007/s10508-015-0480-x

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Stall R, Mills TC, Williamson J, Hart T, Greenwood G, Paul J, et al. Association of co-occurring psychosocial health problems and increased vulnerability to HIV/AIDS among urban men who have sex with men. Am J Public Health. (2003) 93:939–42. doi: 10.2105/AJPH.93.6.939

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Brooks VR. Minority Stress and Lesbian Women. Free Press (1981).

PubMed Abstract | Google Scholar

23. Meyer IH. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychol Bull. (2003) 129:674–97. doi: 10.1037/0033-2909.129.5.674

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Rich AJ, Salway T, Scheim A, Poteat T. Sexual minority stress theory: remembering and honoring the work of Virginia Brooks. LGBT Health. (2020) 7:124–7. doi: 10.1089/lgbt.2019.0223

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Hatzenbuehler ML. How does sexual minority stigma “Get Under the Skin”? a psychological mediation framework. Psychol Bull. (2009) 135:707–30. doi: 10.1037/a0016441

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Hatzenbuehler ML, Phelan JC, Link BG. Stigma as a fundamental cause of population health inequalities. Am J Public Health. (2013) 103:813–21. doi: 10.2105/AJPH.2012.301069

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Leigh-Hunt N, Bagguley D, Bash K, Turner V, Turnbull S, Valtorta N, et al. An overview of systematic reviews on the public health consequences of social isolation and loneliness. Public Health. (2017) 152:157–71. doi: 10.1016/j.puhe.2017.07.035

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Barrera M. Distinctions between social support concepts, measures, and models. Am J Comm Psychol. (1986) 14:413–45. doi: 10.1007/BF00922627

CrossRef Full Text | Google Scholar

29. Cohen S, Wills TA. Stress, social support, and the buffering hypothesis. Psychol Bull. (1985) 98:310–57. doi: 10.1037/0033-2909.98.2.310

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Lakey B, Orehek E. Relational regulation theory: A new approach to explain the link between perceived social support and mental health. Psychol Rev. (2011) 118:482–95. doi: 10.1037/a0023477

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Szkody E, McKinney C. Appraisal and social support as moderators between stress and physical and psychological quality of life. Stress Health. (2020) 1–10. doi: 10.1002/smi.2957

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Dalgard OS, Bjørk S, Tambs K. Social support, negative life events and mental health. Br J Psychiatry. (1995) 166:29–34. doi: 10.1192/bjp.166.1.29

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Gariépy G, Honkaniemi H, Quesnel-Vallée A. Social support and protection from depression: Systematic review of current findings in Western countries. Br J Psychiatry. (2016) 209:284–93. doi: 10.1192/bjp.bp.115.169094

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Lakey B, Cronin A. Low social support and major depression: research, theory and methodological issues. In: Dobson K, Dozois D, editor. Risk Factors in Depression. Elsevier Academic Press (2008). p. 385–408.

Google Scholar

35. Santini ZI, Koyanagi A, Tyrovolas S, Mason C, Haro JM. The association between social relationships and depression: a systematic review. J Affect Disord. (2015) 175:53–65. doi: 10.1016/j.jad.2014.12.049

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Hall WJ. Psychosocial risk and protective factors for depression among lesbian, gay, bisexual, and queer youth: a systematic review. J Homosex. (2018) 65:263–316. doi: 10.1080/00918369.2017.1317467

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Moe JL. Wellness and distress in LGBTQ populations: A meta-analysis. J LGBT Issues Counsel. (2016) 10:112–29. doi: 10.1080/15538605.2016.1163520

CrossRef Full Text | Google Scholar

38. Puckett JA, Matsuno E, Dyar C, Mustanski B, Newcomb ME. Mental health and resilience in transgender individuals: What type of support makes a difference? J Fam Psychol. (2019) 33:954–64. doi: 10.1037/fam0000561

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Sheets RL Jr, Mohr JJ. Perceived social support from friends and family and psychosocial functioning in bisexual young adult college students. J Counsel Psychol. (2009) 56:152–63. doi: 10.1037/0022-0167.56.1.152

CrossRef Full Text | Google Scholar

40. Budge SL, Adelson JL, Howard KAS. Anxiety and depression in transgender individuals: the roles of transition status, loss, social support, and coping. J Consult Clin Psychol. (2013) 81:545–57. doi: 10.1037/a0031774

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Budge SL, Rossman HK, Howard KAS. Coping and psychological distress among genderqueer individuals: the moderating effect of social support. J LGBT Issues Counsel. (2014) 8:95–117. doi: 10.1080/15538605.2014.853641

CrossRef Full Text | Google Scholar

42. Plöderl M, Fartacek R. Suicidality and associated risk factors among lesbian, gay, and bisexual compared to heterosexual Austrian adults. Suicide Life Threat Behav. (2005) 35:661–70. doi: 10.1521/suli.2005.35.6.661

CrossRef Full Text | Google Scholar

43. Safren SA, Heimberg RG. Depression, hopelessness, suicidality, and related factors in sexual minority and heterosexual adolescents. J Consult Clin Psychol. (1999) 67:859–66. doi: 10.1037/0022-006X.67.6.859

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Burton CL, Wang K, Pachankis JE. Psychotherapy for the spectrum of sexual minority stress: application and technique of the ESTEEM treatment model. Cogn Behav Pract. (2019) 26:285–99. doi: 10.1016/j.cbpra.2017.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Pachankis JE. Uncovering clinical principles and techniques to address minority stress, mental health, and related health risks among gay and bisexual men. Clin Psychol. (2014) 21:313–30. doi: 10.1111/cpsp.12078

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Rodriguez-Seijas C, Burton CL, Pachankis JE. Transdiagnostic approaches to improve sexual minority individuals' co-occurring mental, behavioral, and sexual health. In: Pachankis J, Safren S, editros. Handbook of Evidence-Based Mental Health Practice with Sexual and Gender Minorities. Oxford University Press (2019).

Google Scholar

47. Pancani L, Marinucci M, Aureli N, Riva P. Forced social isolation and mental health: a study on 1006 Italians under COVID-19 lockdown. PsyArXiv [Preprint]. (2020). doi: 10.31234/osf.io/uacfj

CrossRef Full Text | Google Scholar

48. Watson D, Clark LA. The PANAS-X: Manual for the Positive and Negative Affect Schedule - Expanded Form. Iowa: University of Iowa (1994).

PubMed Abstract | Google Scholar

49. Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann. (2002) 32:509–15. doi: 10.3928/0048-5713-20020901-06

CrossRef Full Text | Google Scholar

50. Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. J Statist Softw. (2015) 67:1–48. doi: 10.18637/jss.v067.i01

CrossRef Full Text | Google Scholar

51. Kuznetsova A, Brockhoff PB, Christensen RHB. lmerTest package: tests in linear mixed effects models. J Statist Softw. (2017) 82:1–26. doi: 10.18637/jss.v082.i13

CrossRef Full Text | Google Scholar

52. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol. (1995) 57:289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x

CrossRef Full Text | Google Scholar

53. Fredriksen-Goldsen KI, Kim H-J, Emlet CA, Muraco A, Erosheva EA, Hoy-Ellis CP, et al. The Aging and Health Report: Disparities and Resilience Among Lesbian, Gay, Bisexual, and Transgender Older Adults: (561402013-001). Seattle, WA: American Psychological Association (2011).

PubMed Abstract | Google Scholar

54. Fredriksen-Goldsen KI, Kim H-J, Bryan AEB, Shiu C, Emlet CA. The cascading effects of marginalization and pathways of resilience in attaining good health among LGBT older adults. Gerontologist. (2017) 57(Suppl. 1):S72–83. doi: 10.1093/geront/gnw170

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Goldsen KF. Shifting social context in the lives of LGBTQ older adults. Public Policy Aging Rep. (2018) 28:24–8. doi: 10.1093/ppar/pry003

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Pinquart M, Sörensen S. Influences of socioeconomic status, social network, and competence on subjective well-being in later life: a meta-analysis. Psychol Aging. (2000) 15:187–224. doi: 10.1037/0882-7974.15.2.187

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Espinoza R. The diverse elders coalition and LGBT aging: connecting communities, issues, and resources in a historic moment. Public Policy Aging Rep. (2011) 21:8–12. doi: 10.1093/ppar/21.3.8

CrossRef Full Text | Google Scholar

58. Dyar C, Feinstein BA, London B. Dimensions of sexual identity and minority stress among bisexual women: The role of partner gender. Psychol Sex Orient Gender Diver. (2014) 1:441–51. doi: 10.1037/sgd0000063

CrossRef Full Text | Google Scholar

59. Dyar C, Taggart TC, Rodriguez-Seijas C, Thompson RG, Elliott JC, Hasin DS, et al. Physical health disparities across dimensions of sexual orientation, race/ethnicity, and sex: evidence for increased risk among bisexual adults. Arch Sex Behav. (2019) 48:225–42. doi: 10.1007/s10508-018-1169-8

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Feinstein BA, Dyar C, Li DH, Whitton SW, Newcomb ME, Mustanski B. The longitudinal associations between outness and health outcomes among gay/lesbian vs. bisexual emerging adults. Arch Sex Behav. (2019) 48:1111–26. doi: 10.1007/s10508-018-1221-8

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Feinstein BA, Dyar C. Bisexuality, minority stress, and health. Curr Sex Health Rep. (2017) 9:42–9. doi: 10.1007/s11930-017-0096-3

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Taggart TC, Rodriguez-Seijas C, Dyar C, Elliott JC, Thompson RG, Hasin DS, et al. Sexual orientation and sex-related substance use: the unexplored role of bisexuality. Behav Res Ther. (2019) 115:55–63. doi: 10.1016/j.brat.2018.12.012

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Clements-Nolle K, Marx R, Guzman R, Katz M. HIV prevalence, risk behaviors, health care use, and mental health status of transgender persons: implications for public health intervention. Am J Public Health. (2001) 91:915. doi: 10.2105/AJPH.91.6.915

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Coulter RW, Blosnich JR, Bukowski LA, Herrick A, Siconolfi DE, Stall RD. Differences in alcohol use and alcohol-related problems between transgender-and nontransgender-identified young adults. Drug Alcohol Depend. (2015) 154:251–9. doi: 10.1016/j.drugalcdep.2015.07.006

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Reisner SL, White JM, Bradford JB, Mimiaga MJ. Transgender health disparities: comparing full cohort and nested matched-pair study designs in a community health center. LGBT Health.. (2014) 1:177–84. doi: 10.1089/lgbt.2014.0009

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Sareen J, Afifi TO, McMillan KA, Asmundson GJG. Relationship between household income and mental disorders: findings from a population-based longitudinal study. Arch Gen Psychiatry. (2011) 68:419–27. doi: 10.1001/archgenpsychiatry.2011.15

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: COVID-19, gender, sexual orientation, well-being, depression, social isolation, mood

Citation: Rodriguez-Seijas C, Fields EC, Bottary R, Kark SM, Goldstein MR, Kensinger EA, Payne JD and Cunningham TJ (2020) Comparing the Impact of COVID-19-Related Social Distancing on Mood and Psychiatric Indicators in Sexual and Gender Minority (SGM) and Non-SGM Individuals. Front. Psychiatry 11:590318. doi: 10.3389/fpsyt.2020.590318

Received: 01 August 2020; Accepted: 19 November 2020;
Published: 22 December 2020.

Edited by:

Andreas Maercker, University of Zurich, Switzerland

Reviewed by:

Sebastian Euler, University Hospital Zürich, Switzerland
Andres Ricardo Schneeberger, Albert Einstein College of Medicine, United States

Copyright © 2020 Rodriguez-Seijas, Fields, Bottary, Kark, Goldstein, Kensinger, Payne and Cunningham. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tony J. Cunningham, acunnin4@bidmc.harvard.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.