Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

To vax or not to vax: Predictors of anti-vax attitudes and COVID-19 vaccine hesitancy prior to widespread vaccine availability

  • Hannah A. Roberts ,

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing

    hannah.roberts0005@temple.edu (HAR); brianhic@med.umich.edu (BMH)

    Affiliation Department of Psychology and Neuroscience, Temple University, Philadelphia, PA, United States of America

  • D. Angus Clark,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States of America

  • Claire Kalina,

    Roles Conceptualization, Data curation, Investigation

    Affiliation Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States of America

  • Carter Sherman,

    Roles Conceptualization, Data curation, Investigation, Project administration, Supervision

    Affiliation Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States of America

  • Sarah Brislin,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Psychology, Virginia Commonwealth University, Richmond, VA, United States of America

  • Mary M. Heitzeg,

    Roles Funding acquisition, Writing – review & editing

    Affiliation Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States of America

  • Brian M. Hicks

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

    hannah.roberts0005@temple.edu (HAR); brianhic@med.umich.edu (BMH)

    Affiliation Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States of America

Abstract

The novel coronavirus (COVID-19) is a highly contagious disease responsible for millions of deaths worldwide. Effective vaccines against COVID-19 are now available, however, an extreme form of vaccine hesitancy known as anti-vax attitudes challenge vaccine acceptance and distribution efforts. To understand these anti-vax attitudes and their associated psychological characteristics, we examined several predictors of vaccine hesitancy for COVID-19 and anti-vax attitudes generally. We surveyed 1004 adults (M = 47.0 years, SD = 17.1 years, range 18–98 years) in September-October 2020 across the United States (51% female, 49% male; 76.5% White, 23.5% non-White), prior to widespread availability of the COVID-19 vaccines. Attitudes toward vaccinations were influenced by a variety of factors, especially political attitudes. We should therefore anticipate and attempt to mitigate these challenges to achieving widespread vaccination to reduce the spread of COVID-19 and other communicable diseases.

Introduction

The Centers for Disease Control (CDC) reports that vaccination is the single most effective tool in preventing infectious disease [1]. The societal benefits of vaccination are achieved via herd immunity, a process whereby transmission of an infectious disease is unlikely if enough members of the population achieve immunity from the disease. As such, vaccines play a critical role in suppressing the spread of contagious diseases and ending epidemics/pandemics.

In March 2020, the novel coronavirus (COVID-19) was declared a pandemic and has since infected over 393 million people worldwide and claimed more than 5.7 million lives, with the U.S. accounting for almost 15% of these deaths [2, 3]. Besides posing an incredible health concern to the American population, the financial effects of COVID-19 burden the U.S. economy. For example, 7.7 million Americans were facing unemployment due to the COVID-19 pandemic in June 2020. Consequently, those individuals and their dependents lost health insurance coverage, resulting in a total of 14.6 million newly uninsured Americans and led to a large subset of the US population unable to pay rent and purchase necessities [4, 5].

As of February 2022, 64% of Americans were fully vaccinated against COVID-19 [3]. However, a major roadblock in administering widespread COVID-19 vaccines to the American public is hesitancy towards the COVID-19 vaccine, as well as skepticism to vaccination in general called anti-vax attitudes. The World Health Organization (WHO) has identified anti-vax attitudes as a major threat to global health [6, 7]. Anti-vax attitudes can be considered part of a cultural debate, rather than a scientific one, making them particularly resistant to scientific and medical consensus [8]. People with anti-vax beliefs have the devasting potential to increase the spread of infectious disease despite the availability of effective vaccines, and thus it is important to understand the demographic, psychological, and social correlates of this group to improve targeted public health interventions.

The far left and right converge to fight vaccination

Vaccine hesitancy has existed since the introduction of vaccines. In 1796, Edward Jenner developed the first vaccine against a communicable illness (smallpox) effectively preventing infection and the spread of the disease [9]. Shortly after, several organizations including the Anti-Vaccination League protested the dissemination of the vaccine due to safety concerns, and encouraged homeopathic solutions instead [10]. This discourse continued modestly throughout the early 20th century but was reignited in the U.S. as part of the 1970’s “hippie” counter-culture. In 1998, a since retracted publication in a well-respected medical journal suggested a link between the mumps, measles, and rubella (MMR) vaccine and autism [1113]. As a result of this publication and the discourse surrounding it, anti-vax beliefs gained considerable traction within liberal, “neo-hippie” communities, which were often found in affluent and mostly White enclaves. These communities endorsed the idea that a natural and organic lifestyle would provide a sufficient immune response to combat infectious diseases, even more so than vaccines [14].

While the anti-vax movement gained ground on the political left in 1998, a sizable far-right political group more recently joined the anti-vax movement, citing mistrust of the government and “Big Pharma” (i.e., the American medical and pharmaceutical establishment) as their main reasons for vaccine avoidance [15]. Prior to the COVID-19 pandemic, former Republican President Donald Trump aligned himself with the right-wing of the anti-vax movement, which created a mixed political message when the focus of his administration’s pandemic response to COVID-19 was to accelerate vaccine development [16]. Trump also consistently attempted to play down the severity of the health risks associated with COVID-19 via statements that were often partisan in nature. Consequently, it is likely that former President Trump’s messages contributed to the beliefs among conservative Americans that the COVID-19 pandemic is not a serious health concern and vaccination is not an important and effective strategy for preventing the infection and spread of the disease [17, 18]. This can be illustrated by a survey conducted in June 2020 which found that people who intended to vote for Trump in the 2020 presidential election were less willing to receive a COVID-19 vaccine when it became available [19]. Thus, while far-left and far-right groups cite different reasons for vaccine refusal, their behaviors manifest in the same way (i.e., vaccine refusal), contributing to a major global health concern.

Correlates of anti-vax attitudes: Demographics, psychological characteristics, political attitudes, and COVID-19 experiences

Our goal was to conduct an examination of the correlates of anti-vax attitudes in general and COVID-19 vaccination hesitancy specifically. Besides socio-political attitudes, it is important to understand how demographic characteristics are associated with vaccination hesitancy. Recent studies of COVID-19 vaccine hesitancy in the UK and the U.S. found that Black and other non-White members of the population were less willing to receive a COVID-19 vaccine [19, 20]. This trend has been observed with other communicable illnesses, including MMR and the annual flu vaccine [20, 21]. Similarly, in most U.S. states, Black and Hispanic Americans are receiving COVID-19 vaccinations at lower rates than White American [22]. These trends, in part, may be explained by a history of racial barriers and injustices in the American medical establishment. For example, people of color report more frequent negative experiences with healthcare providers and lower rates of health insurance coverage than White Americans [23].

Low levels of educational attainment have been generally associated with greater vaccine hesitancy [24]. Research on hesitancy in yearly flu vaccine uptake indicates that motivations for hesitancy differ across the education spectrum, with more educated people having greater skepticism of the scientific mechanisms of the medicine and its efficacy and safety, while less educated people may decline vaccination due to lack of information [24]. The associations between vaccine hesitancy and income are less clear [25]. Studies examining the role of income in willingness to receive the COVID-19 vaccine have found associations between lower income and COVID-19 hesitancy as well as null effects [19, 20]. Makarovs and Achterberg (2017) suggest that income may be best understood in the context of overall socioeconomic status, which combines both income and education, making a test of the relative predictive power of income on vaccine hesitancy novel [24].

In research exploring COVID-19 vaccine uptake, women reported greater vaccine hesitancy than men [19, 20]. Women often bear most of the responsibility for family health care, and so it may be that women are generally more aware of and concerned about negative side effects of vaccinations [19]. There are mixed results for age on COVID-19 vaccine hesitancy, with studies showing both greater hesitancy in young people and no effect of age [20, 26]. Historically, there has been limited research on the association between sex, age, and vaccine hesitancy.

The role of broad psychological characteristics such as personality, mental health, and substance use have been understudied as a correlates of anti-vax attitudes. However, they play an important role in health behaviors and may therefore contribute to anti-vax attitudes and hesitancy. For example, personality traits such as low conscientiousness and neuroticism as well as depression, smoking, and heavy alcohol use are all associated with poorer physical health and health-related behaviors in general, and so may contribute to anti-vax attitudes or slow vaccine uptake [2731].

Liberal and conservative social and political attitudes are likely to have strong associations with anti-vax attitudes. Given that Donald Trump was the standing president during when the COVID-19 pandemic began, we examined Trump job approval as it related to COVID-19 vaccine hesitancy and anti-vax attitudes generally. Additionally, the COVID-19 pandemic has been characterized by substantial misinformation or “fake news” regarding origin of the virus, contents of the COVID-19 vaccine, etc., which has been propagated through social media, now the main source of news among a large proportion of Americans [32, 33]. Anti-vax groups of both the left and right variety also utilize social media to amplify their message and recruit new members. Consequently, we tested whether social media use—especially problematic use associated with negative consequences and an inability to control use—made an additional contribution to anti-vax attitudes and COVID-19 vaccine hesitancy over and above other psychological characteristics and behaviors.

Finally, it is likely that people’s individual experiences during the COVID-19 pandemic will relate to their attitudes about vaccination over and above more general characteristics like demographics, personality, mental health, and political attitudes. Therefore, we included several measures related to COVID-19 experiences, emotions, and behaviors including COVID-19 related worry and stress and negative impacts associated with the pandemic such as illness to self or relatives and friends, financial stress, restriction of activities, etc. We also included people’s adherence to recommendations for safety behaviors and mitigation strategies (e.g., mask-wearing and social distancing) and their attitudes about government mandates and restrictions.

Current study

We examined the role of political attitudes, personality, mental health, and substance use on anti-vax attitudes and vaccine hesitancy. In consideration of the current political landscape, we measured alignment with former President Trump’s ideology regarding COVID-19 vaccine hesitancy and broad anti-vax attitudes. Also, as social media has been an important way through which false information regarding COVID-19 has been propagated, we examined the impact of social media use on both COVID-19 vaccine hesitancy and broad anti-vax attitudes. Finally, we explored the impact of several proximal social and environmental factors related to the COVID-19 pandemic itself; negative impacts associated with the pandemic, COVID-19 related worry and stress, adherence to recommendations for safety behaviors and mitigation strategies, and attitudes about government mandates and restrictions.

We hypothesized that more conservative and less liberal sociopolitical attitudes, greater approval of Trump, less conscientiousness and more neuroticism, greater depressive symptoms, greater substance use, and social media use and problematic use would be associated with greater anti-vax attitudes and COVID-19 vaccine hesitancy. We also predicted that people who had experienced more COVID-19 related stress/worry, more negative impacts, and were more adherent to mitigation strategies and had higher approval of government restrictions would endorse less anti-vax attitudes in general and less COVID-19 vaccine hesitancy.

Methods

Sample ascertainment

Data were collected from September 24 through October 25, 2020, using an actively managed, double-opt-in research panel using Qualtrics XM survey software. Recruitment was designed to ascertain a sample consistent with major demographic characteristics of the United States general population for age (12.8% 18–24; 17.7% 25–34; 16.7% 35–44; 17.7% 45–54; 16.4% 55–64; 18.8% +65), gender (51% female; 49% male), and race/ethnicity (61.9% non-Hispanic White; 12.3% non-Hispanic Black; 17.4% Hispanic; 5.3% Asian; 3.2% Other). Quotas were created for each variable and monitored while the survey was in the field. Respondents were recruited using a dashboard-style web page on the Qualtrics website and cellphone app where participants see a list of surveys that they have the option to participate in. Recruitment was also conducted through emails sent to established panel members within the Qualtrics database. In all recruitment methods, potential participants received information on the estimated length of the survey and compensation for completing it. Specific details about the survey content were not available until the participants opted-in to avoid self-selection bias. Upon opting into the study, participants read and provided an electronic signature on a consent form containing an overview of the survey contents. Participation was voluntary and anonymous as no individually identifying information was collected. Upon completion, participants were awarded credits by Qualtrics which they could cash out or use to purchase gift cards. Contact information for the research team was provided in case participants had questions about the survey. The University of Michigan Medical School Institutional Review Board (IRB) reviewed all study protocols.

The survey was completed by 1024 respondents. Data were manually checked, and 20 respondents were excluded due to inconsistent and illogical responses, resulting in a final sample size of 1004 respondents (487 men, 512 women, and 5 that reported non-binary gender). Examples of excluded responses include those who failed item-level quality control checks and those who consistently (>75%) chose only one response option, e.g., all “2”s. Single measures were excluded on a case-by-case basis if all other responses from that participant were within a plausible range of values. The final sample included responses from participants aged 18 to 98 years old (M = 46.5 years, SD = 17.1). The median response time for completing the survey was 28.1 minutes.

Demographics

The demographic characteristics of the sample are reported in Table 1, which were similar to those reported in the 2019 American Community Survey (ACS) 1-year estimates conducted by the US Census Bureau, though some differences occurred in education due to a lack of quota for this variable. The gender split for our sample was 51.1% female, 48.9% male (51.3% female, 48.7% male in US population ages 18 years and older). The age distribution for the survey sample was similar to the US general population with the proportion of the sample in 10-year age bands differing by 0% to 1.1% to that of the ACS. Mean educational level was higher than the US general population due to lower rates of people with a high school diploma or less (17.3% sample versus 39.1% US population ages 18 years and older) and higher rates of people with a bachelor (34.7% sample versus 19.3% US population) and graduate degree (22.3% sample versus 11.3% US population). Mean household income was also higher than the US general population with lower incomes (< $50,000) underrepresented (34.2% sample vs 38.4% US households) while middle incomes ($50,000 to $100,000; 33.2% sample vs 30.2% US households) and higher incomes (> $100,000; 32.6% sample vs 31.4% US households) were somewhat overrepresented. Hispanic ethnicity (17.7% sample vs 16.8% US population 18 years and over) and racial representation were similar to the US census (White 76.2% sample, 74.6% US population; Black or African American 14.3% sample vs 13.0% US population; Asian 6.0% sample vs 4.9% US population). Other races represented in the sample but not included here are American Indian, Alaska Native, Native Hawaiian and Pacific Islander. In terms of political party affiliation, persons affiliated with the Democratic party were overrepresented (39.0% vs 33.0%), persons affiliated with the Republican party were slightly underrepresented (26.5% vs 29.0%) and persons identified as independent or not registered with a political party were also slightly underrepresented (31.5% vs 34.0%) relative to the general electorate [34]. Three percent of the sample identified with another political party (Libertarian, Green, Constitution, Independent, or other).

Measures

Outcome variables.

Anti-vax scale. Participants responded to six questions assessing general support for vaccinations (strongly disagree = 1, disagree = 2, somewhat disagree = 3, somewhat agree = 4, agree = 5, strongly agree = 6; M = 17.11) [35]. Item content and psychometric properties are reported in Table 2. The six items exhibited good to excellent discrimination parameters in graded item response models. The mean discrimination parameter was a = 2.52 (range .94 to 6.29) and the mean standardized factor loading was λ = .72 (range .48 to .97). The marginal reliability for the scale was .86 and internal consistency (Cronbach’s α) was .79. Graded response models were estimated using flexMIRT version 3.6 with full information maximum likelihood estimation [36].

thumbnail
Table 2. Anti-vax scale items and psychometric properties.

https://doi.org/10.1371/journal.pone.0264019.t002

COVID-19 vaccine hesitancy. We assessed openness to receiving a vaccination for the COVID-19 virus with the single item “How likely are you to get a COVID-19 vaccine that has gone through the normal protocol for development (e.g., clinical trials, tests for safety and efficacy)?” (very unlikely, unlikely, likely, very likely). A COVID-19 vaccination had not yet been released in any country at the time of assessment.

Predictor variables.

Demographics. Demographic characteristics used in the prediction models included age, sex assigned at birth (male, female), race (White, non-White), annual household income, and educational attainment.

Personality. The Big Five Inventory-2 short form (30-items) was used to assess extraversion (sociability, assertiveness, energy level; α = .71), agreeableness (compassion, respectfulness, trust; α = .76), conscientiousness (organization, productiveness, responsibility, α = .78), negative emotionality (anxiety, depression, emotional volatility, α = .85), and open-mindedness (aesthetic sensitivity, intellectual curiosity, creative imagination, α = .68) [37].

Mental health. We used the general Depression scale (20-items; α = .93) from the Inventory of Depression and Anxiety Symptoms to provide a measure of overall depressive symptoms and dysphoria [38].

Binge drinking. We assessed alcohol use by asking participants to report how often they had engaged in binge drinking (i.e., five or more drinks on one occasion) in the past 30 days (Never, once a month, 2–3 times per month, once or twice per week, 3–4 times per week, nearly every day, twice per day, three or more times per day).

Nicotine use. Participants reported frequency of smoking cigarettes, using smokeless tobacco, or e-cigarettes (Never, once or twice, occasionally but not regularly, regularly in the past, regularly now). Response options “regularly in the past” and “regularly now” were coded the same for the analyses. The highest frequency reported among the three nicotine questions was used for the nicotine use variable.

Social media use. Participants indicated their use of a list of social media platforms. If they indicated the use of any social media platform, they were coded as a “1” on a binary social media use variable. If they indicated a response of “None”, they were coded as a “0”.

Problematic social media use. A 9-item scale (α = .88) was used to assess problematic social media use. Items were modeled on facets of behavioral addiction including overuse, functional impairment, using social media to reduce negative emotions, and attempts to cut down on use without success (e.g., “Spent a lot of time thinking about social media.”, “Used social media so much that it has had a negative impact on your job/studies.”).

Liberal and conservative social attitudes. We used the Right-Wing Authoritarianism (RWA; 22-items) scale to provide a measure of liberal and conservative political and social attitudes [39]. Ten items were worded in the direction of endorsement of more liberal attitudes (α = .88; e.g., “Everyone should have their own lifestyle, religious beliefs, and sexual preferences, even if it makes them different from everyone else.”) and 12 items were worded in the direction of more conservative and authoritarian attitudes (α = .92; e.g., “The only way our country can get through the crisis ahead is to get back to our traditional values, put some tough leaders in power, and silence the troublemakers spreading bad ideas.”). The liberalism and conservatism scales had a significant negative correlation (r = -.54), but still had sufficient unique variance to provide incremental predictive power relative to a single scale.

Approval of President Trump. We asked respondents to report their approval of President Trump’s job performance in general (strongly approve, approve, somewhat approve, somewhat disapprove, disapprove, strongly disapprove).

COVID-19 related safety behaviors and attitudes about government mandates and restrictions. For safety behaviors, participants were asked how often they followed the “social distancing” or “shelter-in-place” restrictions put in place in your community in the past 3 months, and how often they wear a mask when in public (never, seldom, sometimes, often, always). Participants were also asked three questions to assess attitudes about government responses to COVID-19 including the necessity of COVID-19 related restrictions (very necessary, necessary, somewhat necessary, neither necessary or unnecessary, somewhat unnecessary, unnecessary, very unnecessary), approval of their state government’s social distancing restrictions (strongly approve, approve, somewhat approve, somewhat disapprove, disapprove, strongly disapprove), and attitudes about the pace at which their community was lifting social distancing restrictions (much too soon, somewhat too soon, about right, somewhat too late, much too late). A composite variable of COVID-19 related safety behaviors and attitudes about government restrictions was calculated by taking the mean of the five items (α = .81).

COVID-19 stress/worry. Seven items from the COVID-19 Adolescent Symptom and Psychological Experience Questionnaire were used to assess COVID-19 related negative emotions during the past 30 days [40]. Participants reported their level of general stress and worry related to the COVID-19 pandemic, how stressful they have found the related restrictions on leaving home, disruptions to future plans, and uncertainty of the future related to the COVID-19 pandemic. Participants also reported their level of worry about becoming infected with COVID-19, their physical and mental health being impacted by COVID-19, and friends or family being infected with COVID-19 (α = .92).

Negative impacts of the COVID-19 pandemic. We assessed the number of negative impacts incurred due to the COVID-19 pandemic by providing participants with a multiple-response list of negative events including: Self/loved one has the virus; having to stay home; not seeing friends in person; many people are dying because of the virus; not going to school/work; self/child participating in virtual education; spending more time with family; financial difficulties; concern about the health of self/loved ones; concern about the government; missing important events; and a free-response option. A composite variable of negative impacts was calculated by taking the sum of all responses (0 = was not selected as a negative event, 1 = selected as a negative event).

Data analytic strategy

Separate multiple regression models were fit to examine the extent to which predictor variables were associated with the anti-vax beliefs and hesitancy to receive a COVID-19 vaccine. Fig 1 illustrates the organization of the predictors into conceptually related blocks. Blocks were ordered in increasing conceptual proximity to the individual outcome (from right to left in Fig 1). Vaccine outcomes were first regressed on a block of demographic predictors that included: age, sex assigned at birth, White versus non-White race, income, and education. The second block of predictors included person-level psychological variables and behaviors including personality traits, depression, alcohol and nicotine use, social media use (Yes/No), and problematic social media use. The third block of predictors included social and political attitudes including conservative and liberal attitudes in general and the job approval of then President Donald Trump specifically. The fourth block captured behaviors and attitudes specific to the COVID-19 pandemic, including stress/worry about COVID-19, negative impacts incurred as a result of the COVID-19 pandemic, and frequency of following safety behaviors and attitudes about government restriction to mitigate the spread of COVID-19. Anti-vax beliefs were also included as a predictor of hesitancy to receive a COVID-19 vaccine after this fourth block.

thumbnail
Fig 1. All predictors from COVID-19 vaccine hesitancy models.

https://doi.org/10.1371/journal.pone.0264019.g001

All models were fit in Mplus version 8.5 using full information maximum likelihood estimation [41]. Confidence intervals were derived via nonparametric percentile bootstrapping (10,000 draws), which provides reliable assessments of parameter estimate precision across a variety of data conditions [42].

Results

See https://osf.io/cqa6m/?view_only=659f436af1ce4049b2e1d01d8b540343 for full data set. Table 2 provides the endorsement rates for each anti-vax option. Based on these endorsement rates, about 40% of the sample strongly disagreed with anti-vax attitudes and about 60% of the sample either disagreed or strongly disagreed with anti-vax attitudes. About 4%-7% of the sample strongly agreed with anti-vax attitudes and about 10%-15% either agreed or strongly agreed with anti-vax attitudes. Table 3 provides the correlations between the six individual items that comprise the anti-vax scale. Table 4 provides the correlations among all predictors in both models.

For hesitancy to receive a COVID-19 vaccine, the endorsement rates for the response options to the question, “How likely are you to get a COVID-19 vaccine?”, were: 38.3% Very likely, 30.8% Somewhat likely, 17.0% Somewhat unlikely, and 13.8% Very unlikely. Scores on the anti-vax scale and responses to the COVID-19 vaccine hesitancy item were correlated at r = .48, p < .001, indicating people with more anti-vax beliefs were also likely to report greater COVID-19 vaccine hesitancy.

Descriptive information for the vaccine outcomes across different demographic groups is presented in Table 5, along with Cohen’s ds for the mean differences. Non-White participants (especially Black participants) and people with lower incomes and less education were more likely to endorse anti-vax attitudes, while older participants were less likely to have anti-vax attitudes. Women, non-White participants (especially Black participants), and people with lower incomes and less education reported greater COVID-19 vaccine hesitancy. Participants that were older and reported higher incomes expressed greater willingness to receive a COVID-19 vaccine.

thumbnail
Table 5. Descriptive statistics and group differences in vaccine outcomes in fall 2020.

https://doi.org/10.1371/journal.pone.0264019.t005

COVID-19 vaccine hesitancy

Zero-order correlations, standardized regression coefficients, and R2 values from the multiple regression models predicting COVID-19 vaccine hesitancy are presented in Table 6. The correlations between the demographic variables and COVID-19 vaccine hesitancy were consistent with the mean differences reported above. COVID-19 vaccine hesitancy was unrelated to personality traits, depression, and substance use, and only had a small association with not using social media. COVID-19 vaccine hesitancy had medium to small associations with less liberal social attitudes, more conservative social attitudes, and higher approval of President Trump. COVID-19 vaccine hesitancy had a large association with anti-vax attitudes, less adherence to COVID-19 safety behaviors and lower approval of government restrictions and had small associations with less COVID-19 related stress/worry and experiencing fewer negative impacts associated with the pandemic.

thumbnail
Table 6. Standardized regression coefficients from COVID-19 vaccine hesitancy models.

https://doi.org/10.1371/journal.pone.0264019.t006

The final model that included all the predictor variables accounted for 36% of the variance in COVID-19 vaccine hesitancy. The largest effects were observed for anti-vax attitudes (β = .38) and less adherence to COVID-19 safety behaviors and lower approval of government restrictions (β = -.22). We also detected small effects for less social media problem use (β = -.11), less liberal social attitudes (β = -.10), and demographic variables including younger age (β = -.09), female sex (β = -.12), non-White race (β = .10), and lower income (β = -.08). The negative association between vaccine hesitancy and social media problem use seems to be a suppressor effect that emerged after adjusting for the common variance between social media problem use and age (age has significant negative associations with vaccine hesitancy and social media problem use) and anti-vax attitudes (anti-vax attitudes have significant positive associations with vaccine hesitancy and social media problem use), and so is not interpreted further.

Anti-vax attitudes

Zero-order correlations, standardized regression coefficients, and R2 values from the multiple regression models predicting anti-vax attitudes are presented in Table 7. The correlations between the demographic predictors and anti-vax attitudes were consistent with the mean differences reported above. Anti-vax attitudes had small but significant associations with low conscientiousness, depression, binge drinking, and nicotine use, and a medium association with social media problem use. Anti-vax attitudes also had medium to large associations with more conservative social attitudes, less liberal social attitudes, and higher approval ratings of President Trump. Finally, anti-vax attitudes were associated with less adherence to COVID-19 safety behaviors, less approval of COVID-19 related government restrictions, and experiencing slightly fewer negative impacts due to the COVID-19 pandemic.

thumbnail
Table 7. Standardized regression coefficients from anti vax models.

https://doi.org/10.1371/journal.pone.0264019.t007

The final regression model that included all the predictors accounted for 32% of the variance in anti-vax attitudes. The largest unique effects were observed for non-White race (β = .20), conservative social attitudes (β = .18), and less adherence to COVID-19 safety behaviors and less approval of government restrictions (β = -.22). We also detected small effects for less liberal social attitudes (β = -.12), lower income (β = -.11), greater social media problem use (β = .12), and greater nicotine use (β = .07).

Discussion

We examined the demographic, psychological, political, and behavioral correlates of anti-vax attitudes and COVID-19 vaccine hesitancy in a national online sample of American adults. We sought to determine the relative predictive power of stable demographic and psychological variables versus factors more proximal to COVID-19 and vaccination itself. We found that younger age, non-White race, lower income, less education, more conservative and less liberal social attitudes, and less adherence to COVID-19 safety behaviors and lower approval of government restrictions were common correlates of anti-vax attitudes in general and COVID-19 vaccine hesitancy specifically.

Younger age was associated with greater vaccine hesitancy, though it was not a significant predictor of anti-vax attitudes in the multiple regression model. Older adults are at greater risk of serious illness and death from COVID-19, which likely accounts for the greater willingness of older participants to receive a COVID-19 vaccine. In contrast, younger people may be more likely to believe that receiving a COVID-19 vaccine is relatively unimportant or would not incur significant benefits [19]. Negative associations between income and vaccine hesitancy are consistent with some prior findings [20]. These associations, however, may be complicated by broader socioeconomic status, which incorporates both income and educational attainment [24]. Indeed, income and educational attainment were moderately correlated in our sample (r = .39) and lower educational attainment consistently predicted anti-vax attitudes and COVID-19 vaccine hesitancy. Lower educational attainment may discourage vaccine reception via susceptibility to misinformation and reduced capability to consider the scientific nuances of vaccines [24].

Next, the negative attitudes towards vaccines in non-White participants may be traced to historical and present-day racial injustices and disparities in the American medical establishment. Systematic racial disparities in medical care are widespread as evidenced, for example, in the high maternal and infant mortality rates, bias in pain management, and the disparities in illness and death from COVID-19 in Black Americans [4346]. Consequently, many Black Americans harbor mistrust of the U.S. medical establishment and thus are suspicious of vaccines [19]. Further, several barriers to medical care are more common among Black Americans including lack of health insurance, high out-of-pocket expenses for things like copays, a history of poor quality of care, etc., all of which may directly affect vaccine uptake [47].

Social and political attitudes had strong associations with anti-vax attitudes and significant but weaker associations with COVID-19 vaccine hesitancy. We found that people who disagreed with relatively liberal social attitudes (e.g., acceptance of homosexuality, women working outside the home) tended not to support vaccination—both in general and specifically for the COVID-19 vaccine. Conservative and authoritarian attitudes were also strongly associated with anti-vax attitudes, though they had a weaker association with COVID-19 vaccine hesitancy. Both liberal and conservative social attitudes were assessed using items from the Right-Wing Authoritarian scale, which conceptualizes the authoritarian personality as having unwavering obedience to a respected leader and the desire for strict societal rules [39]. This desire is often exhibited as a commitment to traditional social values and disdain, resistance, and repression of non-traditional political and social movements. It is surprising, then, that more authoritarian attitudes (i.e., less liberal, more conservative) were associated with ignoring recommendations for vaccinations from medical and political authorities. One explanation may be that political parties most aligned with conservative voters (the Republican party in the United States) have positioned themselves to be in opposition to and undermine the legitimacy of certain authorities that are perceived to be progressive such as academics and scientists, and even some government agencies (e.g., Centers for Disease Control, Food and Drug Administration). These progressive “out groups” are thus deemed less credible than trusted “in group” conservative authorities [8]. In fact, some research has demonstrated conservative social attitudes are associated with a general distrust of medical and scientific experts among conservatives [48].

Finally, anti-vax attitudes and COVID-19 vaccine hesitancy were associated with a lack of adherence to COVID-19 safety behaviors and support for government restrictions to mitigate the spread of COVID-19. In other words, if an individual does not believe that vaccines against COVID-19 and other infectious diseases are necessary and important, then they will not be motivated to participate in related health and safety behaviors. This aligns with recent COVID-19 related literature showing that greater belief in general vaccine effectiveness and/or importance is negatively associated with willingness to receive a COVID-19 vaccine [19]. People with anti-vax attitudes may approach other novel health issues with a similar heuristic structure as well, where one’s opinion about the severity of a disease directly influences their health behavior. More broadly, anti-vax attitudes may be associated with a general distrust of medical advice and intervention especially when endorsed by the government, including the COVID-19 pandemic. This is well understood through the lens of credibility heuristics, i.e., that individual perception of source credibility determines their evaluation of an argument [8].

Anti-vax attitudes

Anti-vax attitudes were also associated with low conscientiousness, depression, binge drinking, nicotine use, problematic social media use, higher approval of President Trump, and experiencing slightly fewer negative impacts due to the COVID-19 pandemic. We hypothesized that several facets of psychological adjustment might relate to anti-vax attitudes, though it may be more constructive to conceptualize these specific facets as converging onto a broader psychological structure associated with poor health behavior in general. These psychological and behavioral characteristics include the small associations with low conscientiousness, smoking, heavy drinking, and depression. These traits and behaviors may be indicators of a general lack of concern about one’s health and tendency to disregard health recommendations, or they may be psychological characteristics that impair one’s ability to learn about best health practices or the ability to implement changes necessary to experience the benefit of those practices. These associations, however, were small and many were no longer significant after adjusting for other more salient variables (e.g., race, social and political attitudes).

The association between anti-vax attitudes and problematic social media use might also be attributed to poor psychological adjustment in general, as problematic social media use exhibited strong correlations with depression (r = .57), binge drinking (r = .44), smoking (r = .39), and conscientiousness (r = -.43). Problematic social media use, however, continued to have an incremental association with anti-vax attitudes after controlling for these psychological variables, suggesting problematic social media use also has a direct effect on the acquisition of anti-vax attitudes, which is reasonable given the effort anti-vax groups have invested in propagating their beliefs through social media platforms [49].

The association between anti-vax attitudes and the approval of President Trump reflects a broader political alignment among conservative interest groups and the rightwing of the modern anti-vax movement. This interpretation is further buttressed by the weaker association between approval for President Trump and COVID-19 vaccine hesitancy, that is, the rightwing of the anti-vax movement fits within a broader conservative political coalition in the United States that pre-dates the COVID-19 pandemic. The small negative association between anti-vax attitudes and experiencing negative impacts of COVID-19 is unclear. For example, characteristics associated with anti-vax and more conservative social attitudes might account for fewer negative events, or people with those beliefs may be engaging in behaviors that reduce the risk for experiencing negative impacts.

COVID-19 vaccine hesitancy

The only unique predictors of hesitancy for a COVID-19 vaccine were female sex and general anti-vax attitudes. Historically, women have been integral players in the anti-vax movement. Since mothers are disproportionately the primary caregivers of children, they are often the coordinator and final decision maker about children’s medical care. It may follow that women face increased anxieties surrounding the safety of vaccines both for their children—and in the case of COVID-19—themselves.

The connection between general anti-vax attitudes and hesitancy for a COVID-19 vaccine follows from the principle of the general attitude influencing attitudes about a specific case. Consequently, it is important to reflect on the mean-level of anti-vax attitudes within a society and how that will impact an effective societal response that includes the widespread adoption of vaccines to mitigate and potentially eradicate a disease. Based on our sample estimates, over 60% of Americans do not hold anti-vax attitudes while only 10%-15% endorse anti-vax sentiments. This suggests a relatively low ceiling for anti-vax attitudes, but also a notable minority that are unlikely to accept vaccinations under most circumstances and another 25%-30% of Americans who have mixed opinions on anti-vax attitudes. Unfortunately, if a significant minority of the population is unwilling to vaccinate (over 30% in our sample), this significantly reduces the effectiveness of vaccination as a public health intervention to achieve herd immunity and eradicate a disease like COVID-19. The consequence of this is that the disease continues to circulate within the population, infecting the unvaccinated and allowing time for mutations of the virus to occur that could result in variants that are resistant to medical intervention and vaccines. Similarly, having allowed anti-vax attitudes to persist in American society has created conditions that are now contributing to a vulnerability in effectively fighting this and future pandemics.

An understanding of the correlates of anti-vax attitudes beyond COVID-19 could help public health officials develop targeted approaches for certain vaccine-hesitant populations. Several positive public health outcomes can be achieved if anti-vax attitudes are appropriately addressed and curbed, including the eradication of diseases and fewer medical and public health costs. On the other hand, failure to appropriately curb vaccine refusal may incur negative public health consequences. For example, caregivers have been increasingly refusing vaccinations for their kindergarteners, citing personal or moral reasons, which has led to a direct increase in measles cases, which was thought to be eradicated in the United States just 20 years ago [50]. It is possible that COVID-19 may follow a similar trajectory, even if widespread vaccination is achieved within the next few years.

Taken together, these results help explicate factors related to the maintenance of ongoing public health concerns. As COVID-19 cases proliferate while a large percentage of the population remains unvaccinated, this demonstration of the relative predictive power of demographic, trait, and state factors can be utilized to develop educational campaigns and public health interventions.

Limitations and future directions

While this study provides novel insights into anti-vax attitudes, there were some limitations. Importantly, we were unable to examine effects in non-Black minority groups due to a small sample size. All racial and ethnic disparities related to public health should be a focus of future study. Next, we did not examine the reasons why or why not respondents are willing to receive a COVID-19 vaccine. Thus, we were unable to consider potential barriers to receiving a vaccine, that is, lack of health insurance, transportation issues, and even fear of needles [51]. Some individuals may also have medical issues in which receiving a COVID-19 vaccine would not be advised, for example, an allergy to a vaccine ingredient or compromised immune conditions that increase the risk of adverse reaction to vaccines. Such barriers have the potential to directly influence vaccine reception, whether a person wishes to be vaccinated or not. Additionally, there was substantial variance in both anti-vax attitudes and COVID-19 vaccine hesitancy that was unaccounted for indicating there are other variables that remain to be identified.

Next, we faced inevitable challenges related to reliability and validity for our COVID-19 vaccine hesitancy variable. First, internal consistency cannot be computed with a single-item response. The current study was also cross-sectional thus retest reliability could not be computed. Further, it is difficult to establish convergent and discriminant validity when, to our knowledge, no validated scales of willingness to receive a COVID-19 exist. Therefore, we rely on the face validity of the question and associations with other variables in the data set. For example, the large correlation (r = .48) between COVID-19 vaccine hesitancy and our Anti-Vax attitudes scale.

The most important limitation is that the COVID-19 pandemic is an ongoing and dynamic situation. Most relevant to the current analyses was that a vaccine was not yet available when this data was collected. Further, a presidential election also occurred that resulted in a shift of power from a conservative (aligned with anti-vax advocates) to a liberal political party. These events may have led to substantial changes in attitudes regarding vaccination. Future work will follow up with respondents over the course of the pandemic and post-pandemic to determine the trajectory of anti-vax attitudes and the long-term health impacts of vaccine hesitancy.

References

  1. 1. A CDC Framework for Preventing Infectious Diseases: Sustaining the Essentials and Innovating for the Future [Internet]. Atlanta: Centers for Disease Control and Prevention; 2011 [cited 10 August 2021]. Available from: https://web.archive.org/web/20170829133723/https://www.cdc.gov/oid/docs/ID-Framework.pdf
  2. 2. Coronavirus in the U.S.: Latest Map and Case Count [Internet]. Nytimes.com. 2022 [cited 6 February 2022]. Available from: https://www.nytimes.com/interactive/2021/us/covid-cases.html
  3. 3. Ritchie H, Ortiz-Ospina E, Beltekian D, Mathieu E, Hasell J, Macdonald B et al. Coronavirus Pandemic (COVID-19) [Internet]. Our World in Data. 2022 [cited 6 February 2022]. Available from: https://ourworldindata.org/covid-vaccinations?country=USA
  4. 4. Fronstin P, Woodbury S. How Many Have Lost Jobs with Employer Coverage During Pandemic? | Commonwealth Fund [Internet]. Commonwealthfund.org. 2020 [cited 10 August 2021]. Available from: https://www.commonwealthfund.org/publications/issue-briefs/2020/oct/how-many-lost-jobs-employer-coverage-pandemic
  5. 5. Parker K, Minkin R, Bennett J. Economic Fallout From COVID-19 Continues To Hit Lower-Income Americans the Hardest [Internet]. Pew Research Center’s Social & Demographic Trends Project. 2020 [cited 10 August 2021]. Available from: https://www.pewresearch.org/social-trends/2020/09/24/economic-fallout-from-covid-19-continues-to-hit-lower-income-americans-the-hardest/
  6. 6. Gellin B, Maibach E, Marcuse E. Do Parents Understand Immunizations? A National Telephone Survey. Pediatrics. 2000;106(5):1097–1102. pmid:11061781
  7. 7. Akbar R. Ten health issues WHO will tackle this year [Internet]. Who.int. 2019 [cited 10 August 2021]. Available from: https://www.who.int/news-room/spotlight/ten-threats-to-global-health-in-2019
  8. 8. Kahan D, Braman D, Cohen G, Gastil J, Slovic P. Who fears the HPV vaccine, who doesn’t, and why? An experimental study of the mechanisms of cultural cognition. Law and Human Behavior. 2010;34(6):501–516. pmid:20076997
  9. 9. Stern A, Markel H. The History Of Vaccines And Immunization: Familiar Patterns, New Challenges. Health Affairs. 2005;24(3):611–621. pmid:15886151
  10. 10. Wolfe R. Anti-vaccinationists past and present. BMJ. 2002;325(7361):430–432. pmid:12193361
  11. 11. Eggertson L. Lancet retracts 12-year-old article linking autism to MMR vaccines. Canadian Medical Association Journal. 2010;182(4):E199–E200. pmid:20142376
  12. 12. Kumar S, Dean S, Golding W, Moodley P, Webster S. Fitness to Practice Panel Hearing. Fitness to Practice Panel Hearing. General Medical Council; 2007. p. 1–143.
  13. 13. Wakefield A, Montgomery S. Measles, mumps, rubella vaccine: through a glass, darkly. Adverse drug reactions and toxicological reviews. 2000;19(4):265–292. pmid:11212459
  14. 14. Reich J. Neoliberal Mothering and Vaccine Refusal. Gender & Society. 2014;28(5):679–704.
  15. 15. MacFarquhar N. Far-Right Extremists Move From ‘Stop the Steal’ to Stop the Vaccine [Internet]. Nytimes.com. 2021 [cited 10 August 2021]. Available from: https://www.nytimes.com/2021/03/26/us/far-right-extremism-anti-vaccine.html
  16. 16. Hellinger D. Conspiracies and Conspiracy Theories in the Age of Trump. 1st ed. London: Palgrave Macmillan; 2018.
  17. 17. Joslyn M, Sylvester S. The Determinants and Consequences of Accurate Beliefs About Childhood Vaccinations. American Politics Research. 2017;47(3):628–649.
  18. 18. Tyson A. Republicans remain far less likely than Democrats to view COVID-19 as a major threat to public health [Internet]. Pew Research Center. 2020 [cited 10 August 2021]. Available from: https://www.pewresearch.org/fact-tank/2020/07/22/republicans-remain-far-less-likely-than-democrats-to-view-covid-19-as-a-major-threat-to-public-health/
  19. 19. Callaghan T, Moghtaderi A, Lueck J, Hotez P, Strych U, Dor A et al. Correlates and disparities of intention to vaccinate against COVID-19. Social Science & Medicine. 2021;272:113638. pmid:33414032
  20. 20. Robertson E, Reeve K, Niedzwiedz C, Moore J, Blake M, Green M et al. Predictors of COVID-19 vaccine hesitancy in the UK household longitudinal study. Brain, Behavior, and Immunity. 2021;94:41–50. pmid:33713824
  21. 21. Chang J, Kochel R. Vaccine Hesitancy and Attributions for Autism among Racially and Ethnically Diverse Groups of Parents of Children with Autism Spectrum Disorder: A Pilot Study. Autism Research. 2020;13(10):1790–1796. pmid:32710507
  22. 22. Ndugga N, Hill L, Artiga S, Parker N. Latest Data on COVID-19 Vaccinations by Race/Ethnicity [Internet]. KFF. 2021 [cited 10 August 2021]. Available from: https://www.kff.org/coronavirus-covid-19/issue-brief/latest-data-on-covid-19-vaccinations-race-ethnicity/
  23. 23. Artiga S, Kates J. Addressing Racial Equity in Vaccine Distribution [Internet]. KFF. 2020 [cited 10 August 2021]. Available from: https://www.kff.org/racial-equity-and-health-policy/issue-brief/addressing-racial-equity-vaccine-distribution/
  24. 24. Makarovs K, Achterberg P. Contextualizing educational differences in “vaccination uptake”: A thirty nation survey. Social Science & Medicine. 2017;188:1–10. pmid:28692824
  25. 25. Carpiano R, Polonijo A, Gilbert N, Cantin L, Dubé E. Socioeconomic status differences in parental immunization attitudes and child immunization in Canada: Findings from the 2013 Childhood National Immunization Coverage Survey (CNICS). Preventive Medicine. 2019;123:278–287. pmid:30904601
  26. 26. Allington D, McAndrew S, Moxham-Hall V, Duffy B. Coronavirus conspiracy suspicions, general vaccine attitudes, trust and coronavirus information source as predictors of vaccine hesitancy among UK residents during the COVID-19 pandemic. Psychological Medicine. 2021;:1–12.
  27. 27. Bogg T, Roberts B. Conscientiousness and Health-Related Behaviors: A Meta-Analysis of the Leading Behavioral Contributors to Mortality. Psychological Bulletin. 2004;130(6):887–919. pmid:15535742
  28. 28. Lahey B. Public health significance of neuroticism. American Psychologist. 2009;64(4):241–256. pmid:19449983
  29. 29. Cassano P, Fava M. Depression and public health. Journal of Psychosomatic Research. 2002;53(4):849–857. pmid:12377293
  30. 30. Office on Smoking and Health, National Center for Chronic Disease Prevention and Health Promotion. 2014 Surgeon General’s Report: The Health Consequences of Smoking—50 Years of Progress [Internet]. Atlanta: Centers for Disease Control and Prevention; 2014. Available from: https://www.cdc.gov/tobacco/data_statistics/sgr/50th-anniversary/index.htm#report
  31. 31. World Health Organization. Global status report on alcohol and health—2018 [Internet]. Geneva: World Health Organization; 2018. Available from: https://www.who.int/publications/i/item/9789241565639
  32. 32. Brennen J, Simon F, Howard P, Nielsen R. http://www.primaonline.it/wp-content/uploads/2020/04/COVID-19_reuters.pdf. [Internet]. Oxford: Reuters Institute for the Study of Journalism.; 2020 [cited 10 August 2021]. Available from: https://www.primaonline.it/wp-content/uploads/2020/04/COVID-19_reuters.pdf
  33. 33. Shearer E, Mitchell A. News use across social media platforms in 2020. [Internet]. Pew Research Center’s Journalism Project. 2021 [cited 10 August 2021]. Available from: https://www.journalism.org/2021/01/12/news-consumption-on-social-media-methodology/
  34. 34. In Changing U.S. Electorate, Race and Education Remain Stark Dividing Lines [Internet]. Pew Research Center—U.S. Politics & Policy. 2020 [cited 10 August 2021]. Available from: https://www.pewresearch.org/politics/2020/06/02/in-changing-u-s-electorate-race-and-education-remain-stark-dividing-lines/
  35. 35. Jones J, Saad L. Gallup News Service: December Wave One. Gallup News Service; 2019.
  36. 36. Houts C, Cai L. Flexible Multilevel Multidimensional Item Analysis and Test Scoring. Chapel Hill, NC: Vector Psychometric Group; 2020.
  37. 37. Soto C, John O. Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality. 2017;68:69–81.
  38. 38. Watson D, O’Hara M, Simms L, Kotov R, Chmielewski M, McDade-Montez E et al. Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS). Psychological Assessment. 2007;19(3):253–268. pmid:17845118
  39. 39. Altemeyer B. Right-Wing Authoritarianism. Winnipeg: University of Manitoba Press; 1981.
  40. 40. Ladouceur C. COVID-19 Adolescent Symptom and Psychological Experience Questionnaire (CASPE [Internet]. Bethesda: National Library of Medicine, National Institutes of Health; 2020 [cited 10 August 2021]. Available from: https://www.nlm.nih.gov/dr2/CASPE_AdolSelfReport_Qualtrics.pdf
  41. 41. Muthén L, Muthén B. Mplus User’s Guide. 8th ed. Los Angeles, CA: Muthén & Muthén; 2020.
  42. 42. Falk C. Are Robust Standard Errors the Best Approach for Interval Estimation With Nonnormal Data in Structural Equation Modeling?. Structural Equation Modeling: A Multidisciplinary Journal. 2018;25(2):244–266.
  43. 43. Artiga S, Pham O, Orgera K, Ranji U. Racial Disparities in Maternal and Infant Health: An Overview—Issue Brief [Internet]. Kaiser Family Foundation; 2020. Available from: https://www.kff.org/report-section/racial-disparities-in-maternal-and-infant-health-an-overview-issue-brief/
  44. 44. Noonan A, Velasco-Mondragon H, Wagner F. Improving the health of African Americans in the USA: an overdue opportunity for social justice. Public Health Reviews. 2016;37(1). pmid:29450054
  45. 45. Meghani S, Byun E, Gallagher R. Time to Take Stock: A Meta-Analysis and Systematic Review of Analgesic Treatment Disparities for Pain in the United States. Pain Medicine. 2012;13(2):150–174. pmid:22239747
  46. 46. Gold J, Rossen L, Ahmad F, Sutton P, Li Z, Salvatore P et al. Race, Ethnicity, and Age Trends in Persons Who Died from COVID-19—United States, May–August 2020 [Internet]. Cdc.gov. 2020 [cited 10 August 2021]. Available from: http://dx.doi.org/10.15585/mmwr.mm6942e1
  47. 47. Bulatao R, Anderson N. Understanding racial and ethnic differences in health in late life. Washington, D.C.: National Academies Press; 2004.
  48. 48. Motta M. The Dynamics and Political Implications of Anti-Intellectualism in the United States. American Politics Research. 2017;46(3):465–498.
  49. 49. Germani F, Biller-Andorno N. The anti-vaccination infodemic on social media: A behavioral analysis. PLOS ONE. 2021;16(3):e0247642. pmid:33657152
  50. 50. Olive J, Hotez P, Damania A, Nolan M. The state of the antivaccine movement in the United States: A focused examination of nonmedical exemptions in states and counties. PLOS Medicine. 2018;15(6):e1002578. pmid:29894470
  51. 51. Hornsey M, Harris E, Fielding K. The psychological roots of anti-vaccination attitudes: A 24-nation investigation. Health Psychology. 2018;37(4):307–315. pmid:29389158