Skip to main content
  • Research article
  • Open access
  • Published:

Patient-reported reactogenicity and safety of COVID-19 vaccinations vs. comparator vaccinations: a comparative observational cohort study

Abstract

Background

In the course of the SARS-CoV-2 pandemic, multiple vaccines were developed. Little was known about reactogenicity and safety in comparison to established vaccines, e.g. influenza, pneumococcus, or herpes zoster. Therefore, the present study aimed to compare self-reported side effects in persons vaccinated against SARS-CoV-2 with the incidence of side effects in persons receiving one of the established vaccines.

Methods

A longitudinal observational study was conducted over a total of 124 days using web-based surveys. Persons receiving either a vaccination against SARS-CoV-2 or one of the established vaccines (comparator group) were included. In the first questionnaire (short-term survey), 2 weeks after vaccination, mainly local and systemic complaints were evaluated. The long-term survey (42 days after vaccination) and follow-up survey (124 weeks after vaccination) focused on medical consultations for any reason. Multivariate analyses were conducted to determine the influence of the vaccine type (SARS-CoV-2 vs. comparator) and demographic factors.

Results

In total, data from 16,636 participants were included. Self-reported reactogenicity was lowest in the comparator group (53.2%) and highest in the ChAdOx1 group (85.3%). Local reactions were reported most frequently after mRNA-1273 (73.9%) and systemic reactions mainly after vector-based vaccines (79.8%). Almost all SARS-CoV-2 vaccines showed increased odds of reporting local or systemic reactions. Approximately equal proportions of participants reported medical consultations. None in the comparator group suspected a link to vaccination, while this was true for just over one in 10 in the mRNA-1273 group. The multivariate analysis showed that people with SARS-CoV-2 vaccination were not more likely to report medical consultations; patients who had received a regimen with at least one ChAdOx1 were even less likely to report medical consultations. Younger age, female gender and higher comorbidity were mostly associated with higher odds of medical consultations.

Conclusion

The rate of adverse reactions after established vaccinations was roughly comparable to previous studies. Two weeks after vaccination, participants in the SARS-CoV-2 vaccination group reported more local and systemic local reactions than participants in the comparator group. In the further course, however, there were no higher odds of medical consultations in either of the two groups. Thus, altogether, we assume comparable safety.

Trial registration

DRKS-ID DRKS00025881 and DRKS-ID DRKS00025373.

Peer Review reports

Background

In December 2019, a novel viral infection associated with pneumonia as well as prominent general symptoms was reported for the first time in Wuhan, China [1]. Initially called the 2019 novel coronavirus (2019-nCoV), and later SARS-CoV-2, the infection spread rapidly across the globe. As a result of substantial efforts to expand research and development of vaccines against SARS-CoV-2, the first vaccine was already licensed in December 2020, followed by further vaccines on different pharmacological bases. Large randomised controlled trials have demonstrated the safety and efficacy of the vaccines BNT162b2 (Comirnaty®, INN Tozinameran from BioNTech and Pfizer), mRNA-1273 (Spikevax®, INN Elasomeran from Moderna), ChAdOx1 (Vaxzevria® from AstraZeneca and Oxford University) and Ad26.COV2.S (Jcovden® from Janssen-Cilag) [2,3,4,5]. Starting with the administration of BNT162b2 in December 2020, the overall vaccination rate in countries of the European Economic Area has reached 72.8% as per August 2022 [6]. One reason for the insufficient vaccination rate against SARS-CoV-2 is a more fundamental vaccination scepticism for various reasons, e.g. the fear of vaccination consequences [7], fuelled by a general scepticism due to the fast development, the novel technology of mRNA vaccines, and media reports of very rare adverse events such as vaccine-induced immune thrombotic thrombocytopenia [8] or myocarditis [9, 10]. This scepticism fell on fertile ground: While established vaccinations are considered highly effective in preventing diseases and are one of the most significant public health achievements of the modern era [11], vaccination hesitancy has been identified by the WHO as a key threat of global health [12]. In 2016, citizens in Europe were more critical of the safety and benefits of vaccination than citizens in other regions of the world, and seven of the ten countries with the least confidence in vaccine safety were located in Europe [13]. In 2020, after the rise of SARS-CoV-2 and before the development of corresponding vaccines, only 68% of German citizens reported to be willing to take a vaccine against SARS-CoV-2 even if it was proven safe and effective [14].

Against this background, the Corona Vakzin Konsortium (CoVaKo) project tries to elucidate the efficacy and safety of the SARS-CoV-2 vaccines under real-world conditions. The CoVaKo safety study reported here aimed to assess reactogenicity and self-reported health problems compared with other common vaccinations such as those against influenza or pneumococcus [15, 16]. While the incidence of adverse events after administration of established vaccines varies widely and severe consequences are exceedingly rare [11], a comparison of the new SARS-CoV-2 vaccines with the established vaccines is still lacking. The work presented aims to contribute to bridging this research gap by comparing patient-reported outcomes after vaccination with SARS-CoV-2 vaccines or established vaccines.

Methods

We conducted a longitudinal online cohort observational study to assess health problems and healthcare utilisation after vaccination against SARS-CoV-2 and multiple other vaccinations. Reporting of the study is based on the STROBE (Strengthening the Reporting of Observational studies in Epidemiology) recommendations (see Additional file 1) [17].

Study design and recruiting

Web-based surveys were used to elucidate reactogenicity and health problems that occurred within a total time of 124 days after the vaccinations and that have resulted in medical consultation, medication intake or sick leave. Vaccinations included SARS-CoV-2 (SARS-CoV-2 vaccine group) and influenza, pneumococcus, tick-borne encephalitis (TBE), tetanus and diphtheria (Td) vaccinations with or without pertussis and poliomyelitis (TdaP and TdaP-IPV), and herpes zoster (comparator group). Short- and long-term surveys were sent 14 and 40 days after vaccination, respectively. Additionally, participants received the follow-up survey 124 days after vaccination.

Due to the changing SARS-CoV-2 vaccination recommendations over time, the intervals between first and second vaccinations changed over the course of the study. It was therefore decided to omit individual survey time points when short- and long-term surveys were in an unfavourable temporal relationship. Figure 1 provides an overview of the sequence of survey time points for both groups and immunisation regimes.

Fig. 1
figure 1

Depiction of the sequence of the survey dates. After vaccination against SARS-CoV-2 or against one of the comparators, participants received an invitation to the short-term survey at 14 days latency, and an invitation to the long-term survey after a further 26 days. One hundred twenty-four days after vaccination, all participants received an invitation to the follow-up survey. Surveys included in the analysis are highlighted in blue, while those excluded from the analysis are highlighted in grey

The recruitment strategy and the surveys were evaluated in a feasibility study [18] (DRKS ID DRKS00025881 [19]). Recruitment started on April 17th, 2021 for the feasibility study and on May 20th, 2021 for the main study (DRKS ID DRKS00025373 [16]) in vaccination centres as well as primary care and occupational physicians’ practices in Bavaria, Germany. Recruitment continued until April 17th, 2022, data collection period closed on August 28th, 2022. After vaccination, leaflets were given to individuals providing information about the study. Individuals had the opportunity to voluntarily register on a secure web-based platform and give their informed consent. Participants should preferably register at the time of the first vaccination. However, registration was possible during the whole observation period. They were then provided via e-mail with links to the relevant surveys. Depending on the time of registration participants received links to the short-term, long-term and/or follow-up surveys. After receiving the link to the survey, participants had to respond within 5 days. Given the dynamic changes in COVID-19 vaccine schedules and the importance of obtaining real-world evidence on vaccine safety, data from both the feasibility study and the main study were included in the data analysis. This was considered to be a methodologically sound approach by the authors, as there was little change in the survey between the feasibility study and the main study. All survey methods were implemented in accordance with the relevant guidelines and regulations.

Sample size planning was conducted prior to the start of the study, assuming an event probability of 0.1% for rare events. The corresponding 95% confidence interval ranges from 0.02 to 0.29% for N = 3000 according to Clopper and Pearson [20]. For larger event probabilities, the width of the confidence interval narrows.

Participants and data acquisition

Patients who were older than eleven years (older than 17 years at the time of the study start due to changing recommendations) and had received a vaccination against SARS-CoV-2, influenza, pneumococcus, tickborne encephalitis, tetanus with or without diphtheria/pertussis/poliomyelitis, and/or herpes zoster in the last 124 days were included. Exclusion criteria were incomplete registrations, registration before vaccination date or later than 124 days after vaccination of first or single dose, and an interval between prime and boost SARS-CoV-2 immunisation of less than 14 days.

At registration, participants were asked about socio-demographic characteristics, comorbidities and information about the vaccination including brand name and batch number. Morbidity was assessed based on a modified German version of the Self-Administered Comorbidity Questionnaire (m-SCQ-D) [21, 22]. In the short-term survey, solicited and unsolicited local and systemic reactions were recorded. The endpoint ‘local reactions’ is composed of pain, erythema or swelling, limitation of movement and abscess, while ‘systemic reactions’ includes headache, fatigue, nausea or vomiting, fever or chills, muscle or joint pain, allergic reactions, dyspnoea, syncope, seizure, dizziness, numbness or paraesthesia, and coagulation disorder. Unsolicited reactions were those reactions not covered by the prespecified local or systemic reactions and could be reported in a free text field. The participants were asked to specify any consequences of the observed reactions. These included medication intake, sick leave, ambulatory consultation, hospital outpatient consultation, or hospitalisation. In the long-term and follow-up surveys, participants were asked to report all health problems that led or will lead to consulting a doctor (outpatient consultation) or to seeking hospital care (inpatient consultation), including hospitalisation. The subjects were asked to report all health problems that occurred in the respective time interval and to assess afterwards whether they assumed an association with the vaccination and whether the health problem was pre-existing. All surveys can be found in the Additional file 2. If changes had to be made, mainly due to changes in vaccination recommendations, they are indicated in that document.

Data collection was carried out with the web-based software platform REDCap (Research Electronic Data Capture), hosted at Universitätsklinikum Erlangen [23, 24]. Data were recorded on a server of the Uniklinikum Erlangen.

Data preparation

In case a person registered twice with the same email address, the data records were merged. If two participants used the same email address, both data sets were handled separately. For purposes of plausibility testing, it was checked whether the invitation links were sent at the correct time with regard to the vaccination date. If the answers were sent at an incorrect time, they were counted as missing. In case of implausible data on age (year of birth before 1900), weight (less than 30 kg or more than 300 kg), height (less than 100 cm or more than 250 cm) and/or pregnancy (for male participants or participants with year of birth before 1975), the corresponding variables were set to missing. Batch numbers were checked for plausibility and compared with the database of the Federal Institute for Drugs and Medical Devices (Bundesinstitut für Arzneimittel und Medizinprodukte). Data records with invalid batch numbers were excluded. The total number of completed questionnaires included in the analysis was 16,636.

The analysis compared the following cohorts:

  • Short-term survey: BNT162b2, mRNA-1273, ChAdOx1, Ad26.COV2.S, and comparator vaccinations

  • Long-term survey: BNT162b2, mRNA-1273, ChAdOx1, Ad26.COV2.S, and comparator vaccinations

  • Follow-up survey: homologous mRNA (BNT162b2 + BNT162b2 or mRNA-1273 + mRNA-1273), homologous vector (ChAdOx1 + ChAdOx1), heterologous immunisation (ChAdOx1 + BNT162b2 or ChAdOx1 + mRNA-1273), and comparator vaccinations

The data selection and preparation process are depicted in Fig. 2.

Fig. 2
figure 2

Data selection and preparation process. If a person registered twice with the same email address, data sets were merged. If an email address was used by more than one participant, data records were considered separately. Batch numbers were checked for plausibility: surveys regarding vaccinations with invalid batch numbers were counted as missing; invalid batch number was defined as an unknown number or an incorrect combination of number and vaccine

Statistical analysis

Age was determined by subtracting the reported year of birth from the registration year (2021/2022). Sociodemographic characteristics and comorbidities are reported as proportion or as mean/median. Comorbidity in form of m-SCQ-D was calculated. Consequences of reactions were queried in a multiple-choice question. The consequence that is considered to be the most severe is being reported (hierarchically ordered from no consequence to medication intake, sick leave, ambulatory consultation, hospital outpatient consultation, and hospitalisation). Health problems are reported as absolute and relative frequencies.

To compare cohorts, multivariable logistic regressions were performed. For the short-term surveys, the outcome was local and systemic reactions. For the long-term and follow-up surveys, the outcomes were outpatient and inpatient medical consultations that had occurred or were planned. Predictors included vaccination type (short-term and long-term surveys) or vaccination regimen (follow-up survey), respectively, age (in years), gender, m-SCQ-D, vaccination-registration interval (in days), and another vaccination in the 8 weeks prior to registration or since answering the last survey. Reference was represented by comparator vaccinations. We conducted a subgroup analysis including only those participants who had received influenza vaccination in the reference group.

R Statistical Software (version 4.0.2, R Foundation for Statistical Computing, Vienna, Austria) was used for conducting data preparation, analyses, and figure creation.

Results

Sociodemographic characteristics

In total, 3266 short-term surveys, 3379 long-term surveys and 9991 follow-up surveys have been included in the analysis. In the short-term survey, the SARS-CoV-2 vaccination group comprised 3063 participants whereas the comparator group included 203 individuals (Table 1). All comparator vaccines were inactivated vaccines. In the SARS-CoV-2 vaccination cohort, most of the individuals had a vaccination with an mRNA vaccine; while vector-based vaccines were more likely to be given to male participants, mRNA vaccines were mostly administered to female participants. In the short-term survey, participants in the comparator group were to a larger extent female and had a higher mean age than those in the SARS-CoV-2 vaccination group (comparator group: 59.1% female, 49.8 years; SARS-CoV-2 group: 55.5% female, 42.0 years). The age difference was least prominent compared with participants who received ChAdOx1 (46.1 years) and most pronounced compared to participants vaccinated with Ad26.COV2.S (39.2 years). Participants in the comparator group more frequently reported no pre-existing diseases than participants with a SARS-CoV-2-vaccination (37.4% vs. 44.7 to 60.0% for short-term surveys, 33.5% vs. 40.0 to 61.0% for long-term surveys and 32.8% vs. 29.9 to 41.9% for follow-up surveys). Body mass index was similar between the groups. In the comparator cohort, around one-third reported having received another immunisation in the 8 weeks before receiving the vaccination.

Table 1 Sociodemographic characteristics of participants who responded to the surveys

Descriptive results of the short-term survey

Considerably more participants in the SARS-CoV-2 vaccine group reported at least one local, systemic or unsolicited reaction than participants in the comparator cohort (local: 47.7% to 73.9% vs. 42.9%, systemic: 48.5% to 81.9% vs. 32.5%, unsolicited: 9.7% to 15.8% vs. 5.4%; Table 2). In the case of vector-based vaccines, local reactions were reported less frequently than systemic reactions (51.2% vs. 79.8%). Participants reported more local than systemic reactions for the mRNA-based vaccines (61.8% vs. 51.4%) and the comparator vaccines (42.9% vs. 32.5%).

Table 2 Symptom-burden within 14 days after the first vaccination (short-term survey)

Local reactions

For most of the individuals, local vaccine reactions had no consequence (86.2% to 97.7%). If one was reported, medication intake was most frequent, ranging from 2.3% in the comparator group up to 8.5% in the mRNA-1273 group. Sick leave and ambulatory consultation were less frequent consequences (comparator group: 0.0% for both; mRNA-1273 group: 3.0% and 2.0%, respectively). Hospital outpatient consultation only occurred very rarely and only in participants with mRNA-1273. Hospitalisations due to local reactions were reported in none of the groups.

Systemic reactions entailed more consequences than local reactions. While the majority of participants in the comparator cohort (81.8%) and in the mRNA cohorts (71.3%/67.1%) as well reported no consequences, this proportion was markedly lower in those vaccinated with vector-based vaccines (46.2%/40.8%). In all groups, medication intake was the most common consequence but with distinct differences, being lowest in comparator vaccines (13.6%) and highest in vector-based vaccines (33.3%/37.9%). In a similar manner, sick leave was reported more frequently in the vector-based cohorts (11.0%/23.3%) than in the mRNA (4.5%/5.4%) or comparator (3.0%) cohorts. Ambulatory consultations occurred roughly in equally low frequencies in all groups, with a minimum in comparator-vaccinated participants. Hospital outpatient consultations and hospitalisations due to systemic reactions were only reported by participants vaccinated with BNT162b2 and were very rare events.

Unsolicited reactions were reported more frequently in patients with vaccinations against SARS-CoV-2 than those with comparator vaccinations (11.0% vs. 5.4%). For participants with comparator vaccinations, however, these had consequences more frequently in contrast to participants with SARS-CoV-2 vaccinations, mainly driven by taking sick leave.

Multivariate regression analyses of local and systemic reactions reported in the short-term surveys

Local reactions

In contrast to the comparator group, participants in the SARS-CoV-2 vaccination group showed higher odds of reporting any, local, or systemic reactions (Table 3). Vaccination with mRNA-1273 was associated with particularly higher odds of reporting a local reaction (OR 3.12, 95% CI [2.20, 4.44]). Vaccination with BNT162b2 (OR 1.52, 95% CI [1.11, 2.09]) and ChAdOx1 (OR 1.69, 95% CI [1.10, 2.60]) showed smaller odds. There was no significant difference between the Ad26.COV2.S group and the comparator group. Younger age and female gender were associated with a higher reporting of local reactions. m-SCQ-D, interval between vaccination and registration, and receiving another vaccination had no influence on reporting.

Table 3 Multivariate regression analyses of local and systemic reactions in the short-term survey and of outpatient and inpatient consultations reported in the long-term and follow-up surveys. Odds ratio of reporting local and systemic adverse events in the short-term survey (A) and consulting a doctor (outpatient consultation) or seeking hospital care (inpatient consultation) (both occurred and planned) in the long-term (B) and follow-up survey (C) depending on the vaccine used compared to comparator vaccines, age, sex, comorbidities and interval between vaccination and study registration

Systemic reactions

In the case of systemic reactions, the odds of reporting were highly increased in participants with ChAdOx1 (OR 11.52, 95% CI [7.04, 19.29]) and Ad26.COV2.S (OR 7.61, 95% CI [4.64, 12.72]). mRNA-1273 (OR 2.69, 95% CI [1.89, 3.85]) and BNT162b2 (OR 1.82, 95% CI [1.31, 2.54]) both increased reporting significantly, but on a lower level. Younger age and female gender were as well associated with an increased reporting of systemic reactions. Lower m-SCQ-D and shorter interval between vaccination and registration were significantly associated with lower odds of reporting systemic reactions. Having another vaccination had no influence on reporting systemic reactions.

The subgroup analysis, which restricted the comparator group to influenza vaccinations, showed no relevant changes in the predictors (data not shown). However, we observed that participants with Ad26.COV2.S vaccine reported local reactions significantly more often than people with influenza vaccination (OR 1.78, 95% CI [1.09, 2.94]).

Descriptive results the long-term and follow-up surveys

In both the long-term and the follow-up survey, approximately equal parts of participants reported having sought medical consultation (14.2% vs. 13.0 to 16.7% for long-term surveys and 20.9% vs. 16.4 to 21.6% for follow-up surveys). The proportion of participants who had sought medical consultation, declared that their health problems were unknown and that they suspected a connection with the vaccination was lowest in the comparison group (2.1% vs. 3.1 to 9.4% for long-term surveys and 0.0% vs. 2.3 to 4.2% for follow-up surveys) (Table 4). In the long-term survey, patients in the comparator group were less likely to report medical consultation due to musculoskeletal complaints (25% vs. 34 to 49% of patients with medical consultation). Cardiovascular complaints were reported least frequently in all groups in both surveys (9% to 19% of patients with medical consultation).

Table 4 Medical consultations, health problems and regarding patients’ views within 40 and 124 days after vaccination (long-term and follow-up surveys)

Multivariate regression analyses of medical consultations and health problems reported in the long-term and follow-up surveys

Long-term survey

There was no statistically significant difference in out- or inpatient medical consultations with regard to vaccination (Table 3). Lower age, female gender, and higher m-SCQ-D were associated with higher odds of reporting an outpatient medical consultation. In the case of inpatient consultation, there was no influence of gender.

Follow-up survey

Odds of reporting medical out- or inpatient consultations was not higher in participants with homologous vaccination with BNT162b2 or mRNA-1273 than in the comparator group. However, participants with homologous vaccination with ChAdOx1 or heterologous vaccination reported significantly less outpatient medical consultations (homologous: OR 0.52, 95% CI [0.35, 0.76], ChAdOx1 + BNT162b2: OR 0.57, 95% CI [0.41, 0.79]; ChAdOx1 + mRNA-1273: OR 0.47, 95% CI [0.33, 0.67]). Female gender, higher m-SCQ-D, and longer interval between vaccination and registration was associated with more reports of outpatient consultations. Age had no influence on reporting outpatient consultations. In a similar manner, fewer inpatient consultations were reported by patients with heterologous vaccination, but not with ChAdOx1 homologous immunisation (ChAdOx1 + BNT162b2: OR 0.34, 95% CI [0.14, 0.86]; ChAdOx1 + mRNA-1273: OR 0.24, 95% CI [0.09, 0.65]). Age and gender had no influence on reporting of inpatient consultations, while the influence of m-SCQ-D and interval to registration persisted. Receiving another vaccination in the 2 months prior to registration or since answering the last survey had no influence on reporting out- or inpatient consultations in the long-term as well as in the follow-up surveys.

Restricting the reference group to only those participants who had received influenza vaccination did not lead to relevant changes in the results of the long-term and follow-up survey (data not shown). However, the results showed that participants with homologous ChAdOx1 vaccination — in line with the results for participants with heterologous vaccination in the main analysis — were significantly less likely to report inpatient consultations in the follow-up survey than people with influenza vaccination (OR 0.36, 95% CI [0.14, 0.96]).

Discussion

A longitudinal observational study was conducted to contrast reactogenicity and medical consultations following SARS-CoV-2 and comparator vaccinations. In the comparator group, local and systemic reactions were less frequently reported. For both local and systemic reactions, those vaccinated with comparator vaccinations were more likely to report no consequences. If consequences were reported, medication intake and sick leave were most commonly reported in all groups. Multivariate regression analyses showed a strong influence of younger age, female gender, and more comorbidities on reporting local as well as systemic reactions. In the long-term survey and the follow-up survey, a comparable frequency of seeking medical consultation in all groups has been observed. Comparator-vaccinated patients were significantly less likely to suspect an association with the vaccination than patients who had received SARS-CoV-2 vaccination. In the follow-up survey, participants vaccinated with a regime including ChAdOx1 were less likely to report out- or inpatient medical consultations than participants in the comparator group.

Published data on side effects of the comparator vaccines differ strongly and are of limited comparability, e.g. due to the different approval status of sera in different countries, but also due to different survey designs, outcomes or study populations. Low incidences of local side effects in up to half of all patients have been reported after administration of different vaccines against influenza, FSME-Immun® (TBE), and Encepur® (TBE), with reports ranging between 6.7 and 44.7% of patients [25,26,27,28]. In a second group of vaccinations — Shingrix® (herpes zoster), Pneumovax® 23 (pneumococcus), Boostrix® (Td), and Boostrix-Polio® (TdaP-IPV) — a higher incidence of local reactions has been found (75.9 to 88.0%) [29,30,31,32,33]. Systemic adverse events show a similar distribution but on a lower level: Vaccinations against influenza and TBE remain a group with a low frequency of systemic side effects, ranging from 0.6 to 31.0% [25,26,27,28]. This contrasts with vaccinations with Shingrix®, against pneumococcus, and against tetanus and diphtheria (with and without pertussis or poliomyelitis) as a group with a high frequency of systemic side effects, ranging from 64.8 to 82.1% [29,30,31,32,33]. The reactogenicity reported in our study was roughly the same as observed in other studies. Similarly, the prevalence of systemic reactions was lower than the prevalence of local reactions. The SARS-CoV-2 vaccination group reported considerably higher prevalences of local as well as systemic reactions (SARS-CoV-2 vaccination group: 60.7 and 54.5%, respectively). However, higher reporting of adverse events after SARS-CoV-2 vaccination may partly also be attributed to a nocebo effect [34, 35]. This hypothesis is supported by corresponding results of recent research from New Zealand, in which media reports of vaccine-induced myocarditis led to increased reports of cardiac symptoms [36].

To our knowledge, consequences in the form of medication intake, sick leave, or medical consultations had rather been included as outcomes of the vaccination in vaccine studies before SARS-CoV-2 than as side effects of the vaccinations. Very few studies discussed these consequences as reactions to the vaccination itself, such as Nichol et al. who reported a work loss due to side effects of a influenza vaccination in healthy subjects of 2 days per 100 persons [37]. Seeking medical consultation due to vaccination side effects was a common consequence, with 4.7 to 7.6% of patients with vaccination against influenza, pneumococcus or tetanus and diphtheria reporting consultations [32, 38]. With the introduction of the SARS-CoV-2 vaccinations, the consequences of adverse events after vaccination were increasingly surveyed. In two German studies, 13.1 and 28.4% of participants reported taking at least 1 day of sick leave after the first and the second vaccination against SARS-CoV-2, respectively [39], and 8% of participants felt unable to work after the first vaccination with BNT162b2, increasing to 35% of participants after the second vaccination [40]. 5.6% of BNT162b2 vaccinees with at least one side effect reported a need for medical care [41]. We found considerably lower reports of consequences after SARS-CoV-2 vaccination, with consequences after comparator vaccinations even lower. In our study, no medical consultations due to local reactions were reported in the comparator group, and systemic reactions resulted in only 1.5% of that population reporting outpatient medical consultations. That proportion of outpatient consultations due to adverse events was slightly higher in participants with vaccination against SARS-CoV-2, with up to 2.0% for local reactions and up to 5.9% for systemic reactions. A similar pattern was also found for the medication intake and sick leave.

Female gender had a significant influence on reports of outpatient medical consultations, but not of inpatient medical consultations. Gender-related differences in consultation frequency have already been described and discussed several times and contrast different health behaviours in similar symptoms on one side with different symptom compositions on the other [42,43,44]. One possible explanation for the pattern we observed may be a filtering function of primary care — while women presented more often as outpatients, they might have been referred to inpatient care just as often as men. This explanation assumes that women were more likely to present to outpatient care due to symptoms—which is supported by our short-term data—but were not more likely to have severe symptoms requiring inpatient care than men. A higher prevalence of adverse events in women has been reported before in vaccinations against SARS-CoV-2 [45, 46] as well as in the vaccines used as comparators [47,48,49,50]. Despite the fact that antibody responses to specific vaccine doses often tend to be higher in females than in males, low dose vaccination of comparator vaccines for women to reduce the prevalence of side effects has not been systematically investigated or deliberated to our knowledge so far [51]. Yet, reduction of the vaccination dose against SARS-CoV-2 was discussed shortly after the start of the vaccination campaign and the observed increased side effect rate in women [52].

Limitations and strengths

Due to the design as a prospective observational study, group sizes differed significantly. While 3063 participants responded to the first survey with SARS-CoV-2 vaccination, this number increased to a total of 9613 participants in the follow-up survey. For the comparator vaccinations, by contrast, responses were only by 203 (short-term survey), 337 (long-term survey) and 378 participants (follow-up survey), respectively. This pronounced difference makes comparisons of adverse events with a very low incidence particularly difficult, even more so because the survey was powered for an event rate of 0.1%. Therefore, we performed a multivariate logistic regression to consider the different vaccination recommendations with regard to gender and age, as descriptive results may not be transferable to the German population as a whole. Secondly, resulting from the limited number of participants who had received one of the comparator vaccinations, we opted to combine the corresponding group. Consequently, this group comprised above all, though not exclusively, adjuvanted inactivated vaccines for which greater reactogenicity has been reported [53]. Thus, we performed a subgroup analysis focusing on participants with influenza vaccination only. This analysis did not reveal significant changes in the odds ratios of reporting local or systemic reactions, as well as outpatient and inpatient consultations.

Participants in our survey tended to be younger than would be expected based on vaccination recommendations, presumably due to an age-related digital divide in the sense of a selection bias. As higher reactogenicity after vaccination against SARS-CoV-2 in younger patients has been reported before [54], we assume that we tend to overestimate the reactogenicity of some vaccinations. However, we could hardly find any data on age-related reactogenicity after other than SARS-CoV-2 vaccinations. We also consider the possibility of survivor bias, which means that very rare but fatal health problems may be underrepresented in our data.

One of the strengths of the survey is the reporting of adverse events by the participants themselves, i.e. patient-reported outcome measures. As the data basis does not consist of medical reports but of self-reports, this survey allows for a direct and unmediated comparison of the frequency of reactions and medical consultations. However, due to this direct reporting by patients, it must be considered that non-response bias might lead to a skewing of the results and are therefore subject to uncertainty.

Conclusions

Participants in the SARS-CoV-2 vaccination group were more likely to report local and systemic side effects 14 days after their vaccination than those in the comparator group. However, 16 weeks later, there was no higher reporting of seeking medical consultations in the SARS-CoV-2 vaccination group. Patients who had received ChAdOx1 at least once even reported significantly fewer outpatient and inpatient consultations than the comparator group. Adverse events and medical consultations were reported significantly more frequently by women, younger people and people with pre-existing medical conditions.

Availability of data and materials

Aggregated data that support the findings of this study are available from the corresponding author for researchers who provide a methodologically sound proposal after consent of the data protection supervisor.

Abbreviations

Ad26.COV2.S:

Jcovden® (Janssen-Cilag)

BMI:

Body mass index

BNT162b2:

Comirnaty® (INN Tozinameran; BioNTech/Pfizer)

ChAdOx1:

Vaxzevria® (AstraZeneca/Oxford University)

CoVaKo:

Corona Vakzin Konsortium (Corona Vaccine Consortium)

COVID-19:

Coronavirus disease 2019

mRNA:

Messenger ribonucleic acid

mRNA-1273:

SpikeVax® (INN Elasomeran; Moderna)

m-SCQ-D:

Self-Administered Comorbidity Questionnaire, modified German version

REDCap:

Research Electronic Data Capture

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus type 2

STROBE:

Strengthening the Reporting of Observational studies in Epidemiology

TBE:

Tick-borne encephalitis

Td:

Tetanus and diphtheria

TdaP(-IPV):

Tetanus, diphtheria, pertussis and polio

WHO:

World Health Organization

References

  1. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan China. Lancet. 2020;395(10223):497–506.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N Engl J Med. 2021;384(5):403–16.

    Article  CAS  PubMed  Google Scholar 

  3. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine. N Engl J Med. 2020;383(27):2603–15.

    Article  CAS  PubMed  Google Scholar 

  4. Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet. 2021;397(10269):99–111.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Final analysis of efficacy and safety of single-dose Ad26.COV2.S. N Engl J Med. 2022;386(9):847–60.

  6. European Centre for Disease Prevention and Control. Overview of the implementation of COVID-19 vaccination strategies and deployment plans in the EU/EEA. 8 September 2022. Stockholm: ECDC; 2022.

  7. Troiano G, Nardi A. Vaccine hesitancy in the era of COVID-19. Public Health. 2021;194:245–51.

    Article  CAS  PubMed  Google Scholar 

  8. Greinacher A, Thiele T, Warkentin TE, Weisser K, Kyrle PA, Eichinger S. Thrombotic thrombocytopenia after ChAdOx1 nCov-19 vaccination. N Engl J Med. 2021;384(22):2092–101.

    Article  CAS  PubMed  Google Scholar 

  9. Bautista García J, Peña Ortega P, Bonilla Fernández JA, Cárdenes León A, Ramírez Burgos L, Caballero DE. Acute myocarditis after administration of the BNT162b2 vaccine against COVID-19. Rev Esp Cardiol (Engl Ed). 2021;74(9):812–4.

    Article  PubMed  Google Scholar 

  10. Behers BJ, Patrick GA, Jones JM, Carr RA, Behers BM, Melchor J, et al. Myocarditis following COVID-19 vaccination: a systematic review of case reports. Yale J Biol Med. 2022;95(2):237–47.

    CAS  PubMed  PubMed Central  Google Scholar 

  11. Geoghegan S, O’Callaghan KP, Offit PA. Vaccine safety: myths and misinformation. Front Microbiol. 2020;11:372.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Löffler P. Review: Vaccine myth-buster - cleaning up with prejudices and dangerous misinformation. Front Immunol. 2021;12: 663280.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Larson HJ, de Figueiredo A, Xiahong Z, Schulz WS, Verger P, Johnston IG, et al. The state of vaccine confidence 2016: global insights through a 67-country survey. EBioMedicine. 2016;12:295–301.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Lazarus JV, Ratzan SC, Palayew A, Gostin LO, Larson HJ, Rabin K, et al. A global survey of potential acceptance of a COVID-19 vaccine. Nat Med. 2021;27(2):225–8.

    Article  CAS  PubMed  Google Scholar 

  15. Überla K. Course of COVID-19 in vaccinated and unvaccinated individuals [Internet]. Köln, Bundesinstitut für Arzneimittel und Medizinprodukte; 2021. Available from: https://drks.de/search/de/trial/DRKS00024739. [cited 2023 March].

  16. Sebastiao M. CoVaKo: Active recording of adverse events after COVID-19 vaccination [Internet]. Köln, Bundesinstitut für Arzneimittel und Medizinprodukte; 2021. Available from: https://drks.de/search/de/trial/DRKS00025373. [cited 2023 March].

  17. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(7624):806–8.

    Article  Google Scholar 

  18. Zeschick N, Warkentin L, Kühlein T, Steininger P, Überla K, Hueber S, et al. Active monitoring of adverse reactions following COVID-19 and other vaccinations: a feasibility study as part of the CoVaKo project. Pilot Feasibility Stud. 2022;8(1):134.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Sebastiao M. CoVaKo: Active recording of adverse events after COVID-19 vaccination (Feasability Study)[Internet]. Köln, Bundesinstitut für Arzneimittel und Medizinprodukte; 2021. Available from: https://drks.de/search/de/trial/DRKS00025881. [cited 2023 March].

  20. Clopper CJ, Pearson ES. The use of confidence of fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26(4):404–13.

    Article  Google Scholar 

  21. Streibelt M, Schmidt C, Brünger M, Spyra K. Comorbidity from the patient perspective - does it work? Validity of a questionnaire on self-estimation of comorbidity (SCQ-D). Orthopade. 2012;41(4):303–10.

    Article  CAS  PubMed  Google Scholar 

  22. Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum. 2003;49(2):156–63.

    Article  PubMed  Google Scholar 

  23. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

    Article  PubMed  Google Scholar 

  24. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95: 103208.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Bender FL, Rief W, Wilhelm M. Really just a little prick? A meta-analysis on adverse events in placebo control groups of seasonal influenza vaccination RCTs. Vaccine. 2023;41(2):294–303.

    Article  CAS  PubMed  Google Scholar 

  26. Loew-Baselli A, Konior R, Pavlova BG, Fritsch S, Poellabauer E, Maritsch F, et al. Safety and immunogenicity of the modified adult tick-borne encephalitis vaccine FSME-IMMUN®: Results of two large phase 3 clinical studies. Vaccine. 2006;24(24):5256–63.

    Article  CAS  PubMed  Google Scholar 

  27. Loew-Baselli A, Poellabauer E-M, Pavlova BG, Fritsch S, Koska M, Bobrovsky R, et al. Seropersistence of tick-borne encephalitis antibodies, safety and booster response to FSME-IMMUN® 0.5 ml in adults aged 18–67 years. Hum Vaccin. 2009;5(8):551–6.

  28. Gagliardi AM, Andriolo BN, Torloni MR, Soares BG, de Oliveira Gomes J, Andriolo RB, et al. Vaccines for preventing herpes zoster in older adults. Cochrane Database Syst Rev. 2019;2019(11):1–116.

  29. Cunningham AL, Lal H, Kovac M, Chlibek R, Hwang S-J, Díez-Domingo J, et al. Efficacy of the herpes zoster subunit vaccine in adults 70 years of age or older. N Engl J Med. 2016;375(11):1019–32.

    Article  CAS  PubMed  Google Scholar 

  30. Lal H, Cunningham AL, Godeaux O, Chlibek R, Diez-Domingo J, Hwang S-J, et al. Efficacy of an adjuvanted herpes zoster subunit vaccine in older adults. N Engl J Med. 2015;372(22):2087–96.

    Article  PubMed  Google Scholar 

  31. Halperin SA, Donovan C, Marshall GS, Pool V, Decker MD, Johnson DR, et al. Randomized controlled trial of the safety and immunogenicity of revaccination with tetanus-diphtheria-acellular pertussis vaccine (Tdap) in adults 10 years after a previous dose. J Pediatric Infect Dis Soc. 2019;8(2):105–14.

    Article  PubMed  Google Scholar 

  32. Kovac M, Kostanyan L, Mesaros N, Kuriyakose S, Varman M. Immunogenicity and safety of a second booster dose of an acellular pertussis vaccine combined with reduced antigen content diphtheria-tetanus toxoids 10 years after a first booster in adolescence: An open, phase III, non-randomized, multi-center study. Hum Vaccin Immunother. 2018;14(8):1977–86.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Jackson LA, Gurtman A, van Cleeff M, Jansen KU, Jayawardene D, Devlin C, et al. Immunogenicity and safety of a 13-valent pneumococcal conjugate vaccine compared to a 23-valent pneumococcal polysaccharide vaccine in pneumococcal vaccine-naive adults. Vaccine. 2013;31(35):3577–84.

    Article  CAS  PubMed  Google Scholar 

  34. Amanzio M, Mitsikostas DD, Giovannelli F, Bartoli M, Cipriani GE, Brown WA. Adverse events of active and placebo groups in SARS-CoV-2 vaccine randomized trials: a systematic review. Lancet Reg Health Eur. 2022;12: 100253.

    Article  PubMed  Google Scholar 

  35. Amanzio M, Cipriani GE, Bartoli M. How do nocebo effects in placebo groups of randomized controlled trials provide a possible explicative framework for the COVID-19 pandemic? Expert Rev Clin Pharmacol. 2021;14(4):439–44.

    Article  CAS  PubMed  Google Scholar 

  36. MacKrill K. Impact of media coverage on side effect reports from the COVID-19 vaccine. J Psychosom Res. 2023;164: 111093.

    Article  PubMed  Google Scholar 

  37. Nichol KL, Lind A, Margolis KL, Murdoch M, McFadden R, Hauge M, et al. The effectiveness of vaccination against influenza in healthy, working adults. N Engl J Med. 1995;333(14):889–93.

    Article  CAS  PubMed  Google Scholar 

  38. D’Alessandro D, Ciriminna S, Rossini A, Bossa MC, Fara GM. Requests of medical examinations after pneumococcal & influenza vaccination in the elderly. Indian J Med Res. 2004;119(Suppl):108–14.

    PubMed  Google Scholar 

  39. Nohl A, Brune B, Weichert V, Standl F, Stang A, Dudda M. COVID-19: Vaccination side effects and sick leave in frontline healthcare-workers. a web-based survey in Germany. Vaccines (Basel). 2022;10(3):1–12.

  40. Niekrens V, Esse J, Held J, Knobloch CS, Steininger P, Kunz B, et al. Homologous COVID-19 BNT162b2 mRNA vaccination at a German tertiary care university hospital: a survey-based analysis of reactogenicity, safety, and inability to work among healthcare workers. Vaccines (Basel). 2022;10(5):1–14.

  41. Shapiro Ben David S, Shamir-Stein N, Baruch Gez S, Lerner U, Rahamim-Cohen D, Ekka Zohar A. Reactogenicity of a third BNT162b2 mRNA COVID-19 vaccine among immunocompromised individuals and seniors - a nationwide survey. Clin Immunol. 2021;232:108860.

  42. Hunt K, Ford G, Harkins L, Wyke S. Are women more ready to consult than men? Gender differences in family practitioner consultation for common chronic conditions. J Health Serv Res Policy. 1999;4(2):96–100.

    Article  CAS  PubMed  Google Scholar 

  43. Hunt K, Adamson J, Hewitt C, Nazareth I. Do women consult more than men? A review of gender and consultation for back pain and headache. J Health Serv Res Policy. 2011;16(2):108–17.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Adamson J, Hunt K, Nazareth I. The influence of socio-demographic characteristics on consultation for back pain–a review of the literature. Fam Pract. 2011;28(2):163–71.

    Article  PubMed  Google Scholar 

  45. Menni C, Klaser K, May A, Polidori L, Capdevila J, Louca P, et al. Vaccine side-effects and SARS-CoV-2 infection after vaccination in users of the COVID Symptom Study app in the UK: a prospective observational study. Lancet Infect Dis. 2021;21(7):939–49.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Pfrommer LR, Schoeps M, Blettner M, Wollschläger D, Herm-Stapelberg N, Mittnacht L, et al. Self-reported reactogenicity after different COVID-19 vaccination regimens. Dtsch Arztebl Int. 2022;119(43):727–34.

    PubMed  Google Scholar 

  47. Flanagan KL, Fink AL, Plebanski M, Klein SL. Sex and gender differences in the outcomes of Vaccination over the life course. Annu Rev Cell Dev Biol. 2017;33(1):577–99.

    Article  CAS  PubMed  Google Scholar 

  48. Cook IF, Pond D, Hartel G. Comparative reactogenicity and immunogenicity of 23 valent pneumococcal vaccine administered by intramuscular or subcutaneous injection in elderly adults. Vaccine. 2007;25(25):4767–74.

    Article  CAS  PubMed  Google Scholar 

  49. Nichol KL, Margolis KL, Lind A, Murdoch M, McFadden R, Hauge M, et al. Side effects associated with influenza vaccination in healthy working adults. A randomized, placebo-controlled trial. Arch Intern Med. 1996;156(14):1546–50.

  50. Su JR, Moro PL, Ng CS, Lewis PW, Said MA, Cano MV. Anaphylaxis after vaccination reported to the vaccine adverse event reporting system, 1990–2016. J Allergy Clin Immunol. 2019;143(4):1465–73.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Klein SL, Pekosz A. Sex-based biology and the rational design of influenza vaccination strategies. J Infect Dis. 2014;209(Suppl 3):S114–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Green MS, Peer V, Magid A, Hagani N, Anis E, Nitzan D. Gender differences in adverse events following the Pfizer-BioNTech COVID-19 vaccine. Vaccines (Basel). 2022;10(2):1–12.

  53. Hervé C, Laupèze B, Del Giudice G, Didierlaurent AM, Tavares Da Silva F. The how’s and what’s of vaccine reactogenicity. NPJ Vaccines. 2019;4(1):39.

  54. Nachtigall I, Bonsignore M, Hohenstein S, Bollmann A, Günther R, Kodde C, et al. Effect of gender, age and vaccine on reactogenicity and incapacity to work after COVID-19 vaccination: a survey among health care workers. BMC Infect Dis. 2022;22(1):291.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank all participants filling out the surveys as well as the staff at the vaccination centres and primary care practices. We thank Carolin Nürnberger for assisting in the data collection and Pascal Zrenner for his much-appreciated support in preparing the data. We would like to thank the Bavarian Ministry of Science and Art (“Bayerisches Staatsministerium für Wissenschaft und Kunst”). We acknowledge financial support by Deutsche Forschungsgemeinschaft and Friedrich-Alexander-Universität Erlangen-Nürnberg within the funding programme “Open Access Publication Funding”. Open Access publication is supported by the Interdisciplinary Center for Clinical Research (IZKF) at the University Hospital of the University of Erlangen-Nuremberg (Clinician Scientist Programm).

The present work was performed in (partial) fulfilment of the requirements for obtaining the degree “Dr. med.” for FW.

Funding

Open Access funding enabled and organized by Projekt DEAL. The study is funded by the Bavarian Ministry of Science and Art (https://www.stmwk.bayern.de/). Open Access funding enabled and organised by Projekt DEAL. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

SH, LW, NZ, MS, TK, PS, and KÜ designed the study. SH, LW, NZ, and MS were responsible for data collection. IK, SH, and LW were involved in preparing the data. IK and LW verified it. IK analysed the data. SH, LW, FW, NZ, MS, PS, TK, and KÜ contributed to the interpretation of the data. KÜ initiated the study and acquired the funding for the study. SH, LW and FW drafted the manuscript. All authors revised it critically and approved the final version for publication.

Corresponding author

Correspondence to Felix Werner.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of the Friedrich-Alexander University approved the study (47_21 B, 01.03.2021 and 161_21 B, 12.05.2021). All participants gave their informed consent.

Consent for publication

Not applicable.

Competing interests

LW and NZ own(ed) stocks of BioNTech, the investments were made before being involved in the project. The authors declare that they have no further competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Werner, F., Zeschick, N., Kühlein, T. et al. Patient-reported reactogenicity and safety of COVID-19 vaccinations vs. comparator vaccinations: a comparative observational cohort study. BMC Med 21, 358 (2023). https://doi.org/10.1186/s12916-023-03064-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-023-03064-6

Keywords