Skip to main content
Download PDF

Placebo response and effect in randomized clinical trials: meta-research with focus on contextual effects

Trials volume 22, Article number: 493 (2021) Cite this article

Abstract

Background

Contextual effects (i.e., placebo response) refer to all health changes resulting from administering an apparently inactive treatment. In a randomized clinical trial (RCT), the overall treatment effect (i.e., the post-treatment effect in the intervention group) can be regarded as the true effect of the intervention plus the impact of contextual effects. This meta-research was conducted to examine the average proportion of the overall treatment effect attributable to contextual effects in RCTs across clinical conditions and treatments and explore whether it varies with trial contextual factors.

Methods

Data was extracted from trials included in the main meta-analysis from the latest update of the Cochrane review on “Placebo interventions for all clinical conditions” (searched from 1966 to March 2008). Only RCTs reported in English having an experimental intervention group, a placebo comparator group, and a no-treatment control group were eligible.

Results

In total, 186 trials (16,655 patients) were included. On average, 54% (0.54, 95%CI 0.46 to 0.64) of the overall treatment effect was attributable to contextual effects. The contextual effects were higher for trials with blinded outcome assessor and concealed allocation. The contextual effects appeared to increase proportional to the placebo effect, lower mean age, and proportion of females.

Conclusion

Approximately half of the overall treatment effect in RCTs seems attributable to contextual effects rather than to the specific effect of treatments. As the study did not include all important contextual factors (e.g., patient-provider interaction), the true proportion of contextual effects could differ from the study’s results. However, contextual effects should be considered when assessing treatment effects in clinical practice.

Trial registration

PROSPERO CRD42019130257. Registered on April 19, 2019.

Peer Review reports

Background

The importance of patients’ expectations, emotions, and clinical context in medical practice should not be ignored, but their impact on health care outcomes has only recently been evaluated [1,2,3,4,5,6]. Patients’ expectations and memories, the place in which the treatment is delivered, and the interaction between the patient and provider are just some of many factors in a “therapeutic environment” that can affect the treatment outcome [7, 8] and are linked to the placebo response [1, 7].

The Society for Interdisciplinary Placebo Studies defines placebo effects as changes specifically attributable to placebo mechanisms (e.g., the neurobiological and psychological mechanisms of expectations), whereas placebo response refers to all health changes resulting from administering an inactive treatment, including regression towards the mean and natural course of the disease [9]. Hence, the placebo response includes the placebo effect and is also referred to as contextual effects; see Fig. 1.

Fig. 1
figure 1

Explanatory diagram illustrating the contribution of the placebo effect and placebo response relative to the estimated effect of active treatment

Full size image

Because any positive health change is of importance to patients, clinicians should acknowledge both the placebo effect (i.e. in research) and the placebo response (i.e. in practice). In clinical trials, the difference between the group receiving the experimental intervention and the placebo (comparator) group indicates the strength of the active treatment (i.e., net benefit). By looking only at the difference between these two groups, the clinical impact of the placebo response (i.e., the contextual effects) gets overlooked [10]. This omission can result in an ‘efficacy paradox’—a discrepancy between treatment effects reported in randomized clinical trials (RCTs), and the overall treatment effect experienced by patients and observed in clinical practice [11].

Contextual effects have been quantified by using the proportional contextual effect (PCE)—the proportion of the overall treatment effect attributable to contextual effects [12]. While the net benefit remains an important goal for any randomized trial, a shift in focus to the overall benefit and the PCE would mitigate the efficacy paradox and highlight the contribution of contextual effects, both in research and clinical practice.

Our primary objective of this meta-epidemiological study was to examine the average proportion of the overall treatment effect that may be explained as contextual effects, in an attempt to address the aforementioned “efficacy paradox” [10, 11]. Our secondary objective was to examine whether the contextual effects differ for different contextual factors; i.e., factors related to study design, type of intervention, and patients included. Our third objective was to explore the association between the contextual effects and placebo effect.

Methods

Study selection, assessment of eligibility criteria, data extraction, and statistical analysis were performed based on a predefined protocol (PROSPERO registration no. CRD42019130257, Additional file 1), in accordance with the methodology guidelines from Cochrane. The findings are reported according to the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) statement [13] (Additional file 2).

Data sources and searches

Only trials included in the latest update of the Cochrane review “Placebo interventions for all clinical conditions” by Hróbjartsson and Gøtzsche [14] were considered eligible, and therefore, no new literature search was performed [15, 16].

Study selection

Only randomized trials having an experimental intervention group, a placebo comparator group, and a no-treatment (control) group were considered eligible. As in the original meta-analysis [14, 17], participants were patients with any somatic or psychiatric disease or symptoms. Besides the exclusion criteria described in detail in the Cochrane review [14], trials without an intervention group and trials written in languages other than English were excluded.

Data collection process and data items

A data-extraction form was developed for data collection. One reviewer (S.H.H.) extracted data and selected the outcome of interest based on the description in the Cochrane review [14]. A second reviewer (R.C) was consulted when necessary, and doubts were discussed to consensus. The extracted data included the year of publication, study design, number of participants randomized and analyzed, baseline characteristics (average age, proportion of women, diagnosis, chronic or non-chronic condition), time of outcome measurement, type of placebo (pharmacological, physical, or psychological), experimental and no-treatment intervention and primary outcome.

Further, the type of outcome was categorized in (i) patient-reported outcomes (e.g., pain); (ii) observable patient-reported outcomes (e.g., vomiting); (iii) observer-reported outcomes dependent on cooperation of the patient (e.g., forced expiratory volume); (iv) observer-reported outcomes not dependent on patient cooperation (e.g., blood pressure); and (v) laboratory data (e.g., hemoglobin concentration). Other extracted information included dropout rate; blinding of participants, providers, and observers; allocation concealment; settings (i.e., single-center or multicenter); and information given to participants (i.e., whether participants were informed that the trial involved a placebo intervention). End-of-treatment data were preferred over follow-up data to reduce bias due to patients leaving the primary trial and effects consequentially diminishing. Change from baseline was preferred, but if only final values were available, these were used. For crossover trials, data were extracted from the first treatment period only, to avoid any carry-over effect. If that was not possible, summary data were used (naively) as if they had been derived from a parallel-group trial.

Risk of bias in individual studies

Risk of bias of the included studies was assessed and compared to those from the original Cochrane review [14]. This approach enabled us to rate the risk of bias in domains from the Cochrane Risk of Bias tool [18] as High, Low, or Unclear risk. In addition, a simple risk-of-bias assessment proposed in the Cochrane review [14] was used, where trials with low risk of bias were defined as fulfilling the three following criteria: (i) adequate concealment of allocation, (ii) dropout rate no more than 15%, and (iii) inclusion of at least 50 patients.

Summary measures

Proportional contextual effect (PCE)

For each trial, the PCE was calculated by dividing the improvement in the placebo control group (∆mC) by the improvement in the experimental intervention (∆mI) group (i.e., PCE=∆mC/∆mI) [19]. For trials with continuous outcomes, the improvement was defined as the mean change from baseline in the group, in the unit of standard deviation (SD). For trials with binary outcomes, improvement was defined as the number of participants improved in each group (placebo: nC, and intervention: nI), divided by the number of participants randomized to that particular group (NC and NI). For trials with more than one relevant experimental intervention group (or placebo group), where all arms were relevant, treatment groups were combined into one group by calculating a weighted mean prior to perform the meta-analysis techniques. The PCE ratio was loge-transformed to normalize the distribution for the analysis and back-transformed for reporting. Theoretically, the PCE should range from 0 to 1, where 0 indicates no contribution from contextual effects while 1 indicates 100% contribution from contextual effects [10].

In trials with continuous outcomes, where either the intervention or placebo group showed no improvement (change score = 0) or worsening (negative score) from baseline, a miniscule effect (i.e., 1% benefit [multiplying by 1.01]) was imputed to enable estimation of the ratio (rather than excluding the trial from the primary analysis). In trials with binary outcomes, where no participants improved in the placebo group, it was not possible to log-transform the PCE. In these cases, we applied a “modified Woolf approach” where 0.5 was added to all cells as if 0.5 participant had improved and corresponding 0.5 participant had worsened, making it possible to include the trial in the primary quantitative synthesis.

Placebo effect in Cochrane review

For our third objective, exploring the association between the PCE and placebo effect, we used the estimates directly from the Cochrane review [14], odds ratio (OR) for binary outcomes, and standardized mean difference (SMD) for continuous outcomes—estimated by comparing the placebo comparator group and the no treatment control group. As a second step, in order to enable a meta-analytic combination of results, these placebo effect results were converted from OR to SMD. This conversion was done by converting the ln(OR) to the corresponding SMD, dividing by 1.81 (i.e.,\( \pi /\sqrt{3} \)), as suggested by Chinn [20].

Data synthesis and analysis

A Restricted Maximum Likelihood (REML) mixed-effects model was applied to combine the loge(PCEs) across trials. To evaluate the degree of heterogeneity, the I2 index was estimated describing the percentage of total variation attributable to heterogeneity [21].

As outlined in the protocol, a number of pre-specified stratified analyses were performed: (i) time of outcome measurement, (ii) type of intervention, (iii) type of outcome, (iv) blinding of participants and treatment providers, (v) blinding of outcome assessor, (vi) allocation concealment, (vii) risk of bias, (viii) information to participants, and (ix) trial settings. Furthermore, the patient’s condition (i.e., chronic or non-chronic) was assessed at trial-level (based on the trial’s eligibility criteria).

Meta-regression analysis (REML models) was conducted involving covariates at trial-level to investigate whether individual covariates could explain heterogeneity (i.e., reduce variability) of the PCE among studies. These variables were (i) patient age, (ii) proportion of females, (iii) sample size, and (iv) year of publication. A meta-regression analysis was also performed to investigate the association between PCE and the corresponding placebo effect (i.e., SMD), as reported in the Cochrane review [14]. Small-study bias was examined using a funnel plot and Egger’s test [22]. Furthermore, based on the various risk-of-bias assessments for each trial, pre-specified exploratory sensitivity analyses were conducted in order to assess whether possible biases could affect the estimates. Trial characteristics, such as overall risk of bias, sample size [23], and trial settings (single-center or multicenter trial) [24], were further used in the pre-specified analyses to evaluate possible bias across studies. P values were obtained as part of the meta-regression analysis; i.e., based on F tests if more than two groups were compared and t tests if only two groups were compared. All statistical tests were performed using STATA/IC 15.1 (Stata Corp LLC, TX, USA).

Results

Search results

All 202 trials included in the main analysis of the Cochrane review by Hróbjartsson and Gøtzsche [14] were screened for inclusion (Fig. 2). Five trials [25,26,27,28,29] were not in English. The remaining 197 trials were read in full text, of which 7 trials [30,31,32,33,34,35,36] did not meet the inclusion criteria. Relevant outcome data were not accessible in 4 trials [37,38,39,40], leaving 186 trials for inclusion in the meta-analysis.

Fig. 2
figure 2

Flow diagram of study selection criteria.

aTrials where either intervention or placebo group showed no improvement or got worse, requiring adjustment in the form of imputation of a small treatment effect

Full size image

Included studies

The included trials were conducted in 23 countries and published between 1961 and 2008, with the majority published after 1994. There were 11 crossover trials [41,42,43,44,45,46,47,48,49,50,51], of which 10 (total of 250 patients) had no data available from the first period only, and thus were handled as parallel trials by using summary data (ignoring the design). There were 54 trials (total of 5,160 patients) having more than three arms. In 18 of those [52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69], one or more additional arms were disregarded (a total of 796 patients) in order to calculate the PCE for groups that had comparable interventions. In the remaining 36 trials with more than three arms, all arms were relevant and therefore included which left a total number of 16,655 patients for the meta-analysis.

Trial characteristics are summarized in Table 1. The mean age of participants ranged from 0 (infants) to 83.8 years, with an average mean age of 39.9 years (age was not reported in 11 trials). The percentage of females ranged from 0 to 100, with mean percentage of 58.6 (female/male proportions was not reported in 23 trials). Patients included in the trials had a broad spectrum of conditions, such as depression, hypertension, obesity, or headaches. Pain was the most common outcome measure (reported in 53 trials). Other frequent measures were for anxiety, medication use, smoking cessation, and nausea. Interventions were categorized into three types: pharmacological (e.g., medication or supplements given orally or via injection/inhalation), physical (e.g., acupuncture or transcutaneous electrical nerve stimulation), and psychological (e.g., cognitive therapy or hypnosis). In 22 trials, patients were not informed that the study involved placebo. There were 97 single-center trials and 33 multicenter trials (unclear in 56 studies). Explicit trial characteristics are presented in Additional file 3.

Table 1 Summary of trial characteristics
Full size table

Risk of bias within studies

Methodological characteristics were assessed by Hróbjartsson and Gøtzsche [14] and are listed in detail in the original Cochrane review. In summary, adequate sequence generation was reported in 39 trials (21%); 28 trials (15%) reported adequate concealment of allocation; 59 trials (32%) were judged to have adequate blinding of patients and providers; and 81 trials (44%) to have adequate blinding of outcome assessor. Overall, 81 trials (44%) had a sample size of at least 50 patients, and 80 trials (43%) had a dropout rate of 15% or lower. Following the simple risk-of-bias assessment proposed in the Cochrane review, 16 trials [70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85] (9%) fulfilled all three criteria and were therefore judged as having low risk of bias among the included trials.

Proportional contextual effect

As illustrated in Additional file 4, there was a considerable degree of heterogeneity across PCE’s from various trials (I2=93.6). The pooled PCE across all 186 trials corresponded to 54% of the observed effect (0.54, 95%CI 0.46 to 0.64). There was statistically significantly higher PCE in trials with pharmacological and physical interventions, compared to psychological, and PCE was non-significantly higher for patient-involved outcomes (patient-reported outcomes and observer-reported outcomes dependent on patient cooperation). Trials where patients were not informed that the study involved placebo had non-significantly higher PCE. Trials with binary outcomes had statistically non-significant, but potentially higher PCE’s compared to trials with continuous outcomes. None of these factors, however, explained much of the observed heterogeneity. Publication year and sample size did not have any effect on heterogeneity either, and no association was found with PCE (see Additional file 5). There was a significant association between PCE and mean age and percentage of females, where PCE decreased with higher mean age of participants (slope = 0.986; 95%CI 0.976 to 0.995) and increased with higher percentage of females (slope = 1.006; 95%CI 1.000 to 1.012). However, only the proportion of females in the trial populations seemed to explain some of the between-study variance (reduction in τ2 = 14.1%, I2 = 92.5); see Table 2.

Table 2 Results from random-effect meta-analysis and meta-regression analysis
Full size table

Neither patient’s condition/diagnosis (e.g., fibromyalgia, cancer, smoking; increase in τ2 = 4.5%, I2 = 93.8) nor outcome domain (e.g., pain, nausea, smoking cessation; increase in τ2 = 0.7%, I2 = 93.5) was an important factor in reducing the between-study variance. However, whether the condition was chronic or not reduced between-study variance slightly (slope = 0.69; 95%CI 0.49 to 0.96; reduction in τ2 = 3.0%); chronic conditions had a significantly lower PCE.

Proportional contextual effects and placebo effect

As illustrated in Fig. 3, there was an association between PCE and the corresponding placebo effect, estimated as SMD and reported in the Cochrane review [14], where PCE increased with an increasing placebo effect (slope = 1.55; 95%CI 1.07 to 2.24).

Fig. 3
figure 3

Meta-regression plot illustrating the association between the PCE and the placebo effect (SMD). Larger SMD indicates a larger placebo effect. (k = 186). PCE, proportional contextual effect; SMD, standardized mean difference

Full size image

Risk of bias across studies

The risk of small-study bias across trials was assessed using funnel plot, followed by Egger’s test [22]. The funnel plot was asymmetrical (Fig. 4), which Egger’s test confirmed (p < 0.001). Small studies tended to show smaller PCE. Furthermore, the funnel plot showed a vertical line of points (ln[PCE] = − 4.6) that indicated the trials where either the intervention group or the placebo group showed no improvement or got worse, requiring adjustment in the form of the described imputation of a small treatment effect. For sensitivity, when comparing the fixed-effect estimate for the PCE to the random-effects estimate, the PCE increased from 0.54 (95%CI 0.46 to 0.64) to 0.82 (95%CI 0.80 to 0.83). This indicates a discrepancy between random and fixed-effect models. However, a subsequent visual inspection of the funnel plot did not indicate an important small study bias.

Fig. 4
figure 4

Funnel plot of all trials included in the main meta-analysis (k = 186). The vertical line shows the average effect size. The median SE(ln[PCE]) is 0.27; i.e., SE(ln[PCE]) larger than this are “smaller studies.” PCE, proportional contextual effect

Full size image

When conducting the pre-specified sensitivity analyses according to the risk-of-bias assessment, the blinding of the outcome assessor was the most important factor, being associated with a significantly higher PCE. Furthermore, the PCE was significantly higher in trials with concealed allocation, and there was a non-significant increased PCE in trials with an overall low risk of bias. Neither trial setting (single-center or multicenter) nor sample size had an important effect on PCE or explained much of the reported heterogeneity, with blinding of outcome assessor apparently being the most important factor (reduction in τ2 = 5.8%).

What influenced the heterogeneity the most were the 18 trials [41, 46, 48, 86,87,88,89,90,91,92,93,94,95,96,97,98,99,100] (including 890 patients) where either the intervention or placebo group showed no improvement or got worse; these trials required imputing a very small treatment effect in order to calculate PCE so they could be included in the meta-analysis (reduction in τ2 = 80.6%, I2 = 84.4). Due to this imputation technique, a sensitivity analysis was performed where the aforementioned 18 trials were excluded.

Sensitivity analysis

A meta-analysis of the remaining 168 studies (total of 15,765 patients) resulted in PCE of 0.72 (95%CI 0.67 to 0.79), τ2 = 0.2080, and a slightly lower heterogeneity (I2 = 85.7). Many of the trends apparent in the main analysis (e.g., higher PCE in trials with concealed allocation) diminished or disappeared (see Additional file 6). Ten of the 18 excluded trials had psychological interventions [87,88,89,90, 92, 93, 95, 97, 99, 100], which led to a radical shift in PCE for the remaining trials with psychological interventions. This shift in PCE, in turn, led to a non-significantly higher PCE in trials with physical interventions compared to pharmacological and psychological interventions. The PCE was still higher in trials with concealed allocation, blinded outcome assessor, and overall low risk of bias, but only the blinding of outcome assessor resulted in significantly higher PCE (slope = 1.22; 95%CI 1.03 to 1.44). The significantly higher PCE in trials of non-chronic conditions diminished and was no longer significant. None of these factors were important in explaining the between-study variance. Neither sample size, publication year, whether trials had binary or continuous outcomes, mean age of participants, nor percentage of females seemed to have any effect on heterogeneity, and no association was found with PCE in the sensitivity analyses.

For the sensitivity analysis of the association between PCE and placebo effect, an additional five trials with binary outcomes were excluded because in these trials, no improvement was seen in the no-treatment group. In order to be eligible for inclusion in the synthesis, these trials needed adjustment (0.5 added to each cell of the 2 × 2 table) prior to calculating the OR, and afterwards SMD. The association found earlier between PCE and placebo effect diminished and was non-significant after the exclusion of all 23 trials that needed adjustment. The association between PCE and placebo effect (SMD) for the sensitivity analysis is illustrated in Fig. 5.

Fig. 5
figure 5

Meta-regression plot. Meta-regression plot, illustrating association between the PCE and the placebo effect (SMD) after exclusion of the 23 trials that needed adjustment prior to analysis. Larger SMD indicates a larger placebo effect (k = 163). PCE, proportional contextual effect

Full size image

A new funnel plot and Egger’s test was conducted for the remaining 163 trials in the sensitivity analysis, which also resulted in an asymmetrical funnel plot (Additional file 7; Egger´s test, p < 0.001), suggesting that small studies report smaller PCE.

Discussion

Summary of the evidence

This study shows, based on 186 trials, that the majority (average PCE: 54%) of the overall treatment effect of diverse interventions across conditions was attributable to contextual effects. Several contextual factors and trial characteristics were found to impact the observed variation in PCE. The factors that increased the PCE, and thus are potentially valuable, were adequate allocation concealment, blinded outcome assessor, lower mean age of participants, higher proportion of females, larger placebo effect, and trials of non-chronic conditions. As anticipated the PCE was higher in trials with low risk of bias and using patient-reported outcomes. The proportion of females was the only pre-specified covariate that significantly reduced the between-study variance; other factors had only minimal impact on the between-study variance.

The sensitivity analysis showed insignificant variation of PCE for the most part; only blinding of outcome assessor remained significant. No factors were found to significantly reduce the between-study variance, and no association was found between PCE and mean age, percentage of females, or placebo effects, respectively.

Our findings support those reported in earlier PCE study by Zou et al. [12], who also found larger PCE in studies with concealed allocation. Neither study could explain, however, whether this is due to greater contextual effects or smaller experimental (intervention group) effects. Also, our findings support those found by Whiteside et al. [19], who reported an increase in PCE with higher proportions of females. There are, however, two crucial differences between this study and previous PCE studies. First, the two previous studies examined a single condition, (osteoarthritis [12] and fibromyalgia [19]), where the primary outcome was pain. Second, both studies excluded trials where one or more groups did not improve or even worsened. Due to these exclusions, it might be more appropriate to compare the findings from the sensitivity analysis in this study to the previous PCE studies. The overall PCEs reported in previous studies are similar to the findings from the present sensitivity analysis (75% in osteoarthritis and 60% in fibromyalgia compared to 72% in the present study). Zou et al. [12] reported the lowest PCE for treatments delivered with oral medications and higher PCE for treatments delivered via physical means and needles/injections. In the present sensitivity analysis, there was also insignificantly higher PCE in physical interventions compared to pharmacological. The categories in this study, however, cover a broader range of interventions than the categories used by Zou et al. [12]; nevertheless, our study generally corroborates earlier findings. We found that there was a direct association between PCE and the placebo effect reported in the Cochrane review [14]. This association, however, was not apparent in the sensitivity analysis, meaning that the PCE was constant even though the placebo effect diminished.

There are several similarities between the findings in the Cochrane review [14] and the findings in this study. The Cochrane review reported a larger placebo effect in trials with patient-reported outcomes, in trials where patients were falsely informed that no placebo was involved in the study, and in trials with concealed allocation. Similar results were seen in the sensitivity analysis in the present study, where trials with patient-reported outcomes suggested a higher PCE compared to outcomes not dependent on patient involvement. Trials with concealed allocation had significantly higher PCE in the main analysis but not in the sensitivity analysis. These similarities between PCE and placebo effect reported in the Cochrane review indicate that the difference between the improvements seen in the intervention and placebo groups is less prominent in studies with a large placebo effect.

Limitations

A major limitation of this study was the inclusion of studies with high risk of bias, mainly due to lack of sequence generation and allocation concealment in 79% and 85% of trials, respectively. Only 16 trials (9%) out of 186 fulfilled all three predefined criteria for low risk of bias. An updated literature search may have added more studies at low risk of bias, as the majority of the included trials did not describe factors such as sequence generation and allocation concealment adequately. Since there were trends for higher PCE in trials with a low risk of bias this could have affected the outcomes. Furthermore, the meta-analytic methods used did not allow for patient-and clinical-related variables changes over time. Many changes in the patient populations could be experienced in 47 years.

This study correlates with previous studies of bias, reporting that bias due to unblinded assessor or inadequate allocation concealment tends to overestimate treatment effect [101,102,103]. Furthermore, a small-study bias was detected, whereby small-sample studies report smaller PCE. Based on the presence of small-study bias, and that studies with a lower risk of bias tended to have higher PCE, the PCE reported in this study could have been underestimated.

As described above, there was a considerably high degree of heterogeneity, which may have affected our study’s outcomes. Although subgroup analyses were carried out, the heterogeneity remained high, and no factors were able to explain the heterogeneity, except for the 18 trials that needed adjustment prior to analysis. Furthermore, not all the important contextual factors were included in the model. This could lead to uncontrolled confounding in the meta-analytic study, leading to biased effect estimates. Thus, the conclusions claimed in this article could be incorrect. A more in-depth sensitivity analysis would have been helpful to assess the magnitude of these biases. However, many contextual factors that are known to be important, such as the patient-provider interaction and patient’s expectations, were not considered because these factors are rarely reported in RCTs.

In contrast to earlier PCE studies, we decided to also include trials where either the intervention or placebo group showed no improvement or even worsened (i.e., where the PCE became negative). That decision might have been both a strength and a limitation. Earlier PCE studies excluded such trials because the measure of PCE does not allow negative values when the ratio is log-transformed, and worsening in a group could indicate side/nocebo effect, which is not the focus of interest for the PCE [12]. However, we viewed the exclusion of studies that did not fit to the pre-specified hypothesis as a source of bias; we therefore decided to add a miniscule effect to the groups that had not improved, in order to be able to perform the necessary calculations. This was the case for 17 trials with continuous outcomes and one trial with binary outcomes. Afterwards, it was clear these 18 trials had great impact on the results, and it was questionable whether this kind of adjustment was optimal for retaining the trials in our study.

Conclusion

This study suggests that at least half of the overall treatment effect observed in clinical trials across conditions is attributable to contextual effects rather than to the specific experimental intervention on trial. Factors such as blinding of outcome assessor, concealed allocation, lower mean age, and higher proportion of females had the most impact on the PCE. This analysis in our study did not include all known important contextual factors (e.g., patient’s expectations), so the true proportion of contextual effects could have been underestimated. The association between PCE and methodological quality (lower risk of bias) indicates that the true PCE may be higher than estimated. These findings highlight the importance of contextual effects in clinical practice and their large impact on patient care. In reporting of RCTs, it is important to not only focus on the net benefit of a treatment but also to consider the PCE when translating findings from clinical trials to clinical practice. The findings could encourage health care professionals to consider potentially modifiable contextual factors, such as their patient-provider interaction, in any attempt to enhance the overall treatment response to interventions. Contextual effects are important contributors to the overall treatment effect and should be embraced in both clinical trials and practice for their potential benefits to patients.

Availability of data and materials

All data generated or analyzed during this study are included in this published article and its supplementary information files.

Abbreviations

OR:

Odds ratio

PCE:

Proportional contextual effect

PRISMA:

Preferred Reporting Items for Systematic reviews and Meta-Analyses

RCT

Randomized clinical trial

REML

Restricted Maximum Likelihood

SMD:

Standardized mean difference

95% CI

95% confidence interval

References

  1. Di Blasi Z, Harkness E, Ernst E, Georgiou A, Kleijnen J. Influence of context effects on health outcomes: a systematic review. Lancet. 2001;357(9258):757–62. https://doi.org/10.1016/S0140-6736(00)04169-6.

    Article  PubMed  Google Scholar 

  2. Kaptchuk TJ, Friedlander E, Kelley JM, Sanchez MN, Kokkotou E, Singer JP, et al. Placebos without deception: a randomized controlled trial in irritable bowel syndrome. PLoS One. 2010;5(12):e15591. https://doi.org/10.1371/journal.pone.0015591.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Atlas LY, Wager TD. How expectations shape pain. Neurosci Lett. 2012;520(2):140–8. https://doi.org/10.1016/j.neulet.2012.03.039.

    Article  CAS  PubMed  Google Scholar 

  4. Colloca Lab, Miller FGb. Role of expectations in health. Curr Opin Psychiatry. 2011;24(2):149–55.

    Article  Google Scholar 

  5. Amanzio M, Benedetti F. Neuropharmacological dissection of placebo analgesia: expectation-activated opioid systems versus conditioning-activated specific subsystems. J Neurosci. 1999;19(1):484–94. https://doi.org/10.1523/JNEUROSCI.19-01-00484.1999.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Benedetti F, Pollo A, Lopiano L, Lanotte M, Vighetti S, Rainero I. Conscious expectation and unconscious conditioning in analgesic, motor, and hormonal placebo/nocebo responses. J Neurosci. 2003;23(10):4315–23. https://doi.org/10.1523/JNEUROSCI.23-10-04315.2003.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Rossettini G, Carlino E, Testa M. Clinical relevance of contextual factors as triggers of placebo and nocebo effects in musculoskeletal pain. BMC Musculoskelet Disord. 2018;19(1):27. https://doi.org/10.1186/s12891-018-1943-8.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Carlino E, Benedetti F. Different contexts, different pains, different experiences. Neuroscience. 2016;338:19–26. https://doi.org/10.1016/j.neuroscience.2016.01.053.

    Article  CAS  PubMed  Google Scholar 

  9. Evers AWM, Colloca L, Blease C, Annoni M, Atlas LY, Benedetti F, et al. Implications of placebo and nocebo effects for clinical practice: expert consensus. Psychother Psychosom. 2018;87(4):204–10. https://doi.org/10.1159/000490354.

    Article  PubMed  Google Scholar 

  10. Zhang W, Doherty M. Efficacy paradox and proportional contextual effect (PCE). Clin Immunol. 2018;186:82–6. https://doi.org/10.1016/j.clim.2017.07.018.

    Article  CAS  PubMed  Google Scholar 

  11. Walach H. The efficacy paradox in randomized controlled trials of CAM and elsewhere: beware of the placebo trap. J Altern Complement Med. 2001;7(3):213–8. https://doi.org/10.1089/107555301300328070.

    Article  CAS  PubMed  Google Scholar 

  12. Zou K, Wong J, Abdullah N, Chen X, Smith T, Doherty M, et al. Examination of overall treatment effect and the proportion attributable to contextual effect in osteoarthritis: meta-analysis of randomised controlled trials. Ann Rheum Dis. 2016;75(11):1964–70. https://doi.org/10.1136/annrheumdis-2015-208387.

    Article  PubMed  Google Scholar 

  13. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. https://doi.org/10.1371/journal.pmed.1000100.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hróbjartsson A, Gøtzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev. 2010;(1):CD003974. https://doi.org/10.1002/14651858.CD003974.pub3.

  15. Ioannidis JPA. Meta-research: why research on research matters. PLoS Biol. 2018;16(3):e2005468.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ioannidis JP, Fanelli D, Dunne DD, Goodman SN. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 2015;13(10):e1002264.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Hróbjartsson A, Gøtzsche PC. Is the placebo powerless? N Engl J Med. 2001;344(21):1594–602. https://doi.org/10.1056/NEJM200105243442106.

    Article  PubMed  Google Scholar 

  18. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343(oct18 2):d5928. https://doi.org/10.1136/bmj.d5928.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Whiteside N, Sarmanova A, Chen X, Zou K, Abdullah N, Doherty M, et al. Proportion of contextual effects in the treatment of fibromyalgia-a meta-analysis of randomised controlled trials. Clin Rheumatol. 2018;37(5):1375–82. https://doi.org/10.1007/s10067-017-3948-3.

    Article  PubMed  Google Scholar 

  20. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat Med. 2000;19(22):3127–31. https://doi.org/10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M.

    Article  CAS  PubMed  Google Scholar 

  21. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. https://doi.org/10.1136/bmj.327.7414.557.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34. https://doi.org/10.1136/bmj.315.7109.629.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Dechartres A, Trinquart L, Boutron I, Ravaud P. Influence of trial sample size on treatment effect estimates: meta-epidemiological study. Bmj. 2013;346(apr24 14):f2304. https://doi.org/10.1136/bmj.f2304.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Intern Med. 2011;155(1):39–51. https://doi.org/10.7326/0003-4819-155-1-201107050-00006.

    Article  PubMed  Google Scholar 

  25. Najnigier B, Patkowski W, Zieniewicz K, Nyckowski P, et al. Zofran (ondansectron) in preventing postoperative nausea and vomiting after laparoscopic cholecystectomy [Zofran w zapobieganiu nudnosciom i wymiotom po cholecystektomii laparoskopipwej]. Acta Endoscopica Polona. 1997;7(3):125–8.

    Google Scholar 

  26. Watzl H, Olbrich R, Rist F, Cohen R. Placebo injections and alcohol surveillance in inpatient treatment of alcoholic women: An experimental study of two treatment characteristics [Placebo-injektionen und Alkoholkontrollen in der stationären Behandlung alkoholkranker Frauen - eine experimentalle Untersuchung zweier Behandlungsmerkmale]. Z Klin Psychol. 1986;15(4):333–45.

    Google Scholar 

  27. Chenard JR, Marchand S, Charest J, Jinxue L, et al. Evaluation of a behavioral intervention for chronic low-back pain: 'The interactional back school' [Évaluation d'un traitementcomportmental de la lombalgie chronique: 'I´ école interactionelle du dos']. Science et Comportement. 1991;21(4):225–39.

    Google Scholar 

  28. Kokol R, Berger C, Haas J, Kopera D. Venous leg ulcers: no improvement of wound healing with 685-nm low level laser therapy. Randomised, placebo-controlled, double-blind study. Hautarzt. 2005;56(6):570–5. https://doi.org/10.1007/s00105-004-0864-7.

    Article  CAS  PubMed  Google Scholar 

  29. Tremeau ML, Fontanie-Ravier P, Teurnier F, Demouzon J. Protocol of cervical maturation by acupuncture [Protocole de maturation cervicale par acupuncture]. J Gynecol Obstet Biol Reprod. 1992;21:375–80.

    CAS  Google Scholar 

  30. Rabkin JG, McGrath PJ, Quitkin FM, Tricamo E, Stewart JW, Klein DF. Effects of pill-giving on maintenance of placebo response in patients with chronic mild depression. Am J Psychiatry. 1990;147(12):1622–6. https://doi.org/10.1176/ajp.147.12.1622.

    Article  CAS  PubMed  Google Scholar 

  31. Thomas KB. General practice consultations: is there any point in being positive? Br Med J (Clin Res Ed). 1987;294(6581):1200–2. https://doi.org/10.1136/bmj.294.6581.1200.

    Article  CAS  Google Scholar 

  32. Tyler DB. The influence of a placebo, body position and medication on motion sickness. Am J Physiol. 1946;146(3):458–66. https://doi.org/10.1152/ajplegacy.1946.146.3.458.

    Article  CAS  PubMed  Google Scholar 

  33. Antivalle M, Lattuada S, Salvaggio A, Paravicini M, Rindi M, Libretti A. Placebo effect and adaptation to noninvasive monitoring of BP. J Hum Hypertens. 1990;4(6):633–7.

    CAS  PubMed  Google Scholar 

  34. Asmar R, Boutelant S, Chaignon M, Guedon J, Topouchian J, Mallion JM, et al. Repeated measurement of non-invasive ambulatory blood pressure: distinction between reproducibility and the proper effect of placebo. Blood Press Monit. 1996;1(3):283–8.

    CAS  PubMed  Google Scholar 

  35. Hossmann V, FitzGerald GA, Dollery CT. Influence of hospitalization and placebo therapy on blood pressure and sympathetic function in essential hypertension. Hypertension. 1981;3(1):113–8. https://doi.org/10.1161/01.HYP.3.1.113.

    Article  CAS  PubMed  Google Scholar 

  36. Lee PCL, Jawad MSM, Hull JD, West WHL, Shaw K, Eccles R. The antitussive effect of placebo treatment on cough associated with acute upper respiratory infection. Psychosom Med. 2005;67(2):314–7. https://doi.org/10.1097/01.psy.0000155667.59662.92.

    Article  PubMed  Google Scholar 

  37. Dibble SL, Luce J, Cooper BA, Israel J, Cohen M, Nussey B, et al. Acupressure for chemotherapy-induced nausea and vomiting: a randomized clinical trial. Oncol Nurs Forum. 2007;34(4):813–20. https://doi.org/10.1188/07.ONF.xxx-xxx.

    Article  PubMed  Google Scholar 

  38. May O, Hansen NC. Comparison of terbutaline, isotonic saline, ambient air and non-treatment in patients with reversible chronic airway obstruction. Eur Respir J. 1988;1(6):527–30.

    CAS  PubMed  Google Scholar 

  39. Thomas KS, Muir KR, Doherty M, Jones AC, O'Reilly SC, Bassey EJ. Home based exercise programme for knee pain and knee osteoarthritis: randomised controlled trial. BMJ. 2002a;325(7367):752. https://doi.org/10.1136/bmj.325.7367.752.

  40. Thomas KS, Muir KR, Doherty M, Jones AC, O’Reilly SC, Bassey EJ. Home based exercise programme for knee pain and knee osteoarthritis: randomised controlled trial. BMJ. 2002b;325(7367):752–5.

  41. Blades KJ, Patel S, Aidoo KE. Oral antioxidant therapy for marginal dry eye. Eur J Clin Nutr. 2001;55(7):589–97. https://doi.org/10.1038/sj.ejcn.1601186.

    Article  CAS  PubMed  Google Scholar 

  42. Godfrey S, Silverman M. Demonstration by placebo response in asthma by means of exercise testing. J Psychosom Res. 1973;17(4):293–7. https://doi.org/10.1016/0022-3999(73)90106-2.

    Article  CAS  PubMed  Google Scholar 

  43. Morton AR, Fazio SM, Miller D. Efficacy of laser-acupuncture in the prevention of exercise-induced asthma. Ann Allergy. 1993;70(4):295–8.

    CAS  PubMed  Google Scholar 

  44. Pelham WE, Murphy DA, Vannatta K, Milich R, Licht BG, Gnagy EM, et al. Methylphenidate and attributions in boys with attention-deficit hyperactivity disorder. J Consult Clin Psychol. 1992;60(2):282–92. https://doi.org/10.1037/0022-006X.60.2.282.

    Article  PubMed  Google Scholar 

  45. Roscoe JA, Morrow GR, Bushunow P, Tian L, Matteson S. Acustimulation wristbands for the relief of chemotherapy-induced nausea. Altern Ther Health Med. 2002;8(4):56–7 59-63.

    PubMed  Google Scholar 

  46. Rossi A, Ziacchi V, Lomanto B. The hypotensive effect of a single daily dose of labetalol: a preliminary study. Int J Clin Pharmacol Ther Toxicol. 1982;20(9):438–45.

    CAS  PubMed  Google Scholar 

  47. Rowbotham MC, Davies PS, Verkempinck C, Galer BS. Lidocaine patch: double-blind controlled study of a new treatment method for post-herpetic neuralgia. Pain. 1996;65(1):39–44. https://doi.org/10.1016/0304-3959(95)00146-8.

    Article  CAS  PubMed  Google Scholar 

  48. Sumaya IC, Rienzi BM, Deegan JF 2nd, Moss DE. Bright light treatment decreases depression in institutionalized older adults: a placebo-controlled crossover study. J Gerontol A Biol Sci Med Sci. 2001;56(6):M356–60. https://doi.org/10.1093/gerona/56.6.M356.

    Article  CAS  PubMed  Google Scholar 

  49. Wilcock A, Walton A, Manderson C, Feathers L, El Khoury B, Lewis M, et al. Randomised, placebo controlled trial of nebulised furosemide for breathlessness in patients with cancer. Thorax. 2008;63(10):872–5. https://doi.org/10.1136/thx.2007.091538.

    Article  CAS  PubMed  Google Scholar 

  50. Double DB, Warren GC, Evans M, Rowlands RP. Efficacy of maintenance use of anticholinergic agents. Acta Psychiatr Scand. 1993;88(5):381–4. https://doi.org/10.1111/j.1600-0447.1993.tb03477.x.

    Article  CAS  PubMed  Google Scholar 

  51. Classen W, Feingold E, Netter P. Influence of sensory suggestibility on treatment outcome in headache patients. Neuropsychobiology. 1983;10(1):44–7. https://doi.org/10.1159/000117982.

    Article  CAS  PubMed  Google Scholar 

  52. Steinsbekk A, Bentzen N, Fonnebo V, Lewith G. Self treatment with one of three self selected, ultramolecular homeopathic medicines for the prevention of upper respiratory tract infections in children. A double-blind randomized placebo controlled trial. Br J Clin Pharmacol. 2005;59(4):447–55. https://doi.org/10.1111/j.1365-2125.2005.02336.x.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Hashish I, Hai HK, Harvey W, Feinmann C, Harris M. Reduction of postoperative pain and swelling by ultrasound treatment: a placebo effect. Pain. 1988;33(3):303–11. https://doi.org/10.1016/0304-3959(88)90289-8.

    Article  PubMed  Google Scholar 

  54. Benedetti F, Amanzio M, Maggi G. Potentiation of placebo analgesia by proglumide. Lancet. 1995;346(8984):1231. https://doi.org/10.1016/S0140-6736(95)92938-X.

    Article  CAS  PubMed  Google Scholar 

  55. Biro P, Meier T, Cummins AS. Comparison of topical anaesthesia methods for venous cannulation in adults. Eur J Pain. 1997;1(1):37–42. https://doi.org/10.1016/S1090-3801(97)90051-3.

    Article  CAS  PubMed  Google Scholar 

  56. Fisher P, McCarney R, Hasford C, Vickers A. Evaluation of specific and non-specific effects in homeopathy: feasibility study for a randomised trial. Homeopathy. 2006;95(4):215–22. https://doi.org/10.1016/j.homp.2006.07.006.

    Article  PubMed  Google Scholar 

  57. Frank E, Kupfer DJ, Perel JM, Cornes C, Jarrett DB, Mallinger AG, et al. Three-year outcomes for maintenance therapies in recurrent depression. Arch Gen Psychiatry. 1990;47(12):1093–9. https://doi.org/10.1001/archpsyc.1990.01810240013002.

    Article  CAS  PubMed  Google Scholar 

  58. Mayaux MJ, Guihard-Moscato ML, Schwartz D, Benveniste J, Coquin Y, Crapanne JB, et al. Controlled clinical trial of homoeopathy in postoperative ileus. Lancet. 1988;1(8584):528–9. https://doi.org/10.1016/s0140-6736(88)91314-1.

    Article  CAS  PubMed  Google Scholar 

  59. Heinzl S, Andor J. Preoperative administration of prostaglandin to avoid dilatation-induced damage in first-trimester pregnancy terminations. Gynecol Obstet Invest. 1981;12(1):29–36. https://doi.org/10.1159/000299565.

    Article  CAS  PubMed  Google Scholar 

  60. Helms JM. Acupuncture for the management of primary dysmenorrhea. Obstet Gynecol. 1987;69(1):51–6.

    CAS  PubMed  Google Scholar 

  61. Hong C-Z, Chen Y-C, Pon CH, Yu J. Immediate effects of various physical medicine modalities on pain threshold of an active myofascial trigger point. J Musculoskelet Pain. 1993;1(2):37–53. https://doi.org/10.1300/J094v01n02_04.

    Article  Google Scholar 

  62. Hyland MR, Webber-Gaffney A, Cohen L, Lichtman PT. Randomized controlled trial of calcaneal taping, sham taping, and plantar fascia stretching for the short-term management of plantar heel pain. J Orthop Sports Phys Ther. 2006;36(6):364–71. https://doi.org/10.2519/jospt.2006.2078.

    Article  PubMed  Google Scholar 

  63. Karst M, Winterhalter M, Munte S, Francki B, Hondronikos A, Eckardt A, et al. Auricular acupuncture for dental anxiety: a randomized controlled trial. Anesth Analg. 2007;104(2):295–300. https://doi.org/10.1213/01.ane.0000242531.12722.fd.

    Article  PubMed  Google Scholar 

  64. Levine JD, Gordon NC. Influence of the method of drug administration on analgesic response. Nature. 1984;312(5996):755–6. https://doi.org/10.1038/312755a0.

    Article  CAS  PubMed  Google Scholar 

  65. Lick J. Expectancy, false galvanic skin response feedback, and systematic desensitization in the modification of phobic behavior. J Consult Clin Psychol. 1975;43(4):557–67. https://doi.org/10.1037/h0076894.

    Article  CAS  PubMed  Google Scholar 

  66. Sinaiko AR, Gomez-Marin O, Prineas RJ. Effect of low sodium diet or potassium supplementation on adolescent blood pressure. Hypertension. 1993;21(6, Part 2):989–94.

    Article  CAS  PubMed  Google Scholar 

  67. Sipich JF, Russell RK, Tobias LL. A comparison of covert sensitization and “nonspecific” treatment in the modification of smoking behavior. J Behav Ther Exp Psychiatry. 1974;5(2):201–3. https://doi.org/10.1016/0005-7916(74)90115-3.

    Article  Google Scholar 

  68. Tritrakarn T, Lertakyamanee J, Koompong P, Soontrapa S, Somprakit P, Tantiwong A, et al. Both EMLA and placebo cream reduced pain during extracorporeal piezoelectric shock wave lithotripsy with the Piezolith 2300. Anesthesiology. 2000;92(4):1049–54. https://doi.org/10.1097/00000542-200004000-00023.

    Article  CAS  PubMed  Google Scholar 

  69. Wojciechowski FL. Behavioral treatment of tension headache: a contribution to controlled outcome research methodology. Gedrag. 1984;12(5):16–30.

    Google Scholar 

  70. Alkaissi A, Evertsson K, Johnsson VA, Ofenbartl L, Kalman S. P6 acupressure may relieve nausea and vomiting after gynecological surgery: an effectiveness study in 410 women. Can J Anaesth. 2002;49(10):1034–9. https://doi.org/10.1007/BF03017897.

    Article  PubMed  Google Scholar 

  71. Brinkhaus B, Witt CM, Jena S, Linde K, Streng A, Wagenpfeil S, et al. Acupuncture in patients with chronic low back pain: a randomized controlled trial. Arch Intern Med. 2006;166(4):450–7. https://doi.org/10.1001/archinte.166.4.450.

    Article  PubMed  Google Scholar 

  72. Erdogmus CB, Resch KL, Sabitzer R, Muller H, Nuhr M, Schoggl A, et al. Physiotherapy-based rehabilitation following disc herniation operation: results of a randomized clinical trial. Spine (Phila Pa 1976). 2007;32(19):2041–9. https://doi.org/10.1097/BRS.0b013e318145a386.

    Article  Google Scholar 

  73. Faas A, Chavannes AW, van Eijk JT, Gubbels JW. A randomized, placebo-controlled trial of exercise therapy in patients with acute low back pain. Spine (Phila Pa 1976). 1993;18(11):1388–95. https://doi.org/10.1097/00007632-199318110-00002.

    Article  CAS  Google Scholar 

  74. Foster NE, Thomas E, Barlas P, Hill JC, Young J, Mason E, et al. Acupuncture as an adjunct to exercise based physiotherapy for osteoarthritis of the knee: randomised controlled trial. BMJ. 2007;335(7617):436. https://doi.org/10.1136/bmj.39280.509803.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Kaptchuk TJ, Kelley JM, Conboy LA, Davis RB, Kerr CE, Jacobson EE, et al. Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome. BMJ. 2008;336(7651):999–1003. https://doi.org/10.1136/bmj.39524.439618.25.

    Article  PubMed  PubMed Central  Google Scholar 

  76. Lander J, Fowler-Kerry S. TENS for children's procedural pain. Pain. 1993;52(2):209–16. https://doi.org/10.1016/0304-3959(93)90133-A.

    Article  PubMed  Google Scholar 

  77. Lincoln NB, Flannaghan T. Cognitive behavioral psychotherapy for depression following stroke: a randomized controlled trial. Stroke. 2003;34(1):111–5. https://doi.org/10.1161/01.STR.0000044167.44670.55.

    Article  CAS  PubMed  Google Scholar 

  78. Linde K, Streng A, Jurgens S, Hoppe A, Brinkhaus B, Witt C, et al. Acupuncture for patients with migraine: a randomized controlled trial. JAMA. 2005;293(17):2118–25. https://doi.org/10.1001/jama.293.17.2118.

    Article  CAS  PubMed  Google Scholar 

  79. Melchart D, Streng A, Hoppe A, Brinkhaus B, Witt C, Wagenpfeil S, et al. Acupuncture in patients with tension-type headache: randomised controlled trial. BMJ. 2005;331(7513):376–82. https://doi.org/10.1136/bmj.38512.405440.8F.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Molsberger AF, Mau J, Pawelec DB, Winkler J. Does acupuncture improve the orthopedic management of chronic low back pain--a randomized, blinded, controlled trial with 3 months follow up. Pain. 2002;99(3):579–87. https://doi.org/10.1016/S0304-3959(02)00269-5.

    Article  PubMed  Google Scholar 

  81. O'Brien B, Relyea MJ, Taerum T. Efficacy of P6 acupressure in the treatment of nausea and vomiting during pregnancy. Am J Obstet Gynecol. 1996;174(2):708–15. https://doi.org/10.1016/S0002-9378(96)70454-4.

    Article  CAS  PubMed  Google Scholar 

  82. Scharf HP, Mansmann U, Streitberger K, Witte S, Kramer J, Maier C, et al. Acupuncture and knee osteoarthritis: a three-armed randomized trial. Ann Intern Med. 2006;145(1):12–20. https://doi.org/10.7326/0003-4819-145-1-200607040-00005.

    Article  PubMed  Google Scholar 

  83. Shen J, Wenger N, Glaspy J, Hays RD, Albert PS, Choi C, et al. Electroacupuncture for control of myeloablative chemotherapy-induced emesis: A randomized controlled trial. JAMA. 2000;284(21):2755–61. https://doi.org/10.1001/jama.284.21.2755.

    Article  CAS  PubMed  Google Scholar 

  84. Tarrier N, Yusupoff L, Kinney C, McCarthy E, Gledhill A, Haddock G, et al. Randomised controlled trial of intensive cognitive behaviour therapy for patients with chronic schizophrenia. BMJ. 1998;317(7154):303–7. https://doi.org/10.1136/bmj.317.7154.303.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  85. Witt C, Brinkhaus B, Jena S, Linde K, Streng A, Wagenpfeil S, et al. Acupuncture in patients with osteoarthritis of the knee: a randomised trial. Lancet. 2005;366(9480):136–43. https://doi.org/10.1016/S0140-6736(05)66871-7.

    Article  CAS  PubMed  Google Scholar 

  86. Karunakara S, Hammersley MS, Morris RJ, Turner RC, Holman RR. The fasting hyperglycaemia study: III. Randomized controlled trial of sulfonylurea therapy in subjects with increased but not diabetic fasting plasma glucose. Metabolism. 1997;46(12 Suppl 1):56–60. https://doi.org/10.1016/S0026-0495(97)90319-X.

    Article  Google Scholar 

  87. Parker JC, Smarr KL, Buckelew SP, Stucky-Ropp RC, Hewett JE, Johnson JC, et al. Effects of stress management on clinical outcomes in rheumatoid arthritis. Arthritis Rheum. 1995;38(12):1807–18. https://doi.org/10.1002/art.1780381214.

    Article  CAS  PubMed  Google Scholar 

  88. Rybarczyk BD, Auerbach SM. Reminiscence interviews as stress management interventions for older patients undergoing surgery. Gerontologist. 1990;30(4):522–8. https://doi.org/10.1093/geront/30.4.522.

    Article  CAS  PubMed  Google Scholar 

  89. Spanos NP, Mondoux TJ, Burgess CA. Comparison of multi-component hypnotic and non-hypnotic treatments for smoking. Contemp Hypn. 1995;12(1):12–9.

    Google Scholar 

  90. Anderson BJ, Brackett J, Ho J, Laffel LM. An office-based intervention to maintain parent-adolescent teamwork in diabetes management. Impact on parent involvement, family conflict, and subsequent glycemic control. Diabetes Care. 1999;22(5):713–21. https://doi.org/10.2337/diacare.22.5.713.

    Article  CAS  PubMed  Google Scholar 

  91. Defrin R, Ariel E, Peretz C. Segmental noxious versus innocuous electrical stimulation for chronic pain relief and the effect of fading sensation during treatment. Pain. 2005;115(1-2):152–60. https://doi.org/10.1016/j.pain.2005.02.018.

    Article  PubMed  Google Scholar 

  92. Frankel BL, Patel DJ, Horwitz D, Friedewald WT, Gaarder KR. Treatment of hypertension with biofeedback and relaxation techniques. Psychosom Med. 1978;40(4):276–93. https://doi.org/10.1097/00006842-197806000-00002.

    Article  CAS  PubMed  Google Scholar 

  93. Kendall PC, Williams L, Pechacek TF, Graham LE, Shisslak C, Herzoff N. Cognitive-behavioral and patient education interventions in cardiac catheterization procedures: the Palo Alto Medical Psychology Project. J Consult Clin Psychol. 1979;47(1):49–58. https://doi.org/10.1037/0022-006X.47.1.49.

    Article  CAS  PubMed  Google Scholar 

  94. Kober A, Scheck T, Greher M, Lieba F, Fleischhackl R, Fleischhackl S, et al. Prehospital analgesia with acupressure in victims of minor trauma: a prospective, randomized, double-blinded trial. Anesth Analg. 2002;95(3):723–7. https://doi.org/10.1097/00000539-200209000-00035.

    Article  PubMed  Google Scholar 

  95. Longo DJ, Clum GA, Yaeger NJ. Psychosocial treatment for recurrent genital herpes. J Consult Clin Psychol. 1988;56(1):61–6. https://doi.org/10.1037/0022-006X.56.1.61.

    Article  CAS  PubMed  Google Scholar 

  96. Macaluso AD, Conelly AM, Hayes WB, Houb MC, Ramsay MA, Suit CT, et al. Oral transmucosal fentanyl citrate for premedication in adults. Anesth Analg. 1996;82(1):158–61. https://doi.org/10.1097/00000539-199601000-00029.

    Article  CAS  PubMed  Google Scholar 

  97. Quayhagen MP, Quayhagen M, Corbeil RR, Roth PA, Rodgers JA. A dyadic remediation program for care recipients with dementia. Nurs Res. 1995;44(3):153–9.

    Article  CAS  PubMed  Google Scholar 

  98. Sprott H, Müller W. Efficacy of acupuncture in patients with fibromyalgia. Reumatologia. 1994;32(4):414–21.

    Google Scholar 

  99. Thomas VJ, Dixon AL, Milligan P, Thomas N. Cognitive-behaviour therapy for the management of sickle cell disease pain: an evaluation of a community-based intervention. Br J Health Psychol. 1999;4(3):209–29. https://doi.org/10.1348/135910799168588.

    Article  Google Scholar 

  100. Guglielmi RS, Roberts AH, Patterson R. Skin temperature biofeedback for Raynaud's disease: a double-blind study. Biofeedback Self Regul. 1982;7(1):99–120. https://doi.org/10.1007/BF00999058.

    Article  CAS  PubMed  Google Scholar 

  101. Hróbjartsson A, Thomsen ASS, Emanuelsson F, Tendal B, Hilden J, Boutron I, et al. Observer bias in randomized clinical trials with measurement scale outcomes: a systematic review of trials with both blinded and nonblinded assessors. CMAJ. 2013;185(4):E201–E11. https://doi.org/10.1503/cmaj.120744.

    Article  PubMed  PubMed Central  Google Scholar 

  102. Hróbjartsson A, Thomsen ASS, Emanuelsson F, Tendal B, Hilden J, Boutron I, et al. Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors. BMJ. 2012;344(feb27 2):e1119. https://doi.org/10.1136/bmj.e1119.

    Article  PubMed  Google Scholar 

  103. Kunz R, Vist G, Oxman AD. Randomisation to protect against selection bias in healthcare trials. Cochrane Database Syst Rev. 2007;2:MR000012.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Data sharing

The dataset has been published as additional information (Additional file 8).

Funding

We would like to acknowledge the support that the Parker Institute, Bispebjerg and Frederiksberg Hospital receives via a core grant from the Oak Foundation (OCAY-18-774-OFIL): the Oak Foundation commits its resources to address issues of global, social and environmental concern, particularly those that have a major impact on the lives of the disadvantaged. The Oak Foundation had no role in the study design, data collection and analysis, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Section for Biostatistics and Evidence-Based Research, the Parker Institute, Bispebjerg and Frederiksberg Hospital, Nordre Fasanvej 57, DK-2000, Copenhagen F, Denmark

    Sigurlaug H. Hafliðadóttir, Sabrina M. Nielsen & Robin Christensen

  2. SEARCH Research Group, Research Unit of Musculoskeletal Function and Physiotherapy, Institute of Sports Science and Clinical Biomechanics, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark

    Sigurlaug H. Hafliðadóttir & Carsten B. Juhl

  3. Department of Physiotherapy and Occupational Therapy, University Hospital of Copenhagen, Herlev, Gentofte, Denmark

    Carsten B. Juhl

  4. Research Unit of Rheumatology, Department of Clinical Research, University of Southern Denmark, Odense University Hospital, Odense, Denmark

    Sabrina M. Nielsen & Robin Christensen

  5. The Parker Institute, Copenhagen University Hospital Bispebjerg and Frederiksberg, Copenhagen, Denmark

    Marius Henriksen & Henning Bliddal

  6. Whitlam Orthopaedic Research Centre, Ingham Institute for Applied Medical Research, Sydney, New South Wales, Australia

    Ian A. Harris

  7. Faculty of Medicine, South Western Sydney Clinical School, The University of New South Wales, Sydney, New South Wales, Australia

    Ian A. Harris

  8. Institute of Musculoskeletal Health, School of Public Health, The University of Sydney, Sydney, New South Wales, Australia

    Ian A. Harris

Authors
  1. Sigurlaug H. Hafliðadóttir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carsten B. Juhl
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sabrina M. Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marius Henriksen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ian A. Harris
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Henning Bliddal
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Robin Christensen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SHH and RC conceptualized the study. All authors participated in the development and design of the study. SHH, CBJ, and RC performed the statistical analysis and interpretation of data. SHH and RC drafted the manuscript. All authors were substantially involved in the critical revision of the manuscript. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Robin Christensen.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Protocol.

Additional file 2.

PRISMA Checklist.

Additional file 3.

Characteristics of included trials. NS, not specified; ADHD, attention deficit hyperactivity disorder; OA, osteoarthritis; RA, rheumatoid arthritis. n, number of patients analyzed in intervention and placebo groups. aTrials with low risk of bias fulfilled all three criteria: (i) clearly concealed allocation, (ii) dropout rate ≤15% and, (iii) sample size of at least 50. bPatients analyzed in crossover trials that were handled as parallel-group trials (each patient counted twice).

Additional file 4.

Forest plot. PCE, proportional contextual effect.

Additional file 5.

Meta-regression plot, illustrating association between the PCE and publication year. PCE, proportional contextual effect.

Additional file 6.

Results of sensitivity analysis (random-effect meta-analysis). k, number of trials; n, number of patients analyzed; τ2, estimate of between-study variance; I2, variation in PCE attributable to heterogeneity, estimated by random-effect subgroup analysis. aSample size analyzed by dividing the trials in two groups, 75 (the median) being the cut-point.

Additional file 7.

Funnel plot of trials included in sensitivity analysis (k=163). The vertical line indicates the average effect size. PCE, proportional contextual effect.

Additional file 8.

Dataset. Data on all screened trials.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hafliðadóttir, S.H., Juhl, C.B., Nielsen, S.M. et al. Placebo response and effect in randomized clinical trials: meta-research with focus on contextual effects. Trials 22, 493 (2021). https://doi.org/10.1186/s13063-021-05454-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-021-05454-8

Keywords

Trials

ISSN: 1745-6215