Abstract
Objectives
Extensive research suggests that short-term meditation interventions may hold therapeutic promise for a wide range of psychosocial outcomes. In response to calls to subject these interventions to more methodologically rigorous tests, a randomized controlled trial tested the effectiveness of a mindfulness meditation intervention and a compassion meditation intervention against an active control in a demographically diverse sample of medically and psychiatrically healthy adults.
Methods
Two hundred and four participants completed a battery of questionnaires to assess psychological experience, participated in a laboratory stress test to measure their biological stress reactivity, and wore the Electronically Activated Recorder (EAR) to assess daily behaviors before and after an eight-week intervention (mindfulness meditation intervention, compassion meditation intervention, or health education discussion group).
Results
Neither meditation intervention reliably impacted participants’ subjective psychological experience, biological stress reactivity, or objectively assessed daily behaviors. Furthermore, post hoc moderation analyses found that neither baseline distress nor intervention engagement significantly moderated effects.
Conclusions
Results from this trial—which was methodologically rigorous and powered to detect all but small effects—were essentially null. These results are an important data point for the body of research about meditation interventions. Implications of these non-significant effects are discussed in the context of prior studies, and future directions for contemplative intervention research are recommended.
Clinical Trial Registry
Registry Number: NCT01643369.
Similar content being viewed by others
Data Availability
Open access to the data and materials associated with this study are provided on the Open Science Framework at: https://osf.io/6jt9q/.
References
Alderson, P. (2004). Absence of evidence is not evidence of absence. British Medical Journal Publishing Group, 328(7438), 476–477. https://doi.org/10.1136/bmj.328.7438.476
Anderson, S. F., & Maxwell, S. E. (2017). Addressing the “replication crisis”: Using original studies to design replication studies with appropriate statistical power. Multivariate Behavioral Research, 52(3), 305–324.
Baddeley, J. L., Pennebaker, J. W., & Beevers, C. G. (2013). Everyday social behavior during a major depressive episode. Social Psychological & Personality Science, 4, 445–452. https://doi.org/10.1177/1948550612461654
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13(1), 27–45.
Beck, A. T., & Steer, R. A. (1984). Internal consistencies of the original and revised Beck Depression Inventory. Journal of Clinical Psychology, 40(6), 1365–1367.
Bollich, K. L., Doris, J. M., Vazire, S., Raison, C. L., Jackson, J. J., & Mehl, M. R. (2016). Eavesdropping on character: Assessing everyday moral behaviors. Journal of Research in Personality, 61, 15–21. https://doi.org/10.1016/j.jrp.2015.12.003
Britton, W. B., Lindahl, J. R., Cooper, D. J., Canby, N. K., & Palitsky, R. (2021). Defining and measuring meditation-related adverse effects in mindfulness-based programs. Clinical Psychological Science, 2167702621996340. https://doi.org/10.1177/2167702621996340
Brown, K. W., Ryan, R. M., & Creswell, J. D. (2007). Mindfulness: Theoretical foundations and evidence for its salutary effects. Psychological Inquiry, 18(4), 211–237.
Brown, K. W., Creswell, J. D., & Ryan, R. M. (2015). Handbook of mindfulness: Theory, research, and practice: Guilford Publications.
Cohen, S. (1988a). Perceived stress in a probability sample of the United States. In S. Spacapan & S. Oskamp (Eds.), The social psychology of health (pp. 31–67). Sage Publications Inc.
Cohen, J. (1988b). The effect size index: D. Statistical power analysis for the behavioral sciences. Abingdon-on-Thames: Routledge Academic.
Coronado-Montoya, S., Levis, A. W., Kwakkenbos, L., Steele, R. J., Turner, E. H., & Thombs, B. D. (2016). Reporting of positive results in randomized controlled trials of mindfulness-based mental health interventions. PloS one, 11(4), e0153220.
Creswell, J. D. (2017). Mindfulness interventions. Annual Review of Psychology, 68, 491–516.
Cuijpers, P., Van Straten, A., & Warmerdam, L. (2007). Behavioral activation treatments of depression: A meta-analysis. Clinical Psychology Review, 27(3), 318–326.
Davidson, R. J., & Kaszniak, A. W. (2015). Conceptual and methodological issues in research on mindfulness and meditation. American Psychologist, 70(7), 581–592. https://doi.org/10.1037/a0039512
Desbordes, G., Negi, L. T., Pace, T. W., Wallace, B. A., Raison, C. L., & Schwartz, E. L. (2012). Effects of mindful-attention and compassion meditation training on amygdala response to emotional stimuli in an ordinary, non-meditative state. Frontiers in Human Neuroscience, 6, 292. https://doi.org/10.3389/fnhum.2012.00292
Dickerson, S. S., Gable, S. L., Irwin, M. R., Aziz, N., & Kemeny, M. E. (2009). Social-evaluative threat and proinflammatory cytokine regulation: An experimental laboratory investigation. Psychological Science, 20(10), 1237–1244. https://doi.org/10.1111/j.1467-9280.2009.02437.x
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75.
Dimidjian, S., & Segal, Z. V. (2015). Prospects for a clinical science of mindfulness-based intervention. American Psychologist, 70(7), 593–620. https://doi.org/10.1037/a0039589
Dodds, S. E., Pace, T. W., Bell, M. L., Fiero, M., Negi, L. T., Raison, C. L., & Weihs, K. L. (2015). Feasibility of Cognitively-Based Compassion Training (CBCT) for breast cancer survivors: A randomized, wait list controlled pilot study. Supportive Care in Cancer, 23(12), 3599–3608.
Eberth, J., & Sedlmeier, P. (2012). The effects of mindfulness meditation: A meta-analysis. Mindfulness, 3(3), 174–189. https://doi.org/10.1007/s12671-012-0101-x
Funder, D. C., & Ozer, D. J. (2019). Evaluating effect size in psychological research: Sense and nonsense. Advances in Methods and Practices in Psychological Science, 2(2), 1576-168. https://doi.org/10.1177/2515245919847202
Fydrich, T., Dowdall, D., & Chambless, D. L. (1992). Reliability and validity of the Beck Anxiety Inventory. Journal of Anxiety Disorders, 6(1), 55–61.
Goleman, D., & Davidson, R. J. (2017). Altered Traits: Science reveals how meditation changes your mind, brain, and body. Penguin.
Goyal, M., Singh, S., Sibinga, E. M., Gould, N. F., Rowland-Seymour, A., Sharma, R., Berger, Z., Sleicher, D., Maron, D. D., Shihab, H. M., Ranasinghe, P. D., Linn, S., Saha, S., Bass, E. B., & Haythornwaite, J. A. (2014). Meditation programs for psychological stress and well-being: A systematic review and meta-analysis. JAMA Internal Medicine, 174(3), 357–368. https://doi.org/10.1001/jamainternmed.2013.13018
Harrington, A., & Dunne, J. D. (2015). When mindfulness is therapy: Ethical qualms, historical perspectives. American Psychologist, 70(7), 621–631. https://doi.org/10.1037/a0039460
Heyman, R. E., Lorber, M. F., Eddy, J. M., & West, T. V. (2014). Behavioral observation and coding. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 345–372). Cambridge University Press.
Hofmann, S. G., Grossman, P., & Hinton, D. E. (2011). Loving-kindness and compassion meditation: Potential for psychological interventions. Clinical Psychology Review, 31(7), 1126–1132. https://doi.org/10.1016/j.cpr.2011.07.003
Johnson, B. T., Scott-Sheldon, L. A., & Carey, M. P. (2010). Meta-synthesis of health behavior change meta-analyses. American Journal of Public Health, 100(11), 2193–2198. https://doi.org/10.2105/AJPH.2008.155200
Kaplan, D. M., Raison, C. L., Milek, A., Tackman, A. M., Pace, T. W. W., & Mehl, M. R. (2018). Dispositional mindfulness in daily life: A naturalistic observation study. PLoS ONE, 13(11), e0206029. https://doi.org/10.1371/journal.pone.0206029
Kaplan, D. M., Rentscher, K. E., Lim, M., Reyes, R., Keating, D., Romero, J., Shah, A., Smith, A. D., York, K. A., Milek, A., Tackman, A. M., & Mehl, M. R. (2020). Best practices for Electronically Activated Recorder (EAR) research: A practical guide to coding and processing EAR data. Behavior Research Methods. https://doi.org/10.3758/s13428-019-01333-y
Khoury, B., Sharma, M., Rush, S. E., & Fournier, C. (2015). Mindfulness-based stress reduction for healthy individuals: A meta-analysis. Journal of Psychosomatic Research, 78(6), 519–528. https://doi.org/10.1016/j.jpsychores.2015.03.009
Kirschbaum, C., Pirke, K.-M., & Hellhammer, D. H. (1993). The ‘Trier Social Stress Test’–A tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology, 28(1–2), 76–81. https://doi.org/10.1159/000119004
Kyabgon, T. (2007). The practice of Lojong: Cultivating compassion through training the mind. Shambhala Publications.
Lally, P., Van Jaarsveld, C. H., Potts, H. W., & Wardle, J. (2010). How are habits formed: Modelling habit formation in the real world. European Journal of Social Psychology, 40(6), 998–1009. https://doi.org/10.1002/ejsp.674
Lindahl, J. R., Fisher, N. E., Cooper, D. J., Rosen, R. K., & Britton, W. B. (2017). The varieties of contemplative experience: A mixed-methods study of meditation-related challenges in Western Buddhists. PLoS ONE, 12(5), e0176239. https://doi.org/10.1371/journal.pone.0176239
Lindsay, E. K., Young, S., Smyth, J. M., Brown, K. W., & Creswell, J. D. (2018). Acceptance lowers stress reactivity: Dismantling mindfulness training in a randomized controlled trial. Psychoneuroendocrinology, 87, 63–73.
MacCoon, D. G., Imel, Z. E., Rosenkranz, M. A., Sheftel, J. G., Weng, H. Y., Sullivan, J. C., Bonus, K. A., Stoney, C. M., Salomons, T. V., Davidson, R. J., & Lutz, A. (2012). The validation of an active control intervention for Mindfulness Based Stress Reduction (MBSR). Behaviour Research and Therapy, 50(1), 3–12. https://doi.org/10.1016/j.brat.2011.10.011
Marsland, A. L., Walsh, C., Lockwood, K., & John-Henderson, N. A. (2017). The effects of acute psychological stress on circulating and stimulated inflammatory markers: A systematic review and meta-analysis. Brain, Behavior, and Immunity, 64, 208–219. https://doi.org/10.1016/j.bbi.2017.01.011
Mascaro, J. S., Rilling, J. K., Tenzin Negi, L., & Raison, C. L. (2012). Compassion meditation enhances empathic accuracy and related neural activity. Social Cognitive and Affective Neuroscience, 8(1), 48–55. https://doi.org/10.1093/scan/nss095
Mehl, M. R. (2017). The Electronically Activated Recorder (EAR): A method for the naturalistic observation of daily social behavior. Current Directions in Psychological Science, 26(2), 184–190. https://doi.org/10.1177/0963721416680611
Mehl, M. R., Pennebaker, J. W., Crow, D. M., Dabbs, J., & Price, J. H. (2001). The Electronically Activated Recorder (EAR): A device for sampling naturalistic daily activities and conversations. Behavior Research Methods, Instruments, & Computers, 33(4), 517–523. https://doi.org/10.3758/bf03195410
Mehl, M. R., & Conner, T. S. (2012). Handbook of research methods for studying daily life. Guilford Press.
Mehl, M. R., Robbins, M. L., & Deters, F. große. (2012). Naturalistic observation of health-relevant social processes: The Electronically Activated Recorder (EAR) Methodology in Psychosomatics. Psychosomatic Medicine, 74(4), 410–417. https://doi.org/10.1097/PSY.0b013e3182545470
Pace, T. W., Mletzko, T. C., Alagbe, O., Musselman, D. L., Nemeroff, C. B., Miller, A. H., & Heim, C. M. (2006). Increased stress-induced inflammatory responses in male patients with major depression and increased early life stress. American Journal of Psychiatry, 163(9), 1630–1633. https://doi.org/10.1176/ajp.2006.163.9.1630
Pace, T. W., Negi, L. T., Adame, D. D., Cole, S. P., Sivilli, T. I., Brown, T. D., Issa, M. J., & Raison, C. L. (2009). Effect of compassion meditation on neuroendocrine, innate immune and behavioral responses to psychosocial stress. Psychoneuroendocrinology, 34(1), 87–98. https://doi.org/10.1016/j.psyneuen.2008.08.011
Pace, T. W., Negi, L. T., Dodson-Lavelle, B., Ozawa-de Silva, B., Reddy, S. D., Cole, S. P., Danese, A., Craighead, L. W., & Raison, C. L. (2013). Engagement with cognitively-based compassion training is associated with reduced salivary C-reactive protein from before to after training in foster care program adolescents. Psychoneuroendocrinology, 38(2), 294–299. https://doi.org/10.1016/j.psyneuen.2012.05.019
Palitsky, R., Kaplan, D. M., Brenner, S., Mehl, M. R., & Sullivan, D. Worldviews matter for implementation-relevant responses to mindfulness-based interventions: An empirical investigation of existential and religious perspectives. [Manuscript submitted for publication]. Department of Psychiatry and Human Behavior, Brown University.
Palitsky, R., & Kaplan, D. M. (2021). The role of religion for mindfulness-based interventions: Implications for dissemination and implementation. Mindfulness, 12(8), 2076–2089.
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015). The development and psychometric properties of LIWC2015. UT Faculty/Researcher Works.
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879.
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569.
Pruessner, J. C., Kirschbaum, C., Meinlschmid, G., & Hellhammer, D. H. (2003). Two formulas for computation of the area under the curve represent measures of total hormone concentration versus time-dependent change. Psychoneuroendocrinology, 28(7), 916–931. https://doi.org/10.1016/s0306-4530(02)00108-7
Reddy, S. D., Negi, L. T., Dodson-Lavelle, B., Ozawa-de Silva, B., Pace, T. W., Cole, S. P., Raison, C. L., & Craighead, L. W. (2013). Cognitive-Based Compassion Training: A promising prevention strategy for at-risk adolescents. Journal of Child and Family Studies, 22(2), 219–230. https://doi.org/10.1007/s10826-012-9571-7
Rosenzweig, S., Greeson, J. M., Reibel, D. K., Green, J. S., Jasser, S. A., & Beasley, D. (2010). Mindfulness-based stress reduction for chronic pain conditions: Variation in treatment outcomes and role of home meditation practice. Journal of Psychosomatic Research, 68(1), 29–36. https://doi.org/10.1016/j.jpsychores.2009.03.010
Russell, D., Peplau, L. A., & Cutrona, C. E. (1980). The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology, 39(3), 472–480. https://doi.org/10.1037//0022-3514.39.3.472
Santorelli, S. F., Kabat-Zinn, J., Blacker, M., Meleo-Meyer, F., & Koerbel, L. (2017). Mindfulness-based stress reduction (MBSR) authorized curriculum guide. Center for Mindfulness in Medicine, Health Care, and Society (CFM). University of Massachusetts Medical School.Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47(5), 609-612.
Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47(5), 609–612.
Shapiro, S. L., & Jazaieri, H. (2015). Mindfulness-based stress reduction for healthy stressed adults. In K.W. Brown, J.D. Creswell & R.M. Ryan (Eds.). Handbook of mindfulness: Theory, research, and practice (pp. 269–282). Guilford Press.
Shonin, E., Van Gordon, W., Dunn, T. J., Singh, N. N., & Griffiths, M. D. (2014). Meditation Awareness Training (MAT) for work-related wellbeing and job performance: A randomised controlled trial. International Journal of Mental Health and Addiction, 12(6), 806–823. https://doi.org/10.1007/s11469-014-9513-2
Steer, R. A., Clark, D. A., Beck, A. T., & Ranieri, W. F. (1995). Common and specific dimensions of self-reported anxiety and depression: A replication. Journal of Abnormal Psychology, 104(3), 542–545. https://doi.org/10.1037//0021-843x.104.3.542
Steer, R. A., Clark, D. A., Beck, A. T., & Ranieri, W. F. (1999). Common and specific dimensions of self-reported anxiety and depression: The BDI-II versus the BDI-IA. Behaviour Research and Therapy, 37(2), 183–190. https://doi.org/10.1016/s0005-7967(98)00087-4
The Importance of No Evidence. (2019). Nature Human Behavior, 3(3), 197.
Van Dam, N. T., Van Vugt, M. K., Vago, D. R., Schmalzl, L., Saron, C. D., Olendzki, A., Meissner, T., Lazar, S. W., Kerr, C. E., & Gorchov, J. (2018). Mind the hype: A critical evaluation and prescriptive agenda for research on mindfulness and meditation. Perspectives on Psychological Science, 13(1), 36–61.
van Ginkel, J. R., & Kroonenberg, P. M. (2014). Analysis of variance of multiply imputed data. Multivariate Behavioral Research, 49(1), 78–91. https://doi.org/10.1080/00273171.2013.855890
Von Dawans, B., Kirschbaum, C., & Heinrichs, M. (2011). The Trier Social Stress Test for Groups (TSST-G): A new research tool for controlled simultaneous social stress exposure in a group format. Psychoneuroendocrinology, 36(4), 514–522. https://doi.org/10.1016/j.psyneuen.2010.08.004
Watson-Singleton, N. N., Black, A. R., & Spivey, B. N. (2019). Recommendations for a culturally-responsive mindfulness-based intervention for African Americans. Complementary Therapies in Clinical Practice, 34, 132–138. https://doi.org/10.1016/j.ctcp.2018.11.013
Acknowledgements
The authors would like to acknowledge and thank the participants who contributed to this research, as well as the numerous Research Assistants in the Naturalistic Observation of Social Interactions (NOSI) lab at the University of Arizona who worked for years to code the behavioral data.
Funding
This research was supported by the National Institutes of Health grants 3R01AT004698 (Charles Raison), 5R01AT004698 (Charles Raison), UL1TR000454 (David Stephens, Emory University). The preparation of this manuscript was supported by the National Institutes of Health grant 1F32HL154751 (Kaplan).
Author information
Authors and Affiliations
Contributions
DMK: Supported the data analyses and drafted this manuscript with assistance from MRM and CLR. MRM: Collaborated on the design and execution of the study, supported the data analysis, and contributed to writing the manuscript. TWWP: Collaborated on the design and execution of the study and contributed to writing the manuscript. LTN: Collaborated on the design of the study and editing of the manuscript. BOS: Collaborated on the design of the study and editing of the manuscript. BDL: Collaborated on the execution of the study and editing of the manuscript. TS: Collaborated on the execution of the study and editing of the manuscript. AW: Collaborated on the execution of the study and editing of the manuscript. TC: Collaborated on the execution of the study and editing of the manuscript. BP: Collaborated on the execution of the study and editing of the manuscript. VM: Provided data management oversight for the study and contributed to writing the manuscript. MLR: Provided data management oversight for the study and contributed to writing the manuscript. SPC: Conducted statistical analyses for the manuscript, with assistance from DMK and MRM. WEC: Collaborated on the design of the study and editing of the manuscript. CLR: Secured funding, designed and executed the study, and assisted with writing and editing of the manuscript.
Corresponding author
Ethics declarations
Ethics Statement
All procedures for this study were approved by Institutional Research Boards at Emory University and the University of Arizona.
Informed Consent Statement
All participants in this research provided informed consent for participating in this trial.
Conflict of Interest
DMK is a certified instructor of Cognitively Based Compassion Training (CBCT®) and has taught CBCT® on behalf of the University of Arizona’s Center for Compassion Studies. LTN is the Executive Director and BOS is an Associate Director for the Center for Contemplative Science and Compassion-Based Ethics at Emory University. The Center holds a registered trademark for CBCT® and offers trainings in the procedure. CLR serves as a consultant for Usona Institute, Sage Pharmaceuticals, Novartis, and Emory Healthcare. The other authors declared that they had no conflicts of interest with respect to their authorship or the publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Kaplan, D.M., Mehl, M.R., Pace, T.W.W. et al. Implications of a “Null” Randomized Controlled Trial of Mindfulness and Compassion Interventions in Healthy Adults. Mindfulness 13, 1197–1213 (2022). https://doi.org/10.1007/s12671-022-01861-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12671-022-01861-3