Abstract
With new tools from artificial intelligence and new perspectives on personalizing interventions, we could revolutionize the way mental health services are delivered and achieve major gains in improving the public’s mental health. We examine Dr. Bickman’s vision around these technological and paradigm changes that would usher in major scientific, workforce training, and societal cultural changes. We argue that additional efforts in research evaluations in implementation have the potential to scale up and adapt existing interventions and scale them out to diverse populations and service systems. The next stage of this work involves testing the effectiveness of personalized interventions that are preferred by the public and integrating these choices into sustainable service systems. We note cautions on the delivery of these programs as automated algorithmic recommendations are heretofore foreign to humans.
Similar content being viewed by others
References
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science,12(1), 111. https://doi.org/10.1186/s13012-017-0640-6.
Berkel, C., Gallo, C. G., Sandler, I. N., Mauricio, A. M., Smith, J. D., & Brown, C. H. (2019). Redesigning implementation measurement for monitoring and quality improvement in community delivery settings. Journal of Primary Prevention,40(1), 111–127. https://doi.org/10.1007/s10935-018-00534-z.
Brown, C. H., Brincks, A., Huang, S., Perrino, T., Cruden, G., Pantin, H., et al. (2018). Two-year impact of prevention programs on adolescent depression: An integrative data analysis approach. Prevention Science,19(Supplement 1), 74–94. https://doi.org/10.1007/s11121-016-0737-1.
Brown, C. H., Chamberlain, P., Saldana, L., Padgett, C., Wang, W., & Cruden, G. (2014). Evaluation of two implementation strategies in 51 child county public service systems in two states: Results of a cluster randomized head-to-head implementation trial. Implementation Science,9, 134. https://doi.org/10.1186/s13012-014-0134-8.
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., et al. (2017). An overview of research and evaluation designs for dissemination and implementation. Annual Review of Public Health,38(38), 1–22. https://doi.org/10.1146/annurev-publhealth-031816-044215.
Brown, C. H., Sloboda, Z., Faggiano, F., Teasdale, B., Keller, F., Burhart, G., et al. (2013). Methods for synthesizing findings on moderation effects across multiple randomized trials. Prevention Science,14(2), 144–156. https://doi.org/10.1007/s11121-011-0207-8.
Brown, C. H., Ten Have, T. R., Jo, B., Dagne, G., Wyman, P. A., Muthen, B., et al. (2009). Adaptive designs for randomized trials in public health. Annual Review of Public Health,30, 1–25. https://doi.org/10.1146/annurev.publhealth.031308.100223.
Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence,95(Suppl 1), S74–S104. https://doi.org/10.1016/j.drugalcdep.2007.11.013.
Brown, C. H., Wyman, P. A., Guo, J., & Peña, J. (2006). Dynamic wait-listed designs for randomized trials: New designs for prevention of youth suicide. Clinical Trials,3(3), 259–271. https://doi.org/10.1191/1740774506cn152oa.
Burnham, J. C. (1987). How superstition won and science lost: Popularizing science and health in the United States. New Brunswick: Rutgers University Press.
Chambers, D. A., Glasgow, R., & Stange, K. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science,8, 117. https://doi.org/10.1186/1748-5908-8-117.
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care,50(3), 217–226. https://doi.org/10.1097/MLR.0b013e3182408812.
Dagne, G., Brown, C. H., Howe, G., Kellam, S., & Liu, L. (2016). Testing moderation in network meta-analysis with individual participant data. Statistics in Medicine,35(15), 2485–2502. https://doi.org/10.1002/sim.6883.
Doll, R. (1992). Sir Austin Bradford Hill and the progress of medical science. BMJ British Medical Journal,305(6868), 1521.
Duan, N. (2017). Personalized biostatistics, small data, and N-of-1 trials. In Prevention Science and Methodology Group Virtual Grand Rounds.
Gallo, C. G., Berkel, C., Mauricio, A. M., Sandler, I. N., Villamar, J., Mehrotra, S., & Brown, C. H. (2020). Implementation methodology from a systems-level perspective. Manuscript submitted for publication.
Gallo, C. G., Pantin, H., Villamar, J., Prado, G. J., Tapia, M., Ogihara, M., et al. (2015). Blending qualitative and computational linguistics methods for fidelity assessment: Experience with the familias unidas preventive intervention. Administration and Policy in Mental Health and Mental Health Services Research,42(5), 574–585. https://doi.org/10.1007/s10488-014-0538-4.
Gibbons, R. D., Hooker, G., Finkelman, M. D., Weiss, D. J., Pilkonis, P. A., Frank, E., et al. (2013). The computerized adaptive diagnostic test for major depressive disorder (CAD-MDD): A screening tool for depression. Journal of Clinical Psychiatry,74(7), 669–674. https://doi.org/10.4088/JCP.12m08338.
Gibbons, R. D., Hur, K., Brown, C. H., Davis, J. M., & Mann, J. J. (2012). Benefits from antidepressants: Synthesis of 6-week patient-level outcomes from double-blind placebo-controlled randomized trials of fluoxetine and venlafaxine. Archives of General Psychiatry,69(6), 572–579. https://doi.org/10.1001/archgenpsychiatry.2011.2044.
Gibbons, R. D., Smith, J. D., Brown, C. H., Sajdak, M., Tapia, N. J., Kulik, A., et al. (2019). Improving the evaluation of adult mental disorders in the criminal justice system with computerized adaptive testing. Psychiatric Services,70(11), appips201900038. https://doi.org/10.1176/appi.ps.201900038.
Gibbons, R. D., Weiss, D. J., Frank, E., & Kupfer, D. (2016). Computerized adaptive diagnosis and testing of mental health disorders. Annual Review of Clinical Psychology,12, 83–104. https://doi.org/10.1146/annurev-clinpsy-021815-093634.
Goldston, D. B., Molock, S. D., Whitbeck, L. B., Murakami, J. L., Zayas, L. H., & Hall, G. C. (2008). Cultural considerations in adolescent suicide prevention and psychosocial treatment. American Psychologist,63(1), 14–31. https://doi.org/10.1037/0003-066X.63.1.14.
Howe, G. W. (2019). Preventive effect heterogeneity: Causal inference in personalized prevention. Prevention Science,20(1), 21–29.
Huang, S., MacKinnon, D. P., Perrino, T., Gallo, C. G., Cruden, G., & Brown, C. H. (2016). A statistical method for synthesizing mediation analyses using the product of coefficient approach across multiple trials. Statistical Methods & Applications,25(4), 565–579. https://doi.org/10.1007/s10260-016-0354-y.
Imel, Z. E., Steyvers, M., & Atkins, D. C. (2015). Computational psychotherapy research: Scaling up the evaluation of patient-provider interactions. Psychotherapy,52(1), 19. https://doi.org/10.1037/a0036841.
Inoue, M., Ogihara, M., Hanada, R., & Furuyama, N. (2010). Utility of gestural cues in indexing semantic miscommunication. Paper presented at the 2010 5th International Conference on Future Information Technology.
Kane, J. M., Robinson, D. G., Schooler, N. R., Mueser, K. T., Penn, D. L., Rosenheck, R. A., et al. (2015). Comprehensive versus usual community care for first-episode psychosis: 2-year outcomes from the NIMH RAISE early treatment program. American Journal of Psychiatry,173(4), 362–372. https://doi.org/10.1176/appi.ajp.2015.15050632.
Kilbourne, A. M., Almirall, D., Eisenberg, D., Waxmonsky, J., Goodrich, D. E., Fortney, J. C., et al. (2014). Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): Cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implementation Science. https://doi.org/10.1186/s13012-13014-10132-x.
Landsverk, J., Brown, C. H., Smith, J. D., Chamberlain, P., Curran, G. M., Palinkas, L., et al. (2018). Design and analysis in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 201–228). New York: Oxford University Press.
Li, D. H., Brown, C. H., Gallo, C., Morgan, E., Sullivan, P. S., Young, S. D., et al. (2019). Design considerations for implementing eHealth behavioral interventions for HIV prevention in evolving sociotechnical landscapes. Current HIV/AIDS Reports,16(4), 335–348. https://doi.org/10.1007/s11904-019-00455-4.
Marcus, S. M., Stuart, E. A., Wang, P., Shadish, W. R., & Steiner, P. M. (2012). Estimating the causal effect of randomization versus treatment preference in a doubly randomized preference trial. Psychological Methods,17(2), 244.
McNulty, M., Smith, J. D., Villamar, J., Burnett-Zeigler, I., Vermeer, W., Benbow, N., et al. (2019). Implementation research methodologies for achieving scientific equity and health equity. Ethnicity and Disease,29(Suppl 1), 83–92. https://doi.org/10.18865/ed.29.S1.83.
Mensah, G. A., Cooper, R. S., Siega-Riz, A. M., Cooper, L. A., Smith, J. D., Brown, C. H., et al. (2018). Reducing cardiovascular disparities through community-engaged implementation research: A National Heart, Lung, and Blood Institute Workshop Report. Circulation Research,122(2), 213–230. https://doi.org/10.1161/CIRCRESAHA.117.312243.
Mensah, G. A., Wei, G. S., Sorlie, P. D., Fine, L. J., Rosenberg, Y., Kaufmann, P. G., et al. (2017). Decline in cardiovascular mortality: Possible causes and implications. Circulation Research,120(2), 366–380.
Mohr, D. C., Cheung, K., Schueller, S. M., Brown, C. H., & Duan, N. (2013). Continuous evaluation of evolving behavioral intervention technologies. American Journal of Preventive Medicine,45(4), 517–523. https://doi.org/10.1016/j.amepre.2013.06.006.
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011). Supportive accountability: A model for providing human support to enhance adherence to eHealth interventions. Journal of Medical Internet Research,13(1), e30. https://doi.org/10.2196/jmir.1602.
Muthén, B. O., & Brown, C. H. (2009). Estimating drug effects in the presence of placebo response: Causal inference using growth mixture modeling. Statistics in Medicine,28(27), 3363–3395. https://doi.org/10.1002/sim.3721.
Palinkas, L. A. (2018). Achieving implementation and exchange: A science of delivering evidence-based practices to at-risk youth In Department of psychiatry ground rounds presentation. New York: Columbia University.
Palinkas, L. A., Aarons, G. A., Chorpita, B. F., Hoagwood, K., Landswerk, J., & Weisz, J. R. (2009). Cultural exchange and the implementation of evidence-based practice: Two case studies. Research on Social Work Practice,19(5), 602–612. https://doi.org/10.1177/1049731509335529.
Palinkas, L. A., Spear, S., Mendon, S., Villamar, J. A., Reynolds, C., Green, C. D., et al. (2019). Conceptualizing and measuring sustainability of prevention programs and initiatives. Translational and Behavioral Medicine,10(1), 136–145. https://doi.org/10.1093/tbm/ibz170.
Perrino, T., Brincks, A., Howe, G., Brown, C. H., Prado, G., & Pantin, H. (2016). Reducing internalizing symptoms among high-risk, hispanic adolescents: Mediators of a preventive family intervention. Prevention Science,17(5), 595–605. https://doi.org/10.1007/s11121-016-0655-2.
Powell, B. J., Proctor, E. K., & Glass, J. E. (2014). A systematic review of strategies for implementing empirically supported mental health interventions. Research on Social Work Practice,24(2), 192–212. https://doi.org/10.1177/1049731513505778.
Rasing, S., Creemers, D. H., Janssens, J. M., & Scholte, R. H. (2017). Depression and anxiety prevention based on cognitive behavioral therapy for at-risk adolescents: A meta-analytic review. Frontiers in Psychology,8, 1066.
Shortliffe, E. H. (2005). Strategic action in health information technology: Why the obvious has taken so long. Health Affairs,24(5), 1222–1233.
Siddique, J., Chung, J. Y., Brown, C. H., & Miranda, J. (2012). Comparative effectiveness of medication versus cognitive behavioral therapy in a randomized controlled trial of low-income young minority women with depression. Journal of Consulting and Clinical Psychology,80(6), 995–1006. https://doi.org/10.1037/a0030452.
Smith, J. D., Li, D., & Rafferty, M. R. (2020). The implementation research logic model: A method for planning, executing, reporting, and synthesizing implementation projects. medRxiv. https://doi.org/10.1101/2020.04.05.20054379.
Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., et al. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science,10(1), 109.
Wang, D., Ogihara, M., Gallo, C. G., Villamar, J., Smith, J. D., Vermeer, W., et al. (2016). Automatic classification of communication logs into implementation stages via text analysis. Implementation Science,11(1), 119. https://doi.org/10.1186/s13012-016-0483-6.
Weisz, J. R., Kuppens, S., Ng, M. Y., Vaughn-Coaxum, R. A., Ugueto, A. M., Eckshtain, D., et al. (2019). Are psychotherapies for young people growing stronger? Tracking trends over time for youth anxiety, depression, attention-deficit/hyperactivity disorder, and conduct problems. Perspectives on Psychological Science,14(2), 216–237.
Wyman, P. A., Henry, D., Knoblauch, S., & Brown, C. H. (2015). Designs for testing group-based interventions with limited numbers of social units: The dynamic wait-listed and regression point displacement designs. Prevention Science,16(7), 956–966. https://doi.org/10.1007/s11121-014-0535-6.
Acknowledgements
I would like to thank all my colleagues in the Center for Prevention Implementation Methodology (Ce-PIM) for all the many contributions to this commentary and to their willingness to let their disciplines intermingle and coalesce. I also thank the National Institute on Drug Abuse (NIDA) and the NIH Office of Disease Prevention for their support for Ce-PIM (P30DA027828, Brown PI), NIDA for support for sustainment measurement (R34DA037516, Palinkas PI), as well as the National Institute of Mental Health for support on synthesis across trials (R01MH117598, Brown PI). The material in this paper is the responsibility of the author and does not necessarily reflect the opinions of the funders or my colleagues.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Festschrift for Leonard Bickman Special Issue on The Future of Children's Mental Health Services.
Rights and permissions
About this article
Cite this article
Brown, C.H. Three Flavorings for a Soup to Cure what Ails Mental Health Services. Adm Policy Ment Health 47, 844–851 (2020). https://doi.org/10.1007/s10488-020-01060-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-020-01060-z