Abstract
With a career spanning more than half a century, Leonard Bickman has contributed to improving children’s mental health through research on innovative interventions, such as measurement-based care, and service-level initiatives, including systems of care. Len’s highly productive career in children’s mental health services research is founded in his influence on the science of program evaluation, particularly in the area of program theory. This article provides an abridged and combined version of a video interview with Len dated April 16, 2019 and written responses to a series of questions posed to Len in advance of the festschrift held in his honor at Johns Hopkins Bloomberg School of Public Health on May 11, 2018.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The Eastern Evaluation Research Society (https://eers.org/about-eers/) is not the same organization.
References
Bickman, L. (1971). The effect of another bystander's ability to help on bystander intervention in an emergency. Journal of Experimental Social Psychology,7, 367–379. https://doi.org/10.1016/0022-1031(71)90035-7.
Bickman, L. (1984). Bystander intervention in crimes: Research and application. In J. Karylowski, J. Rekowsky, E. Staub, & D. Bar-Tal (Eds.), Development and maintenance of prosocial behavior: International perspectives (pp. 457–470). New York: Plenum.
Bickman, L. (1987). The functions of program theory. New Directions for Program Evaluation,1987(33), 5–18. https://doi.org/10.1002/ev.1443.
Bickman, L. (1989). Barriers to the use of program theory. Evaluation and Program Planning,12(4), 387–390. https://doi.org/10.1016/0149-7189(89)90056-6.
Bickman, L. (1996a). A continuum of care. More is not always better. The American Psychologist,51(7), 689–701. https://doi.org/10.1037/0003-066x.51.7.689.
Bickman, L. (1996b). The application of program theory to the evaluation of a managed mental health care system. Evaluation and Program Planning,19(2), 111–119. https://doi.org/10.1016/0149-7189(96)00002-x.
Bickman, L. (1997). Resolving issues raised by the Fort Bragg evaluation. New directions for mental health services research. The American Psychologist,52(5), 562–565. https://doi.org/10.1037/0003-066x.52.5.562.
Bickman, L. (1999). Practice makes perfect and other myths about mental health services. American Psychologist,54(11), 965–978. https://doi.org/10.1037/h0088206.
Bickman, L. (2006). My life as an applied social psychologist. Current Psychology: Developmental, Learning, Personality, Social,25(2), 67–92. https://doi.org/10.1007/s12144-006-1005-5.
Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Association of Child and Adolescent Psychiatry,47, 1114–1119. https://doi.org/10.1097/chi.0b013e3181825af8.
Bickman, L., & Henchy, T. (Eds.). (1972). Beyond the laboratory: Field research in social psychology. New York: McGraw-Hill.
Bickman, L., & Peterson, K. A. (1990). Using program theory to describe and measure program quality. New Directions for Program Evaluation,1990(47), 61–72. https://doi.org/10.1002/ev.1555.
Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Douglas Kelley, S., Breda, C., et al., Tempesti, T., Dew-Reeves, S. E., Brannan, A. M., & Vides de Andrade, A. R. (Eds.). (2010). Manual of the peabody treatment progress battery (2nd ed.). Nashville, TN: Vanderbilt University.
Bickman, L., Douglas Kelley, S., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services,62(12), 1423–1429. https://doi.org/10.1176/appi.ps.002052011.
Bickman, L., Douglas, S. R., De Andrade, A. R., Vides, T. M., Gleacher, A., … Hoagwood, K., (2016). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental Health and Mental Health Services Research,43(3), 410–425. https://doi.org/10.1007/s10488-015-0647-8.
Bickman, L., Noser, K., & Summerfelt, W. T. (1999). Long-term effects of a system of care on children and adolescents. The Journal of Behavioral Health Services & Research,26(2), 185–202. https://doi.org/10.1007/bf02287490.
Bickman, L., Riemer, M., Lambert, E. W., Douglas Kelley, S., Breda, C., Dew, S. E., et al., Brannan, A. M., & Vides de Andrade, A. R. (Eds.). (2007). Manual of the peabody treatment progress battery. Nashville, TN: Vanderbilt University.
Blass, T. (2005). The urban psychology of Stanley Milgram. Journal of Urban Distress and the Homeless,14(1–2), 12–22. https://doi.org/10.1179/105307805807066293.
de Jong, K., Barkham, M., Wolpert, M., Douglas, S., & Delgadillo, J. et al. (2019). The impact of progress feedback on outcomes of psychological interventions: An overview of the literature and a roadmap for future research. Manuscript submitted for peer review.
Douglas Kelley, S., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry,22, 363–368. https://doi.org/10.1097/yco.0b013e32832c9162.
Douglas Kelley, S., Bickman, L., & Norwood, E. (2010). Evidence-based treatments and common factors in youth psychotherapy. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: What works in therapy (2nd ed., pp. 325–355). Washington: American Psychological Association. https://doi.org/10.1037/12075-011.
Douglas, S., Button, S., & Casey, S. E. (2016). Implementing for sustainability: Promoting use of a measurement feedback system for innovation and quality improvement. Administration and Policy in Mental Health and Mental Health Services Research,43(3), 286–291. https://doi.org/10.1007/s10488-014-0607-8.
Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy Research,25(6), 678–693. https://doi.org/10.1080/10503307.2015.1059966.
Fitzpatrick, J. (2002). A conversation with Leonard Bickman. American Journal of Evaluation,23(1), 69–80. https://doi.org/10.1016/s1098-2140(01)00164-3.
Fitzpatrick, J., Christie, C., & Mark, M. M. (2009). The evaluation of the Ft. Bragg and Stark County systems of care for children and adolescents: An interview with Len Bickman. In Evaluation in action: Interviews with expert evaluators (pp. 69–92). Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412990288.d17.
Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., … Hoagwood, K. (2016). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research,43(3), 426–440. https://doi.org/10.1007/s10488-015-0642-0.
Guttentag, M., & Struening, E. L. (Eds.). (1975). Handbook of evaluation research (v 2). Thousand Oaks, CA: Sage Publications.
Joint Commission. (2011). Comprehensive accreditation manual for behavioral health care. Oakbrook Terrace, IL: Joint Commission Resources.
Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L. (2006). Meta-analysis of therapeutic relationship variables in youth and family therapy: The evidence for different relationship variables in the child and adolescent treatment outcome literature. Clinical Psychological Review,26(1), 50–65. https://doi.org/10.1016/j.cpr.2005.09.001.
Leviton, L. C., Khan, L. K., Rog, D., Dawkins, N., & Cotton, D. (2010). Evaluability assessment to improve publich health policies, programs, and practices. Annual Review of Public Health,31, 213–233. https://doi.org/10.1146/annurev.publhealth.012809.103625.
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., et al. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry,76(3), 324–335. https://doi.org/10.1001/jamapsychiatry.2018.3329.
Riemer, M., Athay, M. M., Bickman, L., Breda, C., Douglas Kelley, S., & Vides de Andrade, A. R. (2012). The peabody treatment progress battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research,39(1–2), 3–12. https://doi.org/10.1007/s10488-012-0404-1.
Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson, & B. Campbell (Eds.), Social psychology and evaluation (pp. 102–139). New York, NY: Guilford Press.
Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America,14(2), 241–254. https://doi.org/10.1016/j.chc.2004.05.002.
Rivlin, L. G. (1992). A tribute to Harold M. Proshansky (1920–1990). Journal of Environmental Psychology,12(1), 1–4. https://doi.org/10.1016/s0272-4944(05)80292-0.
Rotheram-Borus, M. J., Swendeman, D., & Chorpita, B. F. (2012). Disruptive innovations for designing and diffusing evidence- based interventions. American Psychologist,67(6), 463–476. https://doi.org/10.1037/a0028180.
Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice,22(1), 49–59. https://doi.org/10.1016/j.cbpra.2014.01.010.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Susan Douglas reported receipt of compensation related to the Peabody Treatment Progress Battery and a financial relationship with Mirah; there is a management plan to ensure that this conflict does not jeopardize the objectivity of her research. No other disclosures were reported.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Douglas, S. An Innovator and a Disruptor: Leonard Bickman on Program Theory, Null Findings, and Advice to Future Child Mental Health Services Researchers. Adm Policy Ment Health 47, 788–794 (2020). https://doi.org/10.1007/s10488-020-01043-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-020-01043-0