Abstract
Background
Physicians are increasingly asked to improve the delivery of clinical services and patient experiences of care.
Objective
We evaluated the association between clinical performance and patient experiences in a statewide sample of physician practice sites and a sample of physicians within a large physician group.
Design, Setting, Participants
We separately identified 373 practice sites and 119 individual primary care physicians in Massachusetts.
Measurements
Using Health Plan Employer Data and Information Set data, we produced two composites addressing processes of care (prevention, disease management) and one composite addressing outcomes. Using Ambulatory Care Experiences Survey data, we produced seven composite measures summarizing the quality of clinical interactions and organizational features of care. For each sample (practice site and individual physician), we calculated adjusted Spearman correlation coefficients to assess the relationship between the composites summarizing patient experiences of care and those summarizing clinical performance.
Results
Among 42 possible correlations (21 correlations involving practice sites and 21 involving individual physicians), the majority were positive in site level (71%) and physician level (67%) analyses. For the 28 possible correlations involving patient experiences and clinical process composites, 8 (29%) were significant and positive, and only 2 (7%) were significant and negative. The magnitude of the significant positive correlations ranged from 0.13 to 0.19 at the site level and from 0.28 to 0.51 at the physician level. There were no significant correlations between patient experiences and the clinical outcome composite.
Conclusions
The modest correlations suggest that clinical quality and patient experience are distinct, but related domains that may require separate measurement and improvement initiatives.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.
Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348:2218–27.
Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353:692–700.
Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003;289:305–12.
Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. Jama. 2000;283:1866–74.
Massachusetts Health Quality Partners. Quality Reports. Available at: http://www.mhqp.org/quality/whatisquality.asp?nav = 030000. Accessed August 5, 2008.
Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148:111–23.
Rosenthal MB, Landon BE, Normand SL, Frank RG, Epstein AM. Pay for performance in commercial HMOs. N Engl J Med. 2006;355:1895–902.
Doran T, Fullwood C, Gravelle H, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355:375–84.
Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. Jama. 2005;294:1788–93.
Institute of Medicine. Primary Care: America’s Health in a New Era. Washington, DC: National Academy Press; 1996.
Safran DG, Karp M, Coltin K, et al. Measuring patients’ experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006;21:13–21.
Audet AM, Davis K, Schoenbaum SC. Adoption of patient-centered care practices by physicians: results from a national survey. Arch Intern Med. 2006;166:754–9.
Bergeson SC, Dean JD. A systems approach to patient-centered care. Jama. 2006;296:2848–51.
Hasnain-Wynia R. Is evidence-based medicine patient-centered and is patient-centered care evidence-based? Health Serv Res. 2006;41:1–8.
Friedberg MW, Coltin KL, Pearson SD, et al. Does Affiliation of Physician Groups with One Another Produce Higher Quality Primary Care? J Gen Intern Med. 2007.
Dillman DA. Mail and Telephone Surveys: The Total Design Method. New York: John Wiley; 1978.
Barton MB, Dayhoff DA, Soumerai SB, Rosenbach ML, Fletcher RH. Measuring access to effective care among elderly medicare enrollees in managed and Fee-for-Service care: a retrospective cohort study. BMC Health Serv Res. 2001;1:11.
Pereira AG, Kleinman KP, Pearson SD. Leaving the practice: effects of primary care physician departure on patient care. Arch Intern Med. 2003;163:2733–6.
Sequist TD, Marshall R, Lampert S, Buechler EJ, Lee TH. Missed opportunities in the primary care management of early acute ischemic heart disease. Arch Intern Med. 2006;166:2237–43.
Sequist TD, Adams A, Zhang F, Ross-Degnan D, Ayanian JZ. Effect of quality improvement on racial disparities in diabetes care. Arch Intern Med. 2006;166:675–81.
Sequist TD, Fitzmaurice GM, Marshall R, Shaykevich S, Safran DG, Ayanian JZ. Physician performance and racial disparities in diabetes mellitus care. Arch Intern Med. 2008;168:1145–51.
National Center for Quality Assurance. HEDIS 2005 Volume 1: Narrative - What’s in it and why it matters.; 2004.
Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor: Health Administration Press; 1980.
Nunnally JC, Bernstein IH. Psychometric Theory. New York: McGraw Hilll; 1994.
Davis K, Schoenbaum SC, Audet AM. A 2020 vision of patient-centered primary care. J Gen Intern Med. 2005;20:953–7.
Safran DG. Defining the future of primary care: what can we learn from patients? Ann Intern Med. 2003;138:248–55.
Schneider EC, Zaslavsky AM, Landon BE, Lied TR, Sheingold S, Cleary PD. National quality monitoring of Medicare health plans: the relationship between enrollees’ reports and the quality of clinical care. Med Care. 2001;39:1313–25.
Fung CH, Elliott MN, Hays RD, et al. Patients’ preferences for technical versus interpersonal quality when selecting a primary care physician. Health Serv Res. 2005;40:957–77.
Montgomery JE, Irish JT, Wilson IB, et al. Primary care experiences of medicare beneficiaries, 1998 to 2000. J Gen Intern Med. 2004;19:991–8.
Kahn KL, Schneider EC, Malin JL, Adams JL, Epstein AM. Patient centered experiences in breast cancer: predicting long-term adherence to tamoxifen use. Med Care. 2007;45:431–9.
Kahn KL, Tisnado DM, Adams JL, et al. Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease? Health Serv Res. 2007;42:63–83.
Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–20.
DiMatteo MR. Enhancing patient adherence to medical recommendations. Jama. 1994;271:79–83.
DiMatteo MR, Sherbourne CD, Hays RD, et al. Physicians’ characteristics influence patients’ adherence to medical treatment: results from the Medical Outcomes Study. Health Psychol. 1993;12:93–102.
Werner RM, Bradlow ET. Relationship between Medicare’s hospital compare performance measures and mortality rates. Jama. 2006;296:2694–702.
Acknowledgements
We would like to thank Massachusetts Health Quality Partners for allowing us use of statewide data for these analyses; Jo-Anne Foley at HVMA for helping to obtain physician-level data; and Angela Li, Angie Rodday, and Hong Chang at Tufts-New England Medical Center for analytic support. This study was funded by the Commonwealth Fund and the William Randolph Hearst Foundation. Dr. Sequist has served as a consultant on the Aetna External Advisory Committee for Racial and Ethnic Equality. Dr. Sequist had full access to all the data in the study and takes responsibility for the integrity and the accuracy of the data analysis.
Conflict of Interest
None disclosed.
Author information
Authors and Affiliations
Corresponding author
Additional information
Acknowledgements: This study was funded by the Commonwealth Fund and the William Randolph Hearst Foundation. Dr. Sequist had full access to all the data in the study and takes responsibility for the integrity and the accuracy of the data analysis. This work was presented in abstract form at the 2007 Society for General Internal Medicine Annual Conference. We would like to thank Massachusetts Health Quality Partners for allowing us use of statewide data for these analyses; Jo-Anne Foley at HVMA for helping to obtain physician-level data; and Angela Li, Angie Rodday, and Hong Chang at Tufts-New England Medical Center for analytic support. Dr. Sequist has served as a consultant on the Aetna External Advisory Committee for Racial and Ethnic Equality.
Rights and permissions
About this article
Cite this article
Sequist, T.D., Schneider, E.C., Anastario, M. et al. Quality Monitoring of Physicians: Linking Patients’ Experiences of Care to Clinical Quality and Outcomes. J GEN INTERN MED 23, 1784–1790 (2008). https://doi.org/10.1007/s11606-008-0760-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-008-0760-4