Abstract
Background
Little is known about what determines strategy implementation around quality improvement (QI) in small- and medium-sized practices. Key questions are whether QI strategies are associated with practice readiness and practice characteristics.
Objective
Grounded in organizational readiness theory, we examined how readiness and practice characteristics affect QI strategy implementation. The study was a component of a larger practice-level intervention, Heart of Virginia Healthcare, which sought to transform primary care while improving cardiovascular care.
Design
This observational study analyzed practice correlates of QI strategy implementation in primary care at 3 and 12 months. Data were derived from surveys completed by clinicians and staff and from assessments by practice coaches.
Participants
A total of 175 small- and medium-sized primary care practices were included.
Main Measures
Outcome was QI strategy implementation in three domains: (1) aspirin, blood pressure, cholesterol, and smoking cessation (ABCS); (2) care coordination; and (3) organizational-level improvement. Coaches assessed implementation at 3 and 12 months. Readiness was measured by baseline member surveys, 1831 responses from 175 practices, a response rate of 73%. Practice survey assessed practice characteristics, a response rate of 93%. We used multivariate regression.
Key Results
QI strategy implementation increased from 3 to 12 months: the mean for ABCS from 1.20 to 1.59, care coordination from 2.15 to 2.75, organizational improvement from 1.37 to 1.78 (95% CI). There was no statistically significant association between readiness and QI strategy implementation across domains. Independent practice implementation was statistically significantly higher than hospital-owned practices at 3 months for ABCS (95% CI, P = 0.01) and care coordination (95% CI, P = 0.03), and at 12 months for care coordination (95% CI, P = 0.04).
Conclusion
QI strategy implementation varies by practice ownership. Independent practices focus on patient care–related activities. FQHCs may need additional time to adopt and implement QI activities. Practice readiness may require more structural and organizational changes before starting a QI effort.
Similar content being viewed by others
INTRODUCTION
Quality improvement (QI) strategies play an essential role in transforming primary care practices to improve population health, enhance patient experiences and outcomes, reduce costs, and improve provider experience.1, 2 The main focus of QI strategies is to implement evidence-based clinical care 3 and to transform practices to improve organizational efficiency 4, 5 and patient experience. 6 Among the strategies implemented by primary care practices to improve quality are the patient-centered medical home model, 7,8,9 evidence-based standards of care, 10 patient portals, electronic reminder systems, 11 team-based care models, 12 and integrated behavioral health care. 13 Our study drew upon organizational readiness theory to explore factors associated with specific primary care strategic activities around QI.
Organizational readiness refers to a construct by which an organization’s members feel committed to a change and a shared belief in their ability to implement that change. 14, 15 When organizational readiness is high, team members are very likely to initiate change. 14 Contextual factors such as culture, organizational resources and structures, and policies and procedures also affect readiness for change. 15 Previous research has established a positive connection between an organization’s readiness and its change outcomes. 16,17,18 Rubenstein et al.17 found a significant association between practice readiness and practices’ commitment to QI capability in predicting leaders’ commitment to change. Another study suggested that primary care practices that were ready to implement evidence-based care could do so if they were able to remove key barriers. 18 Further, providers perceive organizational readiness to change as challenging when there is a lack of time and resources, staff resistance to change, and concern around project sustainability. 19 Although readiness theory provides a compelling conceptual framework, few studies have measured readiness empirically in order to explain variation in QI activity across primary care practices.
In this study, we hypothesized that perceived organizational readiness by practice members, both clinicians and non-clinical staff, would predict QI strategy implementation among primary care practices. 14, 15, 19 Based on the previous research findings, we further hypothesized that practice characteristics such as ownership, size, location, and specialty type, 20, 21 as well as whether the practice was recognized as a patient-centered medical home (PCMH) or part of an accountable care organization (ACO),20, 21 would play a key role in predicting QI strategy implementation. Our study is the first to explore the relationship between QI strategy implementation, practice readiness, and practice characteristics in primary care. A better understanding of factors related to QI strategy implementation can help policymakers, large healthcare systems, and primary care practices target future efforts around QI and address potential preconditions for such efforts.
METHODS
Setting
This study was part of a national project, EvidenceNOW, which was supported by the Agency for Healthcare Research and Quality (AHRQ). 22 The objective of EvidenceNOW was to disseminate and implement evidence-based guidelines in cardiovascular care in primary care settings. The Heart of Virginia Healthcare (HVH) project was one of seven national collaboratives aimed at transforming small- and medium-sized primary care practices to improve population heart health. 22 Based on previous evidence related to the success of practice coaching, 23 practices that enrolled in the HVH received personalized coaching and consultation support from experts who had experienced working with primary care for improvement. 24 The intensive intervention phase was 3 months, followed by a maintenance phase of 9 additional months. Practice coaches worked with primary care practices to identify meaningful changes in cardiovascular disease care to improve patient outcomes. 25
Recruitment
The HVH intervention recruited 203 small- to medium-sized primary care practices as described elsewhere. 20 Participating small- to medium-sized practices had up to 10 providers, including physicians, nurse practitioners, and physician assistants. 21 Practices were categorized as independent (not owned by a hospital system), hospital-owned, or federally qualified health centers (FQHC).20 Our study was approved by George Mason University’s Institutional Review Board (IRB) in 2016.
Data Source
Data were collected as part of the HVH study from 2016 to 2018 and arose from three sources. First, QI strategy implementation was assessed by coaches at the end of the 3- and 12-month intervention periods using a standardized instrument developed for this purpose. Second, self-assessed organizational readiness was assessed by member surveys at baseline, near the start of the HVH intervention, and was completed by practice members, including physicians, practice managers, nurse practitioners, physician assistants, registered nurses, and non-clinical staff. We used responses on total practice size to calculate the individual-level survey response rate. A total of 2714 members received the survey. We included 1831 complete responses on all readiness items from 175 practices, yielding a response rate of 73%. Each participant received $150 compensation upon the completion of the survey. Third, a second practice-level survey was completed by a lead clinician or practice manager at baseline to measure practice characteristics. The response rate for the practice survey was 93 %. Participating practices received $500 compensation upon completion of the survey. The practice member survey and practice survey were both administered online with paper follow-up.
Measures
Our outcome variable was the level of practice QI strategy implementation in three domains. We asked coaches to assess each practice’s QI strategy implementation across 15 different strategy items. We recoded the responses as whether the practice 1 = “has implemented the QI strategy” or 0 = “has not implemented the QI strategy” and summed the strategic activities by three domains: (1) aspirin, blood pressure, cholesterol, smoking cessation (ABCS) preparation; (2) care coordination; and (3) organizational improvement. Before aggregating, we measured the internal consistency of each domain with Cronbach’s alpha which was 0.91 for ABCS preparations, 0.94 for care coordination, and 0.92 for organizational improvement. Pearson product-moment correlations also showed strong positive correlations between each domain (ranging from r = .49 to r = .87). The differences were statistically significant when comparing the average of ABCS with that of care coordination and of organizational improvement (P = 0.001). QI strategy implementation was missing for 10 practices at 12 months.
Our key independent variable was readiness. The practice member survey assessed readiness using an instrument adapted from Weiner et al.26 The 11-item instrument measured self-reported practice readiness to adopt the HVH intervention with a 5-point Likert scale (5 = “strongly agree” to 1 = “strongly disagree”). We first calculated the readiness score by taking the average of the individual responses at the practice level. Then, we calculated the overall composite score and included it in our model as a continuous variable.
Our control variables consisted of practice-level characteristics, including practice ownership (independent practice, hospital-owned practice, or federally qualified health center (FQHC)); a categorical measure of the practice size (2–5 clinicians, 6–10 clinicians, and 11 or more clinicians); practice specialty-mix (single specialty or multispecialty); and whether the practice was located in a medically underserved area. 20, 21, 27 We also included characteristics of the patient population in the practice including the percentage of patients with Medicaid coverage or who were uninsured 20 and the percentage of patients who were age 60 and above. Further, we included indicators of whether the practice was a designated PCMH; 20, 21, 27 whether the practice was part of an ACO; 21 and whether it participated in the Million Hearts project. 28 We included the Million Hearts project in our study because its main objective of achieving population cardiovascular health was aligned with the HVH intervention. 28 We chose these control variables in our analysis based on prior research. 20, 21, 27
Statistical Analysis
Data on QI strategy implementation, readiness, and practice characteristics were measured at the practice level and all analyses were conducted using STATA software. 29 We calculated descriptive statistics of key measures (Table 1) and used multivariate linear regression analysis to assess the relationship between the level of QI strategy implementation and readiness and practice characteristics (Table 2). Each outcome variable was treated as a continuous variable in our regression and we ran separate regression models for each of the three QI strategy domains. We conducted additional analysis to examine the influence of potentially competing programs such as the Million Hearts initiative, PCMH, and ACO by excluding these variables from the regression models and testing for mediation.
RESULTS
Study Population
Among the 203 small- and medium-sized primary care practices participating in the HVH, 175 practices that responded to the readiness questionnaires were included in our analysis.
Descriptive Statistics
Table 1 displays the summary statistics and characteristics of our sample. QI strategy implementation increased across the three domains from 3 to 12 months. The mean score for the ABCS strategy implementation increased by 33%, from 1.20 to 1.59 (95% CI); for care coordination by 28%, from 2.15 to 2.75 (95% CI); and for organizational improvement by 30%, from 1.37 to 1.78 (95% CI). The mean for readiness was 3.83 (95% CI).
Of the 175 practices, 54 were independent practices (31%), 98 were hospital-owned practices (56%), and 23 were FQHCs (13%). Seventy percent of the practices had 5 or fewer clinicians. Seventy percent of the practices were single specialty, and 30% were multispecialty practice. Sixty-four percent of the participating practices were located in medically underserved areas. About half of the practices (52%) had PCMH recognition and 67% of the practices were affiliated with an ACO. Ten percent of practices participated in the Million Hearts project. The average practice had 19% of its patient population with either Medicaid coverage or uninsured and 31% of patients were 60 years or older.
Figure 1 presents the level of practice QI strategy implementation at the end of the 3- and 12-month intervention periods. There was an increase in QI strategy implementation across the domains, and the ABCS-related activities showed the greatest gains from 3 to 12 months.
Figure 2 displays practice readiness by item. The mean overall readiness composite score was 3.83.
Among the readiness components, the items endorsed with the highest scores included the following: (1) “We can support providers as they adjust to the changes” (mean score = 3.97); (2) “We want to implement these changes” (mean score = 3.91); and (3) “We are committed to making these changes” (mean score = 3.87). The lowest three mean scores included: “We can manage the politics of these changes” (mean score = 3.72); “We can keep track of progress in implementing these changes” (mean score = 3.78); and “We will do whatever it takes to implement these changes” (mean score = 3.79).
Association Between QI Strategy Implementation, Readiness, and Practice Characteristics
We conducted multivariate linear regression analysis to examine the association between QI strategy implementation and readiness. There was no statistically significant association between QI strategy implementation and readiness across the three domains (Table 2). In contrast, ownership was associated with QI implementation. Independent status, compared with hospital-owned status, was a strong predictor of higher strategy implementation, and the association was statistically significant for ABCS (95% CI, P = 0.01) and for care coordination (95% CI, P = 0.03) at 3 months. At 12 months, independent ownership continued to be statistically significantly associated with care coordination only (95% CI, P = 0.04). At 3 months, FQHC status was associated with lower implementation relative to hospital-owned practices across all three outcomes, and none was significant: ABCS implementation (95% CI, P = 0.61), care coordination (95% CI, P = 0.31), and organizational improvement (95% CI, P = 0.55). There was no effect of the FQHC status at 12 months.
Practice size was a significant predictor of a higher QI strategy implementation for organizational improvement strategies (95% CI, P = 0.005) at 3 months. Practice recognition as a PCMH was statistically significantly associated with higher strategy implementation for care coordination (95% CI, P = 0.03) at 3 months, but not at 12 months. Practice affiliation with an ACO was also statistically significantly associated with higher strategy implementation for care coordination (95% CI, P = 0.03) at 3 months. Finally, we ran an additional analysis for a possible mediating effect of PCMH and ACO affiliation and the results were unchanged.
DISCUSSIONS
Our findings provide insight into drivers of quality improvement among small- and medium-sized primary care practices. We found practice ownership plays a role in QI strategy implementation efforts, which was in line with previous research. 20, 21 Independent practices demonstrated a higher level of QI strategy implementation than those that were hospital-owned in the short run and sustained quality improvement strategies with a focus on patient care–related strategies at 1 year.
We also found FQHC practices had a lower level of QI strategy implementation in the short run. 20 This finding may reflect the financial challenges that FQHCs face and the complexity of the patients they serve. Further, over a longer time period, FQHCs increased the level of QI strategy implementation indicating that they may need additional time to build up their ability to adopt and implement these strategies. Overall study findings suggest that independently owned practices, health system–owned practices, and FQHCs might be focusing on different types of quality improvement activities.
Practice members perceived organizational readiness as relatively high, although they reported a lower ability to keep track of change and manage politics associated with change. Overall, even though we found practice readiness was positively associated with QI implementation at 3 months and 12 months, its effect was not statistically significant. Our hypothesis that greater perceived motivation and commitment to change would predict QI strategy implementation was not supported. The findings indicate that practice readiness is perhaps established over time and more structural changes at organizational level might be necessary before starting a QI effort. Our findings also suggest that practice leaders should focus on building employee confidence towards change and provide tools to monitor quality improvement activities.
We found a practice recognition as a PCMH significantly predicted a higher QI strategy implementation for care coordination–related activities. The finding was in line with previous research and consistent with the main objectives and the requirements of being a PCMH model. 6,7,8,9 This reflects that the practice was able to make the necessary changes and has an organizational structure in place for ongoing quality improvement. We also found practice affiliation with an ACO was a significant predictor of a higher implementation for care coordination–related strategies, which was consistent with previous research. 21 Finally, our study finding of practice size association with a higher implementation suggests that QI strategy implementation varies by practice size for organizational improvement–related activities.
Our study has several limitations. First, it might be possible that small practices already doing well may have been more likely to participate in the intervention. Second, this study analyzed self-reported readiness by practice staff, and responses to the questions may reflect desirability bias, although we note the significant variation in this measure across practices. Third, there is no standardization of coach qualifications; 25 thus, variation in coaches’ knowledge, experience, and skillsets might have biased the assessment of the practice QI strategic activity. Finally, the study was based on nearly 200 primary care practices in Virginia willing to participate in the Heart of Virginia Healthcare, but results may not generalize to other geographic areas or practices.
To the best of our knowledge, this study is the first that examined the relationship between QI strategy implementation and readiness and practice characteristics. The study’s findings highlight the importance of QI implementation variation in small- to medium-sized primary care practice characteristics with respect to QI efforts. Our findings suggest that FQHC practices may need additional time and support for adapting and implementing QI strategies. There might be a need for more structural changes and resources in quality improvement and transformation efforts for maintaining practice readiness. QI authorities should consider these characteristics and structural needs before designing a quality improvement intervention for an ongoing quality enhancement.
References
Quality Improvement in Primary Care. Content last reviewed September 2018. Agency for Healthcare Research and Quality, Rockville, MD.
Bodenheimer T, Pham HH. Primary care: current problems and proposed solutions. Health Aff (Millwood). 2010 May; 29(5):799-805.
Charif B, Zomahoun A, LeBlanc H, et al. Effective Strategies for Scaling Up Evidence-Based Practices in Primary Care: a Systematic Review. Implementation Sci 12, 139 (2017) doi:https://doi.org/10.1186/s13012-017-0672-y.
Rubenstein, L., Hempel, S., Danz, M. et al. Eight Priorities for Improving Primary Care Access Management in Healthcare Organizations: Results of a Modified Delphi Stakeholder Panel. J GEN INTERN MED (2019). https://doi.org/10.1007/s11606-019-05541-2.
Hung DY, Harrison MI, Martinez MC, Luft HS. Scaling lean in primary care and impacts on organizational performance. J Patient Cent Res Rev. 2016; 3:206.
Kuzel AJ. Ten steps to a patient-centered medical home. Family Practice Management. 2009; 16(6): 18-24.
Crabtree, BF, Nutting P, Miller W et al. Primary Care Practice Transformation Is Hard Work. Med Care. 2011 Dec;49 Suppl: S28-35. doi: https://doi.org/10.1097/MLR.0b013e3181cad65c.
Nutting P, Crabtree BF, Stewart EE et al. Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann. Fam. Med. 2010 May; 8 (Suppl 1): S33-S44.
Reid RJ, Coleman K, Johnson EA, et al. The group health medical home at year 2: cost savings, higher patient satisfaction, and less burnout for providers. Health Aff (Millwood). 2010; 29(5): 835–843.
AAFP Clinical Practice Guidelines. Accessed on November 18, 2019 from https://www.aafp.org/patient-care/browse/type.tag-clinical-practice-guidelines.html
Reed ME, Huang J, Brand RJ et al. Patients with Multiple Chronic Conditions: Health Care Use and Clinical Events Associated with Access to a Patient Portal. PLOS ONE. 2019. doi.org/10.1371/journal.pone.0217636.
Goldberg DG, Beeson T, Kuzel AJ, Love LE, Carver MC. Team-based care: a critical element of primary care practice transformation. Popul Health Manag. 2013; 16 (3):150-6
Mechanic D. More people than ever before are receiving behavioral health care in the United States, but gaps and challenges remain. Health Aff (Millwood) 2014; 33:1416-1424.
Weiner, B.J. A theory of organizational readiness for change. Implement Sci. 2009; 4:67. doi: https://doi.org/10.1186/1748-5908-4-67. Retrieved November 22, 2015 from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2770024/.
Weiner B. J., Amick H, and Lee S. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev, 2008, 65(4):379–436. Retrieved December 1st, 2015 from PubMed.
Holt, D., Armenakis, A., Harris, S. & Field, H. Readiness for organizational change: the systematic development of a scale. Journal of Applied Behavioral Science, Vol.43 No. 2, June 2007. PubMed.
Rubenstein LV, Danz SD, Crain AL, Glasgow RE, Whitebird RR, Solberg LI. Assessing organizational readiness for depression care quality improvement: relative commitment and implementation capability. Implementation Science, 2014; 9:173.
Solberg, L, Crain L, Jaeckels N et al. The DIAMOND initiative: implementing collaborative care for depression in 75 primary care clinics. Implementation Science 2013, 8:135.
Abrahamson K, Myers J, Arling G, Davila H, Mueller C, Abery B. Capacity and readiness for quality improvement among home and community-based service providers. Home Health Care Services Quarterly, Volume 35, 2016 - Issue 3-4.
Cuellar AE, Krist AH, Nichols LM, Kuzel AJ. Effect of practice ownership on work environment, learning culture, psychological safety, and burnout. Annals of Family Medicine. www. Annfammed.org. Vol. 16, Supplement 1, 2018.
Balasubramanian B, Marino M, Cohen D et al. Use of Quality Improvement Strategies Among Small to Medium-Size US Primary Care Practices. Annals of Family Medicine. doi: 10.1370/afm.2172Ann Fam Med April 2018 vol. 16no. Suppl 1 S35-S43.
US Department of Health and Human Services. Agency for Healthcare Research and Quality (AHRQ). Evidence Now: advancing heart health in primary care. Available at: https://www.ahrq.gov/evidencenow/index.html. Accessed November 12, 2015.
Grumbach K, Bainbridge E, Bodenheimer T. Facilitating improvement in primary care: the promise of practice coaching. Issue Brief (Commonw Fund). 2012; 15: 1-14.
Kuzel A. Heart of Virginia Healthcare. (n.d.). Retrieved from: https://www.vahealthinnovation.org/2015/06/04/heart-of-virginia-healthcare/.
Aligning Forces for Quality, “Practice Coaching Program Manual” (Washington, D.C.: Sept. 10, 2010), available at http://forces4quality.org/ practice-coaching-program-manual.
Weiner B. J., H. Amick, and S. Lee. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev, 2008, 65(4):379–436.
Blechter B, Jiang N, Cleland C, Berry C, Ogedegbe O, Shelley D. Correlates of burnout in small independent primary care practices in an urban setting. J Am Board Fam Med. 2018 Jul-Aug;31(4):529-536. doi: https://doi.org/10.3122/jabfm.2018.04.170360.
About Million Hearts. (n.d.). Retrieved from https://millionhearts.hhs.gov/about-million-hearts/index.html.
STATA: StataCorp. 2015. Stata Statistical Software: Release 14. College Station, TX: StataCorp LP.).
Funding
This study was supported by a grant from the Agency for Healthcare Research and Quality, R18: HS023913, Anton J. Kuzel, principal investigator.
Author information
Authors and Affiliations
Contributions
There is no other person who contributed to the manuscript that did not meet the criteria for authorship.
Corresponding author
Ethics declarations
Our study was approved by George Mason University’s Institutional Review Board (IRB) in 2016.
Conflict of Interest
The authors declare that they do not have a conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Soylu, T.G., Cuellar, A.E., Goldberg, D.G. et al. Readiness and Implementation of Quality Improvement Strategies Among Small- and Medium-Sized Primary Care Practices: an Observational Study. J GEN INTERN MED 35, 2882–2888 (2020). https://doi.org/10.1007/s11606-020-05978-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-020-05978-w