Skip to main content

Advertisement

Log in

Investigating Variations in Implementation Fidelity of an Organizational-Level Occupational Health Intervention

  • Published:
International Journal of Behavioral Medicine Aims and scope Submit manuscript

Abstract

Background

The workplace has been suggested as an important arena for health promotion, but little is known about how the organizational setting influences the implementation of interventions.

Purpose

The aims of this study are to evaluate implementation fidelity in an organizational-level occupational health intervention and to investigate possible explanations for variations in fidelity between intervention units.

Method

The intervention consisted of an integration of health promotion, occupational health and safety, and a system for continuous improvements (Kaizen) and was conducted in a quasi-experimental design at a Swedish hospital. Implementation fidelity was evaluated with the Conceptual Framework for Implementation Fidelity and implementation factors used to investigate variations in fidelity with the Framework for Evaluating Organizational-level Interventions. A multi-method approach including interviews, Kaizen notes, and questionnaires was applied.

Results

Implementation fidelity differed between units even though the intervention was introduced and supported in the same way. Important differences in all elements proposed in the model for evaluating organizational-level interventions, i.e., context, intervention, and mental models, were found to explain the differences in fidelity.

Conclusion

Implementation strategies may need to be adapted depending on the local context. Implementation fidelity, as well as pre-intervention implementation elements, is likely to affect the implementation success and needs to be assessed in intervention research. The high variation in fidelity across the units indicates the need for adjustments to the type of designs used to assess the effects of interventions. Thus, rather than using designs that aim to control variation, it may be necessary to use those that aim at exploring and explaining variation, such as adapted study designs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Cohen WS. Health promotion in the workplace: a prescription for good health. Am Psychol. 1985;40(2):213–6.

    Article  CAS  PubMed  Google Scholar 

  2. Ilgen DR. Health issues at work. Opportunities for industrial/organizational psychology. Am Psychol. 1990;45(2):273–83.

    Article  CAS  PubMed  Google Scholar 

  3. Drach-Zahavy A. Workplace health friendliness: a cross-level model for predicting workers’ health. J Occup Health Psychol. 2008;13(3):197–213.

    Article  PubMed  Google Scholar 

  4. Bamberger P, Sonnensthul W. Tailoring union-wide innovations to local conditions: the case of member assistance program implementation in the airline industry. Labor Stud J. 1996;21:19–39.

    Google Scholar 

  5. Hays C, Hays SP, DeVille J, Mulhall PF. Capacity for effectiveness: the relationship between coalition structure and community impact. Eval Program Plan. 2000;23(3):373–9.

    Article  Google Scholar 

  6. Wilson MG, Dejoy DM, Vandenberg RJ, Richardson HA, McGrath AL. Work characteristics and employee health and well‐being: test of a model of healthy work organization. J Occup Organ Psychol. 2004;77(4):565–88.

    Article  Google Scholar 

  7. Nielsen K, Randall R, Holten A, Rial Gonzale E. Conducting organizational-level occupational health interventions: what works? Work Stress. 2010;24(3):234–59.

    Article  Google Scholar 

  8. EU-OSHA. European survey of enterprises on new and emerging risks: managing safety and health at work. Luxembourg. 2010.

  9. Semmer NK. Job stress interventions and the organization of work. Scand J Work Environ Health. 2006;32:515–27.

    Article  PubMed  Google Scholar 

  10. Kompier MAJ, Kristensen TS. Organizational work stress interventions in a theoretical, methodological and practical context. In: Dunham, editor. Stress in the workplace: past, present and future. London: Whurr Publishers; 2001.

  11. Taris TW, Kompier MAJ, Geurts SA, Schreurs PJ, Schaufeli WB, de Boer E, et al. Stress management interventions in the Dutch domiciliary care sector: findings from 81 organizations. Int J Stress Manag. 2003;10(4):297–325.

    Article  Google Scholar 

  12. Mikkelsen A, Saksvik PØ, Landsbergis P. The impact of a participatory organizational intervention on job stress in community health care institutions. Work Stress. 2000;14(2):156–70.

    Article  Google Scholar 

  13. Ruotsalainen J, Serra C, Marine A, Verbeek J. Systematic review of interventions for reducing occupational stress in health care workers. Scand J Work Environ Health. 2008;34(3):169–78.

    Article  PubMed  Google Scholar 

  14. Briner RB, Reynolds S. The costs, benefits, and limitations of organizational level stress interventions. J Organ Behav. 1999;20(5):647–64.

    Article  Google Scholar 

  15. Van der Klink J, Blonk R, Schene AH, Van Dijk F. The benefits of interventions for work-related stress. Am J Public Health. 2001;91(2):270–6.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Nielsen K, Taris T, Cox T. The future of organizational interventions: addressing the challenges of today’s organizations. Work Stress. 2010;24(3):219–33.

    Article  Google Scholar 

  17. Egan M, Bambra C, Thomas S, Petticrew M, Whitehead M, Thomson H. The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control. J Epidemiol Community Health. 2007;61(11):945–54.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Nielsen K, Randall R. Opening the black box: presenting a model for evaluating organizational-level interventions. Eur J Work Organ Psychol. 2013;22(5):601–17.

    Article  Google Scholar 

  19. Murta SG, Sanderson K, Oldenburg B. Process evaluation in occupational stress management programs: a systematic review. Am J Health Promot. 2007;21(4):248–54.

    Article  PubMed  Google Scholar 

  20. Bambra C, Egan M, Thomas S, Petticrew M, Whitehead M. The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions. J Epidemiol Community Health. 2007;61(12):1028–37.

    Article  PubMed Central  PubMed  Google Scholar 

  21. Roen K, Arai L, Roberts H, Popay J. Extending systematic reviews to include evidence on implementation: methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006;63(4):1060–71.

    Article  PubMed  Google Scholar 

  22. Egan M, Bambra C, Petticrew M, Whitehead M. Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions. J Epidemiol Community Health. 2009;63(1):4–11.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  23. Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40).

  24. Steckler AB, Linnan L. Process evaluation for public health interventions and research. Jossey-Bass; 2002.

  25. Womack JP, Jones DT, Roos D. The machine that changed the world: the story of lean production. New York: Rawson Associates; 1990.

    Google Scholar 

  26. Jacobson GH, Mccoin NS, Lescallette R, Russ S, Slovis CM. Kaizen: a method of process improvement in the emergency department. Acad Emerg Med. 2009;16(12):1341–9.

    Article  PubMed  Google Scholar 

  27. Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.

    Article  PubMed  Google Scholar 

  28. Yin RK. Case study research: design and methods. Sage Publications Inc; 2003.

  29. Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5(67).

  30. Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7(23).

  31. von Thiele Schwarz U, Hasson H, Lindfors P. Applying a fidelity framework to understand adaptations in an occupational health intervention. Work. 2014. doi:10.3233/WOR-141840.

  32. Randall R, Nielsen K, Tvedt SD. The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work Stress. 2009;23(1):1–23.

    Article  Google Scholar 

  33. Yang B, Watkins KE, Marsick VJ. The construct of the learning organization: dimensions, measurement, and validation. Hum Resour Dev Q. 2004;15(1):31–55.

    Article  Google Scholar 

  34. Lien BYH, Hung RYY, Yang B, Li M. Is the learning organization a valid concept in the Taiwanese context? Int J Manpow. 2006;27(2):189–203.

    Article  Google Scholar 

  35. Song JH, Joo BKB, Chermack TJ. The Dimensions of Learning Organization Questionnaire (DLOQ): a validation study in a Korean context. Hum Resour Dev Q. 2009;20(1):43–64.

    Article  Google Scholar 

  36. Taylor JC, Bowers DG. Survey of organizations: a machine-scored standardized questionnaire instrument. Ann Arbour: University of Michigan, Institute for Social Research; 1972.

    Google Scholar 

  37. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.

    Article  PubMed  Google Scholar 

  38. Ulhassan W. Westerlund H, Thor J, Sandahl C, von Thiele Schwarz U. How does Lean relate to teamwork? A prospective observational study in a Swedish hospital. Submitted for publication. 2013.

  39. Frykman M. Hasson H, Atlin Muntlin Å, von Thiele Schwarz U. Functions of behavior change interventions when implementing multi-professional teamwork at an emergency department: a comparative case study. BMC Health Serv Res. 2014;14:218.

  40. Nytrø K, Saksvik P, Mikkelsen A, Bohle P, Quinlan M. An appraisal of key factors in the implementation of occupational stress interventions. Work Stress. 2000;14(3):213–25.

    Article  Google Scholar 

  41. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3.

  42. Randall R, Griffiths A, Cox T. Evaluating organizational stress-management interventions using adapted study designs. Eur J Work Organ Psychol. 2005;14(1):23–41.

    Article  Google Scholar 

  43. Cox T, Karanika M, Griffiths A, Houdmont J. Evaluating organizational-level work stress interventions: beyond traditional methods. Work Stress. 2007;21(4):348–62.

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank all employees and managers participating in the study. The study was financed by AFA Insurance (Grant No. 110094).

Ethical Standards

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000 and 2008.

Conflict of Interest

Authors Hanna Augustsson, Ulrica von Thiele Schwarz, Terese Stenfors-Hayes, and Henna Hasson declare that they have no conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hanna Augustsson.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Augustsson, H., von Thiele Schwarz, U., Stenfors-Hayes, T. et al. Investigating Variations in Implementation Fidelity of an Organizational-Level Occupational Health Intervention. Int.J. Behav. Med. 22, 345–355 (2015). https://doi.org/10.1007/s12529-014-9420-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12529-014-9420-8

Keywords

Navigation