Abstract
According to the human factors paradigm for patient safety, health care work systems and innovations such as electronic medical records do not have direct effects on patient safety. Instead, their effects are contingent on how the clinical work system, whether computerized or not, shapes health care providers’ performance of cognitive work processes. An application of the human factors paradigm to interview data from two hospitals in the Midwest United States yielded numerous examples of the performance-altering effects of electronic medical records, electronic clinical documentation, and computerized provider order entry. Findings describe both improvements and decrements in the ease and quality of cognitive performance, both for interviewed clinicians and for their colleagues and patients. Changes in cognitive performance appear to have desirable and undesirable implications for patient safety as well as for quality of care and other important outcomes. Cognitive performance can also be traced to interactions between work system elements, including new technology, allowing for the discovery of problems with “fit” to be addressed through design interventions.
Similar content being viewed by others
References
Aarts J, Koppel R (2009) Implementation of computerized physician order entry in seven countries. Health Aff 28:404–414
Aarts J, Doorewaard H, Berg M (2004) Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center. J Am Med Inform Assoc 11:207–216
Ajzen I (1991) The theory of planned behavior. Org Behav Hum Decis Process 50:179–211
Ammenwerth E, Iller C, Mahler C (2006) IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study. BMC Med Inform Decis Mak, 6:http://www.biomedcentral.com/1472-6947/1476/1473
Ash JS, Bates DW (2005) Factors and forces affecting EHR system adoption: report of a 2004 ACMI discussion. J Am Med Inform Assoc 12:8–12
Ash JS, Berg M, Coiera E (2004) Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 11:104–112
Ash JS, Sittig DF, Dykstra RH, Guappone K, Carpenter JD et al (2007) Categorizing the unintended sociotechnical consequences of computerized provider order entry. Int J Med Inform 76S:S21–S27
Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K (2009) The unintended consequences of computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform 78S:S69–S76
Ballé M, Régnier A (2007) Lean as a learning system in a hospital ward. Leadersh Health Serv 20:33–41
Bates DW, Leape LL, Cullen DJ, Laird N, Peterson LA et al (1998) Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280:1311–1316
Blumenthal D, Glaser JP (2007) Information technology comes to medicine. N Engl J Med 356:2527–2534
Bobb AM, Payne TH, Gross PA (2007) Viewpoint: controversies surrounding use of order sets for clinical decision support in computerized provider order entry. J Am Med Inform Assoc 14:41–47
Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH (2006) Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 13:547–556
Carayon P (2006) Human factors of complex sociotechnical systems. Appl Ergon 37:525–535
Carayon P, Schoofs Hundt A, Karsh B, Gurses AP, Alvarado CJ et al (2006) Work system design for patient safety: the SEIPS model. Qual Saf Health Care 15:i50–i58
Carayon P, Smith P, Hundt AS, Kuruchittham V, Li Q (2009) Implementation of an electronic health records system in a small clinic: the viewpoint of clinic staff. Behav Inf Technol 28:5–20
Casey SM (1993) Set phasers on stun: and other true tales of design, technology and human error. Aegean, Santa Barbara
Chaudhry B, Wu S, Maglione M, Mojica W, Roth E et al (2006) Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 144:E12–E22
Dekker SWA (2007) Doctors are more dangerous than gun owners: a rejoinder to error counting. Hum Factors 49:177–184
Dekker SWA, Woods DD (2002) MABA-MABA or Abracadabra? Progress on human-automation co-ordination. Cogn Technol Work 4:240–244
Dempsey PG, Wogalter MS, Hancock PA (2000) What’s in a name? Using terms from definitions to examine the fundamental foundation of human factors and ergonomics science. Theor Issues Ergon Sci 1:3–10
Eddy DM (1998) Performance measurement: problems and solutions. Health Aff 4:7–25
Emanuel L, Berwick D, Conway J, Combes J, Hatlie M et al. (2008) What exactly is patient safety? In: K. Henriksen, J. B. Battles, M. A. Keyes, M. L. Grady (eds) Advances in patient safety: new directions and alternative approaches AHRQ publication No 08-0034-1, vol 1. Assessment Agency for Healthcare Research and Quality, Rockville
Ericsson KA, Simon HA (1980) Verbal reports as data. Psychol Rev 87:215–251
Furukawa MF, Raghu TS, Spaulding TJ, Vinze A (2008) Adoption of health information technology for medication safety in U.S. hospitals, 2006. Health Aff 27:865–875
Goodhue DL, Thompson RL (1995) Task-technology fit and individual performance. MIS Quart 19:213–236
Han YY, Carcillo JA, Venkataraman ST, Clark RSB, Watson RS et al (2005) Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics 116:1506–1512
Harrison MI, Koppel R (2010) Interactive sociotechnical analysis: identifying and coping with unintended consequences of IT implementation. In: Khoumbati K, Dwivedi YK, Srivastava A, Lal B (eds) Handbook of research on advances in health informatics and electronic healthcare applications: global adoption and impact of information communication technologies IGI global. Hershey, PA, pp 31–49
Harrison MI, Koppel R, Bar-Lev S (2007) Unintended consequences of information technologies in health care—an interactive sociotechnical analysis. J Am Med Inform Assoc 14:542–549
Henriksen K, Battles JB, Keyes MA, Grady ML (eds) (2008) Advances in patient safety: new directions and alternative approaches. AHRQ Publication No. 08-0034. Agency for Healthcare Research and Quality, Rockville
Hoffman RR, Hancock PA, Ford KM, Hayes P (2002) The triples rule. IEEE Intell Syst 17:62–65
Holden RJ (2009) People or systems? To blame is human. The fix is to engineer. Professional Safety, December, 34–41
Holden RJ (2010) Physicians’ beliefs about using EMR and CPOE: in pursuit of a contextualized understanding of health IT use behavior. Int J Med Inform 79:71–80
Holden RJ, Karsh B (2009) A theoretical model of health information technology usage behaviour with implications for patient safety. Behav Inf Technol 28:21–38
Holden RJ, Karsh B (2010) The technology acceptance model: its past and its future in health care. J Biomed Inform 43:159–172
Holden RJ, Alper SJ, Scanlon MC, Murkowski K, Rivera AJ et al. (2008) Challenges and problem-solving strategies during medication management: a study of a pediatric hospital before and after bar-coding. Paper presented at the Proceedings of the 2nd International Conference on Healthcare Systems Ergonomics and Patient Safety, Strasbourg, France
Holden RJ, Scanlon MC, Brown RL, Karsh B (2008b) What is IT? New conceptualizations and measures of pediatric nurses’ acceptance of bar-coded medication administration information technology. Annu Meet Hum Factors Ergon Soc 52:768–772
Hollnagel E (1997) Cognitive ergonomics: it’s all in the mind. Ergonomics 40:1170–1182
Hollnagel E, Woods DD (2005) Joint cognitive systems: foundations of cognitive systems engineering. CRC Press, New York
Hollnagel E, Woods DD, Leveson N (eds) (2006) Resilience engineering: concepts and precepts. Ashgate, Aldershot, UK
Horsky J, Kuperman GJ, Patel VL (2005) Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc 12:377–382
Institute of Medicine (2000) To err is human: building a safer health system. Institute of Medicine Report on Medical Errors. National Academies Press, Washington, DC
Institute of Medicine (2003) Key capabilities of an electronic health record system. National Academies Press, Washington, DC
Institute of Medicine (2007) Preventing medication errors. National Academies Press, Washington, DC
Ivari J (1992) The organizational fit of information systems. J Inform Syst 2:3–29
Jha AK, Doolan D, Grandt D, Scott T, Bates DW (2008) The use of health information technology in seven nations. Int J Med Inform 77:848–854
Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR et al (2009) Use of electronic health records in U.S. hospitals. N Engl J Med 360:1628–1638
Kaplan B (1997) Addressing organizational issues into the evaluation of medical systems. J Am Med Inform Assoc 4:94–101
Kaplan B (2001) Evaluating informatics applications—some alternative approaches: theory, social interactionism, and call for methodological pluralism. Int J Med Inform 64:39–56
Karsh B, Alper SJ (2005) Work system analysis: the key to understanding health care systems. Advances in patient safety: from research to implementation. Agency for Healthcare Research and Quality, Rockville, MD, pp 337–348
Karsh B, Escoto KH, Beasley JW, Holden RJ (2006a) Toward a theoretical approach to medical error reporting system research and design. Appl Ergon 37:283–295
Karsh B, Holden RJ, Alper SJ, Or CKL (2006b) A human factors engineering paradigm for patient safety—designing to support the performance of the health care professional. Qual Saf Health Care 15:i59–i65
Karsh B, Holden RJ, Escoto KH, Alper SJ, Scanlon MC et al (2009) Do beliefs about hospital technologies predict nurses’ perceptions of quality of care? A study of task-technology fit in two pediatric hospitals. Int J Hum Comput Interact 25:374–389
Kaushal R, Bates DW (2002) Information technology and medication safety: what is the benefit? Qual Saf Health Care 11:261–265
Klein G, Ross KG, Moon BM, Klein DE, Hoffman RR et al (2003) Macrocognition. IEEE Intell Syst 18:81–85
Klein G, Woods DD, Bradshaw JM, Hoffman RR, Feltovich PJ (2004) Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intell Syst 19:91–95
Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR et al (2005) Role of computerized physician order entry systems in facilitating medication errors. JAMA 293:1197–1203
Koppel R, Wetterneck TB, Telles JL, Karsh B (2008) Workarounds to barcode medication administration systems: their occurrences, causes, and threats to patient safety. J Am Med Inform Assoc 15:408–423
Kuehn BM (2009) IT vulnerabilities highlighted by errors, malfunctions at Veterans’ Medical Centers. JAMA 301:919–920
Kuperman GJ, Gibson RF (2003) Computer physician order entry: benefits, costs, and issues. Ann Intern Med 139:31–39
Leape LL (2009) Errors in medicine. Clin Chim Acta 404:2–5
Lin L, Vicente KJ, Doyle DJ (2001) Patient safety, potential adverse drug events, and medical device design: a human factors engineering approach. J Biomed Inform 34:274–284
Markus ML, Robey D (1983) The organizational validity of management information systems. Hum Relat 36:203–226
Mays N, Pope C (2000) Qualitative research in health care: assessing quality in qualitative research. Br Med J 320:50–52
McDonald CJ (2006) Computerization can create safety hazards: a barcoding near miss. Ann Intern Med 144:510–516
Miles MB, Huberman AM (1994) Qualitative data analysis. Sage, Thousand Oaks, CA
Miller RH, Sim I (2004) Physicians’ use of electronic medical records: barriers and solutions. Health Aff 23:116–126
Miller A, Scheinkestel C, Steele C (2009) The effects of clinical information presentation on physicians’ and nurses’ decision-making in ICUs. Appl Ergon 40:753–761
National Alliance for Health Information Technology (2008) Defining key health information technology terms [Electronic Version]. Retrieved June 13, 2008 from http://definitions.nahit.org/doc/HITTermsFinalReport_051508.pdf
Oedewald P, Reiman T (2007) Special characteristics of safety critical organizations: work psychological perspective. VTT Technical Research Centre, Espoo
Palmieri PA, Peterson LT, Ford EW (2009) Technological iatrogenesis: new risks force heightened management awareness. J Healthc Risk Manag 27:19–24
Parente ST, McCullough JS (2009) Health information technology and patient safety: evidence from panel data. Health Aff 2:357–360
Patterson ES, Rogers ML, Chapman RJ, Render ML (2006) Compliance with intended use of bar code medication administration in acute and long-term care: an observational study. Hum Factors 48:15–22
Patterson ES, Cook RI, Woods DD, Render ML (2010) Gaps and resilience. In: Bogner MS (ed) Human error in medicine, 2nd edn. Erlbaum, Hillsdale (in press)
Pedersen CA, Gumpper KF (2008) ASHP national survey on informatics: assessment of the adoption and use of pharmacy informatics in U.S. hospitals—2007. Am J Health Syst Pharm 65:2244–2264
Perry SJ, Wears RL, Cook RI (2005) The role of automation in complex system failures. J Patient Saf 1:56–61
Pirnejad H, Niazkhani Z, van der Sijs H, Berg M, Bal R (2008) Impact of a computerized physician order entry system on nurse–physician collaboration in the medication process. Int J Med Inform 77:735–744
Pizziferri L, Kittler AF, Volk LA, Honour MM, Gupta S et al (2005) Primary care physician time utilization before and after implementation of an electronic health record: a time-motion study. J Biomed Inform 38:176–188
Postle BR (2006) Working memory as an emergent property of the mind and brain. Neuroscience 139:23–38
Reason J (2000) Human error: models and management. Br Med J 320:768–770
Reckmann MH, Westbrook JI, Koh Y, Lo C, Day RO (2009) Does computerized provider order entry reduce prescribing errors for hospital inpatients? A systematic review. J Am Med Inform Assoc 16:613–623
Roth EM (2008) Uncovering the requirements of cognitive work. Hum Factors 50:475–480
Saleem JJ, Russ AL, Johnson TR, Zhang J, Sittig DF (2009) Current challenges and opportunities for better integration of human factors research with development of clinical information systems. Yearb Med Inform 48–58
Shekelle PG, Morton SC, Keeler EB (2006) Costs and benefits of health information technology. Evidence Report/Technology Assessment No. 132. Agency for Healthcare Research and Quality, Rockville, MD
Silver MP, Geis MS, Bateman KA (2004) Improving health care systems performance: a human factors approach. Am J Med Qual 19:93–102
Sittig DF, Krall M, Kaalaas-Sittig J, Ash JS (2005) Emotional aspects of computer-based provider order entry: a qualitative study. J Am Med Inform Assoc 12:561–567
Sjoberg G, Williams N, Vaughan TR, Sjoberg AF (1991) The case study approach in social research: basic methodological issues. In: Feagin JR, Orum AM, Sjoberg G (eds) A case for the case study. University of North Carolina Press, Chapel Hill, pp 27–79
Spear SJ (2005) Fixing health care from the inside, today. Harv Bus Rev 83:78–91
Spencer L, Ritchie J, Lewis J, Dillon L (2003) Quality in qualitative evaluation: a framework for assessing research evidence. Government Chief Social Researcher’s Office, Cabinet Office, London
Steele AM, DeBrow M (2008) Efficiency gains with computerized provider order entry. In: Henriksen K, Battles JB, Keyes MA, Grady ML (eds) Advances in patient safety: new directions and alternative approaches AHRQ publication no 08–0034-4, vol 4. Technology and Medication Safety Agency for Healthcare Research and Quality, Rockville, MD
Steinbrook R (2009) Health care and the American Recovery and Reinvestment Act. N Engl J Med 360:1057–1060
Strauss A, Corbin J (1990) Basics of qualitative research: grounded theory, procedures and techniques. Sage, Newbury Park
Tenney YJ, Pew RW (2006) Situation awareness catches on: what? So what? Now what? Rev Hum Factors Ergon 2:1–34
The Leapfrog Group (2008) Computerized physician order entry. Retrieved October 30, 2009 from http://www.leapfroggroup.org/media/file/Leapfrog-Computer_Physician_Order_Entry_Fact_Sheet.pdf
Thielke S, Hammond K, Helbig S (2007) Copying and pasting of examinations within the electronic medical record. Int J Med Inform 76S:S122–S128
Vicente KJ (1999) Cognitive work analysis: toward safe, productive and healthy computer-based work. Erlbaum, Mahwah
Vincent C (2006) Patient safety. Elsevier, London
Vogelsmeier AA, Halbesleben JRB, Scott-Cawiezzel JR (2008) Technology implementation and workarounds in the nursing home. J Am Med Inform Assoc 15:114–119
Walker JM, Carayon P (2009) From tasks to processes: the case for changing health information technology to improve health care. Health Aff 28:467–477
Walker JM, Carayon P, Leveson N, Paulus RA, Tooker J et al (2008) EHR safety: the way forward to safe and effective systems. J Am Med Inform Assoc 15:272–277
Wears RL (2008) The error of counting “errors”. Ann Emerg Med 52:502–503
Weick KE, Sutcliffe KM (2007) Managing the unexpected: resilient performance in an age of uncertainty, 2nd edn. Jossey-Bass, San Francisco
Weiner JP, Kfuri T, Chan K, Fowles JB (2007) “e-Iatrogenesis”: the most critical unintended consequence of CPOE and other HIT. J Am Med Inform Assoc 14:387–388
Wickens CD, Flach JM (1988) Information processing. In: Wiener EL, Nagel DC (eds) Human factors in aviation. Academic Press, San Diego, pp 111–155
Wilson JR (2000) Fundamentals of ergonomics in theory and practice. Appl Ergon 31:557–567
World Health Organization (2009) WHO Patient Safety. Retrieved October 30, 2009 from http://www.who.int/patientsafety/en/
Acknowledgments
The author thanks study participants and Geoffrey Priest, Christine Baker, and Bradley Schmidt. Three anonymous reviewers provided many helpful suggestions. This research was completed as part of a doctoral dissertation under the supervision of Ben-Tzion Karsh. RJH was supported by a pre-doctoral training grant from the National Institutes of Health (1 TL1 RR025013-01) and a post-doctoral training grant from the Agency for Healthcare Research and Quality (5 T32 HS000083-11).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Holden, R.J. Cognitive performance-altering effects of electronic medical records: an application of the human factors paradigm for patient safety. Cogn Tech Work 13, 11–29 (2011). https://doi.org/10.1007/s10111-010-0141-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-010-0141-8