Usability and cognitive load in the design of a personal health record
Introduction
Health information technology (HIT) use in clinical practice is growing and the extensive use of electronic health records (EHRs) has increased in response to the financial incentives promised by Centers for Medicare & Medicaid Services (CMS) and the Office of the National Coordinator for Health IT (ONC) [1] The Health Information Technology for Economic and Clinical Health (HITECH) Act supports the use of EHRs in a way that adds value to patient care through a three-stage incentive program; Meaningful Use [2]. Stage 3 of Meaningful Use aims to boost health information exchange between providers and encourage patient engagement by offering patients secure online access to their personal health information (PHI) [2]. Personal health records (PHRs) are private, secure, and confidential electronic applications that allow patients to access, manage, and share their PHI [3]. PHRs tethered to their healthcare providers’ EHRs, also known as patient portals, provide patients online access to their most up-to-date PHI, including laboratory results, medication lists, immunization histories, and more [4]. PHRs are patient-centered nature have the potential to increase patient engagement and enhance the healthcare decision-making process [3,[5], [6], [7].
Aside from viewing PHI, the PHR allows patients to update their PHI, make payments, download educational materials, schedule or view upcoming clinic visits, and complete intake forms [8]. One such intake form is the pre-visit summary. The pre-visit summary engages patients in reflecting on their medical history and identifying new health concerns before their clinic visit. The pre-visit summary promotes the accurate update of information within the EHR and reduces the time required of clinical staff to update patients’ records before their clinic visit [5]. The in-person clinic visit is then focused on interpreting, discussing, and responding to the information [9].
Several barriers impede PHR adoption, which include the "digital divide," and data accuracy and integrity [3,[10], [11], [12], [13]. One of the main challenges for PHR adoption is poor system usability [11,14,15]. Inefficient, ineffective, and complicated designs lead to dissatisfied users who abandon such PHRs despite their beneficial features [16]. Cognitive load is another challenge associated with PHR adoption. While cognitive load has been studied extensively in healthcare providers [e.g., [17], [18], [19], studies on patient cognitive load are challenging to find.
The TURF (task, user, representation, function) framework was developed specifically to understand and evaluate the usability of EHR systems. According to the TURF framework, the term usability is defined as how “useful, usable, and satisfying a system is for the intended users to accomplish goals in the work domain” [20]. A system is said to be “useful” if it fully incorporates domain functions essential for work. The system is “usable” if it is easy to learn, efficient to operate, and error-tolerant. The system is “satisfying” when it considers the system's likeability. The TURF framework guided this study's methodology. Formal usability evaluation of HIT solutions is a crucial step to HIT's success [14]. There is a gap in the literature concerning in vivo PHR usability evaluations with patients using their PHI to perform tasks. We address this gap by conducting an in vivo usability assessment with real patients completing an online pre-visit summary using their PHI to identify usability issues and cognitive load experienced during use.
Cognitive Load Theory was developed to optimize information presentation and design to promote mental performance [21]. Cognitive load is “the load that performing a task imposes on the cognitive system of a learner” [22]. Cognitive load theory divides cognitive load into three components: intrinsic, extraneous, and germane [23]. The complexity of the task causes intrinsic cognitive load, while poor presentation or design causes extraneous cognitive load. Germane cognitive load is caused by the mental load of converting learned information into a mental schema. Reducing extraneous cognitive load creates more usable systems by easing the cognitive burden of completing a task. The TURF framework refers to two competitive forces: intrinsic complexity and extrinsic difficulty. A well-designed system reduces extrinsic difficulty through simplified representations for the tasks at hand [20].
While there is currently no consensus or “gold standard” for measuring cognitive load, utilization of both objective and subjective measures provides a more accurate measurement of cognitive load [24], [25], [26], [27], [28], [29]. Cognitive load is measured objectively with performance-based or physiological measurements [20,22,[30], [31], [32], [33]. Subjective measures of cognitive load assume that subjects can report their cognitive processes through introspection [22,33].
The purpose of this study is to measure cognitive load to test the usability of an online pre-visit summary. A convergent mixed methods design was used to evaluate cardiovascular patients’ cognitive load using validated measures. We asked the following research question to guide our methodology and analysis:
Which tasks within the pre-visit summary induce an increased cognitive load upon patients completing the form?
Section snippets
Participant population
A convenience sample of thirty-five adult cardiovascular patients participated in the study. Inclusion criteria were as follows: patients had to be English speaking, a current patient at the medical center, and scheduled for a follow-up outpatient clinic visit. Their cardiology physician determined the participant's physical and cognitive competency before participation in the study. Patients with cardiovascular comorbidities were chosen because of the considerable disease burden on US
Participant characteristics
Thirty-five adult patients of the Heart and Vascular Center participated in this study. One participant withdrew consent before completing the first page of the pre-visit summary due to difficulties using a mouse and keyboard. Twelve participants were female, fourteen were between the ages of 19 and 64, and eighteen were 65 years of age or older (Table 4). The participants were also asked to rate their level of comfort using a computer on a 5-point Likert scale, with 24 participants stating
Discussion
Our findings demonstrate that the interactive pre-visit summary intake form is a viable option for patients to use at home and can increase PHR use. Our results show that different types of information require different levels of cognitive effort to complete. While this may seem obvious, most patients still provide their pre-visit summary information using a paper form in the doctor's office. Patients experienced a high intrinsic cognitive load because of the recall of complex health
Conclusion
This study identified several tasks within the pre-visit summary that induced higher cognitive load; Medications, Immunizations, Family History, and Active Health Concerns. Health information recall and User interface design issues contributed to higher cognitive load among participants. Health information recall suggests that participants may have struggled to remember the names of medications or details regarding immunizations. Participants experienced low cognitive load completing pages with
Author Statements
Funding: This research was funded by an NIH AHRQ R-01 grant number HS022110-01A1.
Competing interests: None declared
Ethical approval: This research was approved by the IRB of the University of Nebraska Medical Center.
References (55)
- et al.
TURF: toward a unified framework of EHR usability
J Biomed Inform
(2011) - et al.
An eye-tracking study of website complexity from cognitive load perspective
Decis Support Syst
(2014) - et al.
Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record
Int J Med Inf
(2015) - et al.
The NASA task load index as a measure of overall workload among neonatal, paediatric and adult intensive care nurses
Intensive Crit Care Nurs
(2018) - Centers for Medicare & Medicaid Services. Promoting interoperability (PI)2019....
- Centers for Disease Control and Prevention. Public health and promoting interoperability programs2019....
- et al.
Usability of web-based personal health records: an analysis of consumers’ perspectives background and significance
Perspect Health Inf Manag
(2016) - Vydra Pressler T., Cuaresma E., Kretovics M., Bose-Brill S.Diffusion and use of tethered personal health records in...
- Hummel J., Qualis Health Seattle M., Peggy Evans W., Bearden T., Health Q., Susan McBride I.Providing clinical...
- et al.
The value of personal health records for chronic disease management: what do we know?
Fam Med
(2011)
Harmonized patient-reported data elements in the electronic health record: supporting meaningful use by primary care action on health behaviors and key psychosocial factors
J Am Med Inform Assoc
Putting pre-visit planning into practice
Fam Pract Manag
Technology-enabled transformation in U.S. health care: early findings of personal health records and individual use. Hum.-Comput. Interact. Manag. Inf. Syst. Appl. 6th ed.
Removing barriers in using personal health record systems
The benefits of health information technology: a review of the recent literature shows predominantly positive results
Health Aff (Millwood)
A qualitative study of user-desired personal health record functionality: impact of age on desired PHR functionality. AMIA; 2016
A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence
Int J Med Inf
Barriers to the use of personal health records by patients: a structured review
PeerJ
Usability evaluation of a personal health record
AMIA Annu Symp
An exploratory study of cognitive load in diagnosing patient conditions
Int J Qual Health Care
The effect of cognitive load and patient race on physicians’ decisions to prescribe opioids for chronic low back pain: a randomized trial
Pain Med
Unpacking the complexity of patient handoffs through the lens of cognitive load theory
Teach Learn Med
Cognitive load theory and the format of instruction
Cogn Instr
Instructional control of cognitive load in the training of complex cognitive tasks
Educ Psychol Rev
Cognitive architecture and instructional design
Educ Psychol Rev
Using eye trackers for usability evaluation of health information technology: a systematic literature review
JMIR Hum Factors
Cited by (12)
Assessing the efficient use of the lightwave health information management system for health service delivery in Ghana
2023, BMJ Health and Care InformaticsResearch status and development trend of cognitive load in human-computer interaction
2023, Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMSComparative Study on 2D and 3D User Interface for Eliminating Cognitive Loads in Augmented Reality Repetitive Tasks
2023, International Journal of Human-Computer InteractionVisual Design for Predictive Display in Spatial Time-Delay Environments Considering Workload
2023, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)Private Health Record System: Improving the Patient’s Medical Knowledge with an e-Learning Approach
2023, Lecture Notes in Educational TechnologyNovel Note Templates to Enhance Signal and Reduce Noise in Medical Documentation: Prospective Improvement Study
2023, JMIR Formative Research