https://orcid.org/0000-0002-0195-2834
Figures
Abstract
Background
Nurse practitioners (NPs) play a critical role in the multidisciplinary management of patients with multiple sclerosis (MS). Neurologists´ behavioral characteristics have been associated with suboptimal clinical decisions. However, limited information is available on their impact among NPs involved in MS care. The aim of this study was to assess nurses´ therapeutic choices to understand behavioral factors influencing their decision making process.
Methods
A non-interventional, cross-sectional, web-based study was conducted. NPs actively involved in the care of patients with MS were invited to participate in the study by the Spanish Society of Neurology Nursing. Participants answered questions regarding their standard practice and therapeutic management of seven simulated relapsing-remitting MS (RRMS) case scenarios. A behavioral battery was used to measure participants´ life satisfaction, mood, positive social behaviors, feeling of helpfulness, attitudes toward adoption of evidence-based innovations, occupational burnout, and healthcare-related regret. The outcome of interest was therapeutic inertia (TI), defined as the lack of treatment escalation when there is clinical and radiological evidence of disease activity. A score to quantify TI was created based on the number of simulated scenarios where treatment intensification was warranted.
Results
Overall, 331 NPs were invited to participate, 130 initiated the study, and 96 (29%) completed the study. The mean age (SD) was 44.6 (9.8) years and 91.7% were female. Seventy-three participants (76.0%) felt their opinions had a significant influence on neurologists´ therapeutic decisions. Sixteen NPs (16.5%) showed severe emotional exhaustion related to work and 13 (13.5%) had depressive symptoms. The mean (SD) TI score was 0.97 (1.1). Fifty-six of NPs showed TI in at least one case scenario. Higher years of nursing experience (p = 0.014), feeling of helpfulness (p = 0.014), positive attitudes toward innovations (p = 0.046), and a higher intensity of care-related regret (p = 0.021) were associated with a lower risk of TI (adjusted R2 = 0.28). Burnout was associated with higher risk of TI (p = 0.001).
Citation: Saposnik G, Del Río B, Bueno-Gil G, Sempere ÁP, Lendínez-Mesa A, Rodríguez-Antigüedad A, et al. (2021) Behavioral aspects of nurse practitioners associated with optimal multiple sclerosis care in Spain. PLoS ONE 16(12): e0261050. https://doi.org/10.1371/journal.pone.0261050
Editor: Marcello Moccia, Universita degli Studi di Napoli Federico II, ITALY
Received: September 16, 2021; Accepted: November 24, 2021; Published: December 8, 2021
Copyright: © 2021 Saposnik et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Qualified researchers may request access to individual patient level data through the clinical study data request platform (https://vivli.org/). Further details on Roche's criteria for eligible studies are available at (https://vivli.org/members/ourmembers/). For further details on Roche's Global Policy on the Sharing of Clinical Information and how to request access to related clinical study documents, see (https://www.roche.com/research_and_development/who_we_are_how_we_work/clinical_trials/our_commitment_to_data_sharing.htm).
Funding: The study was funded by Roche Medical Department, Spain (SL42129). The analysis and interpretation of findings was facilitated by NeuroEconoSolutions. The funding source had no role in the design, analysis and interpretation of the data, review or approval of the manuscript, and decision to submit for publication.
Competing interests: This study was funded by the Medical Department of Roche Farma Spain (SL42129). This does not alter our adherence to PLOS ONE policies on sharing data and materials. Gustavo Saposnik is being supported by the Heart and Stroke Foundation of Canada Scientist Award following a peer-reviewed competition and reported receiving unrestricted grants and personal fees from Hoffman La Roche (Canada) and Roche Pharma (Spain). Angel Pérez Sempere received personal compensation for consulting, serving on a scientific advisory board or speaking with Almirall, Biogen Idec, Bayer Schering Pharma, Merck Serono, Novartis, Roche, Sanofi-Aventis, and Teva. Guillermo Bueno-Gil, Nicolas Medrano, and Jorge Maurino are employees of Roche Farma Spain. Beatriz Del Río, Alejandro Lendínez Mesa, Alfredo Rodríguez Antigüedad, and María Terzaghi declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Introduction
In addition to neurologists, nurse practitioners (NPs) play a critical role in the assessment and management of patients with multiple sclerosis (MS) [1, 2]. NPs have a dual liaison function by informing the treating physician of patients´ values and preferences and by facilitating discussions with patients in the shared decision making process [3–5]. This personalized model of care has been associated with higher treatment adherence and better clinical outcomes [6, 7]. Although NPs cannot prescribe MS disease-modifying therapies (DMTs) in Spain, they usually have a role in patients´ education, communicating complex information, discussing tolerability and side effects of treatments, and conveying the importance of adherence. Their close interaction with patients and family members allows them to capture complementary information (e.g. less overt symptoms such as sexual dysfunction) that can be of great help to the neurologists in making decisions.
The rising number of DMTs with different safety and efficacy profiles make the decision-making process in MS more complex [8]. As previously shown by our group and others, therapeutic decisions in MS care are influenced by healthcare providers´ behavioral characteristics, personal perceptions and biases [9–12]. Physicians’ attitudes toward care-related regret and occupational burnout can affect their diagnostic and treatment recommendations [13–15]. Neurologists´ low tolerance to uncertainty was associated with therapeutic inertia and suboptimal therapeutic decisions in MS [16, 17]. However, limited information is available on the impact of these behavioral variables among NPs involved in the multidisciplinary management of patients with MS.
In the present study, we aimed to evaluate the influence of behavioral (positive social behaviors, attitudes toward therapeutic innovations, depression) and perception factors (feeling of helpfulness, occupational burnout, healthcare-related regret) on therapeutic choices among NPs who care for MS patients.
Material and methods
We conducted a non-interventional, cross-sectional, web-based study from December 21, 2020 to April 16, 2021 (DECISIONS-MS Study). NPs actively involved in the care of patients with MS were invited to participate in the study by the Spanish Society of Neurology Nursing (SEDENE). This study was approved by the Research Ethics Board of the Hospital Universitario Clínico San Carlos (Madrid, Spain). All participants provided written informed consent.
Participants answered questions regarding their training, standard practice, and their treatment preferences in seven simulated relapsing-remitting MS (RRMS) case scenarios or case vignettes. Case scenarios were created by our research team and MS experts to reflect most common clinical encounters (S1 File). The current landscape of DMTs for the treatment of RRMS includes first-line therapies (beta interferons, glatiramer acetate, teriflunomide and dimethyl fumarate) and high-efficacy therapies (fingolimod, cladribine, and monoclonal antibodies such as natalizumab, alemtuzumab or ocrelizumab) [18, 19]. Five case scenarios included treatment escalation for patients who were on a first-line DMT and had evidence of clinical progression and subclinical disease activity based on magnetic resonance imaging (MRI) data. The other two case scenarios were used as controls where treatment intensification was not warranted according to contemporary recommendations [18, 19].
Participants also scored on a scale from 0 (no influence) to 10 (maximum influence), their perception of how their opinions were considered by the treating neurologist in the management of MS patients (feeling of helpfulness).
Behavioral battery
We included a comprehensive behavioral battery comprising validated questionnaires to measure participants´ life satisfaction, mood, attitudes toward adoption of evidence-based innovations, positive social behaviors, occupational burnout, and healthcare-related regret [20–26]. The Satisfaction with Life Scale (SWLS) was used to assess psychological or emotional well-being [20]. Participants indicate how much they agree or disagree with each of the five items using a seven-point scale that ranges from 1 (strongly disagree) to 7 (strongly agree). Higher scores reflect higher life satisfaction (a score > 26 indicates that respondents are satisfied or extremely satisfied with life). Depressive symptoms were identified using the self-report Beck Depression Inventory-Fast Screen (BDI-FS) [21]. Responses to the seven items are provided on a four-point scale (no symptoms to severe symptoms) with a total score ranging from 0 to 21. A score ≥ 4 indicates the presence of depressive symptoms. The Evidence-Based Practice Attitude Scale (EBPAS) measures attitudes toward adopting new treatments, interventions, and practices among healthcare providers [22]. The EBPAS consists of 15 items rated on a five-point Likert-type scale, ranging from 0 (not at all) to 4 (to a very great extent). Total score ranges from 1 to 4, with higher scores indicating a more positive attitude toward adoption of evidence-based innovations. Positive social behaviors were assessed using the Prosocial Behavioral Intentions Scale (PBIS) [23]. The PBIS is a validated four-item tool with a seven-point Likert-type scale ranging from 1 (definitely would not do this) to 7 (definitely would do this). Total score ranges from 1 to 7, with higher scores indicating higher levels of prosocial intentions. Occupational burnout is a common phenomenon among healthcare professionals which may influence therapeutic decisions [15]. The Maslach Burnout Inventory—Human Services Survey (MBI-HSS) is a validated 22-item instrument to measure feelings of being emotionally exhausted by the demands of work, attitudes of coldness and distancing toward recipients of care treatment, and feelings of competence and successful achievement at work [24]. In this study, the nine items related to the emotional exhaustion dimension were administered. Each item scores from 0 to 6 with higher scores indicating a greater perception of burnout. A score ≥ 27 indicates a high emotional exhaustion. Regret is an emotion experienced when one believes that the current situation would have had a better outcome by choosing a different course of action [25]. Care-related regret was associated with suboptimal choices by healthcare professionals [13]. The 10-item Regret Intensity Scale (RIS-10) is a validated tool to assess care-related regret caused by a past event, covering affective, physical, and cognitive aspects [26]. For each of the 10 items, participants are asked to rate their agreement on "how they feel now" from 1 (strongly disagree) to 5 (strongly agree). To avoid using mean scores per item, we created a summary score (overall RIS-10) for the 10 items ranging from 10 to 50. Higher scores indicate higher regret intensity. Participants with an overall score higher than 30 were considered as having regret. The validated Spanish versions of all these questionnaires were administered.
Definitions
Therapeutic Inertia (TI) refers to the absence of treatment initiation or intensification when therapeutic goals are unmet [9, 27]. In the present study, TI was defined as lack of treatment intensification from first-line DMT to high-efficacy agents when there is evidence of clinical relapses and subclinical disease activity on MRI (e.g., at least one gadolinium-enhancing T1 lesion on brain MRI) [16, 17].
Participants
NPs actively involved in the care of patients with MS were invited to participate in our study by the Spanish Society of Neurology Nursing (Sociedad Española de Enfermeria Neurológica-SEDENE). Participants received a payment on completion of the study acknowledging the time and effort they provided to collaborate in this research.
Outcome measures
The primary outcome of the study was TI defined as a continuous and binary measurement. We created a score defined as the number of case scenarios that fit the TI criteria over the total number of presented cases (score ranges from 0–5). The presence of TI was defined when participants did not escalate treatment when indicated in at least one out of five presented case scenario (binary outcome).
Statistical analysis
The primary analysis assessed the prevalence and factors associated with TI. We included the following explanatory variables: age, sex, years of professional practice, specialization in MS, work setting (low vs. high complexity), number of MS patients seen per week, co-investigator in clinical trials, co-author in peer-reviewed publications, life satisfaction, mood, attitudes toward innovations, positive social behaviors, burnout, and care-related regret.
We used parametric tests (t-test and Fisher´s exact-test) to compare continuous and categorical variables between groups. Linear regression analysis was used to determine the association of exploratory variables with the TI adjusted by age, years of experience, and behavioral variables of interest. Collinearity was assessed by the VIF score. A multivariable logistic regression analysis with backward selection was completed to determine the association between NPs’ characteristics and TI. Goodness of fitness and discrimination were assessed by the Hosmer-Lemeshow test and c-statistics, respectively. Collinearity was assessed using the VIF score (values lower than 3 are considered as low risk of collinearity). All tests were 2-tailed, and p-values <0.05 were considered significant. We used STATA 13 (College Station, TX: StataCorp LP) to conduct all analyses.
Results
Overall, 331 NPs were invited to participate, 130 initiated the study (39.3%), and 96 completed the study (29%). The mean age (SD) was 44.6 (9.8) years and 91.7% were female. Fifty (52.1%) were NPs specialized in MS care, whereas the remaining 46 (47.9%) were general NPs with some experience in managing MS patients. There were no differences in baseline characteristics between participants who initiated and those who completed the study. Seventy-three participants (76.0%) felt their opinions had a significant influence on neurologist’s therapeutic decisions. Table 1 summarizes main characteristics of the sample.
Sixty-seven NPs (69.8%) were satisfied or extremely satisfied with their life (Table 2). Most of participants had positive attitudes toward evidence-based innovations and prosocial behaviors. Sixteen participants (16.5%) showed severe burnout related to work and 13 (13.5%) had depressive symptoms and care-related regret.
Therapeutic inertia and associated factors
The mean (SD) TI score was 0.97 (1.1) and 56 (58.3%) of NPs had TI in at least one case scenario. One out of four NPs did not escalate treatment in two or more case scenarios. The control cases, where the decision not to escalate was correct, cases 2 and 7, were correctly answered by 77.1% and 82.3% respectively. The rate of the incorrect decision in the other five case scenarios (not to escalate, i.e. the rate of TI), ranged from 8.8 to 33.3% by case.
Higher nursing experience (p = 0.014), belief that their opinions matter to neurologists when making treatment decisions (feeling of helpfulness) (p = 0.014), higher intensity of care-related regret (p = 0.021), and positive attitudes toward innovations (p = 0.046) were associated with lower TI. Similar results were found for TI scores (Table 3). Higher burnout scores were associated with higher likelihood of TI (p = 0.022) or TI scores (p = 0.002). Logistic regression models showed good discrimination (c-statistics = 0.825) and fitness (goodness of fit test = 0.30). Observed vs. predicted TI score derived from linear regression models are depicted in Figs 1 and 2. Linear regression models showed a low mean VIF score of 1.74 with adequate tests for linearity and heteroscedasticity. The adjusted R2 was 0.28. The results of the multivariate linear regression analysis remained unaltered when the TI score was adjusted by the control cases. In addition, the pattern of responses in the control cases (whether or not the respondent would have escalated when not warranted) was not associated with TI score (p-value 0.96) or TI (p = 0.65).
Discussion
Multidisciplinary teams, including neurologists, nurses, and rehabilitation experts, are currently involved in the management of MS patients [2]. Although NPs cannot prescribe, they are susceptible like other healthcare providers to behavioral and perception characteristics that may influence their capability of selecting appropriate treatment choices in different hypothetical case scenarios [11, 17].
In the present study, we found that a feeling of helpfulness, positive attitudes toward evidence-based innovations, care-related regret, and occupational burnout were associated with TI. Nearly 60% of NPs had TI in at least one case scenario. Although older age was associated with higher likelihood to TI, hospital setting, number of patients seen per week, participation in research activities, or the presence of depressive symptoms were not associated with TI.
One in six NPs caring for MS patients experienced severe emotional exhaustion related to work, whereas one in seven participants had some degree of care-related regret. In a recent literature review analyzing burnout among nurses, poor quality of care, lower patient safety, error reporting, medication error, patient dissatisfaction, and family complaints were described [28]. According to our study results, TI could be included as an additional negative consequence of burnout at work among nurses. A higher intensity of regret was associated with lower risk of TI. For every ten points increased in the RIS-10 score, there was a 24% lower TI. Positive effects of regret were previously reported [29, 30]. The perception of a suboptimal choice or evidence of a bad outcome (e.g., life-threatening side effects of a DMT, disability progression, cognitive impairment) may trigger learning from a former mistake and implementation of preventive measures [25, 30]. This phenomenon appears to be associated with more cautious vs. automatic choices and recommendations in patient care.
NPs may have an impactful influence on the trajectory of care with direct consequences on patients’ outcomes [5–7]. A study with 135 NPs specialized in MS from Canada, the United States, France, Germany, Italy, Spain, and the United Kingdom identified several challenges related to disease knowledge, treatment, monitoring, psychosocial factors and patient communication [4]. Participants reported a knowledge gap in treatment sequencing and in their skills of integrating patient’s goals into treatment recommendations. Interprofessional collaboration between physicians and nurses was associated with a positive impact on a number of patient outcomes in different disorders [31]. Relations between neurologists and nurses are critical to deal with a diverse RRMS treatment landscape in complex working conditions [2, 32]. In our study, almost 80 percent of NPs felt their opinions based on a holistic assessment of MS patients had a significant influence on neurologists’ therapeutic decisions. Furthermore, this feeling of helpfulness with their job influenced a lower likelihood of TI (Fig 3).
Honing our understanding of the factors influencing therapeutic choices may allow the development of strategies that result in better patient care [13, 15, 27]. Further education using innovative technologies and proven effective tools is needed to optimize the management of MS patients. For example, a randomized study showed that the traffic light system educational intervention was associated with a 70% improvement in decision choices among neurologists compared to usual care [33]. Similar educative strategies can be developed to target NPs.
Our study has some limitations that deserve mention. First, NPs are not the ultimate decision maker regarding treatment choices. Second, the participants´ knowledge of MS treatment guidelines in order to know if they were able to answer the case scenarios was not collected. In addition, the option to state “I don´t know” was not offered in the multiple-choice design. Therefore, we cannot rule out that poor knowledge may have influenced responses although this should have been mitigated by our recruitment of NPs with strong expertise in MS care and a high rate of involvement in MS clinical trials and training programs. Third, some of the case scenarios contained answers that were not strictly categorical and may have caused confusion for participants. Fourth, we cannot rule out the possibility of residual confounding despite the comprehensive adjustment in the analysis. Finally, this is a single-country study and the results may not necessarily be representative of nurses working in other countries with different activities and responsibilities in the management of MS patients.
Conclusions
The assessment of NPs´ participation in the decision making of DMTs for RRMS has been little explored, especially when considering their role in advising the treating neurologist about patients´ current clinical status. Our results quantified the presence and consequences of feeling of helpfulness, attitudes toward innovation, regret, and burnout in MS care in a sample of NPs in Spain. Continuing education and specific strategies for reducing occupational burnout may lead to better management skills and improve the management of MS patients. Further studies are needed to confirm that these findings are similar among NPs from other countries with different healthcare systems.
Supporting information
S1 File. Case scenarios as presented to participants.
https://doi.org/10.1371/journal.pone.0261050.s001
(PDF)
Acknowledgments
The authors are most grateful to the Spanish Society of Neurology Nursing (SEDENE) and all nurses who participated in the DECISIONS-MS study.
References
- 1. Burke T, Dishon S, McEwan L, Smrtka J. The evolving role of the multiple sclerosis nurse: an international perspective. Int J MS Care. 2011; 13(3):105–12. pmid:24453713.
- 2. Meehan M, Doody O. The role of the clinical nurse specialist multiple sclerosis, the patients’ and families’ and carers’ perspective: An integrative review. Mult Scler Relat Disord. 2020; 39:101918. Epub ahead of print. pmid:31927154.
- 3. Rahn AC, Köpke S, Backhus I, Kasper J, Anger K, Untiedt B, et al. Nurse-led immunotreatment DEcision Coaching In people with Multiple Sclerosis (DECIMS)—Feasibility testing, pilot randomised controlled trial and mixed methods process evaluation. Int J Nurs Stud. 2018; 78:26–36. Epub 2017 Aug 26. pmid:28982479.
- 4. Péloquin S, Schmierer K, Leist TP, Oh J, Murray S, Lazure P. Challenges in multiple sclerosis care: Results from an international mixed-methods study. Mult Scler Relat Disord. 2021; 50:102854. Epub 2021 Feb 23. pmid:33690086.
- 5. Schmid F, Rogan S, Glässel A. A Swiss Health Care Professionals’ Perspective on the Meaning of Interprofessional Collaboration in Health Care of People with MS-A Focus Group Study. Int J Environ Res Public Health. 2021; 18(12):6537. pmid:34204475.
- 6. Di Battista G, Bertolotto A, Gasperini C, Ghezzi A, Maimone D, Solaro C. Multiple Sclerosis State of the Art (SMART): A Qualitative and Quantitative Analysis of Therapy’s Adherence, Hospital Reliability’s Perception, and Services Provided Quality. Mult Scler Int. 2014; 752318. Epub 2014 Aug 26. pmid:25215236.
- 7. Rahn AC, Köpke S, Backhus I, Kasper J, Anger K, Untiedt B, et al. Nurse-led immunotreatment DEcision Coaching In people with Multiple Sclerosis (DECIMS)—Feasibility testing, pilot randomised controlled trial and mixed methods process evaluation. Int J Nurs Stud. 2018; 78:26–36. Epub 2017 Aug 26. pmid:28982479.
- 8. Linker RA, Chan A. Navigating choice in multiple sclerosis management. Neurol Res Pract. 2019; 1:5. pmid:33324871.
- 9. Saposnik G, Montalban X. Therapeutic Inertia in the New Landscape of Multiple Sclerosis Care. Front Neurol. 2018 Mar 20;9:174. pmid:29615967; PMCID: PMC5869922.
- 10. Cameron E, Rog D, McDonnell G, Overell J, Pearson O, French DP. Factors influencing multiple sclerosis disease-modifying treatment prescribing decisions in the United Kingdom: A qualitative interview study. Mult Scler Relat Disord. 2019; 27:378–82. Epub 2018 Nov 22. pmid:30500689.
- 11. Terzaghi MA, Ruiz C, Martínez-López I, Pérez-Encinas M, Bakdache F, Maurino J, et al. Factors associated with therapeutic inertia among pharmacists caring for people with multiple sclerosis. Mult Scler Relat Disord. 2019; 39:101887. Epub ahead of print. pmid:31846865.
- 12. Rodrigues R, Rocha R, Bonifácio G, Ferro D, Sabença F, Gonçalves AI, et al. Therapeutic inertia in relapsing-remitting multiple sclerosis. Mult Scler Relat Disord. 2021; 55:103176. Epub ahead of print. pmid:34343868.
- 13. Djulbegovic M, Beckstead J, Elqayam S, Reljic T, Kumar A, Paidas C, et al. Thinking Styles and Regret in Physicians. PLoS One. 2015; 10(8):e0134038. pmid:26241650.
- 14. Wilson A, Ronnekleiv-Kelly SM, Pawlik TM. Regret in Surgical Decision Making: A Systematic Review of Patient and Physician Perspectives. World J Surg. 2017; 41(6):1454–65. pmid:28243695.
- 15. Patel RS, Bachu R, Adikey A, Malik M, Shah M. Factors Related to Physician Burnout and Its Consequences: A Review. Behav Sci (Basel). 2018; 8(11):98. pmid:30366419.
- 16. Saposnik G, Sempere AP, Prefasi D, Selchen D, Ruff CC, Maurino J, et al. Decision-making in Multiple Sclerosis: The Role of Aversion to Ambiguity for Therapeutic Inertia among Neurologists (DIScUTIR MS). Front Neurol. 2017; 8:65. pmid:28298899.
- 17. Almusalam N, Oh J, Terzaghi M, Maurino J, Bakdache F, Montoya A, et al. Comparison of Physician Therapeutic Inertia for Management of Patients With Multiple Sclerosis in Canada, Argentina, Chile, and Spain. JAMA Netw Open. 2019; 2(7):e197093. pmid:31314113.
- 18. Montalban X, Gold R, Thompson AJ, Otero-Romero S, Amato MP, Chandraratna D, et al. ECTRIMS/EAN Guideline on the pharmacological treatment of people with multiple sclerosis. Mult Scler. 2018; 24(2):96–120. Epub 2018 Jan 20. Erratum in: Mult Scler. 2020; 26(4):517. pmid:29353550.
- 19. Rae-Grant A, Day GS, Marrie RA, Rabinstein A, Cree BAC, Gronseth GS, et al. Practice guideline recommendations summary: Disease-modifying therapies for adults with multiple sclerosis: Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology. Neurology. 2019; 92(2):112. Erratum for: Neurology. 2018; 90(17):777–88. pmid:30617176.
- 20. Pavot W, Diener E, Colvin CR, Sandvik E. Further validation of the Satisfaction with Life Scale: evidence for the cross-method convergence of well-being measures. J Pers Assess. 1991; 57(1):149–61. pmid:1920028.
- 21. Benedict RH, Fishman I, McClellan MM, Bakshi R, Weinstock-Guttman B. Validity of the Beck Depression Inventory-Fast Screen in multiple sclerosis. Mult Scler. 2003; 9(4):393–6. pmid:12926845.
- 22. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004; 6(2):61–74. pmid:15224451.
- 23. Baumsteiger R, Siegel JT. Measuring Prosociality: The Development of a Prosocial Behavioral Intentions Scale. J Pers Assess. 2019; 101(3):305–14. Epub 2018 Feb 15. pmid:29448814.
- 24.
Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory. Manual Fourth Edition, 2018, Menlo Park, CA: Mind Garden, Inc.
- 25. Saposnik G, Bueno-Gil G, Sempere ÁP, Rodríguez-Antigüedad A, Del Río B, Baz M, et al. Regret and Therapeutic Decisions in Multiple Sclerosis Care: Literature Review and Research Protocol. Front Neurol. 2021; 12:675520. pmid:34234734.
- 26. Courvoisier DS, Cullati S, Haller CS, Schmidt RE, Haller G, Agoritsas T, et al. Validation of a 10-item care-related regret intensity scale (RIS-10) for health care professionals. Med Care. 2013; 51(3):285–91. pmid:23295580.
- 27.
O’Connor PJ, Sperl-Hillen JM, Johnson PE, Rush WA, Biltz G. Clinical Inertia and Outpatient Medical Errors. In: Henriksen K, Battles JB, Marks ES, Lewin DI, editors. Advances in Patient Safety: From Research to Implementation (Volume 2: Concepts and Methodology), 2005. Rockville (MD): Agency for Healthcare Research and Quality (US).
- 28. Dall’Ora C, Ball J, Reinius M, Griffiths P. Burnout in nursing: a theoretical review. Hum Resour Health. 2020; 18(1):41. pmid:32503559.
- 29. Sorum PC, Mullet E, Shim J, Bonnin-Scaon S, Chasseigne G, Cogneau J. Avoidance of anticipated regret: the ordering of prostate-specific antigen tests. Med Decis Making. 2004; 24(2):149–59. pmid:15090101.
- 30. Courvoisier DS, Agoritsas T, Perneger TV, Schmidt RE, Cullati S. Regrets associated with providing healthcare: qualitative study of experiences of hospital-based physicians and nurses. PLoS One. 2011; 6(8):e23138. Epub 2011 Aug 2. pmid:21829706.
- 31. Matthys E, Remmen R, Van Bogaert P. An overview of systematic reviews on the collaboration between physicians and nurses and the impact on patient outcomes: what can we learn in primary care? BMC Fam Pract. 2017; 18(1):110. pmid:29273023.
- 32. Negri L, Cilia S, Falautano M, Grobberio M, Niccolai C, Pattini M, et al. Job satisfaction among physicians and nurses involved in the management of multiple sclerosis: the role of happiness and meaning at work. Neurol Sci. 2021; 7:1–8. Epub ahead of print. pmid:34363548.
- 33. Saposnik G, Mamdani M, Montalban X, Terzaghi M, Silva B, Saladino ML, et al. Traffic Lights Intervention Reduces Therapeutic Inertia: A Randomized Controlled Trial in Multiple Sclerosis Care. MDM Policy Pract. 2019; 4(1):2381468319855642. pmid:31259250.