Abstract
Maintaining optimum analgesia in anesthetized patients is challenging due to the inability to self-report pain or exhibit pain-related behaviours. The Analgesia Nociception Index (ANI) (based on heart rate variability [HRV]) and the Nociception Level Index (NOL) (based on HRV, photoplethysmography, skin conductance, and temperature) both include HRV and provide continuous index monitoring for nociception assessment. The research question was: “What are the validation strategies of the NOL and ANI for nociception assessment in anesthetized patients?”. The objectives were to describe and analyze the validation strategies and results. A systematized review was conducted using a comprehensive search with keywords under three concepts (nociception/pain, ANI/NOL, and validity) in four databases. A quality assessment using an adapted GRADE approach for measurement tools, and a risk of bias assessment using QUADAS-2 tool were performed by two reviewers. Out of 525 results, 15 validation studies were included. Strategies included hypothesis testing, discriminative, and criterion validation. Significant changes in ANI/NOL values were found in response to nociceptive stimuli at different opioid concentrations (hypothesis testing). Higher ANI/NOL values were observed during nociceptive stimuli (discriminative). AUCs ranging from 0.83 to 0.99 were obtained to detect nociceptive stimuli (criterion). Both technologies performed superiorly in detecting nociceptive stimuli compared to individual monitoring of HR and blood pressure. Although the aforementioned validation strategies are deemed appropriate, in the absence of a gold standard, criterion validation findings should be interpreted with caution. Moreover, reliability could be examined using test–retest with consistent ANI/NOL values during a stable time-interval.
Similar content being viewed by others
References
Richebe P, Capdevila X, Rivat C. Persistent postsurgical pain: pathophysiology and preventative pharmacologic considerations. Anesthesiology. 2018;129(3):590–607. https://doi.org/10.1097/ALN.0000000000002238.
Tong JG. Poorly controlled postoperative pain: prevalence, consequences, and prevention. J Pain Res. 2017;10:2287.
IASP. Pain terms: a list with definitions and notes on usage. Pain. 2020;6:249.
Raja SN, Carr DB, Cohen M, et al. The revised International Association for the Study of Pain definition of pain: concepts, challenges, and compromises. Pain. 2020. https://doi.org/10.1097/j.pain.0000000000001939.
Guignard B. Monitoring analgesia. Best Pract Res Clin Anaesthesiol. 2006;20(1):161–80. https://doi.org/10.1016/j.bpa.2005.09.002.
Ledowski T. Objective monitoring of nociception: a review of current commercial solutions. Br J Anaesth. 2019;123(2):e312–21. https://doi.org/10.1016/j.bja.2019.03.024.
Treister R, Kliger M, Zuckerman G, Goor Aryeh I, Eisenberg E. Differentiating between heat pain intensities: the combined effect of multiple autonomic parameters. Pain. 2012;153(9):1807–14. https://doi.org/10.1016/j.pain.2012.04.008.
Stein PK, Bosner MS, Kleiger RE, Conger BM. Heart rate variability: a measure of cardiac autonomic tone. Am Heart J. 1994;127(5):1376–81.
Anderson TA. Heart rate variability: implications for perioperative anesthesia care. Curr Opin Anaesthesiol. 2017;30(6):691–7. https://doi.org/10.1097/ACO.0000000000000530.
Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x.
Jeanne M, Logier R, De Jonckheere J, Tavernier B. Validation of a graphic measurement of heart rate variability to assess analgesia/nociception balance during general anesthesia. Conf Proc IEEE Eng Med Biol Soc. 2009;2009:1840–3. https://doi.org/10.1109/IEMBS.2009.5332598.
Ben-Israel N, Kliger M, Zuckerman G, Katz Y, Edry R. Monitoring the nociception level: a multi-parameter approach. J Clin Monit Comput. 2013;27(6):659–68. https://doi.org/10.1007/s10877-013-9487-9.
Gélinas C, Joffe AM, Szumita PM, et al. A psychometric analysis update of behavioral pain assessment tools for noncommunicative, critically Ill adults. AACN Adv Crit Care. 2019;30(4):365–87. https://doi.org/10.4037/aacnacc2019952.
Gélinas C, Puntillo KA, Joffe AM, Barr J. A validated approach to evaluating psychometric properties of pain assessment tools for use in nonverbal critically ill adults. Semin Respir Crit Care Med. 2013;34(2):153–68. https://doi.org/10.1055/s-0033-1342970.
Gélinas C, Loiselle CG, LeMay S, Ranger M, Bouchard E, McCormack D. Theoretical, psychometric, and pragmatic issues in pain measurement. Pain Manag Nurs. 2008;9(3):120–30. https://doi.org/10.1016/j.pmn.2007.12.001.
Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2015.
Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. https://doi.org/10.7326/0003-4819-155-8-201110180-00009.
Funcke S, Sauerlaender S, Pinnschmidt HO, et al. Validation of innovative techniques for monitoring nociception during general anesthesia: a clinical study using tetanic and intracutaneous electrical stimulation. Anesthesiology. 2017;127(2):272–83. https://doi.org/10.1097/ALN.0000000000001670.
Gruenewald M, Ilies C, Herz J, et al. Influence of nociceptive stimulation on analgesia nociception index (ANI) during propofol-remifentanil anaesthesia. Br J Anaesth. 2013;110(6):1024–30. https://doi.org/10.1093/bja/aet019.
Gruenewald M, Herz J, Schoenherr T, Thee C, Steinfath M, Bein B. Measurement of the nociceptive balance by Analgesia Nociception Index and Surgical Pleth Index during sevoflurane-remifentanil anesthesia. Minerva Anestesiol. 2015;81(5):480–9.
Ledowski T, Averhoff L, Tiong WS, Lee C. Analgesia Nociception Index (ANI) to predict intraoperative haemodynamic changes: results of a pilot investigation. Acta Anaesthesiol Scand. 2014;58(1):74–9. https://doi.org/10.1111/aas.12216.
Kommula LK, Bansal S, Umamaheswara Rao GS. Analgesia nociception index monitoring during supratentorial craniotomy. J Neurosurg Anesthesiol. 2019;31(1):57–61. https://doi.org/10.1097/ANA.0000000000000464.
Boselli E, Logier R, Bouvet L, Allaouchiche B. Prediction of hemodynamic reactivity using dynamic variations of Analgesia/Nociception Index (ANI). J Clin Monit Comput. 2016;30(6):977–84. https://doi.org/10.1007/s10877-015-9802-8.
Boselli E, Bouvet L, Begou G, Torkmani S, Allaouchiche B. Prediction of hemodynamic reactivity during total intravenous anesthesia for suspension laryngoscopy using Analgesia/Nociception Index (ANI): a prospective observational study. Minerva Anestesiol. 2015;81(3):288–97.
Jeanne M, Delecroix M, De Jonckheere J, Keribedj A, Logier R, Tavernier B. Variations of the analgesia nociception index during propofol anesthesia for total knee replacement. Clin J Pain. 2014;30(12):1084–8. https://doi.org/10.1097/AJP.0000000000000083.
Logier R, Jeanne M, De Jonckheere J, Dassonneville A, Delecroix M, Tavernier B. PhysioDoloris: a monitoring device for analgesia / nociception balance evaluation using heart rate variability analysis. Annu Int Conf IEEE Eng Med Biol Soc. 2010;2010:1194–7. https://doi.org/10.1109/IEMBS.2010.5625971.
Smith WD, Dutton RC, Smith NT. Measuring the performance of anesthetic depth indicators. Anesthesiology. 1996;84(1):38–51. https://doi.org/10.1097/00000542-199601000-00005.
Stockle PA, Julien M, Issa R, et al. Validation of the PMD100 and its NOL Index to detect nociception at different infusion regimen of remifentanil in patients under general anesthesia. Minerva Anestesiol. 2018;84(10):1160–1168. https://doi.org/10.23736/S0375-9393.18.12720-9.
Renaud-Roy E, Stockle PA, Maximos S, et al. Correlation between incremental remifentanil doses and the Nociception Level (NOL) index response after intraoperative noxious stimuli. Can J Anaesth. 2019;66(9):1049–61. https://doi.org/10.1007/s12630-019-01372-1.
Martini CH, Boon M, Broens SJ, et al. Ability of the nociception level, a multiparameter composite of autonomic signals, to detect noxious stimuli during propofol-remifentanil anesthesia. Anesthesiology. 2015;123(3):524–34. https://doi.org/10.1097/ALN.0000000000000757.
Edry R, Recea V, Dikust Y, Sessler DI. Preliminary intraoperative validation of the nociception level index: a noninvasive nociception monitor. Anesthesiology. 2016;125(1):193–203. https://doi.org/10.1097/ALN.0000000000001130.
Bollag L, Jelacic S, Delgado Upegui C, Wu C, Richebe P. The nociception level index (NOL) response to intubation and incision in patients undergoing video-assisted thoracoscopic surgery (VATS) with and without thoracic epidural analgesia. A pilot study. Res. 2018;7:875. https://doi.org/10.12688/f1000research.15279.1.
Gruenewald M, Ilies C. Monitoring the nociception-anti-nociception balance. Best Pract Res Clin Anaesthesiol. 2013;27(2):235–47. https://doi.org/10.1016/j.bpa.2013.06.007.
Jordan D, Steiner M, Kochs EF, Schneider G. A program for computing the prediction probability and the related receiver operating characteristic graph. Anesth Analg. 2010;111(6):1416–21. https://doi.org/10.1213/ANE.0b013e3181fb919e.
Adina Najwa K, Trevor C, Ruwanthi K-D. Time-dependent ROC curve analysis in medical research: current methods and applications. BMC Med Res Methodol. 2017. https://doi.org/10.1186/s12874-017-0332-6.
Bialocerkowski A, Klupp N, Bragge P. How to read and critically appraise a reliability article. Int J Ther Rehabil. 2010;17(3):114–20. https://doi.org/10.12968/ijtr.2010.17.3.46743.
Rothstein JM. Measurement and Clinical Practice: Theory and Application. 1985
Shahiri TS, Richard-Lalonde M, Richebe P, Gelinas C. Exploration of the Nociception Level (NOL) Index for pain assessment during endotracheal suctioning in mechanically ventilated patients in the intensive care unit: an observational and feasibility study. Pain Manag Nurs. 2020. https://doi.org/10.1016/j.pmn.2020.02.067.
Smart A. A multi-dimensional model of clinical utility. Int J Qual Health Care. 2006;18(5):377–82. https://doi.org/10.1093/intqhc/mzl034.
Duhn LJ, Medves JM. A systematic integrative review of infant pain assessment tools. Adv Neonatal Care. 2004;4(3):126–40. https://doi.org/10.1016/j.adnc.2004.04.005.
Acknowledgements
The authors would like to thank the dedicated librarians, Alexandre Amar-Zifkin, MLIS, and Taline Ekmekjian, MLIS, at McGill University Health Centre Medical Libraries (Montreal, Quebec, Canada) for their help with the literature search process.
Funding
This project was not funded by any funding agencies and it is considered as the authors own work.
Author information
Authors and Affiliations
Contributions
Conception and design: SST, CG. Data acquisition: SST, PR. Data analysis: SST, MRL, CG. Data interpretation: SST, PR, MRL, CG. Drafting and revision of the manuscript: SST, CG. Critical revision of the manuscript for important intellectual content: SST, PR, MRL, CG.
Corresponding author
Ethics declarations
Conflict of interest
SST, MRL, CG declare no conflict of interest. PR has received honorarium for lectures and consultations from Medasense Ltd.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shahiri, T.S., Richebé, P., Richard-Lalonde, M. et al. Description of the validity of the Analgesia Nociception Index (ANI) and Nociception Level Index (NOL) for nociception assessment in anesthetized patients undergoing surgery: a systematized review. J Clin Monit Comput 36, 623–635 (2022). https://doi.org/10.1007/s10877-021-00772-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10877-021-00772-3