Skip to main content
SpringerLink
Log in

Construct validation of a novel hybrid virtual-reality simulator for training and assessing laparoscopic colectomy; results from the first course for experienced senior laparoscopic surgeons

  • New Technology
  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Objectives

The objective of the study was to determine whether the metrics from a left-sided laparoscopic colectomy (LC) simulator could distinguish between the objectively scored performance of minimally invasive colorectal expert and novice surgeons. We report our results from the first virtual reality-based laparoscopic colorectal training course for experienced laparoscopic surgeons.

Methods

Eleven surgeons, experienced but novice in LC, constituted the novice group, and three experienced laparoscopic colorectal surgeons (>300 LCs) served as our experts. Novice subjects received didactic educational sessions and instruction in practice of LC from the experts. All subjects received instruction, demonstration, and supervision on the surgical technique to perform a LC on the simulator. All subjects then performed a laparoscopic colectomy on the simulator. Experts performed the same case as the novices. Outcomes measured by the simulator were time to perform the procedure, instrument path length, and smoothness of the trajectory of the instruments. Anatomy trays from the simulator were objectively scored for explicitly predefined intraoperative errors after each procedure.

Results

Expert surgeons performed significantly better then the novice colorectal surgeons with regard to instrument path length, instrument smoothness, and time taken to complete the procedure. Of the 13 predetermined errors, experts made significantly fewer errors in total then the novices (mean score 2.67 versus 4.7, p = 0.03), and performed better in 8 out of 13 errors.

Conclusion

The parameters assessed by the ProMIS VR simulator for laparoscopic colorectal training distinguished between novice and expert colorectal surgeons, despite using otherwise experienced novices who had extensive training before the procedure and expert mentoring during it. Experts performed the simulated procedure significantly faster with more efficient use of their instruments, and made fewer intraoperative errors. Thus the simulator demonstrated construct validity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Coleman J, Nduka CC, Darzi A (1994) Virtual reality and laparoscopic surgery. Br J Surg 81:1709–1711

    Article  PubMed  CAS  Google Scholar 

  2. Riva G (2003) Applications of Virtual Environments in Medicine. Methods Inf Med 42(5):524–534

    PubMed  CAS  Google Scholar 

  3. Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery; a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR). Endosc 31:310–313

    Article  CAS  Google Scholar 

  4. Taffinder N, Sutton C, Fishwick RJ, McManus IC and Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MISTVR laparoscopic simulator. In: Westwood JD, Hoffman HM, Stredney D, Weghorst SJ (eds) Medicine meets virtual reality. IOS Press and Ohmsha

  5. Satava RM (1993) Virtual reality surgical simulator; the first steps. Surg Endosc 7:203–205

    Article  PubMed  CAS  Google Scholar 

  6. Seymour N, Gallagher A, Roman S, et al (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–464

    Article  PubMed  Google Scholar 

  7. Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenerg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150

    Article  PubMed  CAS  Google Scholar 

  8. Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804

    Article  PubMed  Google Scholar 

  9. Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP (2005) Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 131:217–221

    Article  PubMed  Google Scholar 

  10. Gallagher AG, Satava RM (2002) Objective assessment of experienced, junior and novice laparoscopic performance with virtual reality: Learning curves and reliability measures. Surg Endosc 16:1746–1752

    Article  PubMed  CAS  Google Scholar 

  11. Gallagher AG, McGuigan J, Ritchie K, McClure N (2001) Objective psychomotor assessment of senior, junior and novice laparoscopists with virtual reality. World J Surg 25:1478–1483

    Article  PubMed  CAS  Google Scholar 

  12. Patel AD, Gallagher AG, Nicholson WJ, Cates CU (2006) Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J Am Coll Cardiol 47:1796–1802

    Article  PubMed  Google Scholar 

  13. Guillou PJ, Quirke P, et al (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer. Lancet 365(9472):1718–1726

    Article  PubMed  Google Scholar 

  14. Clinical Outcomes of Surgical Therapy Group (2004) A Comparison of laparoscopically- assisted and open colectomy for colon cancer. N Eng J Med 350:2050–2059

    Article  Google Scholar 

  15. Veldkamp R, Kuhry E, Hop WC, Jecklel J, Kazemier G, Bonjer HJ, et al (2005) Laparoscopic surgery versus open surgery for colon cancer: short term outcomes of a randomised trial. Lancet Oncol 6:477–484

    Article  PubMed  Google Scholar 

  16. Tekkis PP, Senegore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91

    Article  PubMed  Google Scholar 

  17. Schalachta CM, Mamazzo J, Seshadri PA, Caddedu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222

    Article  Google Scholar 

  18. Simons AJ, Anthone GJ, Ortega AE, Franklin M, Fleeshnam J, Geis WP, Beart RW (1995) Laparoscopic-assisted colectomy learning curve. Dis Colon Rectum 38:600–603

    Article  PubMed  CAS  Google Scholar 

  19. Gallagher AG, Ritter EM, Satava R (2003) Fundamental principles of validation and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529

    Article  PubMed  CAS  Google Scholar 

  20. Delaney CP, Neary PC, Heriot AG, Senagore AJ (2007) Operative techniques in laparoscopic colorectal surgery. Lipincott Williams and Wilkins, Philapelphia

    Google Scholar 

  21. American Psychological Association (APA) (1974) American Educational Research Association and National Council on Measurement in Education. Standards for educational and psychological tests. APA, Washington DC

    Google Scholar 

  22. Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19:1216–1219

    Article  PubMed  CAS  Google Scholar 

  23. Van Sickle KR, McClusky DA 3rd, Gallagher AG, Smith CD (2005) Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc 19:1227–1231

    Article  PubMed  Google Scholar 

  24. Bandura A (1971) Social learning theory. General Learning, Moristown, NJ

    Google Scholar 

  25. Gallagher AG, Ritter EM, Champion H, Fried MP, Higgins G, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Surgery, Adelaide and Health Hospital incorporating the National Children’s Hospital, Tallaght, Dublin, 24, Ireland

    Paul C. Neary & Frank B. V. Keane

  2. National Surgical Training Centre, Royal College of Surgeons in Ireland, RCSI House, 123 St. Stephen’s Green, Dublin, 2, Ireland

    Emily Boyle, Frank B. V. Keane & Anthony G. Gallagher

  3. Division of Colorectal Surgery, University Hospital Case Medical Centre, Cleveland, OH, USA

    Conor P. Delaney

  4. Department of Surgery, Michigan State University, Grand Rapids, MI, USA

    Anthony J. Senagore

Authors
  1. Paul C. Neary
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emily Boyle
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Conor P. Delaney
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anthony J. Senagore
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Frank B. V. Keane
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Anthony G. Gallagher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul C. Neary.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Neary, P.C., Boyle, E., Delaney, C.P. et al. Construct validation of a novel hybrid virtual-reality simulator for training and assessing laparoscopic colectomy; results from the first course for experienced senior laparoscopic surgeons. Surg Endosc 22, 2301–2309 (2008). https://doi.org/10.1007/s00464-008-9900-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-008-9900-5

Keywords

Search

Navigation