Abstract
The Objective Structured Clinical Examination (OSCE) is a ubiquitous part of medical education, although there is some debate about its value, particularly around possible impact on learning. Literature and research regarding the OSCE is most often situated within the psychometric or competency discourses of assessment. This paper describes an alternative approach: Actor-network-theory (ANT), a sociomaterial approach to understanding practice and learning. ANT provides a means to productively examine tensions and limitations of the OSCE, in part through extending research to include social relationships and physical objects. Using a narrative example, the paper suggests three ANT-informed insights into the OSCE. We describe: (1) exploring the OSCE as a holistic combination of people and objects; (2) thinking about the influences a checklist can exert over the OSCE; and (3) the implications of ANT educational research for standardisation within the OSCE. We draw from this discussion to provide a practical agenda for ANT research into the OSCE. This agenda promotes new areas for exploration in an often taken-for-granted assessment format.
Similar content being viewed by others
References
Atkins, S., Roberts, C., Hawthorne, K., & Greenhalgh, T. (2016). Simulated consultations: A sociolinguistic perspective. BMC Medical Education, 16(1), 16. doi:10.1186/s12909-016-0535-2.
Bleakley, A. (2012). The proof is in the pudding: Putting actor-network-theory to work in medical education. Medical Teacher, 34(6), 462–467. doi:10.3109/0142159X.2012.671977.
Bowker, G. C., & Star, S. L. (1999). Sorting things out: Classification and its consequences. Cambridge: MIT Press.
Cilliers, F. J., Schuwirth, Lambert W. T., Herman, N., Adendorff, H. J., & van der Vleuten, Cees P. M. (2012). A model of the pre-assessment learning effects of summative assessment in medical education. Advances in Health Sciences Education, 17(1), 39–53. doi:10.1007/s10459-011-9292-5.
Daniels, V. J., Bordage, G., Gierl, M. J., & Yudkowsky, R. (2014). Effect of clinically discriminating, evidence-based checklist items on the reliability of scores from an Internal Medicine residency OSCE. Advances in Health Sciences Education, 19(4), 497–506.
de la Croix, A., & Skelton, J. (2013). The simulation game: An analysis of interactions between students and simulated patients. Medical Education, 47(1), 49–58. doi:10.1111/medu.12064.
Fenwick, T. (2010). (un)Doing standards in education with actor-network theory. Journal of Education Policy, 25(2), 117–133. doi:10.1080/02680930903314277.
Fenwick, T. (2014). Sociomateriality in medical practice and learning: Attuning to what matters. Medical Education, 48(1), 44–52. doi:10.1111/medu.12295.
Fenwick, T., & Edwards, R. (2010). Actor-Network Theory in Education. Abingdon: Routledge.
Fenwick, T., & Edwards, R. (Eds.). (2012). Introduction. In Researching education through actor-network theory (pp. 9–24). West Sussex: Wiley-Blackwell.
Fenwick, T., Edwards, R., & Sawchuk, P. (2011). Emerging approaches to educational research: Tracing the sociomaterial. Abingdon: Routledge.
Goldszmidt, M., & Faden, L. (2016). Is medical education ready to embrace the socio-material? Medical Education, 50(2), 162–164. doi:10.1111/medu.12948.
Gormley, G., Hodges, B. D., McNaughton, N., & Johnston, J. L. (2016). The show must go on? Patients, props and pedagogy in the theatre of the OSCE. Medical Education, 50(12), 1237–1240. doi:10.1111/medu.13016.
Gormley, G., Sterling, M., Menary, A., & McKeown, G. (2012). Keeping it real! Enhancing realism in standardised patient OSCE stations. The Clinical Teacher, 9(6), 382–386.
Harden, R. M. (2015). Misconceptions and the OSCE. Medical Teacher, 37(7), 608–610. doi:10.3109/0142159X.2015.1042443.
Harden, R. M. (2016). Revisiting ‘Assessment of clinical competence using an objective structured clinical examination (OSCE)’. Medical Education, 50(4), 376–379. doi:10.1111/medu.12801.
Hodges, B. D. (2003). Validity and the OSCE. Medical Teacher, 25(3), 250–254. doi:10.1080/01421590310001002836.
Hodges, B. D. (2006). Medical education and the maintenance of incompetence. Medical Teacher, 28(8), 690–696.
Hodges, B. D. (2007). A socio-historical study of the birth and adoption of the objective structured clinical examination (OSCE). Doctor of Philosophy, Ontario Institute for Studies in Education, University of Toronto.
Hodges, B. D., Hanson, M., McNaughton, N., & Regehr, G. (1999). What do psychiatry residents think of an objective structured clinical examination? Academic Psychiatry, 23(4), 198–204.
Hodges, B. D., Martimianakis, M. A., McNaughton, N., & Whitehead, C. (2014). Medical education… meet Michel Foucault. Medical Education, 48(6), 563–571. doi:10.1111/medu.12411.
Johnston, J. L., Lundy, G., McCullough, M., & Gormley, G. J. (2013). The view from over there: Reframing the OSCE through the experience of standardised patient raters. Medical Education, 47(9), 899–909. doi:10.1111/medu.12243.
Khan, K. Z., Gaunt, K., Ramachandran, S., & Pushkar, P. (2013). The objective structured clinical examination (OSCE): AMEE guide no. 81. Part II: Organisation & administration. Medical Teacher, 35(9), e1447–e1463.
LaRochelle, J., Durning, S. J., Boulet, J. R., van der Vleuten, C., van Merrienboer, J., & Donkers, J. (2016). Beyond standard checklist assessment: Question sequence may impact student performance. Perspectives on Medical Education, 52(2), 95–102.
Latour, B. (2005). Reassembling the social: An introduction to actor-network-theory. Oxford: Oxford University Press.
Law, J. (2009). Actor network theory and material semiotics. In B. S. Turner (Ed.), The new Blackwell companion to social theory (pp. 141–158). West Sussex: Wiley-Blackwell.
MacLeod, A., Kits, O., Whelan, E., Fournier, C., Wilson, K., Power, G., et al. (2015). Sociomateriality: A theoretical framework for studying distributed medical education. Academic Medicine, 90(11), 1451–1456. doi:10.1097/acm.0000000000000708.
McMurtry, A., Rohse, S., & Kilgour, K. N. (2016). Socio-material perspectives on interprofessional team and collaborative learning. Medical Education, 50(2), 169–180. doi:10.1111/medu.12833.
Medical Council of Canada (2013). Guidelines for the development of the Objective Structured Clinical Examination (OSCE) Cases. Retrieved October 12 from http://mcc.ca/media/OSCE-Booklet-2014.pdf.
Mol, A. (2002). The body multiple: Ontology in medical practice. Durham, NC: Duke University Press.
Mol, A. (2009). Living with diabetes: Care beyond choice and control. The Lancet, 373(9677), 1756–1757. doi:10.1016/S0140-6736(09)60971-5.
Mol, A. (2010). Actor-network theory: Sensitive terms and enduring tensions. Kölner Zeitschrift für Soziologie und Sozialpsychologie. Sonderheft, 50, 253–269.
Mulcahy, D. (1999). (Actor-Net) Working bodies and representations: Tales from a training field. Science, Technology and Human Values, 24(1), 80–104.
Mulcahy, D. (2011). Assembling the ‘accomplished’ teacher: The performativity and politics of professional teaching standards. Educational Philosophy and Theory, 43(sup1), 94–113. doi:10.1111/j.1469-5812.2009.00617.x.
Müller, M. (2015). Assemblages and actor-networks: Rethinking socio-material power, politics and space. Geography Compass, 9(1), 27–41. doi:10.1111/gec3.12192.
Nyström, S., Dahlberg, J., Edelbring, S., Hult, H., & Dahlgren, M. A. (2016). Debriefing practices in interprofessional simulation with students: A sociomaterial perspective. BMC Medical Education, 16(1), 148. doi:10.1186/s12909-016-0666-5.
Offerdahl, E. G., & Tomanek, D. (2011). Changes in instructors’ assessment thinking related to experimentation with new strategies. Assessment and Evaluation in Higher Education, 36(7), 781–795. doi:10.1080/02602938.2010.488794.
Patrício, M. F., Julião, M., Fareleira, F., & Carneiro, A. V. (2013). Is the OSCE a feasible tool to assess competencies in undergraduate medical education? Medical Teacher, 35(6), 503–514. doi:10.3109/0142159X.2013.774330.
Perrella, A. (2016). Fool me once: The illusion of empathy in interactions with standardized patients. Medical Teacher, 38(12), 1285–1287. doi:10.1080/0142159X.2016.1210115.
Pugh, D., Hamstra, S. J., Wood, T. J., Humphrey-Murto, S., Touchie, C., Yudkowsky, R., et al. (2015). A procedural skills OSCE: Assessing technical and non-technical skills of internal medicine residents. Advances in Health Sciences Education, 20(1), 85–100. doi:10.1007/s10459-014-9512-x.
Regehr, G., Macrae, H., Reznick, R. K., & Szalay, D. (1998). Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Academic Medicine, 73(9), 993–997.
Rudland, J., Wilkinson, T., Smith-Han, K., & Thompson-Fawcett, M. (2008). “You can do it late at night or in the morning. You can do it at home, I did it with my flatmate”. The educational impact of an OSCE. Medical Teacher, 30(2), 206–211. doi:10.1080/01421590701851312.
Setyonugroho, W., Kennedy, K. M., & Kropmans, Thomas J. B. (2015). Reliability and validity of OSCE checklists used to assess the communication skills of undergraduate medical students: A systematic review. Patient Education and Counseling, 98(12), 1482–1491. doi:10.1016/j.pec.2015.06.004.
Sørensen, E. (2009). The materiality of learning: Technology and knowledge in educational practice. Cambridge: Cambridge University Press.
Timmermans, S., & Berg, M. (2003). The gold standard: The challenge of evidence-based medicine and standardization in health care. Philadelphia: Temple University Press.
Timmermans, S., & Epstein, S. (2010). A world of standards but not a standard world: Toward a sociology of standards and standardization. Annual Review of Sociology, 36(1), 69–89. doi:10.1146/annurev.soc.012809.102629.
Tummons, J. (2010). Institutional ethnography and actor–network theory: A framework for researching the assessment of trainee teachers. Ethnography and Education, 5(3), 345–357.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., et al. (2012). A model for programmatic assessment fit for purpose. Medical Teacher, 34(3), 205–214. doi:10.3109/0142159X.2012.652239.
Wear, D., & Varley, J. D. (2008). Rituals of verification: The role of simulation in developing and evaluating empathic communication. Patient Education and Counseling, 71(2), 153–156. doi:10.1016/j.pec.2008.01.005.
Wickramasinghe, N., Bali, R. K., & Tatnall, A. (2007). Using actor network theory to understand network centric healthcare operations. International Journal of Electronic Healthcare, 3(3), 317–328.
Wilkinson, T. J., Frampton, C. M., Thompson-Fawcett, M., & Egan, T. (2003). Objectivity in objective structured clinical examinations: Checklists are no substitute for examiner commitment. Academic Medicine, 78(2), 219–223.
Woolgar, S. (2004). What happened to provocation in science and technology studies? History and Technology, 20(4), 339–349. doi:10.1080/0734151042000304321.
Yeates, P., Moreau, M., & Eva, K. (2015). Are examiners’ judgments in OSCE-style assessments influenced by contrast effects? Academic Medicine, 90(7), 975–980. doi:10.1097/acm.0000000000000650.
Acknowledgements
We would like to acknowledge Professors Tara Fenwick and Anna Vnuk who gave us feedback on ideas and words within this manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bearman, M., Ajjawi, R. Actor-network theory and the OSCE: formulating a new research agenda for a post-psychometric era. Adv in Health Sci Educ 23, 1037–1049 (2018). https://doi.org/10.1007/s10459-017-9797-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-017-9797-7