Abstract
Due to the changing needs and technological advancement in the twenty-first century, “technagogy” or the arts and science of teaching with technology has emerged as an underexplored opportunity in the continuing professional development (CPD). However, little is known on how to develop and evaluate a technagogy-enhanced CPD for health professionals. A mixed-methods study was utilized to generate well-grounded curriculum and evaluation frameworks that integrate technagogy and outcomes-based teaching and learning in CPD. The CPD evaluation of the implemented learning program revealed that a technagogy-enhanced CPD could lead to excellent and effective written, supported, taught, tested, and learned curriculum aspects. The designed frameworks can guide the theory, practice, research, and policy of CPD program development and evaluation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
All data generated or analyzed during this study are included in this published article.
References
Abma TA (2005) Responsive evaluation: its meaning and special contribution to health promotion. Eval Program Plann 28(3):279–289. https://doi.org/10.1016/j.evalprogplan.2005.04.003
Accreditation Council for Pharmacy Education (2015) Guidance on continuing professional development (CPD) for the Profession of Pharmacy. https://www.acpe-accredit.org/pdf/CPDGuidance%20ProfessionPharmacyJan2015.pdf
Ahmed S, Parsons D (2013) Abductive science inquiry using mobile devices in the classroom. Comput Educ 63:62–72. https://doi.org/10.1016/j.compedu.2012.11.017
Balmer JT (2013) The transformation of continuing medical education (CME) in the United States. Adv Med Educ Pract. https://doi.org/10.2147/AMEP.S35087
Barr H, Low H (2013) Introducing Interprofessional Education. http://caipe.org.uk/silo/files/introducing-interprofessional-education.pdf
Bharvad A (2010) Curriculum evaluation. Int Res J 1(12):72–74
Biggs JB, Tang CS (2007) Teaching for quality learning at University, 3rd ed. http://public.eblib.com/choice/publicfullrecord.aspx?p=332709
Biggs JB, Tang CS (2011) Teaching for quality learning at University, 4th ed. http://site.ebrary.com/id/10510868
Borgia E (2014) The Internet of Things vision: key features, applications and open issues. Comput Commun 54:1–31. https://doi.org/10.1016/j.comcom.2014.09.008
Bottenberg MM, DeWitt JE, Wall GC, Fornoff A, Stelter N, Soltis D, Eastman DK (2013) Assessment of interprofessional perceptions and attitudes of health professional students in a simulation laboratory setting. Curr Pharm Teach Learn 5(3):167–174. https://doi.org/10.1016/j.cptl.2012.12.004
Brock D, Abu-Rish E, Chiu C-R, Hammer D, Wilson S, Vorvick L, Zierler B (2013) Interprofessional education in team communication: working together to improve patient safety. BMJ Qual Saf 22(5):414–423. https://doi.org/10.1136/bmjqs-2012-000952
Cant RP, Cooper SJ (2014) Simulation in the Internet age: the place of Web-based simulation in nursing education. An integrative review. Nurs Educ Today 34(12):1435–1442. https://doi.org/10.1016/j.nedt.2014.08.001
Canţer M (2012) E-heutagogy for lifelong e-learning. Procedia Technol 1:129–131. https://doi.org/10.1016/j.protcy.2012.02.025
Chipchase LS, Johnston V, Long PD (2012) Continuing professional development: the missing link. Man Ther 17(1):89–91. https://doi.org/10.1016/j.math.2011.09.004
Chirico M, Thompson JR, Steil C (2014) Development and implementation of a collaborative interprofessional learning program. Curr Pharm Teach Learn 6(4):550–557. https://doi.org/10.1016/j.cptl.2014.04.006
Chiţiba CA (2012) Lifelong learning challenges and opportunities for traditional universities. Procedia-Soc Behav Sci 46:1943–1947. https://doi.org/10.1016/j.sbspro.2012.05.408
Choy M (2013) The iTEaCH Implementation Model: adopting a best-fit approach to implementing ICT in schools. Educ Media Int 50(4):281–290. https://doi.org/10.1080/09523987.2013.859351
Clark E, Draper J, Rogers J (2015) Illuminating the process: enhancing the impact of continuing professional education on practice. Nurs Educ Today 35(2):388–394. https://doi.org/10.1016/j.nedt.2014.10.014
Cornachione EB, Trombetta MR, Casa Nova SPC (2010) Evaluation use and involvement of internal stakeholders: the case of a new non-degree online program in Brazil. Stud Educ Eval 36(1–2):69–81. https://doi.org/10.1016/j.stueduc.2010.09.001
Creswell JW (2015) A concise introduction to mixed methods research. SAGE, Los Angeles
Creswell JW, Plano Clark VL (2011) Designing and conducting mixed methods research, 2nd edn. SAGE Publications, Los Angeles
Davis D, Davis N (2010) Selecting educational interventions for knowledge translation. Can Med Assoc J 182(2):E89–E93. https://doi.org/10.1503/cmaj.081241
Delf P (2013) Designing effective eLearning for healthcare professionals. Radiography 19(4):315–320. https://doi.org/10.1016/j.radi.2013.06.002
Donyai P, Alexander AM, Denicolo PM (2013) A framework for assessing continuing professional development activities for satisfying pharmacy revalidation requirements. J Contin Educ Heal Prof 33(2):127–135. https://doi.org/10.1002/chp.21174
Dubinina I, Berestneva O, Sviridov K (2015) Educational technologies for forming intellectual competence in scientific research and engineering business. Procedia-Soc Behav Sci 166:317–324. https://doi.org/10.1016/j.sbspro.2014.12.530
European Centre for the Development of Vocational Training (CEDEFOP) (2014) Terminology of European education and training policy: a selection of 130 key terms, 2nd ed. http://www.cedefop.europa.eu/EN/Files/4117_en.pdf
Evans D (2012) The internet of everything: how more relevant and valuable connections will change the world. https://www.cisco.com/web/about/ac79/docs/innov/IoE.pdf
Failla KR, Macauley K (2014) Interprofessional simulation: a concept analysis. Clin Simul Nurs 10(11):574–580. https://doi.org/10.1016/j.ecns.2014.07.006
Filipe H, Golnik K, Silva E, Stulting A (2014) Continuing professional development: best practices. Middle East Afr J Ophthalmol 21(2):134. https://doi.org/10.4103/0974-9233.129760
Fischer G, Herrmann T (2011) Socio-technical systems: a meta-design perspective. Int J Sociotechnol Knowl Dev 3(1):1–33. https://doi.org/10.4018/jskd.2011010101
Fulantelli G, Taibi D, Arrigo M (2015) A framework to support educational decision making in mobile learning. Comput Hum Behav 47:50–59. https://doi.org/10.1016/j.chb.2014.05.045
Fundación de la Innovación Bankinter (2011) Understanding the three basic layers of the Internet of Things. In: The Internet of Things, pp 34–42. http://www.fundacionbankinter.org/system/documents/8189/original/XV_FTF_Interneto_of_things.pdf
Geer GC (2000) Students constructing web pages: does it affect educational outcomes? (Ed.D., State University of New York at Albany). http://jerome.stjohns.edu:81/login?url=http://search.proquest.com/docview/304651258?accountid=14068
Glatthorn AA, Boschee FA, Whitehead BM, Boschee BF (2015) Curriculum leadership: strategies for development and implementation, 4th edn. SAGE Publications Inc., Los Angeles
Gómez J, Huete JF, Hoyos O, Perez L, Grigori D (2013) Interaction system based on Internet of Things as support for education. Procedia Comput Sci 21:132–139. https://doi.org/10.1016/j.procs.2013.09.019
Gopalratnam V (2014) Internet of Things: connecting people, processes, data and things. Siliconindia 26–27. bth
Gray DC, Rutledge CM (2014) Using new communication technologies: an educational strategy fostering collaboration and telehealth skills in nurse practitioners. J Nurs Pract 10(10):840–844. https://doi.org/10.1016/j.nurpra.2014.06.018
Grimshaw JM, Santesso N, Cumpston M, Mayhew A, McGowan J (2006) Knowledge for knowledge translation: the role of the Cochrane Collaboration. J Contin Educ Heal Prof 26(1):55–62. https://doi.org/10.1002/chp.51
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE (2012) Knowledge translation of research findings. Implement Sci 7(1):50. https://doi.org/10.1186/1748-5908-7-50
Gubbi J, Buyya R, Marusic S, Palaniswami M (2013) Internet of Things (IoT): a vision, architectural elements, and future directions. Futur Gener Comput Syst 29(7):1645–1660. https://doi.org/10.1016/j.future.2013.01.010
Hayashi ECS, Baranauskas MCC (2013) Affectibility in educational technologies: a socio-technical perspective for design. Educ Technol Soc 16(1):57–68
Hurteau M, MA Nadeau (1985) The pros and cons of responsive evaluation. http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=ED267103&site=ehost-live
Idrus RM (2008) Transforming Engineering Learning via Technogogy. In: Proceedings of the 5th WSEAS/IASME International Conference on Engineering Education, pp 33–38. http://dl.acm.org/citation.cfm?id=1581120.1581131
Idrus RM (2009) Learner Continuum Technology Enhanced Learning Model via Technogogy. In: Proceedings of the 5th WSEAS/IASME International Conference on Educational Technologies (EDUTE’09), pp 198–201. http://www.wseas.us/e-library/conferences/2009/lalaguna/EDUTE/EDUTE-29.pdf
Idrus RM, McComas K (2006) Technology: facilitating the transformation of learning. In: 3rd International Conference on ELearning for the Knowledge Based Society, vol 14, pp 5.1–5.9. http://www.elearningap.com/eLAP2006/Proceeding/p5.1-9-fin-58-keynote-Rozhan-%20Karen.pdf
Ikenwilo D, Skåtun D (2014) Perceived need and barriers to continuing professional development among doctors. Health Policy 117(2):195–202. https://doi.org/10.1016/j.healthpol.2014.04.006
International Labour Office (2012) International Standard Classification of Occupations 2008 (ISCO-08) Structure, Group Definitions and Correspondence Tables. http://public.eblib.com/choice/publicfullrecord.aspx?p=991922
İpek J, Karasu M, Kayahan S, Çukurbaşi E, Yeşil E (2014) Inspection of techno-pedagogical educational qualifications of mathematics teacher candidates. Procedia-Soc Behav Sci 141:718–725. https://doi.org/10.1016/j.sbspro.2014.05.126
Issitt C (2013) Continuing professional development. Saf Health Pract 31(4):25
Joseph S, Juwah C (2012) Using constructive alignment theory to develop nursing skills curricula. Nurse Educ Pract 12(1):52–59. https://doi.org/10.1016/j.nepr.2011.05.007
Karim SI, Irfan F, Qureshi R, Naeem N, Alfaris EAM (2013) Evaluation of continuing professional development program for Family Physicians. Pakistan J Med Sci 29(2):3155. https://doi.org/10.12669/pjms.292.3155
Kemp SJ, Baker M (2013) Continuing professional development—reflections from nursing and education. Nurse Educ Pract 13(6):541–545. https://doi.org/10.1016/j.nepr.2013.04.009
Kvas A, Seljak J (2013) Continuing education and self-assessment of knowledge of nurse leaders. J Contin Educ Nurs 44(8):342–349. https://doi.org/10.3928/00220124-20130603-07
Kyriazis D, Varvarigou T (2013) Smart, autonomous and reliable Internet of Things. Procedia Comput Sci 21:442–448. https://doi.org/10.1016/j.procs.2013.09.059
Laal M (2011) Impact of Technology on Lifelong Learning. Procedia-Soc Behav Sci 28:439–443. https://doi.org/10.1016/j.sbspro.2011.11.084
Laal M, Laal A, Aliramaei A (2014) Continuing education; lifelong learning. Procedia-Soc Behav Sci 116:4052–4056. https://doi.org/10.1016/j.sbspro.2014.01.889
Lawson C, Cowling C (2015) Social media: the next frontier for professional development in radiography. Radiography 21(2):e74–e80. https://doi.org/10.1016/j.radi.2014.11.006
Mabasa LT (2013) A responsive evaluation approach in evaluating the safe schools and the child-friendly schools programmes in the Limpopo Province (Stellenbosch University). http://scholar.sun.ac.za/bitstream/handle/10019.1/80061/mabasa_responsive_2013.pdf
Mack HG, Sandhu SS, Filipe HP (2016) Developing educators for continuing professional development. Can J Ophthalmol 51(3):196–200. https://doi.org/10.1016/j.jcjo.2016.03.008
Mann K, Sargeant J, Hill T (2009) Knowledge translation in interprofessional education: what difference does interprofessional education make to practice? Learn Health Soc Care 8(3):154–164. https://doi.org/10.1111/j.1473-6861.2008.00207.x
Mashal I, Alsaryrah O, Chung T-Y, Yang C-Z, Kuo W-H, Agrawal DP (2015) Choices for interaction with things on Internet and underlying issues. Ad Hoc Netw 28:68–90. https://doi.org/10.1016/j.adhoc.2014.12.006
Mengshoel AM (2012) Mixed methods research—so far easier said than done? Man Ther 17(4):373–375. https://doi.org/10.1016/j.math.2012.02.006
Menon A, Cafaro T, Loncaric D, Moore J, Vivona A, Wynands E, Korner-Bitensky N (2010) Creation and validation of the PERFECT: a critical incident tool for evaluating change in the practices of health professionals: creation and validation of PERFECT. J Eval Clin Pract 16(6):1170–1175. https://doi.org/10.1111/j.1365-2753.2009.01288.x
Milgram P, Takemura H, Utsumi A, Kishino F (1995) In: Das H (ed) Augmented reality: a class of displays on the reality-virtuality continuum. https://doi.org/10.1117/12.197321
Moore DE, Green JS, Gallis HA (2009) Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Heal Prof 29(1):1–15. https://doi.org/10.1002/chp.20001
Morgan DL (2014) Integrating qualitative and quantitative methods: a pragmatic approach. SAGE, Los Angeles
Muresan M (2013) A blended learning system within the cybergogy paradigm. Procedia-Soc Behav Sci 89:193–198. https://doi.org/10.1016/j.sbspro.2013.08.833
Muresan M (2014) Using cybergogy and andragogy paradigms in lifelong learning. Procedia-Soc Behav Sci 116:4722–4726. https://doi.org/10.1016/j.sbspro.2014.01.1015
Olmedo H (2013) Virtuality continuum’s state of the art. Procedia Comput Sci 25:261–270. https://doi.org/10.1016/j.procs.2013.11.032
Ong IL, Diño MJS, Calimag MMP, Hidalgo FA (2018) Developing a valid and reliable assessment of knowledge translation (KT) for continuing professional development program of health professionals. PeerJ 6:e5323. https://doi.org/10.7717/peerj.5323
Ong IL, Diño MJS, Calimag MMP, Hidalgo FA (2019) Development and validation of interprofessional learning assessment tool for health professionals in continuing professional development (CPD). PLoS ONE 14(1):e0211405. https://doi.org/10.1371/journal.pone.0211405
Ott KD (2011) Technology and adult learning: understanding E-learning and the lifelong learner. Int J Technol Knowl Soc 7(3):31–36
Paschou M, Sakkopoulos E, Sourla E, Tsakalidis A (2013) Health Internet of Things: metrics and methods for efficient data transfer. Simul Model Pract Theory 34:186–199. https://doi.org/10.1016/j.simpat.2012.08.002
Pepper K, Hare D (1999) Development of an evaluation model to establish research-based knowledge about teacher education. Stud Educ Eval 25(4):353–377. https://doi.org/10.1016/S0191-491X(99)00035-8
Popescul D, Georgescu M (2013) Internet of Things—some ethical issues. USV Ann Econ Public Admin 13(2):208–214
Popp MP (2013) Technology, lifelong learning and I (or We). Reference User Serv Q 52(3):179–181
Selinger M, Sepulveda A, Buchan J (2013) Education and the internet of everything: how ubiquitous connectedness can help transform pedagogy. http://www.cisco.com/c/dam/en/us/solutions/collateral/industry-solutions/education_internet.pdf
Shaev Y (2014) From the sociology of things to the “Internet of Things.” Procedia-Soc Behav Sci 149:874–878. https://doi.org/10.1016/j.sbspro.2014.08.266
Shaidullin RN, Safiullin LN, Gafurov IR, Safiullin NZ (2014) Blended learning: leading modern educational technologies. Procedia-Soc Behav Sci 131:105–110. https://doi.org/10.1016/j.sbspro.2014.04.087
Shin D (2014) A socio-technical framework for Internet-of-Things design: a human-centered design for the Internet of Things. Telematics Inform 31(4):519–531. https://doi.org/10.1016/j.tele.2014.02.003
Silva H, Bühler FR, Maillet B, Maisonneuve H, Miller LA, Negri A, Stonier PD (2012) Continuing medical education and professional development in the European Union. Pharm Med 26(4):223–233
Simmons B, Wagner S (2009) Assessment of continuing interprofessional education: lessons learned. J Contin Educ Heal Prof 29(3):168–171. https://doi.org/10.1002/chp.20031
Slough S, Connell M (2006) Defining Technogogy and its Natural Corollary, Technogogical Content Knowledge (TCK), pp 1053–1059
Souter D (2014) Building inclusive knowledge societies: a review of UNESCO’s action in implementing the WSIS outcomes. http://unesdoc.unesco.org/images/0022/002264/226425e.pdf
Spector JM (2014) Emerging educational technologies: tensions and synergy. J King Saud Univ-Comput Inf Sci 26(1):5–10. https://doi.org/10.1016/j.jksuci.2013.10.009
Stake RE (1900) (1967) Countenance of educational evaluation. Teach College Record 68:523–540
Stake RE (1991) Excerpts from: “program evaluation, particularly responsive evaluation.” Eval Pract 12(1):63–76. https://doi.org/10.1016/0886-1633(91)90025-S
Suryadi D, Kudwadi B (2010) Application of evaluation model countenance in the Secondary Education Curriculum and Vocational Technology. In: Competence development for the world of work and for sustainable development, pp 197–202. http://fptk.upi.edu/tvet-conference/download/TVET%20Conference%20Proceedings/Papers_Theme2/74_dedy_suryadi_rvd.pdf
Tashakkori A, Teddlie C, Johnson B (2015) Mixed methods. In: International encyclopedia of the social & behavioral sciences, pp 618–623. http://linkinghub.elsevier.com/retrieve/pii/B9780080970868105501
Tawil S, Cougoureux M (2013) Revisiting Learning: the treasure within; assessing the influence of the 1996 Delors Report. http://unesdoc.unesco.org/images/0022/002200/220050e.pdf
Tran D, Tofade T, Thakkar N, Rouse M (2014) US and International Health Professions’ Requirements for Continuing Professional Development. Am J Pharm Educ 78(6):1–129
UNESCO (2013) Rethinking education in a changing world. Presented at the rethinking education in a changing world: meeting of the Senior Experts’ Group, Paris, France. http://unesdoc.unesco.org/images/0022/002247/224743e.pdf
UNESCO, CEDEFOP, ETF, & UIL (2013) Global national qualifications framework inventory. http://www.cedefop.europa.eu/files/2211_en.pdf
UNESCO-IBE (2013) Glossary of Curriculum Terminology. http://www.ibe.unesco.org/fileadmin/user_upload/Publications/IBE_GlossaryCurriculumTerminology2013_eng.pdf
Varetto T, Costa DC (2013) Continuing medical education committee and UEMS-EACCME. Eur J Nucl Med Mol Imaging 40(3):470–474. https://doi.org/10.1007/s00259-012-2317-3
Wareing A, Buissink C, Harper D, Gellert Olesen M, Soto M, Braico S, Rainford L (2017) Continuing professional development (CPD) in radiography: a collaborative European meta-ethnography literature review. Radiography 23:S58–S63. https://doi.org/10.1016/j.radi.2017.05.016
Watts P, Langston SB, Brown M, Prince C, Belle A, Skipper MW, Moss J (2014) Interprofessional education: a multi-patient, team-based intensive care unit simulation. Clin Simul Nurs 10(10):521–528. https://doi.org/10.1016/j.ecns.2014.05.004
Wilson L, Callender B, Hall TL, Jogerst K, Torres H, Velji A (2014) Identifying Global Health Competencies to Prepare 21st Century Global Health Professionals: Report from the Global Health Competency Subcommittee of the Consortium of Universities for Global Health. J Law Med Ethics 42(s2):26–31. https://doi.org/10.1111/jlme.12184
World Health Organization (2013) Transforming and Scaling Up Health Professionals’ Education and Training: World Health Organization Guidelines 2013. http://www.who.int/hrh/resources/transf_scaling_hpet/en/
World Health Organization (2014) Health Workforce 2030: A Global strategy on human resources for health. http://www.who.int/workforcealliance/knowledge/resources/strategy_brochure9-20-14.pdf?ua=1
Yilmaz O, Bayraktar DM (2014) Teachers’ attitudes towards the use of educational technologies and their individual innovativeness categories. Procedia-Soc Behav Sci 116:3458–3461. https://doi.org/10.1016/j.sbspro.2014.01.783
Acknowledgements
We thank Dianne Eraphie A. Tabo-on for her statistical insights and review, the Research Development and Innovation Center of Our Lady of Fatima University for their support throughout this work, and our participants for their commitment and engagement.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection, and analyses were performed by ILO and MJSD. The first draft of the manuscript was written by ILO, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Appendices
Appendix 1
Inventory of reflective vignette—CPD program evaluation (IRV-CPE)
Instruction
For each statement below, please rate your level of agreement about your experience in each statement as follows:
1 = Not at all; 2 = Slightly; 3 = Fairly; 4 = Moderately; 5 = Strongly; 6 = Extremely
IRV-IPL | My expectations before the program | My assessment after the program | IF I joined a lecture program | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Specific experience | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 |
The learning program is based on international standards/recommendations | ||||||||||||||||||
The educational media and technology are aligned with the intended learning outcomes of the program | ||||||||||||||||||
The teacher has facilitated the learning program and its activities by using technology effectively | ||||||||||||||||||
The assessment tasks are aligned to the intended learning outcomes of the program | ||||||||||||||||||
The participants have achieved the intended learning outcomes at the highest possible level of performance | ||||||||||||||||||
General experience | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 |
I have improved my knowledge, competence, skills, attitude, and values | ||||||||||||||||||
I am motivated to use my learning and knowledge in actual practice | ||||||||||||||||||
I have gained a deeper appreciation of the use of technology for teaching and learning | ||||||||||||||||||
I have enjoyed learning together with other participants of the different professions | ||||||||||||||||||
I am interested in engaging more in continuing professional development programs | ||||||||||||||||||
Overall experience | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 |
The program has been successful | ||||||||||||||||||
The program is highly recommended | ||||||||||||||||||
Rights and permissions
About this article
Cite this article
Ong, I.L., Diño, M.J.S., Leus, M.J. et al. Technagogy-enhanced continuing professional development (CPD) for health professionals: design and evaluation. SN Soc Sci 1, 95 (2021). https://doi.org/10.1007/s43545-021-00095-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s43545-021-00095-9