Abstract
The purpose of this study was to evaluate two online instructional design features, namely adaptation to learner prior knowledge and use of questions to enhance interactivity in online portrayals of physician–patient encounters, in the context of instructing surgical specialists to deliver perioperative tobacco interventions. An online learning module on perioperative tobacco control was developed, in formats incorporating permutations of adaptive/non-adaptive and high/low interactivity (i.e., 2 × 2 factorial design). Participants (a national sample of US anesthesiology residents) were randomly assigned to module format. Primary outcomes included tobacco knowledge, time to complete the module, and self-efficacy in delivering tobacco interventions. One hundred fourteen residents completed the module, which required a median of 60 min (interquartile range 49, 138). The difference in post-module tobacco knowledge score was similar for adaptive and non-adaptive formats [mean difference 0.3 of 10 possible (95% CI − 0.3, 1.0), p = 0.25] but time was shorter for the adaptive format [− 7 min (95% CI − 14, 0), p = 0.01] and knowledge efficiency (knowledge score divided by time) was higher [0.08 units (95% 0.03, 0.14), p = 0.004]. The level of interactivity had no significant effect on self-efficacy [− 0.1 on a 5-point scale (95% CI − 0.3, 0.1), p = 0.50] in delivering tobacco interventions (both outcomes using 5-point scales). Adapting online instruction to learners’ prior knowledge appears to improve the efficiency of learning; adaptation should be implemented when feasible. Adding features that encourage learner interaction in an online course does not necessarily improve learning outcomes.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Buckelew, S. M., Adams, S. H., Irwin, C. E., Jr., Gee, S., & Ozer, E. M. (2008). Increasing clinician self-efficacy for screening and counseling adolescents for risky health behaviors: results of an intervention. Journal of Adolescent Health,43(2), 198–200.
Cook, D. A., Beckman, T. J., Thomas, K. G., & Thompson, W. G. (2008a). Adapting web-based instruction to residents’ knowledge improves learning efficiency: a randomized controlled trial. Journal of General Internal Medicine,23(7), 985–990.
Cook, D. A., Erwin, P. J., & Triola, M. M. (2010a). Computerized virtual patients in health professions education: a systematic review and meta-analysis. Academic Medicine,85(10), 1589–1602.
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., et al. (2008b). Internet-based learning in the health professions: a meta-analysis. JAMA,300(10), 1181–1196.
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., et al. (2010b). Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Academic Medicine,85(5), 909–922.
Cook, D. A., Thompson, W. G., & Thomas, K. G. (2011). The motivated strategies for learning questionnaire: score validity among medicine residents. Medical Education,45(12), 1230–1240.
Cook, D. A., Thompson, W. G., & Thomas, K. G. (2014). Test-enhanced web-based learning: optimizing the number of questions (a randomized crossover trial). Academic Medicine,89(1), 169–175.
Courteille, O., Fahlstedt, M., Ho, J., Hedman, L., Fors, U., et al. (2018). Learning through a virtual patient vs. recorded lecture: a comparison of knowledge retention in a trauma case. International Journal of Medical Education,9, 86–92.
Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Advances in Psychology,52, 139–183.
Kerfoot, B. P. (2010). Adaptive spaced education improves learning efficiency: a randomized controlled trial. Journal of Urology,183(2), 678–681.
Kulik, J. A., & Flitcher, J. D. (2016). Effectiveness of intellegent tutoring systems: a meta-analytic review. Review of Educational Research,86, 42–78.
Landsberg, C. R., Astwood, R. S., Van Buskirk, W. L., Townsend, L. N., Steinhauser, N. B., et al. (2012). Review of adaptive trainin system techniques. Military Psychology,24, 96–113.
Larsen, D. P., Butler, A. C., & Roediger, H. L. (2008). Test-enhanced learning in medical education. Medical Education,42(10), 959–966.
Lau, B. D., Shaffer, D. L., Hobson, D. B., Yenokyan, G., Wang, J., et al. (2017). Effectiveness of two distinct web-based education tools for bedside nurses on medication administration practice for venous thromboembolism prevention: a randomized clinical trial. PLoS ONE,12(8), e0181664.
Ozer, E. M., Adams, S. H., Gardner, L. R., Mailloux, D. E., Wibbelsman, C. J., et al. (2004). Provider self-efficacy and the screening of adolescents for risky health behaviors. Journal of Adolescent Health,35(2), 101–107.
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and Psychological Measurement,53, 801–813.
Roediger, H. L., & Karpicke, J. D. (2006). Test-enhanced learning: taking memory tests improves long-term retention. Psychological Science,17(3), 249–255.
Rose, E., Claudius, I., Tabatabai, R., Kearl, L., Behar, S., et al. (2016). The flipped classroom in emergency medicine using online videos with interpolated questions. Journal of Emergency Medicine,51(3), 284–291.
Schultz, C. R., Benson, J. J., Cook, D. A., & Warner, D. O. (2014). Training for perioperative smoking cessation interventions: a national survey of anesthesiology program directors and residents (research support, non-U.S. Gov’t). Journal of Clinical Anesthesia,26(7), 563–569.
TCPGT Tobacco. (2008). A clinical practice guideline for treating tobacco use and dependence: 2008 update. A U.S. public health service report. American Journal of Preventive Medicine,35(2), 158–176.
Thompson, G. A., Holyoak, K. J., Morrison, R. G., & Clark, T. K. (2006). Evaluation of an online analogical patient seimulation program. In IEEE symposium on computer-based medical medical systems. Salt Lake City, UT.
Warner, D. O. (2006). Perioperative abstinence from cigarettes: physiological and clinical consequences. Anesthesiology,104(2), 356–367.
Warner, D. O., & American Society of Anesthesiologists Smoking Cessation Initiative Task Force. (2009). Feasibility of tobacco interventions in anesthesiology practices: a pilot study. Anesthesiology,110(6), 1223–1228.
Warner, D. O., Klesges, R. C., Dale, L. C., Offord, K. P., Schroeder, D. R., et al. (2011). Clinician-delivered intervention to faciliate tobacco quitline use by surgical patients. Anesthesiology,114, 847–855.
Warner, D. O., Sarr, M. G., Offord, K., & Dale, L. C. (2004a). Anesthesiologists, general surgeons, and tobacco interventions in the perioperative period. Anesthesia and Analgesia,99, 1776–1783.
Warner, D. O., Sarr, M. G., Offord, K. P., & Dale, L. C. (2004b). Anesthesiologists, general surgeons, and tobacco interventions in the perioperative period. Anesthesia and Analgesia,99(6), 1766–1773.
Funding
This work was supported in part by an unrestricted educational grant from Pfizer, Grant No. 44252.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical approval
This study was determined to be exempt from review by the Mayo Clinic Institutional Review Board, #13-009744.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Warner, D.O., Nolan, M., Garcia-Marcinkiewicz, A. et al. Adaptive instruction and learner interactivity in online learning: a randomized trial. Adv in Health Sci Educ 25, 95–109 (2020). https://doi.org/10.1007/s10459-019-09907-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-019-09907-3