Assessing Meaningful Outcomes in Program Evaluation of Online Learning
SACME's Virtual Journal Club | June 18, 2020
The ongoing pandemic is creating a a tension between a greater need for continuing professional development and restrictions that make doing so a challenge. This has led many to shift educational strategies related to content, frequency, policy and delivery formats. One of the most common delivery methods has been to leverage online synchronous and asynchronous strategies.
While there is an extensive literature supporting online teaching and learning, how best to conduct and/or fit in effective evaluation of these programs is less clear. In this session, we will examine existing program evaluation and outcome frameworks with the aim of applying these concepts to the evaluation of online delivery formats in CPD.
Materials
Presentation slide deck (PDF)
References
Case Studies:
1. Eltayar, A. N., Eldesoky, N. I., Khalifa, H., & Rashed, S. (2020). Online faculty development using Cognitive apprenticeship in response to COVID 19. Medical Education.
2. Burns, R., Wenger, J. (2020). A remotely conducted paediatric bootcamp for fourth-year medical students. Medical Education.
Additional Key References:
3. Haji,F., Morin, M.P., Parker, K. (2013). Rethinking programme evaluation in health professions education: beyond ‘did it work?’ Medical Education.
4. Frye, A. W., Hemmer, P.A. (2012) Program evaluation models and related theories: AMEE Guide No. 67, Medical Teacher, 34:5, e288-e299.
Presenters
Walter Tavares, PhD
Scientist and Assistant Professor, The Wilson Centre and Post MD Education
Post Graduate Medical Education & Continuing Professional Development
Faculty of Medicine, Institute of Health Policy, Management and Evaluation
Dalla Lana School of Public Health, University Health Network,
University of Toronto
David Wiljer, PhD
Executive Director,
Education Technology Innovation, University Health Network
Associate Professor,
Dept. of Psychiatry,
Institute of Health Policy, Management and Evaluation,
Academic Director, Continuing Professional Development
University of Toronto
Collaborating Scientist,
Centre for Addiction and Mental Health
David Rojas, PhD
Assistant Professor,
Department of Obstetrics and Gynecology, Faculty of Medicine,
University of Toronto
Evaluation Scientist,
Centre for Ambulatory Care Education (CACE), Women’s College Hospital
Office of Assessment and Evaluation, MD Program,
University of Toronto
Cross-Appointed Scientist,
The Wilson Centre, University Health Network & University of Toronto
Facilitator
Mila Kostic, CHCP, FACEHP
Strategic Advisor, Stanford Center for CME
Stanford University