How to Cite
Abstract
Background
Varied assessment strategies are required in the process of deciding whether a surgeon is competent to graduate. Despite doubts about the reliability of the oral examination and the challenges of standardising examiner practices, it remains an important assessment method in surgical exit examinations. Structured orals may facilitate the measurement of course outcomes.
Objectives
This study explored the experiences of surgical trainees and examiners using a video-assisted, mock structured oral examination (SOE) as an assessment tool.
Methods
This descriptive study incorporated procedural videos in a case-based SOE format. One group of trainees had face-to-face contact with the examiner, and the other was assessed on an online platform, e.g., Microsoft Teams™, with a remote examiner. After the SOE, a focus group interview was conducted with surgical trainees and individual interviews with examiners.
Results
Themes were developed from the interview transcripts. These centred around the utility of videos in this examination format and technical issues during the SOE. Further themes highlighted the standardization of questions and preparation of examiners.
Conclusion
Overall, procedural videos as part of the mock SOE were experienced as valuable. Adding video recordings to the online platform posed administrative and technical challenges. However, the trainees and the examiners could log in from peripheral clinical training sites, which was experienced as an advantage. This study provides a glimpse into the application of procedural videos during SOEs as an assessment tool, from the perspective of surgical trainees and examiners. Efforts should focus on standardization of the examination format, optimizing technical issues, and improving examiner preparation.
References
Davis MH, Karunathilake I. The place of the oral examination in today’s assessment systems. Med Teach 2005;27(4):294-297. https://doi.org/10.1080/01421590500126437
Imran M, Doshi C, Kharadi D. Structured and unstructured viva voce assessment: A double-blind, randomised, comparative evaluation of medical students. Int J Health Sci (Qassim) 2019;13(2):3-9.
Bose MM, Gijselaers WH. Why supervisors should promote feedback-seeking behaviour in medical residency. Med Teach 2013;35(11). https://doi.org/10.3109/0142159X.2013.803059
Balsam LB. Zoom into the future with the virtual mock oral examination. JTCVS Open 2020;3:138-139. https:// doi.org/10.1016/j.xjon.2020.08.007
Chaurasia AR, Page BR, Walker AJ, et al. Lessons to learn from a successful virtual mock oral examination pilot experience. Adv Radiat Oncol 2021;6(1):100534. https://doi.org/10.1016/j.adro.2020.07.011
Goodman JF, Saini P, Straughan AJ, Badger CD, Thakkar P, Zapanta PE. The virtual mock oral examination: A multi-institutional study of resident and faculty receptiveness. OTO Open 2021;5(1):2473974X2199739. https://doi.org/10.1177/2473974X21997392
Zemela MS, Malgor RD, Smith BK, Smeds MR. Feasibility and acceptability of virtual mock oral examinations for senior vascular surgery trainees and implications for the certifying exam. Ann Vasc Surg 2021;76:28-37. https:// doi.org/10.1016/j.avsg.2021.03.005
Memon MA, Joughin GR, Memon B. Oral assessment and postgraduate medical examinations: Establishing conditions for validity, reliability and fairness. Adv Health Sci Educ 2010;15(2):277-289. https://doi.org/10.1007/ s10459-008-9111-9
Moore MD, Abelson JS, O’Mahoney P, Bagautdinov I, Yeo H, Watkins AC. Using GoPro to give video-assisted operative feedback for surgery residents: A feasibility and utility assessment. J Surg Educ 2018;75(2):497-502. https://doi.org/10.1016/j.jsurg.2017.07.024
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77-101. https://doi. org/10.1191/1478088706qp063oa
Darzi A, Mackay S. Assessment of surgical competence. Qual Saf Health Care 2001;10(Suppl 2):ii64-ii69. https:// doi.org/10.1136/qhc.0100064
Wang L, Khalaf AT, Lei D, et al. Structured oral examination as an effective assessment tool in lab-based physiology learning sessions. Adv Physiol Educ 2020;44(3):453-458. https://doi.org/10.1152/advan.00059.2020
Mota P, Carvalho N, Carvalho-Dias E, João Costa M, Correia-Pinto J, Lima E. Video-based surgical learning: Improving trainee education and preparation for surgery. J Surg Educ 2018;75(3):828-835. https://doi. org/10.1016/j.jsurg.2017.09.027
Preusche I, Schmidts M, Wagner-Menghin M. Twelve tips for designing and implementing a structured rater training in OSCEs. Med Teach 2012;34(5):368-372. https://doi.org/10.3109/0142159X.2012.652705
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2023 Karin Baatjes