Surgical videos used for face-to-face and virtual oral assessment: experiences of examiners and trainees.
PDF

How to Cite

Surgical videos used for face-to-face and virtual oral assessment: experiences of examiners and trainees. (2023). African Journal of Health Professions Education, 15(3), 8-11. https://doi.org/10.7196/AJHPE.2023.v15i3.890

Abstract

Background

Varied assessment strategies are required in the process of deciding whether a surgeon is competent to graduate. Despite doubts about the reliability of the oral examination and the challenges of standardising examiner practices, it remains an important assessment method in surgical exit examinations. Structured orals may facilitate the measurement of course outcomes.

Objectives

This study explored the experiences of surgical trainees and examiners using a video-assisted, mock structured oral examination (SOE) as an assessment tool.

Methods

This descriptive study incorporated procedural videos in a case-based SOE format. One group of trainees had face-to-face contact with the examiner, and the other was assessed on an online platform, e.g., Microsoft Teams™, with a remote examiner. After the SOE, a focus group interview was conducted with surgical trainees and individual interviews with examiners.

Results

Themes were developed from the interview transcripts. These centred around the utility of videos in this examination format and technical issues during the SOE. Further themes highlighted the standardization of questions and preparation of examiners.

Conclusion

Overall, procedural videos as part of the mock SOE were experienced as valuable. Adding video recordings to the online platform posed administrative and technical challenges. However, the trainees and the examiners could log in from peripheral clinical training sites, which was experienced as an advantage. This study provides a glimpse into the application of procedural videos during SOEs as an assessment tool, from the perspective of surgical trainees and examiners. Efforts should focus on standardization of the examination format, optimizing technical issues, and improving examiner preparation.

PDF

References

Davis MH, Karunathilake I. The place of the oral examination in today’s assessment systems. Med Teach 2005;27(4):294-297. https://doi.org/10.1080/01421590500126437

Imran M, Doshi C, Kharadi D. Structured and unstructured viva voce assessment: A double-blind, randomised, comparative evaluation of medical students. Int J Health Sci (Qassim) 2019;13(2):3-9.

Bose MM, Gijselaers WH. Why supervisors should promote feedback-seeking behaviour in medical residency. Med Teach 2013;35(11). https://doi.org/10.3109/0142159X.2013.803059

Balsam LB. Zoom into the future with the virtual mock oral examination. JTCVS Open 2020;3:138-139. https:// doi.org/10.1016/j.xjon.2020.08.007

Chaurasia AR, Page BR, Walker AJ, et al. Lessons to learn from a successful virtual mock oral examination pilot experience. Adv Radiat Oncol 2021;6(1):100534. https://doi.org/10.1016/j.adro.2020.07.011

Goodman JF, Saini P, Straughan AJ, Badger CD, Thakkar P, Zapanta PE. The virtual mock oral examination: A multi-institutional study of resident and faculty receptiveness. OTO Open 2021;5(1):2473974X2199739. https://doi.org/10.1177/2473974X21997392

Zemela MS, Malgor RD, Smith BK, Smeds MR. Feasibility and acceptability of virtual mock oral examinations for senior vascular surgery trainees and implications for the certifying exam. Ann Vasc Surg 2021;76:28-37. https:// doi.org/10.1016/j.avsg.2021.03.005

Memon MA, Joughin GR, Memon B. Oral assessment and postgraduate medical examinations: Establishing conditions for validity, reliability and fairness. Adv Health Sci Educ 2010;15(2):277-289. https://doi.org/10.1007/ s10459-008-9111-9

Moore MD, Abelson JS, O’Mahoney P, Bagautdinov I, Yeo H, Watkins AC. Using GoPro to give video-assisted operative feedback for surgery residents: A feasibility and utility assessment. J Surg Educ 2018;75(2):497-502. https://doi.org/10.1016/j.jsurg.2017.07.024

Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77-101. https://doi. org/10.1191/1478088706qp063oa

Darzi A, Mackay S. Assessment of surgical competence. Qual Saf Health Care 2001;10(Suppl 2):ii64-ii69. https:// doi.org/10.1136/qhc.0100064

Wang L, Khalaf AT, Lei D, et al. Structured oral examination as an effective assessment tool in lab-based physiology learning sessions. Adv Physiol Educ 2020;44(3):453-458. https://doi.org/10.1152/advan.00059.2020

Mota P, Carvalho N, Carvalho-Dias E, João Costa M, Correia-Pinto J, Lima E. Video-based surgical learning: Improving trainee education and preparation for surgery. J Surg Educ 2018;75(3):828-835. https://doi. org/10.1016/j.jsurg.2017.09.027

Preusche I, Schmidts M, Wagner-Menghin M. Twelve tips for designing and implementing a structured rater training in OSCEs. Med Teach 2012;34(5):368-372. https://doi.org/10.3109/0142159X.2012.652705

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2023 Karin Baatjes