AFRJMS African Research Journal of Medical Sciences 3006-7421 Bioscience Press afrjms-3-1-001 10.62587/AFRJMS.1.1.2024.42-50 Research Paper An action research to introduce direct observation of procedural skills (DOPS) as clinical skill performance assessment tool during medical internship in the department of surgery, Debre Tabor University, Debre Tabor, Ethiopia, 2023 HasenYalew 1 * MequanintAderajew 2 TeshomeTewodros 3 BeleteAmsalu 4 BekeleDerso 5 1Assistant Professor, Department of Anesthesiology, Critcal Care and Pain Medicine, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: yalewhassen11@gmail.com 2Assistant Professor, Surgery Department, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: mequaninttakele@gmail.com 3Lecturer, Pediatric and Child Health Department, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: tewodrosyalemwork@gmail.com 4Assistant Professor, Psychiatry Department, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: amsalu04@gmail.com 5Lecturer, Internal Medicine Department, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: dersobekele1212@gmail.com *Corresponding author: Yalew Hasen, Assistant Professor, Department of Anesthesiology, Critcal Care and Pain Medicine, Debre Tabor University, Debre Tabor, Ethiopia. E-mail: yalewhassen11@gmail.com 01 2024 1 1 42 50 Abstract

Direct observation of procedural skill (DOPS) is a work-based assessment method consisting of a supervisor observing a trainee conducting a procedural skill using structured procedural checklist and providing feedback to the trainee about their performance within an authentic workplace context. The general aim of this study was to introduce DOPS as a clinical skills performance assessment for medical interns and to explore the perceptions and the levels of satisfaction among medical interns and their assessors in their surgery clinical attachments, at Debre Tabor University, Department of Surgery, Debre Tabor, Ethiopia, 2023. The study was an action research that was conducted d during surgery rotation for medical interns. Each student performed at least two procedures. Under the observation of two assessors using direct observation of procedural skills checklists designed for each procedure. Twelve medical interns were completed two procedures in one or each of the four checklists/procedures. Irrespective of the type of procedure, the DOPS performance improved significantly between the first and second assessments in all four procedures. The most common reasons why DOPS is not routinely undertaken were work overload/time constraints for assessors 8 (40%), lack of training about DOPS 5 (25%) and a combination of the two 4 (20%).

 Keywords Direct observation of procedural skills (DOPS) Performance assessment Medical internship Skill assessment Work-place based assessment References Australian Medical Council. (2013). Online cited 2015 September. Available from: http://www.amc.org.au/index.php/ar/psa Bangal Vidyadhar. (2018). Training and assessment of medical interns using “direct observation of procedural skills (DOPS)” tool in obstetrics and gynecology. Women’s Health, 7(4): 120–123. DuffyF.D.et al. (2004). Participants in the american academy on physician and patient’s conference on education and evaluation of competence in communication and interpersonal skills. Assessing competence in communication and interpersonal skills: the Kalamazoo II report. Academic Medicine, 79(6): 495–507. Ethiopian ministry of health competency based integrated modular medical curriculum; 2021. HashimZ.MillerA.FahimN. (2012). The exam skills workshop as formative assessment for medical students International Journal of Collaborative Research on Internal Medicine & Public Health, 4(5): 578–588. Ibrahimet al. (2018). Perceptions of clinical years’ medical students and interns about factors affecting their exam performance. The Journal of Medical Research, 4(3): 132–136. Jui Y.LagooShilpa B.Joshi (2021). Introduction of direct observation of procedural skills (DOPS) as a formative assessment tool during postgraduate training in anaesthesiology: Exploration of perceptions Indian Journal of Anaesthesia, 65(3): 202–209. KhanghahiM.E.AzarF.E. (2018). Direct observation of procedural skills (DOPS) evaluation method: Systematic review of evidence. Med J Islam Repub Iran, 32(45): 254–261. LörwaldAndrea C.et al. (2018). The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis PLoS ONE, 13(6): 1–15. McLeodR.A.MiresG.J.KerJ.S. (2011). The use of the Direct Observation of Procedural Skills (DOPS) assessment tool in the clinical setting—the perceptions of students. International Journal of Clinical Skills, 5(2): 95–102. MillerG.E. (1990). The assessment of clinical skills/competence/performance. Acad Med., 65: S63–S67. NorciniJ.J.MackinleyD.W. (2007). Assessment methods in medical education. Teach Teacher Educ, 23: 239–250. The Royal Australian and New Zealand Collage of psychiatrist. (2023). Direct Observation of Procedural Skills (DOPS). WilkinsonJ.R.CrossleyJ.G.WraggA.MillsP.CowanG.WadeW. (2008). Implementing workplacebased assessment across the medical specialties in the United Kingdom. Med Educ., 42(4): 364–373. WraggA.WadeW.FullerG.CowanG.MillsP. (2003). Assessing the performance of specialist registrars. Clinical Medicine, 3(2): 131–134. ZainabShafiqHidayatUllahFouziaSultana (2019). Challenges in implementing direct observation of procedural skills as assessment tool in postgraduate training of general surgery. Ann Pak Inst Med Sci., 15(2): 66–70.