Journal of Educational Evaluation for Health Professions

Research article

Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:23. Published online September 23, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.23

5,513 View
233 Download
4 Web of Science
5 Crossref

Purpose
It aimed to compare the use of the tele-objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.
Methods
This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.
Results
In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference=–0.277, P<0.001, effect size=0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.
Conclusion
The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.

Citations

Citations to this article as recorded by

Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2024; 29(3): 949. CrossRef
Feasibility of an online clinical assessment of competence in physiotherapy students
Brooke Flew, Lucy Chipchase, Darren Lee, Jodie A. McClelland
Physiotherapy Theory and Practice.2024; : 1. CrossRef
Navigating digital assessments in medical education: Findings from a scoping review
Chin-Siang Ang, Sakura Ito, Jennifer Cleland
Medical Teacher.2024; : 1. CrossRef
Radiography education in 2022 and beyond - Writing the history of the present: A narrative review
Y.X. Tay, J.P. McNulty
Radiography.2023; 29(2): 391. CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef

Review

Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:11. Published online June 1, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.11

7,568 View
416 Download
12 Web of Science
12 Crossref

Abstract PDF Supplementary Material

The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.

Citations

Citations to this article as recorded by

Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2024; 29(3): 949. CrossRef
A level playing field? Evaluation of the virtual Objective Structured Clinical Examination in Psychiatry and Addiction Medicine: A mixed methods study
Rebecca E Reay, Paul A Maguire, Jeffrey CL Looi
Australasian Psychiatry.2024; 32(4): 359. CrossRef
Conducting an objective structured clinical examination under COVID-restricted conditions
Andrea Gotzmann, John Boulet, Yichi Zhang, Judy McCormick, Mathieu Wojcik, Ilona Bartman, Debra Pugh
BMC Medical Education.2024;[Epub] CrossRef
The virtual Clinical Assessment of Skills and Competence: the impact and challenges of a digitised final examination
Kenny Chu, Shivanthi Sathanandan
BJPsych Bulletin.2023; 47(2): 110. CrossRef
Virtual Learning and Assessment in Rheumatology Fellowship Training: Objective Structured Clinical Examination Revisited
Rachel M. Wolfe, Faye N. Hant, Rumey C. Ishizawar, Lisa G. Criscione‐Schreiber, Beth L. Jonas, Kenneth S. O'Rourke, Marcy B. Bolster
Arthritis Care & Research.2023; 75(12): 2435. CrossRef
Innovations in assessment in health professions education during the COVID‐19 pandemic: A scoping review
Jamal Giri, Claire Stewart
The Clinical Teacher.2023;[Epub] CrossRef
Evaluation of the Utility of Online Objective Structured Clinical Examination Conducted During the COVID-19 Pandemic
Mona Arekat, Mohamed Hany Shehata, Abdelhalim Deifalla, Ahmed Al-Ansari, Archana Kumar, Mohamed Alsenbesy, Hamdi Alshenawi, Amgad El-Agroudy, Mariwan Husni, Diaa Rizk, Abdelaziz Elamin, Afif Ben Salah, Hani Atwa
Advances in Medical Education and Practice.2022; Volume 13: 407. CrossRef
Comparison of student pharmacists' performance on in-person vs. virtual OSCEs in a pre-APPE capstone course
Justine S. Gortney, Joseph P. Fava, Andrew D. Berti, Brittany Stewart
Currents in Pharmacy Teaching and Learning.2022; 14(9): 1116. CrossRef
Is online objective structured clinical examination teaching an acceptable replacement in post-COVID-19 medical education in the United Kingdom?: a descriptive study
Vashist Motkur, Aniket Bharadwaj, Nimalesh Yogarajah
Journal of Educational Evaluation for Health Professions.2022; 19: 30. CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
Applying the Student Response System in the Online Dermatologic Video Curriculum on Medical Students' Interaction and Learning Outcomes during the COVID-19 Pandemic
Chih-Tsung Hung, Shao-An Fang, Feng-Cheng Liu, Chih-Hsiung Hsu, Ting-Yu Yu, Wei-Ming Wang
Indian Journal of Dermatology.2022; 67(4): 477. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef

Research articles

Voluntary assignments during the pediatric clerkship to enhance the clinical experiences of medical students in the United States: Conrad Krawiec, Abigail Kate Myers; J Educ Eval Health Prof. 2020;17:17. Published online May 27, 2020; DOI: https://doi.org/10.3352/jeehp.2020.17.17

5,321 View
121 Download
1 Crossref

Abstract PDF Supplementary Material

Purpose
Pediatric clerkships that utilize off-campus clinical sites ensure clinical comparability by requiring completion of patient-focused tasks. Some tasks may not be attainable (especially off-campus); thus, they are not assigned. The objective of this study was to evaluate the feasibility of providing a voluntary assignment list to third-year medical students in their pediatric clerkship.
Methods
This is a retrospective single-center cross-sectional analysis of voluntary assignment completion during the 2019–2020 academic year. Third-year medical students were provided a voluntary assignment list (observe a procedure, use an interpreter phone to obtain a pediatric history, ask a preceptor to critique a clinical note, and follow-up on a patient after the rotation ends). Descriptive statistics were used to assess the timing and distribution of voluntary assignment completion.
Results
In total, 132 subjects (77 on the main campus, 55 off-campus) were included. Eighteen (13.6%) main-campus and 16 (12.1%) off-campus students completed at least 1 voluntary assignment. The following voluntary assignments were completed: observe a procedure (15, 11.4%), use an interpreter phone (26, 19.7%), ask a preceptor to critique a clinical note (12, 9.1%), and follow-up on a patient after the rotation ends (7, 5.3%). Off-campus students completed the assignments more often (29.1%) than on-campus students (23.4%)
Conclusion
Our clerkship values specific patient-focused tasks that may enhance student development, but are not attainable at all clinical sites. When provided a voluntary assignment list, 34 out of 132 students (25.8%) completed them. Clerkships that utilize off-campus sites should consider this approach to optimize the pediatric educational experience.

Citations

Citations to this article as recorded by

Adherence to Self - Care Practice Among Type 2 Diabetes Mellitus Patients Using the Theory of Planned Behavior and Health Belief Model at Comprehensive Specialized Hospitals of Amhara Region, Ethiopia: Mixed Method
Wudneh Simegn, Solomon Ahmed Mohammed, Getachew Moges
Patient Preference and Adherence.2023; Volume 17: 3367. CrossRef

Effect of student-directed solicitation of evaluation forms on the timeliness of completion by preceptors in the United States: Conrad Krawiec, Vonn Walter, Abigail Kate Myers; J Educ Eval Health Prof. 2019;16:32. Published online October 16, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.32

9,723 View
130 Download

Abstract PDF Supplementary Material: Purpose
Summative evaluation forms assessing a student’s clinical performance are often completed by a faculty preceptor at the end of a clinical training experience. At our institution, despite the use of an electronic system, timeliness of completion has been suboptimal, potentially limiting our ability to monitor students’ progress. The aim of the present study was to determine whether a student-directed approach to summative evaluation form collection at the end of a pediatrics clerkship would enhance timeliness of completion for third-year medical students.
Methods
This was a pre- and post-intervention educational quality improvement project focused on 156 (82 pre-intervention, 74 post-intervention) third-year medical students at Penn State College of Medicine completing their 4-week pediatric clerkship. Utilizing REDCap (Research Electronic Data Capture) informatics support, student-directed evaluation form solicitation was encouraged. The Wilcoxon rank-sum test was applied to compare the pre-intervention (May 1, 2017 to March 2, 2018) and post-intervention (April 2, 2018 to December 21, 2018) percentages of forms completed before the rotation midpoint.
Results
In total, 740 evaluation forms were submitted during the pre-intervention phase and 517 during the post-intervention phase. The percentage of forms completed before the rotation midpoint increased after implementing student-directed solicitation (9.6% vs. 39.7%, P<0.05).
Conclusion
Our clerkship relies on subjective summative evaluations to track students’ progress, deploy improvement strategies, and determine criteria for advancement; however, our preceptors struggled with timely submission. Allowing students to direct the solicitation of evaluation forms enhanced the timeliness of completion and should be considered in clerkships facing similar challenges.

Case report

Dental students’ learning attitudes and perceptions of YouTube as a lecture video hosting platform in a flipped classroom in Korea: Chang Wan Seo, A Ra Cho, Jung Chul Park, Hag Yeon Cho, Sun Kim; J Educ Eval Health Prof. 2018;15:24. Published online October 11, 2018; DOI: https://doi.org/10.3352/jeehp.2018.15.24

28,620 View
390 Download
17 Web of Science
18 Crossref

Abstract PDF Supplementary Material

Purpose
The aim of this study was to confirm the applicability of YouTube as a delivery platform of lecture videos for dental students and to assess their learning attitudes towards the flipped classroom model.
Methods
Learning experiences after using the YouTube platform to deliver preliminary video lectures in a flipped classroom were assessed by 69 second-year students (52 males, 17 females) at Dankook University College of Dentistry, Korea, who attended periodontology lectures during 2 consecutive semesters of the 2016 academic year. The instructor uploaded the lecture videos to YouTube before each class. At the end of the second semester, the students were surveyed using a questionnaire devised by the authors.
Results
Of the students, 53 (76.8%) always watched the lecture before the class, 48 (69.6%) used their smartphones, and 66 (95.7%) stated that they watched the lectures at home. The majority of the students replied that the video lectures were easier to understand than face to face lectures (82.6%) and that they would like to view the videos again after graduation (73.9%).
Conclusion
Our results indicate that YouTube is an applicable platform to deliver video lectures and to expose students to increased learning opportunities.

Citations

Citations to this article as recorded by

Does forced-shift to online learning affect university brand image in South Korea? Role of perceived harm and international students’ learning engagement
Umer Zaman, Murat Aktan, Hasnan Baber, Shahid Nawaz
Journal of Marketing for Higher Education.2024; 34(1): 390. CrossRef
YouTube as a source of information about rubber dam: quality and content analysis
Gülsen Kiraz, Arzu Kaya Mumcu, Safa Kurnaz
Restorative Dentistry & Endodontics.2024;[Epub] CrossRef
Use of social media by dental students: A comparative study
Rand Al-Obaidi
Clinical Epidemiology and Global Health.2024; 26: 101559. CrossRef
Structure, governance and delivery of specialist training programs in periodontology and implant dentistry
Moshe Goldstein, Nikolaos Donos, Wim Teughels, Nikolaos Gkranias, Andy Temmerman, Jan Derks, Bahar Eren Kuru, Maria Clotilde Carra, Ana Belen Castro, Xanthippi Dereka, Christel Dekeyser, David Herrera, Katleen Vandamme, Elena Calciolari
Journal of Clinical Periodontology.2024; 51(S27): 55. CrossRef
Social Media in Oral Health Education: A Scoping Review
Zuzanna Apel, Nathalia Carolina Fernandes Fagundes, Nazlee Sharmin, Usama Nassar, Gordon Gow, Dominic Apel, Arnaldo Perez
European Journal of Dental Education.2024;[Epub] CrossRef
Evaluating video‐based lectures on YouTube for dental education
Ryan T. Gross, Nare Ghaltakhchyan, Eleanor M. Nanney, Tate H. Jackson, Christopher A. Wiesen, Paul Mihas, Adam M. Persky, Sylvia A. Frazier‐Bowers, Laura A. Jacox
Orthodontics & Craniofacial Research.2023; 26(S1): 210. CrossRef
Learning of paediatric dentistry with the flipped classroom model
Nuria E. Gallardo, Antonia M. Caleya, Maria Esperanza Sánchez, Gonzalo Feijóo
European Journal of Dental Education.2022; 26(2): 302. CrossRef
Effects of Video Length on a Flipped English Classroom
Zhonggen Yu, Mingle Gao
Sage Open.2022;[Epub] CrossRef
An Evaluation of the Usefulness of YouTube® Videos on Crown Preparation
Syed Rashid Habib, Aleshba Saba Khan, Mohsin Ali, Essam Abdulla Abutheraa, Ahmad khaled alkhrayef, Faisal Jibrin Aljibrin, Nawaf Saad Almutairi, Ammar A. Siddiqui
BioMed Research International.2022; 2022: 1. CrossRef
Perceptions of Students on Distance Education and E-Learning in Dentistry Education: Challenges and Opportunities
Ayşe TORAMAN, Ebru SAĞLAM, Serhat KÖSEOĞLU
Journal of Biotechnology and Strategic Health Research.2022; 6(2): 101. CrossRef
Social Media as a Learning Tool for the Budding Periodontist
Riddhi Awasthi, Balaji Manohar, S Vinay, Santosh Kumar
Advances in Human Biology.2022; 12(3): 286. CrossRef
YouTube and Education: A Scoping Review
Abdulhadi Shoufan, Fatma Mohamed
IEEE Access.2022; 10: 125576. CrossRef
Uso de la plataforma YouTube® por los estudiantes de odontología: Revisión de alcance
María Luján Méndez Bauer, Stella de los Angeles Bauer Walter
Universitas Odontologica.2022;[Epub] CrossRef
Social media as a learning tool: Dental students’ perspectives
Mona T. Rajeh, Shahinaz N. Sembawa, Afnan A. Nassar, Seba A. Al Hebshi, Khalid T. Aboalshamat, Mohammed K. Badri
Journal of Dental Education.2021; 85(4): 513. CrossRef
Social Media Usage among Dental Undergraduate Students—A Comparative Study
Eswara Uma, Pentti Nieminen, Shani Ann Mani, Jacob John, Emilia Haapanen, Marja-Liisa Laitala, Olli-Pekka Lappalainen, Eby Varghase, Ankita Arora, Kanwardeep Kaur
Healthcare.2021; 9(11): 1408. CrossRef
Flipped Classroom Experiences in Clinical Dentistry – A Strategic Mini-Review
Abdullah Aljabr
The Open Dentistry Journal.2021; 15(1): 717. CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef
Attitudes toward Social Media among Practicing Dentists and Dental Students in Clinical Years in Saudi Arabia
Khalid Aboalshamat, Sharifah Alkiyadi, Sarah Alsaleh, Rana Reda, Sharifa Alkhaldi, Arwa Badeeb, Najwa Gabb
The Open Dentistry Journal.2019; 13(1): 143. CrossRef

First
Prev
Page of 1
Next
Last

Search