Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions

OPEN ACCESS
SEARCH
Search

Search

Page Path
HOME > Search
5 "Educational technology"
Filter
Filter
Article category
Keywords
Publication year
Authors
Funded articles
Research article
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia  
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
J Educ Eval Health Prof. 2021;18:23.   Published online September 23, 2021
DOI: https://doi.org/10.3352/jeehp.2021.18.23
  • 4,667 View
  • 223 Download
  • 2 Web of Science
  • 3 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
It aimed to compare the use of the tele-objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.
Methods
This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.
Results
In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference=–0.277, P<0.001, effect size=0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.
Conclusion
The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.

Citations

Citations to this article as recorded by  
  • Radiography education in 2022 and beyond - Writing the history of the present: A narrative review
    Y.X. Tay, J.P. McNulty
    Radiography.2023; 29(2): 391.     CrossRef
  • Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
    Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
    Advances in Health Sciences Education.2023;[Epub]     CrossRef
  • Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
    Sun Kim, A Ra Cho, Chul Woon Chung
    Journal of Educational Evaluation for Health Professions.2021; 18: 28.     CrossRef
Review
Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review  
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
J Educ Eval Health Prof. 2021;18:11.   Published online June 1, 2021
DOI: https://doi.org/10.3352/jeehp.2021.18.11
  • 6,370 View
  • 389 Download
  • 10 Web of Science
  • 9 Crossref
AbstractAbstract PDFSupplementary Material
The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.

Citations

Citations to this article as recorded by  
  • The virtual Clinical Assessment of Skills and Competence: the impact and challenges of a digitised final examination
    Kenny Chu, Shivanthi Sathanandan
    BJPsych Bulletin.2023; 47(2): 110.     CrossRef
  • Virtual Learning and Assessment in Rheumatology Fellowship Training: Objective Structured Clinical Examination Revisited
    Rachel M. Wolfe, Faye N. Hant, Rumey C. Ishizawar, Lisa G. Criscione‐Schreiber, Beth L. Jonas, Kenneth S. O'Rourke, Marcy B. Bolster
    Arthritis Care & Research.2023; 75(12): 2435.     CrossRef
  • Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
    Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
    Advances in Health Sciences Education.2023;[Epub]     CrossRef
  • Innovations in assessment in health professions education during the COVID‐19 pandemic: A scoping review
    Jamal Giri, Claire Stewart
    The Clinical Teacher.2023;[Epub]     CrossRef
  • Evaluation of the Utility of Online Objective Structured Clinical Examination Conducted During the COVID-19 Pandemic
    Mona Arekat, Mohamed Hany Shehata, Abdelhalim Deifalla, Ahmed Al-Ansari, Archana Kumar, Mohamed Alsenbesy, Hamdi Alshenawi, Amgad El-Agroudy, Mariwan Husni, Diaa Rizk, Abdelaziz Elamin, Afif Ben Salah, Hani Atwa
    Advances in Medical Education and Practice.2022; Volume 13: 407.     CrossRef
  • Comparison of student pharmacists' performance on in-person vs. virtual OSCEs in a pre-APPE capstone course
    Justine S. Gortney, Joseph P. Fava, Andrew D. Berti, Brittany Stewart
    Currents in Pharmacy Teaching and Learning.2022; 14(9): 1116.     CrossRef
  • Is online objective structured clinical examination teaching an acceptable replacement in post-COVID-19 medical education in the United Kingdom?: a descriptive study
    Vashist Motkur, Aniket Bharadwaj, Nimalesh Yogarajah
    Journal of Educational Evaluation for Health Professions.2022; 19: 30.     CrossRef
  • Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
    Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
    Journal of Educational Evaluation for Health Professions.2022; 19: 27.     CrossRef
  • Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
    Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
    Journal of Educational Evaluation for Health Professions.2021; 18: 23.     CrossRef
Research articles
Voluntary assignments during the pediatric clerkship to enhance the clinical experiences of medical students in the United States  
Conrad Krawiec, Abigail Kate Myers
J Educ Eval Health Prof. 2020;17:17.   Published online May 27, 2020
DOI: https://doi.org/10.3352/jeehp.2020.17.17
  • 4,743 View
  • 116 Download
  • 1 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
Pediatric clerkships that utilize off-campus clinical sites ensure clinical comparability by requiring completion of patient-focused tasks. Some tasks may not be attainable (especially off-campus); thus, they are not assigned. The objective of this study was to evaluate the feasibility of providing a voluntary assignment list to third-year medical students in their pediatric clerkship.
Methods
This is a retrospective single-center cross-sectional analysis of voluntary assignment completion during the 2019–2020 academic year. Third-year medical students were provided a voluntary assignment list (observe a procedure, use an interpreter phone to obtain a pediatric history, ask a preceptor to critique a clinical note, and follow-up on a patient after the rotation ends). Descriptive statistics were used to assess the timing and distribution of voluntary assignment completion.
Results
In total, 132 subjects (77 on the main campus, 55 off-campus) were included. Eighteen (13.6%) main-campus and 16 (12.1%) off-campus students completed at least 1 voluntary assignment. The following voluntary assignments were completed: observe a procedure (15, 11.4%), use an interpreter phone (26, 19.7%), ask a preceptor to critique a clinical note (12, 9.1%), and follow-up on a patient after the rotation ends (7, 5.3%). Off-campus students completed the assignments more often (29.1%) than on-campus students (23.4%)
Conclusion
Our clerkship values specific patient-focused tasks that may enhance student development, but are not attainable at all clinical sites. When provided a voluntary assignment list, 34 out of 132 students (25.8%) completed them. Clerkships that utilize off-campus sites should consider this approach to optimize the pediatric educational experience.

Citations

Citations to this article as recorded by  
  • Adherence to Self - Care Practice Among Type 2 Diabetes Mellitus Patients Using the Theory of Planned Behavior and Health Belief Model at Comprehensive Specialized Hospitals of Amhara Region, Ethiopia: Mixed Method
    Wudneh Simegn, Solomon Ahmed Mohammed, Getachew Moges
    Patient Preference and Adherence.2023; Volume 17: 3367.     CrossRef
Effect of student-directed solicitation of evaluation forms on the timeliness of completion by preceptors in the United States  
Conrad Krawiec, Vonn Walter, Abigail Kate Myers
J Educ Eval Health Prof. 2019;16:32.   Published online October 16, 2019
DOI: https://doi.org/10.3352/jeehp.2019.16.32
  • 9,142 View
  • 122 Download
AbstractAbstract PDFSupplementary Material
Purpose
Summative evaluation forms assessing a student’s clinical performance are often completed by a faculty preceptor at the end of a clinical training experience. At our institution, despite the use of an electronic system, timeliness of completion has been suboptimal, potentially limiting our ability to monitor students’ progress. The aim of the present study was to determine whether a student-directed approach to summative evaluation form collection at the end of a pediatrics clerkship would enhance timeliness of completion for third-year medical students.
Methods
This was a pre- and post-intervention educational quality improvement project focused on 156 (82 pre-intervention, 74 post-intervention) third-year medical students at Penn State College of Medicine completing their 4-week pediatric clerkship. Utilizing REDCap (Research Electronic Data Capture) informatics support, student-directed evaluation form solicitation was encouraged. The Wilcoxon rank-sum test was applied to compare the pre-intervention (May 1, 2017 to March 2, 2018) and post-intervention (April 2, 2018 to December 21, 2018) percentages of forms completed before the rotation midpoint.
Results
In total, 740 evaluation forms were submitted during the pre-intervention phase and 517 during the post-intervention phase. The percentage of forms completed before the rotation midpoint increased after implementing student-directed solicitation (9.6% vs. 39.7%, P<0.05).
Conclusion
Our clerkship relies on subjective summative evaluations to track students’ progress, deploy improvement strategies, and determine criteria for advancement; however, our preceptors struggled with timely submission. Allowing students to direct the solicitation of evaluation forms enhanced the timeliness of completion and should be considered in clerkships facing similar challenges.
Case report
Dental students’ learning attitudes and perceptions of YouTube as a lecture video hosting platform in a flipped classroom in Korea  
Chang Wan Seo, A Ra Cho, Jung Chul Park, Hag Yeon Cho, Sun Kim
J Educ Eval Health Prof. 2018;15:24.   Published online October 11, 2018
DOI: https://doi.org/10.3352/jeehp.2018.15.24
  • 27,764 View
  • 382 Download
  • 13 Web of Science
  • 16 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
The aim of this study was to confirm the applicability of YouTube as a delivery platform of lecture videos for dental students and to assess their learning attitudes towards the flipped classroom model.
Methods
Learning experiences after using the YouTube platform to deliver preliminary video lectures in a flipped classroom were assessed by 69 second-year students (52 males, 17 females) at Dankook University College of Dentistry, Korea, who attended periodontology lectures during 2 consecutive semesters of the 2016 academic year. The instructor uploaded the lecture videos to YouTube before each class. At the end of the second semester, the students were surveyed using a questionnaire devised by the authors.
Results
Of the students, 53 (76.8%) always watched the lecture before the class, 48 (69.6%) used their smartphones, and 66 (95.7%) stated that they watched the lectures at home. The majority of the students replied that the video lectures were easier to understand than face to face lectures (82.6%) and that they would like to view the videos again after graduation (73.9%).
Conclusion
Our results indicate that YouTube is an applicable platform to deliver video lectures and to expose students to increased learning opportunities.

Citations

Citations to this article as recorded by  
  • YouTube as a source of information about rubber dam: quality and content analysis
    Gülsen Kiraz, Arzu Kaya Mumcu, Safa Kurnaz
    Restorative Dentistry & Endodontics.2024;[Epub]     CrossRef
  • Use of social media by dental students: A comparative study
    Rand Al-Obaidi
    Clinical Epidemiology and Global Health.2024; 26: 101559.     CrossRef
  • Evaluating video‐based lectures on YouTube for dental education
    Ryan T. Gross, Nare Ghaltakhchyan, Eleanor M. Nanney, Tate H. Jackson, Christopher A. Wiesen, Paul Mihas, Adam M. Persky, Sylvia A. Frazier‐Bowers, Laura A. Jacox
    Orthodontics & Craniofacial Research.2023; 26(S1): 210.     CrossRef
  • Learning of paediatric dentistry with the flipped classroom model
    Nuria E. Gallardo, Antonia M. Caleya, Maria Esperanza Sánchez, Gonzalo Feijóo
    European Journal of Dental Education.2022; 26(2): 302.     CrossRef
  • Effects of Video Length on a Flipped English Classroom
    Zhonggen Yu, Mingle Gao
    SAGE Open.2022; 12(1): 215824402110684.     CrossRef
  • An Evaluation of the Usefulness of YouTube® Videos on Crown Preparation
    Syed Rashid Habib, Aleshba Saba Khan, Mohsin Ali, Essam Abdulla Abutheraa, Ahmad khaled alkhrayef, Faisal Jibrin Aljibrin, Nawaf Saad Almutairi, Ammar A. Siddiqui
    BioMed Research International.2022; 2022: 1.     CrossRef
  • Perceptions of Students on Distance Education and E-Learning in Dentistry Education: Challenges and Opportunities
    Ayşe TORAMAN, Ebru SAĞLAM, Serhat KÖSEOĞLU
    Journal of Biotechnology and Strategic Health Research.2022; 6(2): 101.     CrossRef
  • Social media as a learning tool for the budding periodontist: A questionnaire survey
    Riddhi Awasthi, Balaji Manohar, S Vinay, Santosh Kumar
    Advances in Human Biology.2022; 12(3): 286.     CrossRef
  • YouTube and Education: A Scoping Review
    Abdulhadi Shoufan, Fatma Mohamed
    IEEE Access.2022; 10: 125576.     CrossRef
  • Uso de la plataforma YouTube® por los estudiantes de odontología: Revisión de alcance
    María Luján Méndez Bauer, Stella de los Angeles Bauer Walter
    Universitas Odontologica.2022;[Epub]     CrossRef
  • Social media as a learning tool: Dental students’ perspectives
    Mona T. Rajeh, Shahinaz N. Sembawa, Afnan A. Nassar, Seba A. Al Hebshi, Khalid T. Aboalshamat, Mohammed K. Badri
    Journal of Dental Education.2021; 85(4): 513.     CrossRef
  • Social Media Usage among Dental Undergraduate Students—A Comparative Study
    Eswara Uma, Pentti Nieminen, Shani Ann Mani, Jacob John, Emilia Haapanen, Marja-Liisa Laitala, Olli-Pekka Lappalainen, Eby Varghase, Ankita Arora, Kanwardeep Kaur
    Healthcare.2021; 9(11): 1408.     CrossRef
  • Does forced-shift to online learning affect university brand image in South Korea? Role of perceived harm and international students’ learning engagement
    Umer Zaman, Murat Aktan, Hasnan Baber, Shahid Nawaz
    Journal of Marketing for Higher Education.2021; : 1.     CrossRef
  • Flipped Classroom Experiences in Clinical Dentistry – A Strategic Mini-Review
    Abdullah Aljabr
    The Open Dentistry Journal.2021; 15(1): 717.     CrossRef
  • Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
    Sun Kim, A Ra Cho, Chul Woon Chung
    Journal of Educational Evaluation for Health Professions.2021; 18: 28.     CrossRef
  • Attitudes toward Social Media among Practicing Dentists and Dental Students in Clinical Years in Saudi Arabia
    Khalid Aboalshamat, Sharifah Alkiyadi, Sarah Alsaleh, Rana Reda, Sharifa Alkhaldi, Arwa Badeeb, Najwa Gabb
    The Open Dentistry Journal.2019; 13(1): 143.     CrossRef

JEEHP : Journal of Educational Evaluation for Health Professions