Journal of Educational Evaluation for Health Professions

Brief report

Feasibility of clinical performance assessment of medical students on a virtual sub-internship in the United States: John Woller, Sean Tackett, Ariella Apfel, Janet Record, Danelle Cayea, Shannon Walker, Amit Pahwa; J Educ Eval Health Prof. 2021;18:12. Published online June 22, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.12

4,702 View
292 Download
1 Web of Science
1 Crossref

We aimed to determine whether it was feasible to assess medical students as they completed a virtual sub-internship. Six students (out of 31 who completed an in-person sub-internship) participated in a 2-week virtual sub-internship, caring for patients remotely. Residents and attendings assessed those 6 students in 15 domains using the same assessment measures from the in-person sub-internship. Raters marked “unable to assess” in 75/390 responses (19%) for the virtual sub-internship versus 88/3,405 (2.6%) for the in-person sub-internship (P=0.01), most frequently for the virtual sub-internship in the domains of the physical examination (21, 81%), rapport with patients (18, 69%), and compassion (11, 42%). Students received complete assessments in most areas. Scores were higher for the in-person than the virtual sub-internship (4.67 vs. 4.45, P<0.01) for students who completed both. Students uniformly rated the virtual clerkship positively. Students can be assessed in many domains in the context of a virtual sub-internship.

Citations

Citations to this article as recorded by

Association of Virtual Away Rotations With Residency Applicant Outcomes in Otolaryngology
Nicholas R. Lenze, William J. Benjamin, Lauren A. Bohm, Marc C. Thorne, Michael J. Brenner, Angela P. Mihalic, Robbi A. Kupfer
OTO Open.2023;[Epub] CrossRef

Research article

Agreement between medical students’ peer assessments and faculty assessments in advanced resuscitation skills examinations in South Korea: Jinwoo Jeong, Song Yi Park, Kyung Hoon Sun; J Educ Eval Health Prof. 2021;18:4. Published online March 25, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.4

4,964 View
285 Download

Abstract PDF Supplementary Material: Purpose
In medical education, peer assessment is considered to be an effective learning strategy. Although several studies have examined agreement between peer and faculty assessments regarding basic life support (BLS), few studies have done so for advanced resuscitation skills (ARS) such as intubation and defibrillation. Therefore, this study aimed to determine the degree of agreement between medical students’ and faculty assessments of ARS examinations.
Methods
This retrospective explorative study was conducted during the emergency medicine (EM) clinical clerkship of fourth-year medical students from April to July 2020. A faculty assessor (FA) and a peer assessor (PA) assessed each examinee’s resuscitation skills (including BLS, intubation, and defibrillation) using a checklist that consisted of 20 binary items (performed or not performed) and 1 global proficiency rating using a 5-point Likert scale. The prior examinee assessed the next examinee after feedback and training as a PA. All 54 students participated in peer assessment. The assessments of 44 FA/PA pairs were analyzed using the intraclass correlation coefficient (ICC) and Gwet’s first-order agreement coefficient.
Results
The PA scores were higher than the FA scores (mean±standard deviation, 20.2±2.5 [FA] vs. 22.3±2.4 [PA]; P<0.001). The agreement was poor to moderate for the overall checklist (ICC, 0.55; 95% confidence interval [CI], 0.31 to 0.73; P<0.01), BLS (ICC, 0.19; 95% CI, -0.11 to 0.46; P<0.10), intubation (ICC, 0.51; 95% CI, 0.26 to 0.70; P<0.01), and defibrillation (ICC, 0.49; 95% CI, 0.23 to 0.68; P<0.01).
Conclusion
Senior medical students showed unreliable agreement in ARS assessments compared to faculty assessments. If a peer assessment is planned in skills education, comprehensive preparation and sufficient assessor training should be provided in advance.

Brief report

The implementation and evaluation of an e-Learning training module for objective structured clinical examination raters in Canada: Karima Khamisa, Samantha Halman, Isabelle Desjardins, Mireille St. Jean, Debra Pugh; J Educ Eval Health Prof. 2018;15:18. Published online August 6, 2018; DOI: https://doi.org/10.3352/jeehp.2018.15.18

22,894 View
253 Download
3 Web of Science
4 Crossref

Abstract PDF Supplementary Material

Improving the reliability and consistency of objective structured clinical examination (OSCE) raters’ marking poses a continual challenge in medical education. The purpose of this study was to evaluate an e-Learning training module for OSCE raters who participated in the assessment of third-year medical students at the University of Ottawa, Canada. The effects of online training and those of traditional in-person (face-to-face) orientation were compared. Of the 90 physicians recruited as raters for this OSCE, 60 consented to participate (67.7%) in the study in March 2017. Of the 60 participants, 55 rated students during the OSCE, while the remaining 5 were back-up raters. The number of raters in the online training group was 41, while that in the traditional in-person training group was 19. Of those with prior OSCE experience (n= 18) who participated in the online group, 13 (68%) reported that they preferred this format to the in-person orientation. The total average time needed to complete the online module was 15 minutes. Furthermore, 89% of the participants felt the module provided clarity in the rater training process. There was no significant difference in the number of missing ratings based on the type of orientation that raters received. Our study indicates that online OSCE rater training is comparable to traditional face-to-face orientation.

Citations

Citations to this article as recorded by

Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 11. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef
No observed effect of a student-led mock objective structured clinical examination on subsequent performance scores in medical students in Canada
Lorenzo Madrazo, Claire Bo Lee, Meghan McConnell, Karima Khamisa, Debra Pugh
Journal of Educational Evaluation for Health Professions.2019; 16: 14. CrossRef
ОБ’ЄКТИВНИЙ СТРУКТУРОВАНИЙ КЛІНІЧНИЙ ІСПИТ ЯК ВИМІР ПРАКТИЧНОЇ ПІДГОТОВКИ МАЙБУТНЬОГО ЛІКАРЯ
M. M. Korda, A. H. Shulhai, N. V. Pasyaka, N. V. Petrenko, N. V. Haliyash, N. A. Bilkevich
Медична освіта.2019; (3): 19. CrossRef

Research Article

Teaching methods in community health nursing clerkships: experiences of healthcare staff in Iran: Eshagh Ildarabadi, Hossein Karimi-Moonaghi, Abbas Heydari, Ali Taghipour, Abdolghani Abdollahimohammad, Azizollah Arbabisarjou; J Educ Eval Health Prof. 2014;11:25. Published online September 30, 2014; DOI: https://doi.org/10.3352/jeehp.2014.11.25

27,526 View
189 Download
2 Web of Science
2 Crossref

Abstract PDF

Purpose
Healthcare staff educate nursing students during their clerkships at community health nursing programs. Their teaching methods play an important role in nursing students’ acquisition of competencies; however, these methods have not been studied thoroughly. Thus, this study aims to describe, interpret, and understand the experiences of healthcare staff’s teaching methods in clerkships at a community health nursing program. Methods: This study was conducted using purposeful sampling and semi-structured interviews with 13 members of the staff of three urban healthcare centers in Iran. The data were analyzed through qualitative content analysis and thematic analysis. Results: Multiplicity of teaching was identified as the main category of teaching method, and the five subcategories were teaching through lecture, demonstration, doing, visits and field trips, and readiness. The most common method used by the healthcare staff was lecturing. Conclusion: The healthcare staff used multiple methods to teach students in the nursing clerkship of the community health program, which was the strength of the course. However, they should be familiar with, and utilize additional methods, such as discussion rather than lecture.

Citations

Citations to this article as recorded by

Improving nursing student self-confidence and competence through integrated public health care training
Stefanus Mendes Kiik, Muhammad Saleh Nuwa, Yasinta Betan, Irlin Falde Riti
Kontakt.2022; 24(1): 43. CrossRef
Community Health Nursing in Iran: A Review of Challenges and Solutions (An Integrative Review)
Aazam Hosseinnejad, Maryam Rassouli, Simin Jahani, Nasrin Elahi, Shahram Molavynejad
Frontiers in Public Health.2022;[Epub] CrossRef

First
Prev
Page of 1
Next
Last

Search