Journal of Educational Evaluation for Health Professions

Research article

A nationwide survey on the curriculum and educational resources related to the Clinical Skills Test of the Korean Medical Licensing Examination: a cross-sectional descriptive study: Eun-Kyung Chung, Seok Hoon Kang, Do-Hoon Kim, MinJeong Kim, Ji-Hyun Seo, Keunmi Lee, Eui-Ryoung Han; J Educ Eval Health Prof. 2025;22:11. Published online March 13, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.11

5,099 View
330 Download
1 Web of Science
1 Crossref

Purpose
The revised Clinical Skills Test (CST) of the Korean Medical Licensing Exam aims to provide a better assessment of physicians’ clinical competence and ability to interact with patients. This study examined the impact of the revised CST on medical education curricula and resources nationwide, while also identifying areas for improvement within the revised CST.
Methods
This study surveyed faculty responsible for clinical clerkships at 40 medical schools throughout Korea to evaluate the status and changes in clinical skills education, assessment, and resources related to the CST. The researchers distributed the survey via email through regional consortia between December 7, 2023 and January 19, 2024.
Results
Nearly all schools implemented preliminary student–patient encounters during core clinical rotations. Schools primarily conducted clinical skills assessments in the third and fourth years, with a simplified form introduced in the first and second years. Remedial education was conducted through various methods, including one-on-one feedback from faculty after the assessment. All schools established clinical skills centers and made ongoing improvements. Faculty members did not perceive the CST revisions as significantly altering clinical clerkship or skills assessments. They suggested several improvements, including assessing patient records to improve accuracy and increasing the objectivity of standardized patient assessments to ensure fairness.
Conclusion
During the CST, students’ involvement in patient encounters and clinical skills education increased, improving the assessment and feedback processes for clinical skills within the curriculum. To enhance students’ clinical competencies and readiness, strengthening the validity and reliability of the CST is essential.

Citations

Citations to this article as recorded by

Nationwide cross-sectional survey on the necessity of including a clinical skills assessment in the national licensure examination for Doctors of Korean Medicine
Aram Jeong, Eunbyul Cho, Chan-Young Kwon, Sanghoon Lee, Chungsik Cho, Sangwoo Shin, Min Hwangbo, Dong-Hyeon Kim, Hye-Yoon Lee
Medicine.2025; 104(45): e45366. CrossRef

Brief report

Feasibility of clinical performance assessment of medical students on a virtual sub-internship in the United States: John Woller, Sean Tackett, Ariella Apfel, Janet Record, Danelle Cayea, Shannon Walker, Amit Pahwa; J Educ Eval Health Prof. 2021;18:12. Published online June 22, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.12

7,558 View
315 Download
1 Web of Science
1 Crossref

Abstract PDF Supplementary Material

We aimed to determine whether it was feasible to assess medical students as they completed a virtual sub-internship. Six students (out of 31 who completed an in-person sub-internship) participated in a 2-week virtual sub-internship, caring for patients remotely. Residents and attendings assessed those 6 students in 15 domains using the same assessment measures from the in-person sub-internship. Raters marked “unable to assess” in 75/390 responses (19%) for the virtual sub-internship versus 88/3,405 (2.6%) for the in-person sub-internship (P=0.01), most frequently for the virtual sub-internship in the domains of the physical examination (21, 81%), rapport with patients (18, 69%), and compassion (11, 42%). Students received complete assessments in most areas. Scores were higher for the in-person than the virtual sub-internship (4.67 vs. 4.45, P<0.01) for students who completed both. Students uniformly rated the virtual clerkship positively. Students can be assessed in many domains in the context of a virtual sub-internship.

Citations

Citations to this article as recorded by

Association of Virtual Away Rotations With Residency Applicant Outcomes in Otolaryngology
Nicholas R. Lenze, William J. Benjamin, Lauren A. Bohm, Marc C. Thorne, Michael J. Brenner, Angela P. Mihalic, Robbi A. Kupfer
OTO Open.2023;[Epub] CrossRef

Research article

Agreement between medical students’ peer assessments and faculty assessments in advanced resuscitation skills examinations in South Korea: Jinwoo Jeong, Song Yi Park, Kyung Hoon Sun; J Educ Eval Health Prof. 2021;18:4. Published online March 25, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.4

7,445 View
301 Download

Abstract PDF Supplementary Material: Purpose
In medical education, peer assessment is considered to be an effective learning strategy. Although several studies have examined agreement between peer and faculty assessments regarding basic life support (BLS), few studies have done so for advanced resuscitation skills (ARS) such as intubation and defibrillation. Therefore, this study aimed to determine the degree of agreement between medical students’ and faculty assessments of ARS examinations.
Methods
This retrospective explorative study was conducted during the emergency medicine (EM) clinical clerkship of fourth-year medical students from April to July 2020. A faculty assessor (FA) and a peer assessor (PA) assessed each examinee’s resuscitation skills (including BLS, intubation, and defibrillation) using a checklist that consisted of 20 binary items (performed or not performed) and 1 global proficiency rating using a 5-point Likert scale. The prior examinee assessed the next examinee after feedback and training as a PA. All 54 students participated in peer assessment. The assessments of 44 FA/PA pairs were analyzed using the intraclass correlation coefficient (ICC) and Gwet’s first-order agreement coefficient.
Results
The PA scores were higher than the FA scores (mean±standard deviation, 20.2±2.5 [FA] vs. 22.3±2.4 [PA]; P<0.001). The agreement was poor to moderate for the overall checklist (ICC, 0.55; 95% confidence interval [CI], 0.31 to 0.73; P<0.01), BLS (ICC, 0.19; 95% CI, -0.11 to 0.46; P<0.10), intubation (ICC, 0.51; 95% CI, 0.26 to 0.70; P<0.01), and defibrillation (ICC, 0.49; 95% CI, 0.23 to 0.68; P<0.01).
Conclusion
Senior medical students showed unreliable agreement in ARS assessments compared to faculty assessments. If a peer assessment is planned in skills education, comprehensive preparation and sufficient assessor training should be provided in advance.

Brief report

The implementation and evaluation of an e-Learning training module for objective structured clinical examination raters in Canada: Karima Khamisa, Samantha Halman, Isabelle Desjardins, Mireille St. Jean, Debra Pugh; J Educ Eval Health Prof. 2018;15:18. Published online August 6, 2018; DOI: https://doi.org/10.3352/jeehp.2018.15.18

25,234 View
268 Download
5 Web of Science
6 Crossref

Abstract PDF Supplementary Material

Improving the reliability and consistency of objective structured clinical examination (OSCE) raters’ marking poses a continual challenge in medical education. The purpose of this study was to evaluate an e-Learning training module for OSCE raters who participated in the assessment of third-year medical students at the University of Ottawa, Canada. The effects of online training and those of traditional in-person (face-to-face) orientation were compared. Of the 90 physicians recruited as raters for this OSCE, 60 consented to participate (67.7%) in the study in March 2017. Of the 60 participants, 55 rated students during the OSCE, while the remaining 5 were back-up raters. The number of raters in the online training group was 41, while that in the traditional in-person training group was 19. Of those with prior OSCE experience (n= 18) who participated in the online group, 13 (68%) reported that they preferred this format to the in-person orientation. The total average time needed to complete the online module was 15 minutes. Furthermore, 89% of the participants felt the module provided clarity in the rater training process. There was no significant difference in the number of missing ratings based on the type of orientation that raters received. Our study indicates that online OSCE rater training is comparable to traditional face-to-face orientation.

Citations

Citations to this article as recorded by

Leveraging feedback mechanisms to improve the quality of objective structured clinical examinations in Singapore: an exploratory action research study
Han Ting Jillian Yeo, Dujeepa Dasharatha Samarasekera, Michael Dean
Journal of Educational Evaluation for Health Professions.2025; 22: 28. CrossRef
Raters and examinees training for objective structured clinical examination: comparing the effectiveness of three instructional methodologies
Jefferson Garcia Guerrero, Ayidah Sanad Alqarni, Lorraine Turiano Estadilla, Lizy Sonia Benjamin, Vanitha Innocent Rani
BMC Nursing.2024;[Epub] CrossRef
Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 11. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef
No observed effect of a student-led mock objective structured clinical examination on subsequent performance scores in medical students in Canada
Lorenzo Madrazo, Claire Bo Lee, Meghan McConnell, Karima Khamisa, Debra Pugh
Journal of Educational Evaluation for Health Professions.2019; 16: 14. CrossRef
ОБ’ЄКТИВНИЙ СТРУКТУРОВАНИЙ КЛІНІЧНИЙ ІСПИТ ЯК ВИМІР ПРАКТИЧНОЇ ПІДГОТОВКИ МАЙБУТНЬОГО ЛІКАРЯ
M. M. Korda, A. H. Shulhai, N. V. Pasyaka, N. V. Petrenko, N. V. Haliyash, N. A. Bilkevich
Медична освіта.2019; (3): 19. CrossRef

Research Article

Teaching methods in community health nursing clerkships: experiences of healthcare staff in Iran: Eshagh Ildarabadi, Hossein Karimi-Moonaghi, Abbas Heydari, Ali Taghipour, Abdolghani Abdollahimohammad, Azizollah Arbabisarjou; J Educ Eval Health Prof. 2014;11:25. Published online September 30, 2014; DOI: https://doi.org/10.3352/jeehp.2014.11.25

30,085 View
197 Download
2 Web of Science
3 Crossref

Abstract PDF

Purpose
Healthcare staff educate nursing students during their clerkships at community health nursing programs. Their teaching methods play an important role in nursing students’ acquisition of competencies; however, these methods have not been studied thoroughly. Thus, this study aims to describe, interpret, and understand the experiences of healthcare staff’s teaching methods in clerkships at a community health nursing program. Methods: This study was conducted using purposeful sampling and semi-structured interviews with 13 members of the staff of three urban healthcare centers in Iran. The data were analyzed through qualitative content analysis and thematic analysis. Results: Multiplicity of teaching was identified as the main category of teaching method, and the five subcategories were teaching through lecture, demonstration, doing, visits and field trips, and readiness. The most common method used by the healthcare staff was lecturing. Conclusion: The healthcare staff used multiple methods to teach students in the nursing clerkship of the community health program, which was the strength of the course. However, they should be familiar with, and utilize additional methods, such as discussion rather than lecture.

Citations

Citations to this article as recorded by

Community Care Perceptions of Public Health Nursing Graduate Program Students
Betül Özen, Yelda Koçak, Elif Zeynep Metin Gemici, Mustafa Özer
Sağlık Bilimleri Dergisi.2025; 34(3): 477. CrossRef
Improving nursing student self-confidence and competence through integrated public health care training
Stefanus Mendes Kiik, Muhammad Saleh Nuwa, Yasinta Betan, Irlin Falde Riti
Kontakt.2022; 24(1): 43. CrossRef
Community Health Nursing in Iran: A Review of Challenges and Solutions (An Integrative Review)
Aazam Hosseinnejad, Maryam Rassouli, Simin Jahani, Nasrin Elahi, Shahram Molavynejad
Frontiers in Public Health.2022;[Epub] CrossRef

First
Prev
Page of 1
Next
Last

Search