1Department of Emergency Medicine, Dong-A University College of Medicine, Busan, Korea
2Department of Medical Education, Dong-A University College of Medicine, Busan, Korea
3Department of Medical Education and Neurology, Kosin University College of Medicine, Busan, Korea
4Department of Neurology, Busan Paik Hospital, College of Medicine, Inje University, Busan, Korea
5Department of Emergency Medicine, Pusan National University School of Medicine, Busan, Korea
© 2022 Korea Health Personnel Licensing Examination Institute
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Authors’ contributions
Conceptualization: SYP, MJK. Data curation: SYP. Methodology/formal analysis/validation: SYP. Project administration: SYP, SHL, MJK, KHJ, JHR. Funding acquisition: MJK. Writing–original draft: SYP. Writing–reviewing & editing: SYP, SHL, MJK, KHJ, JHR.
Conflict of interest
No potential conflict of interest relevant to this article was reported.
Funding
This work was supported by the Busan-Gyeongnam Clinical Skill Examination Consortium (Fund ref. ID: 20220001). The funders had no role in the study design, data collection and analysis, decision to publish, or manuscript preparation.
Data availability
Data files are available from Harvard Dataverse: https://doi.org/10.7910/DVN/DJNHCM
Dataset 1. Raw score data of examinees for each OSCE.
Date of the OSCE | ||||
---|---|---|---|---|
July 12 | July 13 | July 14 | July 15 | |
No. of examinees | 111 | 109 | 112 | 107 |
Case 1 | ||||
Max | 87.44 | 96.92 | 84.17 | 92.48 |
Min | 35.91 | 44.41 | 36.11 | 45.03 |
Mean±SD | 66.55±10.15 | 71.40±10.41 | 68.23±9.89 | 72.45±9.88 |
Case 2 | ||||
Max | 94.62 | 85.83 | 93.49 | 91.11 |
Min | 46.79 | 33.33 | 43.65 | 32.22 |
Mean±SD | 73.82±9.48 | 68.31±10.38 | 73.39±8.94 | 64.73±14.27 |
Case 3 | ||||
Max | 94.44 | 95.56 | 94.60 | 85.06 |
Min | 41.92 | 38.61 | 42.07 | 26.67 |
Mean±SD | 70.17±12.17 | 67.45±11.37 | 75.13±8.72 | 53.78±13.43 |
Case 4 | ||||
Max | 92.50 | 85.33 | 91.11 | 97.33 |
Min | 15.50 | 39.33 | 39.67 | 41.75 |
Mean±SD | 61.01±13.49 | 68.58±8.93 | 66.05±11.07 | 70.32±10.60 |
Case 5 | ||||
Max | 87.69 | 88.89 | 90.77 | 93.33 |
Min | 6.00 | 38.33 | 37.96 | 37.44 |
Mean±SD | 57.52±14.14 | 68.86±10.83 | 65.87±11.34 | 72.24±11.37 |
Case 6 | ||||
Max | 82.36 | 82.94 | 90.00 | 93.33 |
Min | 39.48 | 38.25 | 32.64 | 40.00 |
Mean±SD | 59.12±9.29 | 65.58±9.44 | 70.88±11.34 | 59.80±11.35 |
Case 7 | ||||
Max | 90.83 | 100.00 | 93.33 | 93.33 |
Min | 34.03 | 39.72 | 37.22 | 39.89 |
Mean±SD | 59.71±12.54 | 64.47±11.46 | 62.10±11.67 | 62.33±9.91 |
Case 8 | ||||
Max | 100.00 | 100.00 | 100.00 | 100.00 |
Min | 27.27 | 33.33 | 32.14 | 31.03 |
Mean±SD | 84.79±11.91 | 80.18±12.89 | 79.85±15.14 | 77.41±12.87 |
Overall (800)a) | ||||
Max | 662.17 | 667.30 | 681.47 | 669.24 |
Min | 330.01 | 409.68 | 348.24 | 408.54 |
Mean±SD | 532.70±58.00 | 554.82±48.96 | 561.51±52.44 | 533.05±56.52 |
No. of items |
||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
15 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | |
July 12 | ||||||||||||||
No. of case | ||||||||||||||
8 | 0.70a) | 0.71 | 0.71 | 0.72 | 0.72 | 0.72 | 0.73 | 0.73 | 0.73 | 0.74 | 0.74 | 0.74 | 0.74 | |
0.54 | 0.55 | 0.56 | 0.56 | 0.57 | 0.57 | 0.58 | 0.58 | 0.59 | 0.59 | 0.59 | 0.6 | 0.6 | ||
9 | 0.73a) | 0.73 | 0.73 | 0.74 | 0.74 | 0.75 | 0.75 | 0.75 | 0.76 | 0.76 | 0.76 | 0.76 | 0.77 | |
0.57 | 0.58 | 0.58 | 0.59 | 0.60 | 0.60 | 0.61 | 0.61 | 0.61 | 0.62 | 0.62 | 0.62 | 0.63 | ||
10 | 0.75a) | 0.75 | 0.75 | 0.76 | 0.76 | 0.77 | 0.77 | 0.77 | 0.77 | 0.78 | 0.78 | 0.78 | 0.78 | |
0.60 | 0.60 | 0.61 | 0.62 | 0.62 | 0.63 | 0.63 | 0.63 | 0.64 | 0.64 | 0.65 | 0.65 | 0.65 | ||
July 13 | ||||||||||||||
No. of case | ||||||||||||||
8 | 0.68 | 0.69 | 0.70a) | 0.70 | 0.71 | 0.71 | 0.72 | 0.72 | 0.72 | 0.73 | 0.73 | 0.73 | 0.74 | |
0.54 | 0.55 | 0.56 | 0.57 | 0.58 | 0.59 | 0.60 | 0.60 | 0.61 | 0.61 | 0.62 | 0.63 | 0.63 | ||
9 | 0.71a) | 0.72 | 0.72 | 0.73 | 0.73 | 0.74 | 0.74 | 0.74 | 0.75 | 0.75 | 0.75 | 0.76 | 0.76 | |
0.57 | 0.58 | 0.59 | 0.60 | 0.61 | 0.62 | 0.62 | 0.63 | 0.64 | 0.64 | 0.65 | 0.65 | 0.66 | ||
10 | 0.73a) | 0.74 | 0.74 | 0.75 | 0.75 | 0.76 | 0.76 | 0.76 | 0.77 | 0.77 | 0.77 | 0.78 | 0.78 | |
0.60 | 0.61 | 0.62 | 0.63 | 0.63 | 0.64 | 0.65 | 0.65 | 0.66 | 0.67 | 0.67 | 0.68 | 0.68 | ||
July 14 | ||||||||||||||
No. of case | ||||||||||||||
8 | 0.66 | 0.68 | 0.69 | 0.69 | 0.70a) | 0.70 | 0.71 | 0.71 | 0.71 | 0.72 | 0.72 | 0.72 | 0.73 | 0.73 |
0.54 | 0.57 | 0.58 | 0.59 | 0.60 | 0.61 | 0.61 | 0.62 | 0.63 | 0.63 | 0.64 | 0.64 | 0.65 | 0.65 | |
9 | 0.69 | 0.71a) | 0.71 | 0.72 | 0.72 | 0.73 | 0.73 | 0.73 | 0.74 | 0.74 | 0.74 | 0.75 | 0.75 | 0.75 |
0.57 | 0.60 | 0.61 | 0.62 | 0.63 | 0.63 | 0.64 | 0.65 | 0.65 | 0.66 | 0.66 | 0.67 | 0.67 | 0.68 | |
10 | 0.71a) | 0.73 | 0.74 | 0.74 | 0.74 | 0.75 | 0.75 | 0.76 | 0.76 | 0.76 | 0.76 | 0.77 | 0.77 | 0.77 |
0.60 | 0.63 | 0.64 | 0.64 | 0.65 | 0.66 | 0.66 | 0.67 | 0.68 | 0.68 | 0.69 | 0.69 | 0.69 | 0.70 | |
July 15 | ||||||||||||||
No. of case | ||||||||||||||
8 | 0.67 | 0.69 | 0.69 | 0.70a) | 0.70 | 0.71 | 0.71 | 0.71 | 0.72 | 0.72 | 0.72 | 0.73 | 0.73 | 0.73 |
0.54 | 0.57 | 0.58 | 0.59 | 0.60 | 0.60 | 0.61 | 0.62 | 0.62 | 0.63 | 0.63 | 0.64 | 0.64 | 0.65 | |
9 | 0.69 | 0.71a) | 0.72 | 0.72 | 0.73 | 0.73 | 0.73 | 0.74 | 0.74 | 0.74 | 0.75 | 0.75 | 0.75 | 0.75 |
0.57 | 0.60 | 0.61 | 0.62 | 0.63 | 0.63 | 0.64 | 0.64 | 0.65 | 0.66 | 0.66 | 0.67 | 0.67 | 0.67 | |
10 | 0.72a) | 0.73 | 0.74 | 0.74 | 0.75 | 0.75 | 0.75 | 0.76 | 0.76 | 0.76 | 0.77 | 0.77 | 0.77 | 0.77 |
0.60 | 0.63 | 0.63 | 0.64 | 0.65 | 0.66 | 0.66 | 0.67 | 0.67 | 0.68 | 0.68 | 0.69 | 0.69 | 0.70 |
Variables are presented as G coefficients (upper) and Phi coefficients (lower). The bold type is the reliability of the OSCE in this study. The acceptable reliability of G coefficients was set to above 0.70.
OSCE, objective structured clinical examination.
a) Minimally required item number of that case.