To evaluate the usefulness of computerized adaptive testing (CAT) in medical school, the General Examination for senior medical students was administered as a paper and pencil test (P&P) and using CAT. The General Examination is a graduate examination, which is also a preliminary examination for the Korean Medical Licensing Examination (KMLE). The correlations between the results of the CAT and P&P and KMLE were analyzed. The correlation between the CAT and P&P was 0.8013 (p=0.000); that between the CAT and P&P was 0.7861 (p=0.000); and that between the CAT and KMLE was 0.6436 (p=0.000). Six out of 12 students with an ability estimate below 0.52 failed the KMLE. The results showed that CAT could replace P&P in medical school. The ability of CAT to predict whether students would pass the KMLE was 0.5 when the criterion of the theta value was set at -0.52 that was chosen arbitrarily for the prediction of pass or failure.
Citations
Citations to this article as recorded by
Analysis on Validity and Academic Competency of Mock Test for Korean Medicine National Licensing Examination Using Item Response Theory Han Chae, Eunbyul Cho, SeonKyoung Kim, DaHye Choi, Seul Lee Keimyung Medical Journal.2023; 42(1): 7. CrossRef
Application of Computerized Adaptive Testing in Medical Education Sun Huh Korean Journal of Medical Education.2009; 21(2): 97. CrossRef
Estimation of an Examinee's Ability in the Web-Based Computerized Adaptive Testing Program IRT-CAT Yoon-Hwan Lee, Jung-Ho Park, In-Yong Park Journal of Educational Evaluation for Health Professions.2006; 3: 4. CrossRef
Korean Medical Licensing Examination(KMLE) 2002 focused on evaluation of the integrative medical knowledge such as primary clinical care or problem-solving competence. We analyzed the correlation among the year-wise student academic scores(grade score), trial examination scores and KMLE score by correlation analysis and multiple regression method. Four times of trial examination were taken in 2001, which were composed according to the principles of KMLE. Trial examination scores were significantly correlated with student grade scores (p<0.05). KMLE score also correlated with student grade score a nd trial examination score. The grade score at senior had higher correlation coefficient than the grade score at junior in correlation analysis. In multiple regressions, grade score at senior and mean score of trial examinatio n score were significant variants affecting KMLE score. Based on this result, regression formula such as [KMLE score] = 110.596 + 21.449*[6th grade score of student] + 0.577*[mean of trial examination score] was established (R2=0.764, p<0.001). Our results show that the trial examination is useful evaluation tool for final assessment of medical achievements. Also a trial examination is used as a reference data for student guidance and control in preparing for KMLE.
Citations
Citations to this article as recorded by
North Korean refugee doctors' preliminary examination scores Sung Uk Chae, Jeong Hee Yang, Joon Seop Hyun, June Hee Kim, Seok Hoon Kang Korean Journal of Medical Education.2016; 28(4): 373. CrossRef
A Six-Year Study of Relationship between Academic Performance in Dental Hygiene School and Performance on the Korean Dental Hygiene Licensing Examination at Yonsei University So-Jung Mun, Hie-Jin Noh, Hyun-Sun Jeon, Ji-Eun Heo, Won-Gyun Chung Journal of dental hygiene science.2014; 14(3): 332. CrossRef
The Relationship between Senior Year Examinations at a Medical School and the Korean Medical Licensing Examination Ki Hoon Jung, Ho Keun Jung, Kwan Lee Korean Journal of Medical Education.2009; 21(1): 17. CrossRef