Journal of Educational Evaluation for Health Professions

Research Article

Test Equating of the Medical Licensing Examination in 2003 and 2004 Based on the Item Response Theory: Mi Kyoung Yim, Sun Huh; J Educ Eval Health Prof. 2006;3:2. Published online July 31, 2006; DOI: https://doi.org/10.3352/jeehp.2006.3.2

30,166 View
134 Download
2 Crossref

The passing rate of the Medical Licensing Examination has been variable, which probably originated from the difference in the difficulty of items and/or difference in the ability level of examinees. We tried to explain the origin of the difference using the test equating method based on the item response theory. The number of items and examinees were 500, 3,647 in 2003 and 550, 3,879 in 2004. Common item nonequivalent group design was used for 30 common items. Item and ability parameters were calculated by three parametric logistic models using ICL. Scale transformation and true score equating were executed using ST and PIE. The mean of difficulty index of the year 2003 was ??.957 (SD 2.628) and that of 2004 after equating was ??.456 (SD 3.399). The mean of discrimination index of year 2003 was 0.487 (SD 0.242) and that of 2004 was 0.363 (SD 0.193). The mean of ability parameter of year 2003 was 0.00617 (SD 0.96605) and that of year 2004 was 0.94636 (SD 1.32960). The difference of the equated true score at the same ability level was high at the range of score of 200??50. The reason for the difference in passing rates over two consecutive years was due to the fact that the Examination in 2004 was easier and the abilities of the examinees in 2004 were higher. In addition, the passing rates of examinees with score of 270??94 in 2003, and those with 322??43 in 2004, were affected by the examination year.

Citations

Citations to this article as recorded by

Comparison of proficiency in an anesthesiology course across distinct medical student cohorts: Psychometric approaches to test equating
Shu-Wei Liao, Kuang-Yi Chang, Chien-Kun Ting, Mei-Yung Tsou, En-Tzu Chen, Kwok-Hon Chan, Wen-Kuei Chang
Journal of the Chinese Medical Association.2014; 77(3): 150. CrossRef
Can computerized tests be introduced to the Korean Medical Licensing Examination?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 124. CrossRef

Review Article

A Pychometric Approach to Setting a Passing Score on Korean National Medical Licensing Examination: Guemin Lee; J Educ Eval Health Prof. 2004;1(1):5-14. Published online January 31, 2004; DOI: https://doi.org/10.3352/jeehp.2004.1.1.5

29,934 View
146 Download
5 Crossref

Abstract PDF

National Health Personnel Licensing Examination Board (hereafter NHPLEB) has used 60% correct responses of overall tests and 40% correct responses of each subject area test as a criterion to give physician licenses to satisfactory candidates. The 60%-40% criterion seems reasonable to laypersons without pychometric or measurement knowledge, but it may causes several severe problems on pychometrician's perspective. This paper pointed out several problematic cases that can be encountered by using the 60%-40% criterion, and provided several pychometric alternatives that could overcome these problems. A fairly new approach, named Bookmark standard setting method, was introduced and explained in detail as an example. This paper concluded with five considerations when the NHPLEB decides to adopt a pychometric standard setting approach to set a cutscore for a licensure test like medical licensing examination.

Citations

Citations to this article as recorded by

Analysis on Validity and Academic Competency of Mock Test for Korean Medicine National Licensing Examination Using Item Response Theory
Han Chae, Eunbyul Cho, SeonKyoung Kim, DaHye Choi, Seul Lee
Keimyung Medical Journal.2023; 42(1): 7. CrossRef
Using the Angoff method to set a standard on mock exams for the Korean Nursing Licensing Examination
Mi Kyoung Yim, Sujin Shin
Journal of Educational Evaluation for Health Professions.2020; 17: 14. CrossRef
Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination
Mikyoung Yim
Korean Journal of Medical Education.2018; 30(4): 347. CrossRef
Presidential address: launching the Korea Health Personnel Licensing Examination Institute, a government-supported special foundation from December 23, 2015
Chang Hwi Kim
Journal of Educational Evaluation for Health Professions.2016; 13: 20. CrossRef
Reconsidering the Cut Score of Korean National Medical Licensing Examination
Duck Sun Ahn, Sowon Ahn
Journal of Educational Evaluation for Health Professions.2007; 4: 1. CrossRef

First
Prev
Page of 1
Next
Last

Search