Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions

OPEN ACCESS
SEARCH
Search
Advanced Search
mobile menu button

Articles

Page Path
HOME > J Educ Eval Health Prof > Volume 5; 2008 > Article
Editorial
 Preparing the Implementation of Computerized Adaptive Testing for High-Stakes Examinations
Sun Huh

DOI: https://doi.org/10.3352/jeehp.2008.5.1
Published online: December 22, 2008
  • 41,695 Views
  • 133 Download
  • 8 Crossref

Department of Parasitology, College of Medicine and Institute of Medical Education, Hallym University, Chuncheon, Korea

*Corresponding e-mail: shuh@hallym.ac.kr

: 

• Received: December 8, 2008   • Accepted: December 10, 2008

©2008, National Health Personnel Licensing Examination Board of the Republic of Korea

This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Full Article

Download PDF Download PDF

On 13 October 2008, staff members of the National Health Personnel Licensing Examination (NHPLE) of the Republic of Korea visited Hallym University to observe students taking a computerized adaptive testing (CAT) via personal computer. Afterwards, the staff members discussed CAT and its installation with Hallym University faculty and the psychometrician. NHPLE is still undecided about the timetable for introducing CAT to the Korean Medical Licensing Examination (KMLE). Although the KMLE is expected to adopt CAT eventually, implementation after an official announcement could take up to four years. Medical schools can use the period before the announcement to prepare for CAT. To adapt CAT to a high-stakes examination such as the KMLE requires that NHPLE, the presiding organization, conduct studies to construct the best system and bench-mark examples from other countries, such as Canada. The role of the psychometrician is essential to the process. In addition, each medical school should prepare for CAT by first introducing computer-based testing (CBT). CBT has many of the same merits as paper-and-pencil tests (PPT), but may provide a more reality-based clinical situation in the medical institutes. Korea’s high-speed internet bandwidths and high-quality hardware provide excellent conditions for CBT, and some schools have already introduced it. After CBT is established, CAT item parameters can be calculated, and the database of items and item parameters can be constructed. One challenge in introducing CAT to individual Korean medical schools is the difficulty of creating stable item parameters, as the number of students in each school is fewer than 150. To overcome this size constraint, medical schools may form consortia to enable the construction of more stable item databases. Open-source CBT and CAT projects already exist at sourceforge. net, which can serve as a good resource for medical schools. Finally, the expertise of psychometricians is essential to the launch of CAT at each school. Many medical schools in Korea have begun to recruit education specialists, but recruiting psychometricians may require more time. These specialists have a theoretical understanding of issues such as item-response theory, models, and other factors that should be considered in applying CAT. If recruitment is not an option, psychometric consultants should be hired. Although implementing CAT at each school may take time, step-by-step preparation is mandatory to facilitate this useful evaluation tool for medical students.

This article is available from: http://jeehp.org/

Figure & Data

References

    Citations

    Citations to this article as recorded by  
    • The relationship between classical item characteristics and item response time on computer-based testing
      Yoo-mi Chae, Seok Gun Park, Ilyong Park
      Korean Journal of Medical Education.2019; 31(1): 1.     CrossRef
    • Effect of Smart Device Ability on the Smart Device-Based Testing National Board Examination for Optometry Students
      Eun Joo Kim, Koon-Ja Lee, Jung Un Jang
      The Korean Journal of Vision Science.2019; 21(4): 631.     CrossRef
    • Overview and current management of computerized adaptive testing in licensing/certification examinations
      Dong Gi Seo
      Journal of Educational Evaluation for Health Professions.2017; 14: 17.     CrossRef
    • Computer‐Based Testing and Construction of an Item Bank Database for Medical Education in Korea
      Sun Huh
      Korean Medical Education Review.2014; 16(1): 11.     CrossRef
    • Team-Based Learning in Pharmacy Education
      William Ofstad, Lane J. Brunner
      American Journal of Pharmaceutical Education.2013; 77(4): 70.     CrossRef
    • Can computerized tests be introduced to the Korean Medical Licensing Examination?
      Sun Huh
      Journal of the Korean Medical Association.2012; 55(2): 124.     CrossRef
    • Emerging tasks of specialty certifying examination: educational measurement considerations
      Inhong Hwang
      Journal of the Korean Medical Association.2012; 55(2): 131.     CrossRef
    • Application of Computerized Adaptive Testing in Medical Education
      Sun Huh
      Korean Journal of Medical Education.2009; 21(2): 97.     CrossRef

    We recommend
    JEEHP : Journal of Educational Evaluation for Health Professions
    © Korea Health Personnel Licensing Examination Institute.