INTRODUCTION

The National Health Personnel Licensing Examination Board (NHPLEB) is an institute that presides over 21 medical health personnel licensing examinations including the Medical Licensing Examination authorized by the Ministry of Health and Welfare, Republic of Korea. Beginning in 2009, to become a physician in Korea, candidates should meet two basic requirements and should pass the Medical Licensing Examination. Not only anyone who has graduated from medical schools in Korea and has earned a bachelor’s degree in medicine but also anyone who has graduated from any international medical school accredited by the Minister for Health and Welfare, obtained a medical license in that country, and passed a preliminary test before the Medical Licensing Examination is eligible to take the Medical Licensing Examination in Korea. The Medical Licensing Examination consists of a written test and a clinical skill test. To obtain a medical license, an applicant must pass both the written test and the clinical skill test. The written test has been executed in early January every year. Meanwhile, the first trial of the clinical skill test was performed for 3 months from September to early December, 2009, in the clinical skill test center located in the NHPLEB building, Seoul. This report reports on the introduction and administration of the clinical skill test as part of the Korean Medical Licensing Examination in order to share the experience with other countries’ examination boards that may wish to adopt a clinical skill test in their health personnel licensing examinations.

PREPARATION OF THE CLINICAL SKILL TEST

In 2006 it was announced that the integration of the clinical skill test into the Medical Licensing Examination in Korea would begin in 2009. The clinical skill test measures proficiency in clinical skills using a mannequin, models, or various equipment as well as attitude and knowledge with the help of systematically trained standardized patients [1]. The move to change the curriculum of medical schools to enforce bedside teaching and the communication with patients rather than lecture-oriented or recall type education has been gaining momentum. Every medical school in Korea has begun to provide a clinical skill center before the first introduction of the clinical skill test. Furthermore, consortia for training for the clinical skill test were organized in several regions so that active research on clinical skill testing has been possible [2]. The NHPLEB has initiated and supported a research project to test the validity of introducing the clinical skill test and to find the best implementation methods since the year 2000. In March 2007, NHPLEB organized the Committee on Promotion of the Clinical Skill Test, the Committee on Execution of the Clinical Skill Test, and the Committee on the Review of Test Items for the Clinical Skill Test to prepare the test. Since 2006, lists of subjects of test items for the clinical skill test were developed and the precise description of test items was established for the test. Items developed were reviewed again to improve their validity. Also, a simulation test was administered annually since 2006 so that the entire system for the clinical skill test could be evaluated completely. In October, 2008, the clinical skill test center was constructed on two floors of the NHPLEB building.

ADMINISTRATION OF THE CLINICAL SKILL TEST

Time table of the clinical skill test

The clinical skill test was announced in July 7, 2009 via the homepage of the NHPLEB (http://www.kuksiwon.or.kr). The duration of receipt of the application was from August 4 to August 8, 2009. The duration of the test was from September 23 to December 1, 2009 (51 days). The release of the list of passing applicants was announced on January 19, 2010 at the same time as the release of the list of applicants passing the written test. The location of the test was the clinical skill test center at the NHPLEB (two clones). The number of applicants was 3,456. The application fee was 510,000 Korean won (500 US dollars).

Distribution of the date of test and subjects of the test

The dates available and the quota of applicants for each medical school were also announced. Applicants can choose the date of the test so that the right of choice by applicants was considered and any confusion arising by the crowding of applications at specific dates can be minimized. The test consisted of two types of evaluation, i.e., a clinical performance examination (CPX) with a standardized patient (SP) and objective structured clinical examination (OSCE). In the CPX, examinees examined the SP, after which their performance proficiency was rated by the SP. In the OSCE, a mannequin, model, or various equipment were used to rate the individual examinee’s skill. The SP was a person trained to act as a real patient. The number of test items, score allotment, and test duration were summarized in Table 1. The same test was administered in three cycles a day: one cycle in the morning and two cycles in the afternoon, from 08:25 am to 11:37 am, from 12:00 md to 15:12 pm, and 15:00 pm to 18:12 pm. Examinees moved to each of twelve sectors between the start bell and the ending bell and performed the tests provided (Figs. 1–4). The content of test items of the clinical skill test of the Korean Medical Licensing Examination in 2009 was listed in Table 2. Each single item of the 12 subjects determined was selected randomly from the item bank.

Rating and setting of a passing score

The proctor (medical faculty member) and SP rate the examinees’ proficiency for the OSCE and CPX respectively. The setting of a passing score was determined by two criteria. First, the applicant’s total score should be equal to or greater than the sum of the passing scores of each of the 12 items that were set by the Committee for Reviewing of the Passing Score. Second, applicants’ number of passing items should be equal to or greater than the number of passing items set by the Committee for Reviewing the Passing Score. A passing item meant that the applicant’s score on an item was equal to or greater than the passing score set by the Committee for Reviewing the Passing Score. The passing score of each item and passing number of items were set by 12 medical faculty members of the Committee for Reviewing the Passing Score according to measurement theory from December 10 to 16, 2009. To earn a medical license, applicants should pass both the clinical skill test and written test. If an applicant passes only one test, it shall be effective until the next year so that the test passed shall be exempted in the next year. The number of raters is listed in Table 3.

Results of the test

Out of 3,456 applicants who performed the first clinical skill test (September–December 2009), 3,289 examinees (95.2%) passed the test. Meanwhile, the written test of the 74th Medical Licensing Examination was administered from January 7 to 8, 2010 in six cities (Seoul, Busan, Daegu, Gwangju, Daejon, Jeonju). The application fee for the written test was 227,000 Korean won (200 US dollars). The three categories of subjects of the written test consisted of 115 items for general medicine, 365 items for specific areas, and 20 items for medical law. Out of 3,452 applicants, 3,349 examinees (97.0%) passed the test. Out of 3,469 applicants 3,439 applied to both the clinical skill test and written test, 17 examinees applied only to the clinical skill test and 13 applied only to the written test. Out of 167 examinees who failed the clinical skill test, 142 passed the written test. This means that the clinical skill test showed characteristics independent from the written test. The final passing rate for the 74th Korean Medical Licensing Examination was 92.9% (3,224/3,469), which was not significantly different from the result of the 73rd examination (93.6%).

Special consideration for prevention of H1N1 influenza

To protect the applicants from H1N1 influenza epidemic infectious disease spreading in 2009, a variety of management plans were carried out [4]. The NHPLEB developed a close relationship with the nearby Regional Health Center. A fever detection camera was located in the front lobby of the NHPLEB and every person was screened for a fever. When the applicants’ identification was verified, they were asked about any suspected symptoms of H1N1 influenza. If applicants were diagnosed or suspected to have H1N1 influenza, their test dates were allocated after their recovery or final diagnosis. During the whole period of the clinical skill test in 2009, two applicants were diagnosed with or suspected to have H1N1 influenza. They were allowed to apply for another test date.

CONCLUSION

Since the 2009 clinical skill test was the first trial for the Medical Licensing Examination in Korea, there was a deal of great tension among and heavy workload for the staff of NHPLB and the participating faculty members and standardized patients. Nevertheless, all processes were satisfactory for continuing the trial. The opinions of examinees and raters will be analyzed and also published soon. Introducing the clinical skill test motivates every medical school in Korea to provide a clinical skill test lab and programs for OSCE and CPX to their students. Also, most students will do their best to perform clinical skills precisely. Korea is the first country to introduce the clinical skill test in Asia. I believe that this is the opening of a new era and environment that emphasizes performance and attitude in addition to knowledge in medical education in Korea. The NHPLB will do its best to improve performance test and to extend it to other health personnel licensing examinations.

Fig. 1.

Examinee receives number card to be attached to lab coat after signing. Staff member confirms if the examinee’s personal identification is correct before start of clinical skill test.

Fig. 2.

Scene of student’s performance for the clinical performance examination with standardized patient viewed outside of oneway mirror room.

Fig. 3.

Examinees are answering the inter-station test during the inter-station interval.

Fig. 4.

Monitoring room located in the clinical skill test center where every room is monitored for emergencies.

References

• 1. Kim S, Park S, Hur Y, Lee SJ. The appropriateness of using standardized patients’ (SPs) assessment scores in clinical performance examination (CPX). Korean J Med Educ 2005;17:163-72. Article
• 2. Yim MK, Lee GM. The school effect on the reliability of clinical performance examination in medical schools. Korean J Med Educ 2010;22:215-23. ArticlePubMed
• 3. Furman GE. The role of standardized patient and trainer training in quality assurance for a high-stakes clinical skills examination. Kaohsiung J Med Sci 2008;24:651-5. ArticlePubMed
• 4. Kim JH, Yoo HS, Lee JS, Lee EG, Park HK, Sung YH, et al. The spread of pandemic H1N1 2009 by age and region and the comparison among monitoring tools. J Korean Med Sci 2010;25:1109-12. ArticlePubMedPMC

Figure & Data

References

Citations

Citations to this article as recorded by  

• Comparing AI chatbot simulation and peer role-play for OSCE preparation: a pilot randomized controlled trial
  Hye-Yoon Lee, Jundong Kim, Hyojae Choi, Hyojin Bae, Aram Jeong, Sungyoul Choi, Ji-Hwan Kim, Chang-Eop Kim
  BMC Medical Education.2025;[Epub]     CrossRef
• Presidential address: improving item validity and adopting computer-based testing, clinical skills assessments, artificial intelligence, and virtual reality in health professions licensing examinations in Korea
  Hyunjoo Pai
  Journal of Educational Evaluation for Health Professions.2023; 20: 8.     CrossRef
• Implementation strategy for introducing a clinical skills examination to the Korean Oriental Medicine Licensing Examination: a mixed-method modified Delphi study
  Chan-Young Kwon, Sanghoon Lee, Min Hwangbo, Chungsik Cho, Sangwoo Shin, Dong-Hyeon Kim, Aram Jeong, Hye-Yoon Lee
  Journal of Educational Evaluation for Health Professions.2023; 20: 23.     CrossRef
• Authenticity, acceptability, and feasibility of a hybrid gynecology station for the Papanicolaou test as part of a clinical skills examination in Korea
  Ji-Hyun Seo, Younglim Oh, Sunju Im, Do-Kyong Kim, Hyun-Hee Kong, HyeRin Roh
  Journal of Educational Evaluation for Health Professions.2018; 15: 4.     CrossRef
• A one-day surgical-skill training course for medical students’ improved surgical skills and increased interest in surgery as a career
  Ho Seok Seo, Yong Hwa Eom, Min Ki Kim, Young-Min Kim, Byung Joo Song, Kyo Young Song
  BMC Medical Education.2017;[Epub]     CrossRef
• Presidential address: launching the Korea Health Personnel Licensing Examination Institute, a government-supported special foundation from December 23, 2015
  Chang Hwi Kim
  Journal of Educational Evaluation for Health Professions.2016; 13: 20.     CrossRef
• Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation
  Mi Kyoung Yim
  Journal of Educational Evaluation for Health Professions.2015; 12: 6.     CrossRef
• Educational intervention as an effective step for reducing blood culture contamination: a prospective cohort study
  W.B. Park, S.J. Myung, M.-d. Oh, J. Lee, N.-J. Kim, E.-C. Kim, J.S. Park
  Journal of Hospital Infection.2015; 91(2): 111.     CrossRef
• Impact of Clinical Performance Examination on Incoming Interns' Clinical Competency in Differential Diagnosis of Headache
  Seong-Min Park, Yun-Mi Song, Bo-Kyoung Kim, Hyoeun Kim
  Korean Journal of Family Medicine.2014; 35(2): 56.     CrossRef
• Can a medical regulatory system be implemented in Korea?
  Sun Huh, Myung-Hyun Chung
  Journal of the Korean Medical Association.2013; 56(3): 158.     CrossRef
• Power of the policy: how the announcement of high-stakes clinical examination altered OSCE implementation at institutional level
  Chi-Wei Lin, Tsuen-Chiuan Tsai, Cheuk-Kwan Sun, Der-Fang Chen, Keh-Min Liu
  BMC Medical Education.2013;[Epub]     CrossRef
• Can computerized tests be introduced to the Korean Medical Licensing Examination?
  Sun Huh
  Journal of the Korean Medical Association.2012; 55(2): 124.     CrossRef
• How can high stakes examination in Korean medical society be improved to the international level?
  Sun Huh
  Journal of the Korean Medical Association.2012; 55(2): 114.     CrossRef
• The impact of introducing the Korean Medical Licensing Examination clinical skills assessment on medical education
  Hoon-Ki Park
  Journal of the Korean Medical Association.2012; 55(2): 116.     CrossRef
• Failed Examinees' Legal Challenge over the Clinical Skill Test in the Korean Medical Licensing Examination
  Sun Huh
  Journal of Educational Evaluation for Health Professions.2010; 7: 5.     CrossRef