Journal of Educational Evaluation for Health Professions

Research articles

Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question: Sejin Kim, Ikseon Choi, Bo Young Yoon, Min Jeong Kwon, Seok-jin Choi, Sang Hyun Kim, Jong-Tae Lee, Byoung Doo Rhee; J Educ Eval Health Prof. 2019;16:10. Published online May 9, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.10

16,389 View
271 Download
3 Crossref

Purpose
This study aimed to explore students’ cognitive patterns while solving clinical problems in 3 different types of assessments—clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ)—and thereby to understand how different types of assessments stimulate different patterns of thinking.
Methods
A total of 6 test-performance cases from 2 fourth-year medical students were used in this cross-case study. Data were collected through one-on-one interviews using a stimulated recall protocol where students were shown videos of themselves taking each assessment and asked to elaborate on what they were thinking. The unit of analysis was the smallest phrases or sentences in the participants’ narratives that represented meaningful cognitive occurrences. The narrative data were reorganized chronologically and then analyzed according to the hypothetico-deductive reasoning framework for clinical reasoning.
Results
Both participants demonstrated similar proportional frequencies of clinical reasoning patterns on the same clinical assessments. The results also revealed that the three different assessment types may stimulate different patterns of clinical reasoning. For example, the CPX strongly promoted the participants’ reasoning related to inquiry strategy, while the MEQ strongly promoted hypothesis generation. Similarly, data analysis and synthesis by the participants were more strongly stimulated by the CBA than by the other assessment types.
Conclusion
This study found that different assessment designs stimulated different patterns of thinking during problem-solving. This finding can contribute to the search for ways to improve current clinical assessments. Importantly, the research method used in this study can be utilized as an alternative way to examine the validity of clinical assessments.

Citations

Citations to this article as recorded by

Future directions of online learning environment design at medical schools: a transition towards a post-pandemic context
Sejin Kim
Kosin Medical Journal.2023; 38(1): 12. CrossRef
Clinical Reasoning Training based on the analysis of clinical case using a virtual environment
Sandra Elena Lisperguer Soto, María Soledad Calvo, Gabriela Paz Urrejola Contreras, Miguel Ángel Pérez Lizama
Educación Médica.2021; 22(3): 139. CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef

Perception survey on the introduction of clinical performance examination as part of the national nursing licensing examination in Korea: Su Jin Shin, Yeong Kyeong Kim, Soon-Rim Suh, Duk Yoo Jung, Yunju Kim, Mi Kyoung Yim; J Educ Eval Health Prof. 2017;14:26. Published online October 25, 2017; DOI: https://doi.org/10.3352/jeehp.2017.14.26

31,776 View
295 Download
2 Web of Science
5 Crossref

Abstract PDF

Purpose
The purpose of this study was to analyze opinions about the action plan for implementation of clinical performance exam as part of the national nursing licensing examination and presents the expected effects of the performance exam and aspects to consider regarding its implementation.
Methods
This study used a mixed-methods design. Quantitative data were collected by a questionnaire survey, while qualitative data were collected by focus group interviews with experts. The survey targeted 200 nursing professors and clinical nurses with more than 5 years of work experience, and the focus group interviews were conducted with 28 of professors, clinical instructors, and nurses at hospitals.
Results
First, nursing professors and clinical specialists agreed that the current written tests have limitations in evaluating examinees’ ability, and that the introduction of a clinical performance exam will yield positive results. Clinical performance exam is necessary to evaluate and improve nurses’ work ability, which means that the implementation of a performance exam is advisable if its credibility and validity can be verified. Second, most respondents chose direct performance exams using simulators or standardized patients as the most suitable format of the test.
Conclusion
In conclusion, the current national nursing licensing exam is somewhat limited in its ability to identify competent nurses. Thus, the time has come for us to seriously consider the introduction of a performance exam. The prerequisites for successfully implementing clinical performance exam as part of the national nursing licensing exam are a professional training process and forming a consortium to standardize practical training.

Citations

Citations to this article as recorded by

The Clinical Nursing Competency Assessment System of Ghana: Perspectives of Key Informants
Oboshie Anim-Boamah, Christmal Dela Christmals, Susan Jennifer Armstrong
SAGE Open.2022; 12(2): 215824402210899. CrossRef
Adaptation of Extended Reality Smart Glasses for Core Nursing Skill Training Among Undergraduate Nursing Students: Usability and Feasibility Study
Sun Kyung Kim, Youngho Lee, Hyoseok Yoon, Jongmyung Choi
Journal of Medical Internet Research.2021; 23(3): e24313. CrossRef
Nursing Students’ Experiences on Clinical Competency Assessment in Ghana
Oboshie Anim-Boamah, Christmal Dela Christmals, Susan Jennifer Armstrong
Nurse Media Journal of Nursing.2021; 11(3): 278. CrossRef
Clinical nursing competency assessment: a scoping review
Oboshie Anim-Boamah, Christmal Dela Christmals, Susan Jennifer Armstrong
Frontiers of Nursing.2021; 8(4): 341. CrossRef
Factors Influencing the Success of the National Nursing Competency Examination taken by the Nursing Diploma Students in Yogyakarta
Yulia Wardani
Jurnal Ners.2020; 14(2): 172. CrossRef

Technical Report

Introduction and Administration of the Clinical Skill Test of the Medical Licensing Examination, Republic of Korea (2009): Kun Sang Kim; J Educ Eval Health Prof. 2010;7:4. Published online December 3, 2010; DOI: https://doi.org/10.3352/jeehp.2010.7.4

52,735 View
216 Download
14 Crossref

Abstract PDF

The first trial of the clinical skill test as part of the Korean Medical Licensing Examination was done from September 23 to December 1, 2009, in the clinical skill test center located in the National Health Personnel Licensing Examination Board (NHPLEB) building, Seoul. Korea is the first country to introduce the clinical skill test as part of the medical licensing examination in Asia. It is a report on the introduction and administration of the test. The NHPLEB launched researches on the validity of introducing the clinical skill test and on the best implementation methods in 2000. Since 2006, lists of subjects of test items for the clinical skill test has been developed. The test consisted of two types of evaluation, i.e., a clinical performance examination (CPX) with a standardized patient (SP) and objective structured clinical examination (OSCE). The proctor (medical faculty member) and SP rate the examinees??proficiency for the OSCE and CPX respectively. Out of 3,456 applicants, 3,289 examinees (95.2%) passed the test. Out of 167 examinees who failed the clinical skill test, 142 passed the written test. This means that the clinical skill test showed characteristics independent from the written test. This successful implementation of the clinical skill test is going to improve the medical graduates??performance of clinical skills.

Citations

Citations to this article as recorded by

Presidential address: improving item validity and adopting computer-based testing, clinical skills assessments, artificial intelligence, and virtual reality in health professions licensing examinations in Korea
Hyunjoo Pai
Journal of Educational Evaluation for Health Professions.2023; 20: 8. CrossRef
Implementation strategy for introducing a clinical skills examination to the Korean Oriental Medicine Licensing Examination: a mixed-method modified Delphi study
Chan-Young Kwon, Sanghoon Lee, Min Hwangbo, Chungsik Cho, Sangwoo Shin, Dong-Hyeon Kim, Aram Jeong, Hye-Yoon Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 23. CrossRef
Authenticity, acceptability, and feasibility of a hybrid gynecology station for the Papanicolaou test as part of a clinical skills examination in Korea
Ji-Hyun Seo, Younglim Oh, Sunju Im, Do-Kyong Kim, Hyun-Hee Kong, HyeRin Roh
Journal of Educational Evaluation for Health Professions.2018; 15: 4. CrossRef
A one-day surgical-skill training course for medical students’ improved surgical skills and increased interest in surgery as a career
Ho Seok Seo, Yong Hwa Eom, Min Ki Kim, Young-Min Kim, Byung Joo Song, Kyo Young Song
BMC Medical Education.2017;[Epub] CrossRef
Presidential address: launching the Korea Health Personnel Licensing Examination Institute, a government-supported special foundation from December 23, 2015
Chang Hwi Kim
Journal of Educational Evaluation for Health Professions.2016; 13: 20. CrossRef
Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation
Mi Kyoung Yim
Journal of Educational Evaluation for Health Professions.2015; 12: 6. CrossRef
Educational intervention as an effective step for reducing blood culture contamination: a prospective cohort study
W.B. Park, S.J. Myung, M.-d. Oh, J. Lee, N.-J. Kim, E.-C. Kim, J.S. Park
Journal of Hospital Infection.2015; 91(2): 111. CrossRef
Impact of Clinical Performance Examination on Incoming Interns' Clinical Competency in Differential Diagnosis of Headache
Seong-Min Park, Yun-Mi Song, Bo-Kyoung Kim, Hyoeun Kim
Korean Journal of Family Medicine.2014; 35(2): 56. CrossRef
Can a medical regulatory system be implemented in Korea?
Sun Huh, Myung-Hyun Chung
Journal of the Korean Medical Association.2013; 56(3): 158. CrossRef
Power of the policy: how the announcement of high-stakes clinical examination altered OSCE implementation at institutional level
Chi-Wei Lin, Tsuen-Chiuan Tsai, Cheuk-Kwan Sun, Der-Fang Chen, Keh-Min Liu
BMC Medical Education.2013;[Epub] CrossRef
Can computerized tests be introduced to the Korean Medical Licensing Examination?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 124. CrossRef
How can high stakes examination in Korean medical society be improved to the international level?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 114. CrossRef
The impact of introducing the Korean Medical Licensing Examination clinical skills assessment on medical education
Hoon-Ki Park
Journal of the Korean Medical Association.2012; 55(2): 116. CrossRef
Failed Examinees' Legal Challenge over the Clinical Skill Test in the Korean Medical Licensing Examination
Sun Huh
Journal of Educational Evaluation for Health Professions.2010; 7: 5. CrossRef

Review Article

The New Horizon for Evaluations in Medical Education in Korea: Sang-Ho Baik; J Educ Eval Health Prof. 2005;2(1):7-22. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.7

33,859 View
215 Download
7 Crossref

Abstract PDF

Over the last two decades, there have been a number of significant changes in the evaluation system in medical education in Korea. One major improvement in this respect has been the listing of learning objectives at medical schools and the construction of a content outline for the Korean Medical Licensing Examination that can be used as a basis of evaluation. Item analysis has become a routine method for obtaining information that often provides valuable feedback concerning test items after the completion of a written test. The use of item response theory in analyzing test items has been spreading in medical schools as a way to evaluate performance tests and computerized adaptive testing. A series of recent studies have documented an upward trend in the adoption of the objective structured clinical examination (OSCE) and clinical practice examination (CPX) for measuring skill and attitude domains, in addition to tests of the knowledge domain. There has been an obvious increase in regional consortiums involving neighboring medical schools that share the planning and administration of the OSCE and CPX; this includes recruiting and training standardized patients. Such consortiums share common activities, such as case development and program evaluation. A short history and the pivotal roles of four organizations that have brought about significant changes in the examination system are discussed briefly.

Citations

Citations to this article as recorded by

Presidential address: Adoption of a clinical skills examination for dental licensing, implementation of computer-based testing for the medical licensing examination, and the 30th anniversary of the Korea Health Personnel Licensing Examination Institute
Yoon-Seong Lee
Journal of Educational Evaluation for Health Professions.2022; 19: 1. CrossRef
Effectiveness of Medical Education Assessment Consortium Clinical Knowledge Mock Examination (2011‐2016)
Sang Yeoup Lee, Yeli Lee, Mi Kyung Kim
Korean Medical Education Review.2018; 20(1): 20. CrossRef
Long for wonderful leadership in a new era of the Korean Association of Medical Colleges
Young Hwan Lee
Korean Journal of Medical Education.2014; 26(3): 163. CrossRef
Major Reforms and Issues of the Medical Licensing Examination Systems in Korea
Sang-Ho Baik
Korean Medical Education Review.2013; 15(3): 125. CrossRef
A Study on the Feasibility of a National Practical Examination in the Radiologic Technologist
Soon-Yong Son, Tae-Hyung Kim, Jung-Whan Min, Dong-Kyoon Han, Sung-Min Ahn
Journal of the Korea Academia-Industrial cooperation Society.2011; 12(5): 2149. CrossRef
The Relationship between Senior Year Examinations at a Medical School and the Korean Medical Licensing Examination
Ki Hoon Jung, Ho Keun Jung, Kwan Lee
Korean Journal of Medical Education.2009; 21(1): 17. CrossRef
What Qualities Do Medical School Applicants Need to Have? - Secondary Publication
Yera Hur, Sun Kim
Yonsei Medical Journal.2009; 50(3): 427. CrossRef

First
Prev
Page of 1
Next
Last

Search