Journal of Educational Evaluation for Health Professions

Technical report

Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination: In Sook Park, Yeon Ok Suh, Hae Sook Park, So Young Kang, Kwang Sung Kim, Gyung Hee Kim, Yeon-Hee Choi, Hyun-Ju Kim; J Educ Eval Health Prof. 2017;14:20. Published online September 11, 2017; DOI: https://doi.org/10.3352/jeehp.2017.14.20

34,079 View
278 Download
4 Web of Science
5 Crossref

Purpose
The purpose of this study was to improve the quality of items on the Korean Nursing Licensing Examination by developing and evaluating case-based items that reflect integrated nursing knowledge.
Methods
We conducted a cross-sectional observational study to develop new case-based items. The methods for developing test items included expert workshops, brainstorming, and verification of content validity. After a mock examination of undergraduate nursing students using the newly developed case-based items, we evaluated the appropriateness of the items through classical test theory and item response theory.
Results
A total of 50 case-based items were developed for the mock examination, and content validity was evaluated. The question items integrated 34 discrete elements of integrated nursing knowledge. The mock examination was taken by 741 baccalaureate students in their fourth year of study at 13 universities. Their average score on the mock examination was 57.4, and the examination showed a reliability of 0.40. According to classical test theory, the average level of item difficulty of the items was 57.4% (80%–100% for 12 items; 60%–80% for 13 items; and less than 60% for 25 items). The mean discrimination index was 0.19, and was above 0.30 for 11 items and 0.20 to 0.29 for 15 items. According to item response theory, the item discrimination parameter (in the logistic model) was none for 10 items (0.00), very low for 20 items (0.01 to 0.34), low for 12 items (0.35 to 0.64), moderate for 6 items (0.65 to 1.34), high for 1 item (1.35 to 1.69), and very high for 1 item (above 1.70). The item difficulty was very easy for 24 items (below −2.0), easy for 8 items (−2.0 to −0.5), medium for 6 items (−0.5 to 0.5), hard for 3 items (0.5 to 2.0), and very hard for 9 items (2.0 or above). The goodness-of-fit test in terms of the 2-parameter item response model between the range of 2.0 to 0.5 revealed that 12 items had an ideal correct answer rate.
Conclusion
We surmised that the low reliability of the mock examination was influenced by the timing of the test for the examinees and the inappropriate difficulty of the items. Our study suggested a methodology for the development of future case-based items for the Korean Nursing Licensing Examination.

Citations

Citations to this article as recorded by

Development and validation of practice-based multimedia assisted item: a mixed-method study
Inyoung Lee, Sujin Shin
BMC Nursing.2025;[Epub] CrossRef
Suggestion for item allocation to 8 nursing activity categories of the Korean Nursing Licensing Examination: a survey-based descriptive study
Kyunghee Kim, So Young Kang, Younhee Kang, Youngran Kweon, Hyunjung Kim, Youngshin Song, Juyeon Cho, Mi-Young Choi, Hyun Su Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 18. CrossRef
Automating assessment of Design exams: A case study of novelty evaluation
Nandita Bhanja Chaudhuri, Debayan Dhar, Pradeep G. Yammiyavar
Expert Systems with Applications.2021; : 116108. CrossRef
Levels, antecedents, and consequences of critical thinking among clinical nurses: a quantitative literature review
Yongmi Lee, Younjae Oh
Journal of Educational Evaluation for Health Professions.2020; 17: 26. CrossRef
Factors Influencing the Success of the National Nursing Competency Examination taken by the Nursing Diploma Students in Yogyakarta
Yulia Wardani
Jurnal Ners.2020; 14(2): 172. CrossRef

Technical Reports

The job analysis of Korean nurses as a strategy to improve the Korean Nursing Licensing Examination: In Sook Park, Yeon Ok Suh, Hae Sook Park, Soo Yeon Ahn, So Young Kang, Il Sun Ko; J Educ Eval Health Prof. 2016;13:24. Published online June 7, 2016; DOI: https://doi.org/10.3352/jeehp.2016.13.24

35,935 View
298 Download
6 Web of Science
6 Crossref

Abstract PDF

Purpose
This study aimed at characterizing Korean nurses’ occupational responsibilities to apply the results for improvement of the Korean Nursing Licensing Examination. Methods: First, the contents of nursing job were defined based on a focus group interview of 15 nurses. Developing a Curriculum (DACOM) method was used to examine those results and produce the questionnaire by 13 experts. After that, the questionnaire survey to 5,065 hospital nurses was done. Results: The occupational responsibilities of nurses were characterized as involving 8 duties, 49 tasks, and 303 task elements. Those 8 duties are nursing management and professional development, safety and infection control, the management of potential risk factors, basic nursing and caring, the maintenance of physiological integrity, medication and parenteral treatments, socio-psychological integrity, and the maintenance and improvement of health. Conclusion: The content of Korean Nursing Licensing Examination should be improved based on 8 duties and 49 tasks of the occupational responsibilities of Korean nurses.

Citations

Citations to this article as recorded by

Are Art-Based Interventions Effective in Improving Psychological Well-Being Among Informal Caregivers of Cancer Patients? A Systematic Review
Mengqin Zhang, Xing Liu, Yan Huang
Journal of Integrative and Complementary Medicine.2025; 31(1): 11. CrossRef
Community of inquiry Framework Combined With Podcast Media in Nursing Education innovation During Covid-19 Pandemic: An Evaluative Study
Ah Yusuf, Ronal Surya Aditya, Daifallah M AlRazeeni, Reem Lafi AlMutairi, Fitriana Kurniasari Solikhah, Siti Kotijah, Wiwit Dwi Nurbadriyah
Advances in Medical Education and Practice.2023; Volume 14: 573. CrossRef
Suggestion for item allocation to 8 nursing activity categories of the Korean Nursing Licensing Examination: a survey-based descriptive study
Kyunghee Kim, So Young Kang, Younhee Kang, Youngran Kweon, Hyunjung Kim, Youngshin Song, Juyeon Cho, Mi-Young Choi, Hyun Su Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 18. CrossRef
Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination
In Sook Park, Yeon Ok Suh, Hae Sook Park, So Young Kang, Kwang Sung Kim, Gyung Hee Kim, Yeon-Hee Choi, Hyun-Ju Kim
Journal of Educational Evaluation for Health Professions.2017; 14: 20. CrossRef
The Knowledge of Nurses on Standards of Job Description at the Intensive Care Units of Broujerd Hospitals, 2016
Kobrs Rashidi, Mahoush Kalhor, Mahdi Berjandi
Iranian Journal of Nursing Research.2017; 12(4): 32. CrossRef
Relevance of the test content of the Korean Nursing Licensing Examination to nursing job
In Sook Park, Yeon Ok Suh, Hae Sook Park, Soo Yeon Ahn, So Young Kang, Kwang Sung Kim
Journal of Educational Evaluation for Health Professions.2016; 13: 23. CrossRef

Relevance of the test content of the Korean Nursing Licensing Examination to nursing job: In Sook Park, Yeon Ok Suh, Hae Sook Park, Soo Yeon Ahn, So Young Kang, Kwang Sung Kim; J Educ Eval Health Prof. 2016;13:23. Published online June 2, 2016; DOI: https://doi.org/10.3352/jeehp.2016.13.23

32,505 View
218 Download
2 Web of Science
3 Crossref

Abstract PDF

Purpose
This study aimed at identifying if there is a relevance of content of the Korean Nursing Licensing Examination (KNLE) revised in 2014 to nursing job. It will be able to provide the validity of revised content of the KNLE. Methods: From October 13 to November 13, 2015, print version of 8 duties with 49-tasks, 155-job item questionnaires were distributed to 1,305 hospital nurses and 202 nursing faculties in Korea. Results were treated by descriptive statistics and comparison analysis. There were responses from 946 nurses or professors (72.5%). Results: The relevance of test content of KNLE to nursing job was shown to be valid with over 3 points out of 4 point Likert scale in all items: from 3.23 at lowest to 3.64 at top. Conclusion: Above results showed that the revised version of KNLE in 2014 was valid to test the nursing students’ knowledge for job performance.

Citations

Citations to this article as recorded by

Suggestion for item allocation to 8 nursing activity categories of the Korean Nursing Licensing Examination: a survey-based descriptive study
Kyunghee Kim, So Young Kang, Younhee Kang, Youngran Kweon, Hyunjung Kim, Youngshin Song, Juyeon Cho, Mi-Young Choi, Hyun Su Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 18. CrossRef
Nursing Students’ Experiences on Clinical Competency Assessment in Ghana
Oboshie Anim-Boamah, Christmal Dela Christmals, Susan Jennifer Armstrong
Nurse Media Journal of Nursing.2021; 11(3): 278. CrossRef
Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination
In Sook Park, Yeon Ok Suh, Hae Sook Park, So Young Kang, Kwang Sung Kim, Gyung Hee Kim, Yeon-Hee Choi, Hyun-Ju Kim
Journal of Educational Evaluation for Health Professions.2017; 14: 20. CrossRef

First
Prev
Page of 1
Next
Last

Search