Journal of Educational Evaluation for Health Professions

Research articles

Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study: Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf; J Educ Eval Health Prof. 2022;19:27. Published online October 17, 2022; DOI: https://doi.org/10.3352/jeehp.2022.19.27

2,695 View
133 Download

Abstract PDF Supplementary Material: Purpose
Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method.
Methods
The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station.
Results
On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts.
Conclusion
The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.

Effects of virtual reality training on decreasing the rates of needlestick or sharp injury in new-coming medical and nursing interns in Taiwan: Szu-Hsien Wu, Chia-Chang Huang, Shiau-Shian Huang, Ying-Ying Yang, Chih-Wei Liu, Boaz Shulruf, Chen-Huan Chen; J Educ Eval Health Prof. 2020;17:1. Published online January 20, 2020; DOI: https://doi.org/10.3352/jeehp.2020.17.1

13,304 View
455 Download
39 Web of Science
40 Crossref

Purpose
Senior nursing and medical interns’ lack of familiarity and confidence with respect to practicing universal precaution for the prevention of occupational needlestick or sharp injuries may harm themselves. Trainees’ self-reported needlestick or sharp injury rate was known to be especially high during the first 2 months of internship in Taiwan. This prospective cohort study aimed to assess the effect of newly developed virtual reality (VR) game, which uses Gagne’s learning model to improve universal precaution for needlestick or sharp injury prevention and decrease the rates of needle stick or sharp injuries in new-coming medical and nursing interns in Taiwan.
Methods
From 2017 to 2019, the VR system was developed and applied in training of 59 new-coming nursing and 50 medical interns. Occupational needlestick or sharp injury prevention was sought to be achieved through a game of right and wrong choices for safe or unsafe universal precaution behaviors.
Results
In comparison with medical interns, a higher proportion of nursing interns had past experiences of deep occupational needlestick or sharp injury. Before VR training, the familiarity and confidence for needlestick or sharp injury prevention were higher among nursing interns than medical interns. Trainees with past experiences of deep needlestick or sharp injury exhibited better performance on the accuracy rate and time needed to complete 20 decisions than those without past experiences in VR practice. All trainees showed an improved performance after VR training. A high proportion of trainees reported that the VR-based training significantly decreased their anxiety about needlestick or sharp injury prevention.
Conclusion
This self-developed VR game system using Gagne’s flow improved universal precaution for needlestick or sharp injury prevention and reduced the needlestick or sharp injury rates in the first 2 months of nursing and medical internship.

Citations

Citations to this article as recorded by

Roles of artificial intelligence experience, information redundancy, and familiarity in shaping active learning: Insights from intelligent personal assistants
Shaofeng Wang, Zhuo Sun
Education and Information Technologies.2025; 30(2): 2525. CrossRef
Game-thinking; utilizing serious games and gamification in nursing education – a systematic review and meta-analysis
Mats Nylén-Eriksen, Marko Stojiljkovic, Daniela Lillekroken, Katrin Lindeflaten, Elisabeth Hessevaagbakke, Tone Nygaard Flølo, Olav Johannes Hovland, Ada Marie Svarstad Solberg, Sylvia Hansen, Ann Kristin Bjørnnes, Christine Tørris
BMC Medical Education.2025;[Epub] CrossRef
Serious games in nursing education: A systematic review of current evidence
Esmaeil Mehraeen, Mohsen Dashti, Pegah Mirzapour, Afsaneh Ghasemzadeh, Shima Jahani, Amir Masoud Afsahi, Sina Mohammadi, Fatemeh Khajeh Akhtaran, Mohammad Mehrtak, SeyedAhmad SeyedAlinaghi
International Journal of Africa Nursing Sciences.2025; 22: 100838. CrossRef
Impact of an immersive virtual reality simulator education program on nursing students' intravenous injection administration: A mixed methods study
Yi-Ya Chang, Li-Fen Chao, Wen Chang, Chih-Ming Lin, Yi-Hsing Lee, Abigail Latimer, Misook L. Chung
Nurse Education Today.2024; 132: 106002. CrossRef
Positive Aspects and Potential Drawbacks of Implementing Digital Teaching/Learning Scenarios in Health Professions Using Nursing Education as an Example: A Research Report from Germany
Lydia Pfeifer, Sophia Fries, Alexander Stirner, Lisa Nagel, Christian Cohnen, Leona Aschentrup, Marleen Schönbeck, Annette Nauerth, Patrizia Raschper, Tim Herzig, Kamil J. Wrona
Nursing Reports.2024; 14(1): 468. CrossRef
Combatting the occurrence of needle-stick injuries in a medical school: why is it still an issue?
Franca Keicher, Janina Zirkel, Tobias Leutritz, Sarah König
BMC Medical Education.2024;[Epub] CrossRef
Development of Immersive Virtual Reality Hospital Fire Management and Evacuation Training Program for Nursing Students in Hong Kong
Wendy Wing Chi Wong, Gary Long Hei So
SN Computer Science.2024;[Epub] CrossRef
A 3-D interactive microbiology laboratory via virtual reality for enhancing practical skills
Ebenezer Chitra, Siti Azreena Mubin, Vishna Devi Nadarajah, Wong Pei Se, Chew Fei Sow, Hui Meng Er, Nilesh Kumar Mitra, Vinesh Thiruchelvam, Fabian Davamani
Scientific Reports.2024;[Epub] CrossRef
Digital Educational Tools for Undergraduate Nursing Education: A Review of Serious Games, Gamified Applications and Non-Gamified Virtual Reality Simulations/Tools for Nursing Students
Vasiliki Eirini Chatzea, Ilias Logothetis, Michail Kalogiannakis, Michael Rovithis, Nikolas Vidakis
Information.2024; 15(7): 410. CrossRef
Occupational Exposure to Sharp Object Injuries Among Healthcare Workers in Dammam and Jeddah Hospitals, Saudi Arabia‏
Mona Al-Zahrani, Mahmoud Berekaa, Mohammed Al-Warthan, Abdulaziz AlMulla
Journal of Multidisciplinary Healthcare.2024; Volume 17: 5199. CrossRef
Systematic Review: Effect of extended reality simulation intervention on midwifery students’ anxiety (Preprint)
Clara Pérez de los Cobos Cintas, Nicolas Vuillerme, Guillaume Thomann, Lionel Di Marco
JMIR Nursing.2024;[Epub] CrossRef
Virtual Reality Head-Mounted Displays in Medical Education
Thomas Tursø-Finnich, Rune Overgaard Jensen, Lasse X. Jensen, Lars Konge, Ebbe Thinggaard
Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2023; 18(1): 42. CrossRef
Review of literature: Knowledge and practice of standard precautions by nursing student and teaching techniques used in training
Stephanie Bouget Mohammedi, Caroline Landelle
American Journal of Infection Control.2023; 51(5): 574. CrossRef
Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial
Li-Jen Hsin, Yi-Ping Chao, Hai-Hua Chuang, Terry B. J. Kuo, Cheryl C. H. Yang, Chung-Guei Huang, Chung-Jan Kang, Wan-Ni Lin, Tuan-Jen Fang, Hsueh-Yu Li, Li-Ang Lee
Virtual Reality.2023; 27(4): 3345. CrossRef
Exploring Key Factors Influencing Nursing Students’ Cognitive Load and Willingness to Serve Older Adults: Cross-sectional Descriptive Correlational Study
Pei-Lun Hsieh, Yu-Rung Wang, Tien-Chi Huang
JMIR Serious Games.2023; 11: e43203. CrossRef
The Development and Pilot Testing of Immersive Virtual Reality Simulation Training for Prelicensure Nursing Students: A Quasi-Experimental Study
Bethany Cieslowski, Tanya Haas, Kyeung Mi Oh, Kathleen Chang, Cheryl A. Oetjen
Clinical Simulation in Nursing.2023; 77: 6. CrossRef
Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse
Juan M. Román-Belmonte, E. Carlos Rodríguez-Merchán, Hortensia De la Corte-Rodríguez
Postgraduate Medicine.2023; 135(5): 440. CrossRef
Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review
Hans Stefan, Michael Mortimer, Ben Horan
Virtual Reality.2023; 27(4): 2839. CrossRef
Virtual reality simulation for nursing education: effectiveness and feasibility
Debra Kiegaldie, Louise Shaw
BMC Nursing.2023;[Epub] CrossRef
Digital Transformation in Nursing Education: A Systematic Review on Computer-Aided Nursing Education Pedagogies, Recent Advancements and Outlook on the Post-COVID-19 Era
Nevena Kostadinova Dicheva, Ikram Ur Rehman, Aamir Anwar, Moustafa M. Nasralla, Laden Husamaldin, Sama Aleshaiker
IEEE Access.2023; 11: 135659. CrossRef
Assessment of preclinical learning using virtual reality based education for nursing students
Sofía Martín Rodríguez, Marcial F Parrilla, Víctor Álvarez-García, Juan Ramón Pérez-Pérez, María Del Mar Fernández-Álvarez, Rubén Martín-Payo
Educational Media International.2023; 60(3-4): 209. CrossRef
Application of Digital Simulation for Training Purposes Through Virtual Reality in The Workplace
Ari Prayogo Pribadi, Vena Jaladara, Chris Dwina Anggiana Br Silalahi, Yusuf Mukasyafah Rizqi Rahman
The Indonesian Journal of Occupational Safety and Health.2023; 12(3): 457. CrossRef
How, for Whom, and in Which Contexts or Conditions Augmented and Virtual Reality Training Works in Upskilling Health Care Workers: Realist Synthesis
Norina Gasteiger, Sabine N van der Veer, Paul Wilson, Dawn Dowding
JMIR Serious Games.2022; 10(1): e31644. CrossRef
Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef
A Systematic Literature Review of Virtual, Augmented, and Mixed Reality Game Applications in Healthcare
Yu Fu, Yan Hu, Veronica Sundstedt
ACM Transactions on Computing for Healthcare.2022; 3(2): 1. CrossRef
Effectiveness of Immersive Virtual Reality in Nursing Education
Jeeyae Choi, C Elise Thompson, Jeungok Choi, Colette B. Waddill, Soyoung Choi
Nurse Educator.2022; 47(3): E57. CrossRef
Systematic Bibliometric Analysis of Research Hotspots and Trends on the Application of Virtual Reality in Nursing
Junqiang Zhao, Yi Lu, Fujun Zhou, Ruping Mao, Fangqin Fei
Frontiers in Public Health.2022;[Epub] CrossRef
Development and Pilot Testing of a Non-stress Test Virtual Reality Simulator
Li-Fen Chao, Tsuey-Yuan Huang, Debra K. Moser, Fen-Fang Chung, Ying-Tung Lau, Xaviera Xiao
CIN: Computers, Informatics, Nursing.2022; 40(6): 357. CrossRef
The Effect of a Child Model on Breath-Sounds Examination Skills and Satisfaction on Nursing Students
Silpthai Thamruangrit, Sermsri Santati, Jumpee Granger, Dongruethai Buadong, Jatuporn Thongsri
Healthcare.2022; 10(7): 1165. CrossRef
Theories informing technology enhanced learning in nursing and midwifery education: A systematic review and typological classification
Siobhan O'Connor, Stephanie Kennedy, Yajing Wang, Amna Ali, Samantha Cooke, Richard G. Booth
Nurse Education Today.2022; 118: 105518. CrossRef
Tendência temporal dos acidentes por exposição percutânea em um hospital público no Brasil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
Revista Brasileira de Enfermagem.2022;[Epub] CrossRef
Temporal trend of accidents due to percutaneous exposure in a public hospital in Brazil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
Revista Brasileira de Enfermagem.2022;[Epub] CrossRef
Influence of Technology in Supporting Quality and Safety in Nursing Education
Gerry Altmiller, Loraine Hopkins Pepe
Nursing Clinics of North America.2022; 57(4): 551. CrossRef
Needlestick and sharps’ injury in healthcare students: Prevalence, knowledge, attitude and practice
Uma Vasant Datar, Mamata Kamat, Mahesh Khairnar, Umesh Wadgave, Karishma Madhusudhan Desai
Journal of Family Medicine and Primary Care.2022; 11(10): 6327. CrossRef
Virtual reality simulations in nurse education: A systematic mapping review
Christian Plotzky, Ulrike Lindwedel, Michaela Sorber, Barbara Loessl, Peter König, Christophe Kunze, Christiane Kugler, Michael Meng
Nurse Education Today.2021; 101: 104868. CrossRef
Virtual Reality in Healthcare Skills Training: The Effects of Presence on Acceptance and Increase of Knowledge
Christian Plotzky, Ulrike Lindwedel, Alexander Bejan, Peter König, Christophe Kunze
i-com.2021; 20(1): 73. CrossRef
A systematic review of immersive virtual reality for industrial skills training
Unnikrishnan Radhakrishnan, Konstantinos Koumaditis, Francesco Chinello
Behaviour & Information Technology.2021; 40(12): 1310. CrossRef
No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand
Chaowanan Khundam, Naparat Sukkriang, Frédéric Noël
Journal of Educational Evaluation for Health Professions.2021; 18: 22. CrossRef
How to train health personnel to protect themselves from SARS-CoV-2 (novel coronavirus) infection when caring for a patient or suspected case
Sun Huh
Journal of Educational Evaluation for Health Professions.2020; 17: 10. CrossRef
Knowledge, attitude and behavior towards COVID-19 among the Turkish healthcare workers
Yasin Uzuntarla, Sumeyra Ceyhan
Journal of Clinical Medicine of Kazakhstan.2020; 6(60): 93. CrossRef

First
Prev
Page of 1
Next
Last

Search