-
Negative effects on medical students’ scores for clinical performance during the COVID-19 pandemic in Taiwan: a comparative study
-
Eunice Jia-Shiow Yuan
, Shiau-Shian Huang , Chia-An Hsu , Jiing-Feng Lirng , Tzu-Hao Li , Chia-Chang Huang , Ying-Ying Yang , Chung-Pin Li , Chen-Huan Chen
-
J Educ Eval Health Prof. 2023;20:37. Published online December 26, 2023
-
DOI: https://doi.org/10.3352/jeehp.2023.20.37
-
-
2,195
View
-
115
Download
-
1
Web of Science
-
1
Crossref
-
Abstract
PDF Supplementary Material
- Purpose
Coronavirus disease 2019 (COVID-19) has heavily impacted medical clinical education in Taiwan. Medical curricula have been altered to minimize exposure and limit transmission. This study investigated the effect of COVID-19 on Taiwanese medical students’ clinical performance using online standardized evaluation systems and explored the factors influencing medical education during the pandemic.
Methods Medical students were scored from 0 to 100 based on their clinical performance from 1/1/2018 to 6/31/2021. The students were placed into pre-COVID-19 (before 2/1/2020) and midst-COVID-19 (on and after 2/1/2020) groups. Each group was further categorized into COVID-19-affected specialties (pulmonary, infectious, and emergency medicine) and other specialties. Generalized estimating equations (GEEs) were used to compare and examine the effects of relevant variables on student performance.
Results In total, 16,944 clinical scores were obtained for COVID-19-affected specialties and other specialties. For the COVID-19-affected specialties, the midst-COVID-19 score (88.513.52) was significantly lower than the pre-COVID-19 score (90.143.55) (P<0.0001). For the other specialties, the midst-COVID-19 score (88.323.68) was also significantly lower than the pre-COVID-19 score (90.063.58) (P<0.0001). There were 1,322 students (837 males and 485 females). Male students had significantly lower scores than female students (89.333.68 vs. 89.993.66, P=0.0017). GEE analysis revealed that the COVID-19 pandemic (unstandardized beta coefficient=-1.99, standard error [SE]=0.13, P<0.0001), COVID-19-affected specialties (B=0.26, SE=0.11, P=0.0184), female students (B=1.10, SE=0.20, P<0.0001), and female attending physicians (B=-0.19, SE=0.08, P=0.0145) were independently associated with students’ scores.
Conclusion COVID-19 negatively impacted medical students' clinical performance, regardless of their specialty. Female students outperformed male students, irrespective of the pandemic.
-
Citations
Citations to this article as recorded by 
- The emergence of generative artificial intelligence platforms in 2023, journal metrics, appreciation to reviewers and volunteers, and obituary
Sun Huh Journal of Educational Evaluation for Health Professions.2024; 21: 9. CrossRef
-
Comparison between residents with a 6-year medical program and a 7-year medical program in terms of objective structured clinical examination performance in postgraduate year training in Taiwan: a 2-group pre- and post-test non-synchronized study
-
Ya-Ting Chang
, Ying-Ying Yang , Chung-Pin Li , Chen-Huan Chen
-
J Educ Eval Health Prof. 2022;19:13. Published online June 24, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.13
-
-
2,979
View
-
219
Download
-
1
Crossref
-
Abstract
PDF Supplementary Material
- Purpose
In 2013, medical schools in Taiwan implemented a 6-year medical program that replaced the previous 7-year medical education program. The postgraduate year (PGY) program was also extended from 1 year to 2 years. The new program is characterized by diversified teaching, integration of medical skills, a system-oriented curriculum, and the implementation of primary care and clinical thinking training. The purpose of this study was to examine whether postgraduate residents who learned under the new program have better patient care skills than those who learned under the previous program.
Methods Of 101 residents in the PGY program at Taipei Veterans General Hospital, 78 were trained in the 6-year program, while 23 were trained in the 7-year program. During the PGY training, 2 objective structured clinical examinations (OSCEs) were used to evaluate clinical reasoning, communication skills, and procedural skills at the beginning of the training and after 11 months of training, respectively. The scores of each OSCE and the rate of improvement of the pre- and post-tests were analyzed.
Results Residents trained in the new program scored higher on clinical reasoning (P<0.001) and the total scores of the 3 tested skills (P=0.019) on the pre-test. In terms of improvement, residents educated in the previous system improved more in clinical reasoning than those educated in the new education system.
Conclusion The new medical education program, which emphasizes clinical thinking, improved residents’ clinical skills. The PGY program was effective in improving the clinical performance of residents who were educated in the previous system.
-
Citations
Citations to this article as recorded by 
- Addressing Burnout Problems among Postgraduate Trainee Doctors
Lien-Chung Wei Taiwanese Journal of Psychiatry.2023; 37(2): 96. CrossRef
-
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
-
Ying-Ying Yang
, Pin-Hsiang Huang , Ling-Yu Yang , Chia-Chang Huang , Chih-Wei Liu , Shiau-Shian Huang , Chen-Huan Chen , Fa-Yauh Lee , Shou-Yen Kao , Boaz Shulruf
-
J Educ Eval Health Prof. 2022;19:27. Published online October 17, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.27
-
-
Abstract
PDF Supplementary Material
- Purpose
Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method.
Methods The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station.
Results On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts.
Conclusion The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.
-
Effects of virtual reality training on decreasing the rates of needlestick or sharp injury in new-coming medical and nursing interns in Taiwan
-
Szu-Hsien Wu
, Chia-Chang Huang , Shiau-Shian Huang , Ying-Ying Yang , Chih-Wei Liu , Boaz Shulruf , Chen-Huan Chen
-
J Educ Eval Health Prof. 2020;17:1. Published online January 20, 2020
-
DOI: https://doi.org/10.3352/jeehp.2020.17.1
-
-
12,831
View
-
447
Download
-
42
Web of Science
-
38
Crossref
-
Abstract
PDF Supplementary Material
- Purpose
Senior nursing and medical interns’ lack of familiarity and confidence with respect to practicing universal precaution for the prevention of occupational needlestick or sharp injuries may harm themselves. Trainees’ self-reported needlestick or sharp injury rate was known to be especially high during the first 2 months of internship in Taiwan. This prospective cohort study aimed to assess the effect of newly developed virtual reality (VR) game, which uses Gagne’s learning model to improve universal precaution for needlestick or sharp injury prevention and decrease the rates of needle stick or sharp injuries in new-coming medical and nursing interns in Taiwan.
Methods From 2017 to 2019, the VR system was developed and applied in training of 59 new-coming nursing and 50 medical interns. Occupational needlestick or sharp injury prevention was sought to be achieved through a game of right and wrong choices for safe or unsafe universal precaution behaviors.
Results In comparison with medical interns, a higher proportion of nursing interns had past experiences of deep occupational needlestick or sharp injury. Before VR training, the familiarity and confidence for needlestick or sharp injury prevention were higher among nursing interns than medical interns. Trainees with past experiences of deep needlestick or sharp injury exhibited better performance on the accuracy rate and time needed to complete 20 decisions than those without past experiences in VR practice. All trainees showed an improved performance after VR training. A high proportion of trainees reported that the VR-based training significantly decreased their anxiety about needlestick or sharp injury prevention.
Conclusion This self-developed VR game system using Gagne’s flow improved universal precaution for needlestick or sharp injury prevention and reduced the needlestick or sharp injury rates in the first 2 months of nursing and medical internship.
-
Citations
Citations to this article as recorded by 
- Game-thinking; utilizing serious games and gamification in nursing education – a systematic review and meta-analysis
Mats Nylén-Eriksen, Marko Stojiljkovic, Daniela Lillekroken, Katrin Lindeflaten, Elisabeth Hessevaagbakke, Tone Nygaard Flølo, Olav Johannes Hovland, Ada Marie Svarstad Solberg, Sylvia Hansen, Ann Kristin Bjørnnes, Christine Tørris BMC Medical Education.2025;[Epub] CrossRef - Impact of an immersive virtual reality simulator education program on nursing students' intravenous injection administration: A mixed methods study
Yi-Ya Chang, Li-Fen Chao, Wen Chang, Chih-Ming Lin, Yi-Hsing Lee, Abigail Latimer, Misook L. Chung Nurse Education Today.2024; 132: 106002. CrossRef - Positive Aspects and Potential Drawbacks of Implementing Digital Teaching/Learning Scenarios in Health Professions Using Nursing Education as an Example: A Research Report from Germany
Lydia Pfeifer, Sophia Fries, Alexander Stirner, Lisa Nagel, Christian Cohnen, Leona Aschentrup, Marleen Schönbeck, Annette Nauerth, Patrizia Raschper, Tim Herzig, Kamil J. Wrona Nursing Reports.2024; 14(1): 468. CrossRef - Combatting the occurrence of needle-stick injuries in a medical school: why is it still an issue?
Franca Keicher, Janina Zirkel, Tobias Leutritz, Sarah König BMC Medical Education.2024;[Epub] CrossRef - Development of Immersive Virtual Reality Hospital Fire Management and Evacuation Training Program for Nursing Students in Hong Kong
Wendy Wing Chi Wong, Gary Long Hei So SN Computer Science.2024;[Epub] CrossRef - A 3-D interactive microbiology laboratory via virtual reality for enhancing practical skills
Ebenezer Chitra, Siti Azreena Mubin, Vishna Devi Nadarajah, Wong Pei Se, Chew Fei Sow, Hui Meng Er, Nilesh Kumar Mitra, Vinesh Thiruchelvam, Fabian Davamani Scientific Reports.2024;[Epub] CrossRef - Digital Educational Tools for Undergraduate Nursing Education: A Review of Serious Games, Gamified Applications and Non-Gamified Virtual Reality Simulations/Tools for Nursing Students
Vasiliki Eirini Chatzea, Ilias Logothetis, Michail Kalogiannakis, Michael Rovithis, Nikolas Vidakis Information.2024; 15(7): 410. CrossRef - Roles of artificial intelligence experience, information redundancy, and familiarity in shaping active learning: Insights from intelligent personal assistants
Shaofeng Wang, Zhuo Sun Education and Information Technologies.2024;[Epub] CrossRef - Occupational Exposure to Sharp Object Injuries Among Healthcare Workers in Dammam and Jeddah Hospitals, Saudi Arabia
Mona Al-Zahrani, Mahmoud Berekaa, Mohammed Al-Warthan, Abdulaziz AlMulla Journal of Multidisciplinary Healthcare.2024; Volume 17: 5199. CrossRef - Virtual Reality Head-Mounted Displays in Medical Education
Thomas Tursø-Finnich, Rune Overgaard Jensen, Lasse X. Jensen, Lars Konge, Ebbe Thinggaard Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2023; 18(1): 42. CrossRef - Review of literature: Knowledge and practice of standard precautions by nursing student and teaching techniques used in training
Stephanie Bouget Mohammedi, Caroline Landelle American Journal of Infection Control.2023; 51(5): 574. CrossRef - Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial
Li-Jen Hsin, Yi-Ping Chao, Hai-Hua Chuang, Terry B. J. Kuo, Cheryl C. H. Yang, Chung-Guei Huang, Chung-Jan Kang, Wan-Ni Lin, Tuan-Jen Fang, Hsueh-Yu Li, Li-Ang Lee Virtual Reality.2023; 27(4): 3345. CrossRef - Exploring Key Factors Influencing Nursing Students’ Cognitive Load and Willingness to Serve Older Adults: Cross-sectional Descriptive Correlational Study
Pei-Lun Hsieh, Yu-Rung Wang, Tien-Chi Huang JMIR Serious Games.2023; 11: e43203. CrossRef - The Development and Pilot Testing of Immersive Virtual Reality Simulation Training for Prelicensure Nursing Students: A Quasi-Experimental Study
Bethany Cieslowski, Tanya Haas, Kyeung Mi Oh, Kathleen Chang, Cheryl A. Oetjen Clinical Simulation in Nursing.2023; 77: 6. CrossRef - Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse
Juan M. Román-Belmonte, E. Carlos Rodríguez-Merchán, Hortensia De la Corte-Rodríguez Postgraduate Medicine.2023; 135(5): 440. CrossRef - Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review
Hans Stefan, Michael Mortimer, Ben Horan Virtual Reality.2023; 27(4): 2839. CrossRef - Virtual reality simulation for nursing education: effectiveness and feasibility
Debra Kiegaldie, Louise Shaw BMC Nursing.2023;[Epub] CrossRef - Digital Transformation in Nursing Education: A Systematic Review on Computer-Aided Nursing Education Pedagogies, Recent Advancements and Outlook on the Post-COVID-19 Era
Nevena Kostadinova Dicheva, Ikram Ur Rehman, Aamir Anwar, Moustafa M. Nasralla, Laden Husamaldin, Sama Aleshaiker IEEE Access.2023; 11: 135659. CrossRef - Assessment of preclinical learning using virtual reality based education for nursing students
Sofía Martín Rodríguez, Marcial F Parrilla, Víctor Álvarez-García, Juan Ramón Pérez-Pérez, María Del Mar Fernández-Álvarez, Rubén Martín-Payo Educational Media International.2023; 60(3-4): 209. CrossRef - Application of Digital Simulation for Training Purposes Through Virtual Reality in The Workplace
Ari Prayogo Pribadi, Vena Jaladara, Chris Dwina Anggiana Br Silalahi, Yusuf Mukasyafah Rizqi Rahman The Indonesian Journal of Occupational Safety and Health.2023; 12(3): 457. CrossRef - How, for Whom, and in Which Contexts or Conditions Augmented and Virtual Reality Training Works in Upskilling Health Care Workers: Realist Synthesis
Norina Gasteiger, Sabine N van der Veer, Paul Wilson, Dawn Dowding JMIR Serious Games.2022; 10(1): e31644. CrossRef - Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef - A Systematic Literature Review of Virtual, Augmented, and Mixed Reality Game Applications in Healthcare
Yu Fu, Yan Hu, Veronica Sundstedt ACM Transactions on Computing for Healthcare.2022; 3(2): 1. CrossRef - Effectiveness of Immersive Virtual Reality in Nursing Education
Jeeyae Choi, C Elise Thompson, Jeungok Choi, Colette B. Waddill, Soyoung Choi Nurse Educator.2022; 47(3): E57. CrossRef - Systematic Bibliometric Analysis of Research Hotspots and Trends on the Application of Virtual Reality in Nursing
Junqiang Zhao, Yi Lu, Fujun Zhou, Ruping Mao, Fangqin Fei Frontiers in Public Health.2022;[Epub] CrossRef - Development and Pilot Testing of a Non-stress Test Virtual Reality Simulator
Li-Fen Chao, Tsuey-Yuan Huang, Debra K. Moser, Fen-Fang Chung, Ying-Tung Lau, Xaviera Xiao CIN: Computers, Informatics, Nursing.2022; 40(6): 357. CrossRef - The Effect of a Child Model on Breath-Sounds Examination Skills and Satisfaction on Nursing Students
Silpthai Thamruangrit, Sermsri Santati, Jumpee Granger, Dongruethai Buadong, Jatuporn Thongsri Healthcare.2022; 10(7): 1165. CrossRef - Theories informing technology enhanced learning in nursing and midwifery education: A systematic review and typological classification
Siobhan O'Connor, Stephanie Kennedy, Yajing Wang, Amna Ali, Samantha Cooke, Richard G. Booth Nurse Education Today.2022; 118: 105518. CrossRef - Tendência temporal dos acidentes por exposição percutânea em um hospital público no Brasil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta Revista Brasileira de Enfermagem.2022;[Epub] CrossRef - Temporal trend of accidents due to percutaneous exposure in a public hospital in Brazil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta Revista Brasileira de Enfermagem.2022;[Epub] CrossRef - Influence of Technology in Supporting Quality and Safety in Nursing Education
Gerry Altmiller, Loraine Hopkins Pepe Nursing Clinics of North America.2022; 57(4): 551. CrossRef - Needlestick and sharps’ injury in healthcare students: Prevalence, knowledge, attitude and practice
Uma Vasant Datar, Mamata Kamat, Mahesh Khairnar, Umesh Wadgave, Karishma Madhusudhan Desai Journal of Family Medicine and Primary Care.2022; 11(10): 6327. CrossRef - Virtual reality simulations in nurse education: A systematic mapping review
Christian Plotzky, Ulrike Lindwedel, Michaela Sorber, Barbara Loessl, Peter König, Christophe Kunze, Christiane Kugler, Michael Meng Nurse Education Today.2021; 101: 104868. CrossRef - Virtual Reality in Healthcare Skills Training: The Effects of Presence on Acceptance and Increase of Knowledge
Christian Plotzky, Ulrike Lindwedel, Alexander Bejan, Peter König, Christophe Kunze i-com.2021; 20(1): 73. CrossRef - A systematic review of immersive virtual reality for industrial skills training
Unnikrishnan Radhakrishnan, Konstantinos Koumaditis, Francesco Chinello Behaviour & Information Technology.2021; 40(12): 1310. CrossRef - No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand
Chaowanan Khundam, Naparat Sukkriang, Frédéric Noël Journal of Educational Evaluation for Health Professions.2021; 18: 22. CrossRef - How to train health personnel to protect themselves from SARS-CoV-2 (novel coronavirus) infection when caring for a patient or suspected case
Sun Huh Journal of Educational Evaluation for Health Professions.2020; 17: 10. CrossRef - Knowledge, attitude and behavior towards COVID-19 among the Turkish healthcare workers
Yasin Uzuntarla, Sumeyra Ceyhan Journal of Clinical Medicine of Kazakhstan.2020; 6(60): 93. CrossRef
-
Dreyfus scale-based feedback increased medical students’ satisfaction with the complex cluster part of a interviewing and physical examination course and improved skills readiness in Taiwan
-
Shiau-Shian Huang
, Chia-Chang Huang , Ying-Ying Yang , Shuu-Jiun Wang , Boaz Shulruf , Chen-Huan Chen
-
J Educ Eval Health Prof. 2019;16:30. Published online October 11, 2019
-
DOI: https://doi.org/10.3352/jeehp.2019.16.30
-
-
10,904
View
-
133
Download
-
1
Web of Science
-
Abstract
PDF Supplementary Material
- Purpose
In contrast to the core part of the clinical interviewing and physical examination (PE) skills course, corresponding to the basic, head-to-toe, and thoracic systems, learners need structured feedback in the cluster part of the course, which includes the abdominal, neuromuscular, and musculoskeletal systems. This study evaluated the effects of using Dreyfus scale-based feedback, which has elements of continuous professional development, instead of Likert scale-based feedback in the cluster part of training in Taiwan.
Methods Instructors and final-year medical students in the 2015–2016 classes of National Yang-Ming University, Taiwan comprised the regular cohort, whereas those in the 2017–2018 classes formed the intervention cohort. In the intervention cohort, Dreyfus scale-based feedback, rather than Likert scale-based feedback, was used in the cluster part of the course.
Results In the cluster part of the course in the regular cohort, pre-trained standardized patients rated the class climate as poor, and students expressed low satisfaction with the instructors and course and low self-assessed readiness. In comparison with the regular cohort, improved end-of-course group objective structured clinical examination scores after the cluster part were noted in the intervention cohort. In other words, the implementation of Dreyfus scale-based feedback in the intervention cohort for the cluster part improved the deficit in this section of the course.
Conclusion The implementation of Dreyfus scale-based feedback helped instructors to create a good class climate in the cluster part of the clinical interviewing and PE skills course. Simultaneously, this new intervention achieved the goal of promoting medical students’ readiness for interviewing, PE, and self-directed learning.
|