Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions

OPEN ACCESS
SEARCH
Search

Search

Page Path
HOME > Search
8 "Ying-Ying Yang"
Filter
Filter
Article category
Keywords
Publication year
Authors
Funded articles
Research articles
Negative effects on medical students’ scores for clinical performance during the COVID-19 pandemic in Taiwan: a comparative study  
Eunice Jia-Shiow Yuan, Shiau-Shian Huang, Chia-An Hsu, Jiing-Feng Lirng, Tzu-Hao Li, Chia-Chang Huang, Ying-Ying Yang, Chung-Pin Li, Chen-Huan Chen
J Educ Eval Health Prof. 2023;20:37.   Published online December 26, 2023
DOI: https://doi.org/10.3352/jeehp.2023.20.37
  • 752 View
  • 71 Download
AbstractAbstract PDFSupplementary Material
Purpose
Coronavirus disease 2019 (COVID-19) has heavily impacted medical clinical education in Taiwan. Medical curricula have been altered to minimize exposure and limit transmission. This study investigated the effect of COVID-19 on Taiwanese medical students’ clinical performance using online standardized evaluation systems and explored the factors influencing medical education during the pandemic.
Methods
Medical students were scored from 0 to 100 based on their clinical performance from 1/1/2018 to 6/31/2021. The students were placed into pre-COVID-19 (before 2/1/2020) and midst-COVID-19 (on and after 2/1/2020) groups. Each group was further categorized into COVID-19-affected specialties (pulmonary, infectious, and emergency medicine) and other specialties. Generalized estimating equations (GEEs) were used to compare and examine the effects of relevant variables on student performance.
Results
In total, 16,944 clinical scores were obtained for COVID-19-affected specialties and other specialties. For the COVID-19-affected specialties, the midst-COVID-19 score (88.513.52) was significantly lower than the pre-COVID-19 score (90.143.55) (P<0.0001). For the other specialties, the midst-COVID-19 score (88.323.68) was also significantly lower than the pre-COVID-19 score (90.063.58) (P<0.0001). There were 1,322 students (837 males and 485 females). Male students had significantly lower scores than female students (89.333.68 vs. 89.993.66, P=0.0017). GEE analysis revealed that the COVID-19 pandemic (unstandardized beta coefficient=-1.99, standard error [SE]=0.13, P<0.0001), COVID-19-affected specialties (B=0.26, SE=0.11, P=0.0184), female students (B=1.10, SE=0.20, P<0.0001), and female attending physicians (B=-0.19, SE=0.08, P=0.0145) were independently associated with students’ scores.
Conclusion
COVID-19 negatively impacted medical students' clinical performance, regardless of their specialty. Female students outperformed male students, irrespective of the pandemic.
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study  
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
J Educ Eval Health Prof. 2022;19:27.   Published online October 17, 2022
DOI: https://doi.org/10.3352/jeehp.2022.19.27
  • 1,658 View
  • 116 Download
AbstractAbstract PDFSupplementary Material
Purpose
Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method.
Methods
The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station.
Results
On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts.
Conclusion
The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.
Medical students’ self-assessed efficacy and satisfaction with training on endotracheal intubation and central venous catheterization with smart glasses in Taiwan: a non-equivalent control-group pre- and post-test study  
Yu-Fan Lin, Chien-Ying Wang, Yen-Hsun Huang, Sheng-Min Lin, Ying-Ying Yang
J Educ Eval Health Prof. 2022;19:25.   Published online September 2, 2022
DOI: https://doi.org/10.3352/jeehp.2022.19.25
  • 3,017 View
  • 227 Download
  • 1 Web of Science
  • 1 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
Endotracheal intubation and central venous catheterization are essential procedures in clinical practice. Simulation-based technology such as smart glasses has been used to facilitate medical students’ training on these procedures. We investigated medical students’ self-assessed efficacy and satisfaction regarding the practice and training of these procedures with smart glasses in Taiwan.
Methods
This observational study enrolled 145 medical students in the 5th and 6th years participating in clerkships at Taipei Veterans General Hospital between October 2020 and December 2021. Students were divided into the smart glasses or the control group and received training at a workshop. The primary outcomes included students’ pre- and post-intervention scores for self-assessed efficacy and satisfaction with the training tool, instructor’s teaching, and the workshop.
Results
The pre-intervention scores for self-assessed efficacy of 5th- and 6th-year medical students in endotracheal intubation and central venous catheterization procedures showed no significant difference. The post-intervention score of self-assessed efficacy in the smart glasses group was better than that of the control group. Moreover, 6th-year medical students in the smart glasses group showed higher satisfaction with the training tool, instructor’s teaching, and workshop than those in the control group.
Conclusion
Smart glasses served as a suitable simulation tool for endotracheal intubation and central venous catheterization procedures training in medical students. Medical students practicing with smart glasses showed improved self-assessed efficacy and higher satisfaction with training, especially for procedural steps in a space-limited field. Simulation training on procedural skills with smart glasses in 5th-year medical students may be adjusted to improve their satisfaction.

Citations

Citations to this article as recorded by  
  • The use of smart glasses in nursing education: A scoping review
    Charlotte Romare, Lisa Skär
    Nurse Education in Practice.2023; 73: 103824.     CrossRef
Comparison between residents with a 6-year medical program and a 7-year medical program in terms of objective structured clinical examination performance in postgraduate year training in Taiwan: a 2-group pre- and post-test non-synchronized study  
Ya-Ting Chang, Ying-Ying Yang, Chung-Pin Li, Chen-Huan Chen
J Educ Eval Health Prof. 2022;19:13.   Published online June 24, 2022
DOI: https://doi.org/10.3352/jeehp.2022.19.13
  • 2,267 View
  • 205 Download
AbstractAbstract PDFSupplementary Material
Purpose
In 2013, medical schools in Taiwan implemented a 6-year medical program that replaced the previous 7-year medical education program. The postgraduate year (PGY) program was also extended from 1 year to 2 years. The new program is characterized by diversified teaching, integration of medical skills, a system-oriented curriculum, and the implementation of primary care and clinical thinking training. The purpose of this study was to examine whether postgraduate residents who learned under the new program have better patient care skills than those who learned under the previous program.
Methods
Of 101 residents in the PGY program at Taipei Veterans General Hospital, 78 were trained in the 6-year program, while 23 were trained in the 7-year program. During the PGY training, 2 objective structured clinical examinations (OSCEs) were used to evaluate clinical reasoning, communication skills, and procedural skills at the beginning of the training and after 11 months of training, respectively. The scores of each OSCE and the rate of improvement of the pre- and post-tests were analyzed.
Results
Residents trained in the new program scored higher on clinical reasoning (P<0.001) and the total scores of the 3 tested skills (P=0.019) on the pre-test. In terms of improvement, residents educated in the previous system improved more in clinical reasoning than those educated in the new education system.
Conclusion
The new medical education program, which emphasizes clinical thinking, improved residents’ clinical skills. The PGY program was effective in improving the clinical performance of residents who were educated in the previous system.
Brief report
Effects of a simulation-based blended training model on nurses’ treatment decision-related knowledge about oral cancer in Taiwan: a pilot survey  
Chia-Chang Huang, Shiau-Shian Huang, Ying-Ying Yang, Shou-Yen Kao
J Educ Eval Health Prof. 2021;18:10.   Published online May 25, 2021
DOI: https://doi.org/10.3352/jeehp.2021.18.10
  • 5,347 View
  • 296 Download
  • 3 Crossref
AbstractAbstract PDFSupplementary Material
The present study aimed to evaluate the effects of virtual reality (VR) simulations combined with bedside assignments on nurses’ self-efficacy in providing pre-treatment educational services. Between March 2019 and November 2020, we conducted a study of VR educational materials that were developed to cover information about the treatment of oral cancers. The effects of the VR simulation, the thinking-path tracking map method, and bedside assignments on the nurses’ treatment decision-related knowledge were evaluated in a ward for oral cancer patients at Taipei Veterans General Hospital, Taipei, Taiwan. The blended training model significantly increased nurses’ familiarity (P<0.01) and confidence (P<0.03) regarding their knowledge of treatments and treatment decision-related knowledge. This model also significantly increased their confidence in their skills in bedside pre-treatment education for admitted oral cancer patients (P<0.002). Oral cancer-specific VR materials enhanced the effectiveness of skills training among nurses in the oral cancer ward.

Citations

Citations to this article as recorded by  
  • The use of simulation-based education in cancer care: a scoping review
    Amina Silva, Kylie Teggart, Corey Heerschap, Jacqueline Galica, Kevin Woo, Marian Luctkar-Flude
    International Journal of Healthcare Simulation.2023;[Epub]     CrossRef
  • Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
    Sun Huh
    Journal of Educational Evaluation for Health Professions.2022; 19: 2.     CrossRef
  • Assessing the Financial Sustainability of High-Fidelity and Virtual Reality Simulation for Nursing Education
    Michael D. Bumbach, Beth A. Culross, Santanu K. Datta
    CIN: Computers, Informatics, Nursing.2022; 40(9): 615.     CrossRef
Research articles
Effects of virtual reality training on decreasing the rates of needlestick or sharp injury in new-coming medical and nursing interns in Taiwan  
Szu-Hsien Wu, Chia-Chang Huang, Shiau-Shian Huang, Ying-Ying Yang, Chih-Wei Liu, Boaz Shulruf, Chen-Huan Chen
J Educ Eval Health Prof. 2020;17:1.   Published online January 20, 2020
DOI: https://doi.org/10.3352/jeehp.2020.17.1
  • 11,041 View
  • 413 Download
  • 33 Web of Science
  • 31 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
Senior nursing and medical interns’ lack of familiarity and confidence with respect to practicing universal precaution for the prevention of occupational needlestick or sharp injuries may harm themselves. Trainees’ self-reported needlestick or sharp injury rate was known to be especially high during the first 2 months of internship in Taiwan. This prospective cohort study aimed to assess the effect of newly developed virtual reality (VR) game, which uses Gagne’s learning model to improve universal precaution for needlestick or sharp injury prevention and decrease the rates of needle stick or sharp injuries in new-coming medical and nursing interns in Taiwan.
Methods
From 2017 to 2019, the VR system was developed and applied in training of 59 new-coming nursing and 50 medical interns. Occupational needlestick or sharp injury prevention was sought to be achieved through a game of right and wrong choices for safe or unsafe universal precaution behaviors.
Results
In comparison with medical interns, a higher proportion of nursing interns had past experiences of deep occupational needlestick or sharp injury. Before VR training, the familiarity and confidence for needlestick or sharp injury prevention were higher among nursing interns than medical interns. Trainees with past experiences of deep needlestick or sharp injury exhibited better performance on the accuracy rate and time needed to complete 20 decisions than those without past experiences in VR practice. All trainees showed an improved performance after VR training. A high proportion of trainees reported that the VR-based training significantly decreased their anxiety about needlestick or sharp injury prevention.
Conclusion
This self-developed VR game system using Gagne’s flow improved universal precaution for needlestick or sharp injury prevention and reduced the needlestick or sharp injury rates in the first 2 months of nursing and medical internship.

Citations

Citations to this article as recorded by  
  • Impact of an immersive virtual reality simulator education program on nursing students' intravenous injection administration: A mixed methods study
    Yi-Ya Chang, Li-Fen Chao, Wen Chang, Chih-Ming Lin, Yi-Hsing Lee, Abigail Latimer, Misook L. Chung
    Nurse Education Today.2024; 132: 106002.     CrossRef
  • Positive Aspects and Potential Drawbacks of Implementing Digital Teaching/Learning Scenarios in Health Professions Using Nursing Education as an Example: A Research Report from Germany
    Lydia Pfeifer, Sophia Fries, Alexander Stirner, Lisa Nagel, Christian Cohnen, Leona Aschentrup, Marleen Schönbeck, Annette Nauerth, Patrizia Raschper, Tim Herzig, Kamil J. Wrona
    Nursing Reports.2024; 14(1): 468.     CrossRef
  • Combatting the occurrence of needle-stick injuries in a medical school: why is it still an issue?
    Franca Keicher, Janina Zirkel, Tobias Leutritz, Sarah König
    BMC Medical Education.2024;[Epub]     CrossRef
  • Development of Immersive Virtual Reality Hospital Fire Management and Evacuation Training Program for Nursing Students in Hong Kong
    Wendy Wing Chi Wong, Gary Long Hei So
    SN Computer Science.2024;[Epub]     CrossRef
  • Virtual Reality Head-Mounted Displays in Medical Education
    Thomas Tursø-Finnich, Rune Overgaard Jensen, Lasse X. Jensen, Lars Konge, Ebbe Thinggaard
    Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2023; 18(1): 42.     CrossRef
  • Review of literature: Knowledge and practice of standard precautions by nursing student and teaching techniques used in training
    Stephanie Bouget Mohammedi, Caroline Landelle
    American Journal of Infection Control.2023; 51(5): 574.     CrossRef
  • Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial
    Li-Jen Hsin, Yi-Ping Chao, Hai-Hua Chuang, Terry B. J. Kuo, Cheryl C. H. Yang, Chung-Guei Huang, Chung-Jan Kang, Wan-Ni Lin, Tuan-Jen Fang, Hsueh-Yu Li, Li-Ang Lee
    Virtual Reality.2023; 27(4): 3345.     CrossRef
  • Exploring Key Factors Influencing Nursing Students’ Cognitive Load and Willingness to Serve Older Adults: Cross-sectional Descriptive Correlational Study
    Pei-Lun Hsieh, Yu-Rung Wang, Tien-Chi Huang
    JMIR Serious Games.2023; 11: e43203.     CrossRef
  • The Development and Pilot Testing of Immersive Virtual Reality Simulation Training for Prelicensure Nursing Students: A Quasi-Experimental Study
    Bethany Cieslowski, Tanya Haas, Kyeung Mi Oh, Kathleen Chang, Cheryl A. Oetjen
    Clinical Simulation in Nursing.2023; 77: 6.     CrossRef
  • Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse
    Juan M. Román-Belmonte, E. Carlos Rodríguez-Merchán, Hortensia De la Corte-Rodríguez
    Postgraduate Medicine.2023; 135(5): 440.     CrossRef
  • Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review
    Hans Stefan, Michael Mortimer, Ben Horan
    Virtual Reality.2023; 27(4): 2839.     CrossRef
  • Virtual reality simulation for nursing education: effectiveness and feasibility
    Debra Kiegaldie, Louise Shaw
    BMC Nursing.2023;[Epub]     CrossRef
  • Digital Transformation in Nursing Education: A Systematic Review on Computer-Aided Nursing Education Pedagogies, Recent Advancements and Outlook on the Post-COVID-19 Era
    Nevena Kostadinova Dicheva, Ikram Ur Rehman, Aamir Anwar, Moustafa M. Nasralla, Laden Husamaldin, Sama Aleshaiker
    IEEE Access.2023; 11: 135659.     CrossRef
  • Assessment of preclinical learning using virtual reality based education for nursing students
    Sofía Martín Rodríguez, Marcial F Parrilla, Víctor Álvarez-García, Juan Ramón Pérez-Pérez, María Del Mar Fernández-Álvarez, Rubén Martín-Payo
    Educational Media International.2023; 60(3-4): 209.     CrossRef
  • How, for Whom, and in Which Contexts or Conditions Augmented and Virtual Reality Training Works in Upskilling Health Care Workers: Realist Synthesis
    Norina Gasteiger, Sabine N van der Veer, Paul Wilson, Dawn Dowding
    JMIR Serious Games.2022; 10(1): e31644.     CrossRef
  • Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
    Sun Huh
    Journal of Educational Evaluation for Health Professions.2022; 19: 2.     CrossRef
  • A Systematic Literature Review of Virtual, Augmented, and Mixed Reality Game Applications in Healthcare
    Yu Fu, Yan Hu, Veronica Sundstedt
    ACM Transactions on Computing for Healthcare.2022; 3(2): 1.     CrossRef
  • Effectiveness of Immersive Virtual Reality in Nursing Education
    Jeeyae Choi, C Elise Thompson, Jeungok Choi, Colette B. Waddill, Soyoung Choi
    Nurse Educator.2022; 47(3): E57.     CrossRef
  • Systematic Bibliometric Analysis of Research Hotspots and Trends on the Application of Virtual Reality in Nursing
    Junqiang Zhao, Yi Lu, Fujun Zhou, Ruping Mao, Fangqin Fei
    Frontiers in Public Health.2022;[Epub]     CrossRef
  • Development and Pilot Testing of a Non-stress Test Virtual Reality Simulator
    Li-Fen Chao, Tsuey-Yuan Huang, Debra K. Moser, Fen-Fang Chung, Ying-Tung Lau, Xaviera Xiao
    CIN: Computers, Informatics, Nursing.2022; 40(6): 357.     CrossRef
  • The Effect of a Child Model on Breath-Sounds Examination Skills and Satisfaction on Nursing Students
    Silpthai Thamruangrit, Sermsri Santati, Jumpee Granger, Dongruethai Buadong, Jatuporn Thongsri
    Healthcare.2022; 10(7): 1165.     CrossRef
  • Theories informing technology enhanced learning in nursing and midwifery education: A systematic review and typological classification
    Siobhan O'Connor, Stephanie Kennedy, Yajing Wang, Amna Ali, Samantha Cooke, Richard G. Booth
    Nurse Education Today.2022; 118: 105518.     CrossRef
  • Tendência temporal dos acidentes por exposição percutânea em um hospital público no Brasil, 2007-2019
    Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
    Revista Brasileira de Enfermagem.2022;[Epub]     CrossRef
  • Temporal trend of accidents due to percutaneous exposure in a public hospital in Brazil, 2007-2019
    Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
    Revista Brasileira de Enfermagem.2022;[Epub]     CrossRef
  • Influence of Technology in Supporting Quality and Safety in Nursing Education
    Gerry Altmiller, Loraine Hopkins Pepe
    Nursing Clinics of North America.2022; 57(4): 551.     CrossRef
  • Virtual reality simulations in nurse education: A systematic mapping review
    Christian Plotzky, Ulrike Lindwedel, Michaela Sorber, Barbara Loessl, Peter König, Christophe Kunze, Christiane Kugler, Michael Meng
    Nurse Education Today.2021; 101: 104868.     CrossRef
  • Virtual Reality in Healthcare Skills Training: The Effects of Presence on Acceptance and Increase of Knowledge
    Christian Plotzky, Ulrike Lindwedel, Alexander Bejan, Peter König, Christophe Kunze
    i-com.2021; 20(1): 73.     CrossRef
  • A systematic review of immersive virtual reality for industrial skills training
    Unnikrishnan Radhakrishnan, Konstantinos Koumaditis, Francesco Chinello
    Behaviour & Information Technology.2021; 40(12): 1310.     CrossRef
  • No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand
    Chaowanan Khundam, Naparat Sukkriang, Frédéric Noël
    Journal of Educational Evaluation for Health Professions.2021; 18: 22.     CrossRef
  • How to train health personnel to protect themselves from SARS-CoV-2 (novel coronavirus) infection when caring for a patient or suspected case
    Sun Huh
    Journal of Educational Evaluation for Health Professions.2020; 17: 10.     CrossRef
  • Knowledge, attitude and behavior towards COVID-19 among the Turkish healthcare workers
    Yasin Uzuntarla, Sumeyra Ceyhan
    Journal of Clinical Medicine of Kazakhstan.2020; 6(60): 93.     CrossRef
Dreyfus scale-based feedback increased medical students’ satisfaction with the complex cluster part of a interviewing and physical examination course and improved skills readiness in Taiwan  
Shiau-Shian Huang, Chia-Chang Huang, Ying-Ying Yang, Shuu-Jiun Wang, Boaz Shulruf, Chen-Huan Chen
J Educ Eval Health Prof. 2019;16:30.   Published online October 11, 2019
DOI: https://doi.org/10.3352/jeehp.2019.16.30
  • 10,250 View
  • 126 Download
  • 1 Web of Science
AbstractAbstract PDFSupplementary Material
Purpose
In contrast to the core part of the clinical interviewing and physical examination (PE) skills course, corresponding to the basic, head-to-toe, and thoracic systems, learners need structured feedback in the cluster part of the course, which includes the abdominal, neuromuscular, and musculoskeletal systems. This study evaluated the effects of using Dreyfus scale-based feedback, which has elements of continuous professional development, instead of Likert scale-based feedback in the cluster part of training in Taiwan.
Methods
Instructors and final-year medical students in the 2015–2016 classes of National Yang-Ming University, Taiwan comprised the regular cohort, whereas those in the 2017–2018 classes formed the intervention cohort. In the intervention cohort, Dreyfus scale-based feedback, rather than Likert scale-based feedback, was used in the cluster part of the course.
Results
In the cluster part of the course in the regular cohort, pre-trained standardized patients rated the class climate as poor, and students expressed low satisfaction with the instructors and course and low self-assessed readiness. In comparison with the regular cohort, improved end-of-course group objective structured clinical examination scores after the cluster part were noted in the intervention cohort. In other words, the implementation of Dreyfus scale-based feedback in the intervention cohort for the cluster part improved the deficit in this section of the course.
Conclusion
The implementation of Dreyfus scale-based feedback helped instructors to create a good class climate in the cluster part of the clinical interviewing and PE skills course. Simultaneously, this new intervention achieved the goal of promoting medical students’ readiness for interviewing, PE, and self-directed learning.
An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study  
Ying-Ying Yang, Boaz Shulruf
J Educ Eval Health Prof. 2019;16:7.   Published online April 10, 2019
DOI: https://doi.org/10.3352/jeehp.2019.16.7
  • 18,326 View
  • 306 Download
  • 13 Web of Science
  • 17 Crossref
AbstractAbstract PDFSupplementary Material
Purpose
Lack of confidence in suturing/ligature skills due to insufficient practice and assessments is common among novice Chinese medical interns. This study aimed to improve the skill acquisition of medical interns through a new intervention program.
Methods
In addition to regular clinical training, expert-led or expert-led plus artificial intelligence (AI) system tutoring courses were implemented during the first 2 weeks of the surgical block. Interns could voluntarily join the regular (no additional tutoring), expert-led tutoring, or expert-led+AI tutoring groups freely. In the regular group, interns (n=25) did not receive additional tutoring. The expert-led group received 3-hour expert-led tutoring and in-training formative assessments after 2 practice sessions. After a similar expert-led course, the expert-led+AI group (n=23) practiced and assessed their skills on an AI system. Through a comparison with the internal standard, the system automatically recorded and evaluated every intern’s suturing/ligature skills. In the expert-led+AI group, performance and confidence were compared between interns who participated in 1, 2, or 3 AI practice sessions.
Results
The end-of-surgical block objective structured clinical examination (OSCE) performance and self-assessed confidence in suturing/ligature skills were highest in the expert-led+AI group. In comparison with the expert-led group, the expert-led+AI group showed similar performance in the in-training assessment and greater improvement in the end-of-surgical block OSCE. In the expert-led+AI group, the best performance and highest post-OSCE confidence were noted in those who engaged in 3 AI practice sessions.
Conclusion
This pilot study demonstrated the potential value of incorporating an additional expert-led+AI system–assisted tutoring course into the regular surgical curriculum.

Citations

Citations to this article as recorded by  
  • Automated measurement extraction for assessing simple suture quality in medical education
    Thanapon Noraset, Prawej Mahawithitwong, Wethit Dumronggittigule, Pongthep Pisarnturakit, Cherdsak Iramaneerat, Chanean Ruansetakit, Irin Chaikangwan, Nattanit Poungjantaradej, Nutcha Yodrabum
    Expert Systems with Applications.2024; 241: 122722.     CrossRef
  • Dental student application of artificial intelligence technology in detecting proximal caries lesions
    Enes Ayan, Yusuf Bayraktar, Çiğdem Çelik, Baturalp Ayhan
    Journal of Dental Education.2024; 88(4): 490.     CrossRef
  • Development of Artificial Intelligence–Teaching Assistant System for Undergraduate Nursing Students
    Yanika Kowitlawakul, Jocelyn Jie Min Tan, Siriwan Suebnukarn, Hoang D. Nguyen, Danny Chiang Choon Poo, Joseph Chai, Devi M. Kamala, Wenru Wang
    CIN: Computers, Informatics, Nursing.2024;[Epub]     CrossRef
  • The Role of Artificial Intelligence in Medical Education: A Systematic Review
    Atinc Tozsin, Harun Ucmak, Selim Soyturk, Abdullatif Aydin, Ali Serdar Gozen, Maha Al Fahim, Selcuk Güven, Kamran Ahmed
    Surgical Innovation.2024;[Epub]     CrossRef
  • Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education
    Thomas K.F. Chiu, Qi Xia, Xinyan Zhou, Ching Sing Chai, Miaoting Cheng
    Computers and Education: Artificial Intelligence.2023; 4: 100118.     CrossRef
  • The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney
    Thomas K. F. Chiu
    Interactive Learning Environments.2023; : 1.     CrossRef
  • Application value of an artificial intelligence-based diagnosis and recognition system in gastroscopy training for graduate students in gastroenterology: a preliminary study
    Peng An, Zhongqiu Wang
    Wiener Medizinische Wochenschrift.2023;[Epub]     CrossRef
  • Technological advancements in surgical laparoscopy considering artificial intelligence: a survey among surgeons in Germany
    Sebastian Lünse, Eric L. Wisotzky, Sophie Beckmann, Christoph Paasch, Richard Hunger, René Mantke
    Langenbeck's Archives of Surgery.2023;[Epub]     CrossRef
  • Artificial intelligence (AI) integration in medical education: A pan-India cross-sectional observation of acceptance and understanding among students
    Vipul Sharma, Uddhave Saini, Varun Pareek, Lokendra Sharma, Susheel Kumar
    Scripta Medica.2023; 54(4): 343.     CrossRef
  • Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus
    S Swaroop Vedula, Ahmed Ghazi, Justin W Collins, Carla Pugh, Dimitrios Stefanidis, Ozanan Meireles, Andrew J Hung, Steven Schwaitzberg, Jeffrey S Levy, Ajit K Sachdeva
    Journal of the American College of Surgeons.2022; 234(6): 1181.     CrossRef
  • The use and future perspective of Artificial Intelligence—A survey among German surgeons
    Mathieu Pecqueux, Carina Riediger, Marius Distler, Florian Oehme, Ulrich Bork, Fiona R. Kolbinger, Oliver Schöffski, Peter van Wijngaarden, Jürgen Weitz, Johannes Schweipert, Christoph Kahlert
    Frontiers in Public Health.2022;[Epub]     CrossRef
  • TIPTA YAPAY ZEKA UYGULAMALARI
    Hatice KELEŞ
    Kırıkkale Üniversitesi Tıp Fakültesi Dergisi.2022; 24(3): 604.     CrossRef
  • Application of Artificial Intelligence in Medicine: An Overview
    Peng-ran Liu, Lin Lu, Jia-yao Zhang, Tong-tong Huo, Song-xiang Liu, Zhe-wei Ye
    Current Medical Science.2021; 41(6): 1105.     CrossRef
  • Applications and Effects of EdTech in Medical Education
    Hyeonmi Hong, Youngjon Kim
    Korean Medical Education Review.2021; 23(3): 160.     CrossRef
  • Artificial Intelligence Education and Tools for Medical and Health Informatics Students: Systematic Review
    A Hasan Sapci, H Aylin Sapci
    JMIR Medical Education.2020; 6(1): e19285.     CrossRef
  • Scientific Development of Educational Artificial Intelligence in Web of Science
    Antonio-José Moreno-Guerrero, Jesús López-Belmonte, José-Antonio Marín-Marín, Rebeca Soler-Costa
    Future Internet.2020; 12(8): 124.     CrossRef
  • An Educational Network for Surgical Education Supported by Gamification Elements: Protocol for a Randomized Controlled Trial
    Natasha Guérard-Poirier, Michèle Beniey, Léamarie Meloche-Dumas, Florence Lebel-Guay, Bojana Misheva, Myriam Abbas, Malek Dhane, Myriam Elraheb, Adam Dubrowski, Erica Patocskai
    JMIR Research Protocols.2020; 9(12): e21273.     CrossRef

JEEHP : Journal of Educational Evaluation for Health Professions