Journal of Educational Evaluation for Health Professions

Research articles

Performance of ChatGPT-4 on the French Board of Plastic Reconstructive and Aesthetic Surgery written exam: a descriptive study: Emma Dejean-Bouyer, Anoujat Kanlagna, François Thuau, Pierre Perrot, Ugo Lancien; J Educ Eval Health Prof. 2025;22:27. Published online September 30, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.27

1,230 View
154 Download

Abstract PDF Supplementary Material: Purpose
This study aims to evaluate the performance of Chat Generative Pre-Trained Transformer 4 (ChatGPT-4) on the French Board of Plastic, Reconstructive, and Aesthetic Surgery written examination and to assess its role as a supplementary resource in helping residents prepare for the qualification examination in plastic surgery.
Methods
This descriptive study evaluated ChatGPT-4’s performance on 213 items from the October 2024 French Board of Plastic, Reconstructive, and Aesthetic Surgery written examination. Responses were assessed for accuracy, logical reasoning, internal and external information use, and were categorized for fallacies by independent reviewers. Statistical analyses included chi-square tests and Fisher’s exact test for significance.
Results
ChatGPT-4 answered all questions across the 10 modules, achieving an overall accuracy rate of 77.5%. The model applied logical reasoning in 98.1% of the questions, utilized internal information in 94.4%, and incorporated external information in 91.1%.
Conclusion
ChatGPT-4 performs satisfactorily on the French Board of Plastic, Reconstructive, and Aesthetic Surgery written examination. Its accuracy met the minimum passing standards for the exam. While responses generally align with expected knowledge, careful verification remains necessary, particularly for questions involving image interpretation. As artificial intelligence continues to evolve, ChatGPT-4 is expected to become an increasingly reliable tool for medical education. At present, it remains a valuable resource for assisting plastic surgery residents in their training.

Mixed reality versus manikins in basic life support simulation-based training for medical students in France: the mixed reality non-inferiority randomized controlled trial: Sofia Barlocco De La Vega, Evelyne Guerif-Dubreucq, Jebrane Bouaoud, Myriam Awad, Léonard Mathon, Agathe Beauvais, Thomas Olivier, Pierre-Clément Thiébaud, Anne-Laure Philippon; J Educ Eval Health Prof. 2025;22:15. Published online May 12, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.15

4,072 View
343 Download
2 Web of Science
3 Crossref

Purpose
To compare the effectiveness of mixed reality with traditional manikin-based simulation in basic life support (BLS) training, testing the hypothesis that mixed reality is non-inferior to manikin-based simulation.
Methods
A non-inferiority randomized controlled trial was conducted. Third-year medical students were randomized into 2 groups. The mixed reality group received 32 minutes of individual training using a virtual reality headset and a torso for chest compressions (CC). The manikin group participated in 2 hours of group training consisting of theoretical and practical sessions using a low-fidelity manikin. The primary outcome was the overall BLS performance score, assessed at 1 month through a standardized BLS scenario using a 10-item assessment scale. The quality of CC, student satisfaction, and confidence levels were secondary outcomes and assessed through superiority analyses.
Results
Data from 155 participants were analyzed, with 84 in the mixed reality group and 71 in the manikin group. The mean overall BLS performance score was 6.4 (mixed reality) vs. 6.5 (manikin), (mean difference, –0.1; 95% confidence interval [CI], –0.45 to +∞). CC depth was greater in the manikin group (50.3 mm vs. 46.6 mm; mean difference, –3.7 mm; 95% CI, –6.5 to –0.9), with 61.2% achieving optimal depth compared to 43.8% in the mixed reality group (mean difference, 17.4%; 95% CI, –29.3 to –5.5). Satisfaction was higher in the mixed reality group (4.9/5 vs. 4.7/5 in the manikin group; difference, 0.2; 95% CI, 0.07 to 0.33), as was confidence in performing BLS (3.9/5 vs. 3.6/5; difference, 0.3; 95% CI, 0.11 to 0.58). No other significant differences were observed for secondary outcomes.
Conclusion
Mixed reality is non-inferior to manikin simulation in terms of overall BLS performance score assessed at 1 month.

Citations

Citations to this article as recorded by

Enhancing virtual reality applications for adult basic life support: insights from a comparative analysis
Nino Fijačko, Benjamin S. Abella, Vinay M. Nadkarni, Špela Metličar, Anne-Astrid Agten, Robert Greif
Virtual Reality.2026;[Epub] CrossRef
Enhancing STEM and STEAM Education at the Grade Level Through Mixed Reality Applications: A Meta-analytical Study
Segun Michael Ojetunde, Umesh Ramnarain
Canadian Journal of Science, Mathematics and Technology Education.2026;[Epub] CrossRef
IMPACTOS DO USO DE SIMULAÇÃO IMERSIVA NA CAPACITAÇÃO EM ATENDIMENTO À PARADA CARDIORRESPIRATÓRIA
Iago Brenner Farias Leal, Izabelly Ferreira de Andrade, Yan Carlos de Sousa Diniz, Lara Maria Ferreira Lopes Valéri Pinto, Maria Helena Vieira Pereira Marques, Francisca Evelyn Abreu de Lira, Thaís Helena Gomes de Sousa, Maria Isabelly Araújo Ferreira, A
Revista Multidisciplinar do Nordeste Mineiro.2025; 16(1): 1. CrossRef

Development and evaluation of an elective course on the pharmacist’s role in disaster management in France: Marc Montana, Fanny Mathias, Pascal Rathelot, Jérôme Lacroix, Patrice Vanelle; J Educ Eval Health Prof. 2019;16:19. Published online July 15, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.19

15,999 View
201 Download
11 Web of Science
10 Crossref

Abstract PDF Supplementary Material

Purpose
To describe our experiences with the development of an elective course on the pharmacist’s role in disaster management for third-year pharmacy students and to evaluate its effects on students’ knowledge and their perceptions of the introduction of this course into the curriculum.
Methods
An expert team of physicians, surgeons, and pharmacists of the Service de Santé des Armées, pharmacists teaching at the Faculty of Pharmacy, and pharmacists from the Bataillon des Marins Pompiers de Marseille developed a program consisting of 30 hours of modules on disaster response training based on previously published recommendations, a literature analysis, and international guidelines. Students’ knowledge of key competencies was assessed after some teaching sessions through a multiple-choice quiz. Students’ self-perceived knowledge, perceptions of teaching quality, and degree of satisfaction were evaluated through a voluntary survey after the last teaching session on November 15.
Results
The final curriculum consisted of 6 modules. Students’ knowledge of key competencies was assessed using multiple-choice quizzes, with a mean score of 19 of 25. Almost all students (98.3%) reported that this training program improved their knowledge of the pharmacist’s role in disaster management, and 79.3% stated that they would recommend this optional course.
Conclusion
This training course demonstrated the potential to increase the number of pharmacists prepared to respond to disasters. It also expanded students’ understanding of the pharmacist’s role and stimulated their interest in emergency preparedness. Further refinement of the program, including a simulation of mass triage in an emergency setting, will be conducted next year.

Citations

Citations to this article as recorded by

Preparing pharmacists for disaster management and practice: A participatory scoping review
Emma Lydon, Shane Scahill, Naoko Arakawa, Anthony R. Cox, Carl R. Schneider, Sara M. Hanning
Currents in Pharmacy Teaching and Learning.2026; 18(1): 102482. CrossRef
Beyond the counter: Pharmacists’ preparedness and response strategies in terrorism-related emergencies in Quetta, Pakistan
Fahad Saleem, Fazal ur Rehman Khilji, Sajjad Haider, Qaiser Iqbal, Baharudin Ibrahim, Fatiha Hana Shabaruddin, Mohammad Bashaar, Ali Ahmed
PLOS One.2026; 21(2): e0342241. CrossRef
Monitoring and evaluation in disaster management courses: a scoping review
George Teo Voicescu, Hamdi Lamine, Andra Elena Loșonți, Eugenia Maria Lupan-Mureșan, Sonia Luka, José García Ulerio, Luca Ragazzoni, Francesco Della Corte, Marta Caviglia
BMC Medical Education.2025;[Epub] CrossRef
Spatial Decision Support for Determining Suitable Emergency Assembly Places Using GIS and MCDM Techniques
Ridvan Ertugrul Yildirim, Aziz Sisman
Sustainability.2025; 17(5): 2144. CrossRef
Impact of Nursing Clinical Elective Courses on New Graduate Nurses' Clinical Practice
Lisa S. Lewis, A. Michelle Hartman, Christina Leonard, Allen Cadavero, Staci S. Reynolds
Nurse Educator.2024; 49(3): 152. CrossRef
A Scoping Review of Pharmacists’ and Pharmacy Students’ Knowledge, Skills, and Attitudes in Medical Emergencies
Thalita Zago Oliveira, Clara Zambon de Rezende, Higor Weslley Cardoso, Sofia Fernandes Nascimento, João Paulo Alves Cunha, Carla Assad Lemos, Fabiana Rossi Varallo, Leonardo Régis Leira Pereira
American Journal of Pharmaceutical Education.2024; 88(1): 100606. CrossRef
How to Best Prepare Pharmacy Students for Disaster Management: A Qualitative Study
Chairun Wiedyaningsih, Akhmad Kharis Nugroho, Niken Nur Widyakusuma, Septimawanto Dwi Prasetyo
Disaster Medicine and Public Health Preparedness.2023;[Epub] CrossRef
Assessment of drug needs and contributions of pharmacists in the aftermath of the 2011 triple disaster in Fukushima, Japan: A combined analysis
Takanao Hashimoto, Akihiko Ozaki, Saori Nonaka, Yasuhiro Kotera, Toyoaki Sawano, Masaharu Tsubokura, Kitae Ito, Tomoyoshi Oikawa
International Journal of Disaster Risk Reduction.2023; 98: 104102. CrossRef
Experience of pharmacy involvement in a disaster simulation exercise within a pediatric hospital emergency department: A pilot project
Kayla Marks, Sarita Chung, Joyce Li, Mark Waltzman, Shannon Manzi, Dhara Shah
American Journal of Health-System Pharmacy.2022; 79(9): e124. CrossRef
Evaluation of Disaster Medicine Preparedness among Healthcare Profession Students: A Cross-Sectional Study in Pakistan
Ali Hassan Gillani, Mohamed Izham Mohamed Ibrahim, Jamshaid Akbar, Yu Fang
International Journal of Environmental Research and Public Health.2020; 17(6): 2027. CrossRef

First
Prev
Page of 1
Next
Last

Search