Journal of Educational Evaluation for Health Professions

Research article

Short-term knowledge gains and learner satisfaction after a basic radiology course for family medicine residents in a 3-dimensional virtual environment: a multi-cohort pretest–posttest study in Spain: Alberto Pino-Postigo, Rocio Lorenzo-Alvarez, Dolores Dominguez-Pinos, Eugenio Lázaro Navarro-Sanchis, Eduardo Ochando-Pulido, Miguel Jose-Ruiz Gomez, Francisco Sendra-Portero; J Educ Eval Health Prof. 2026;23:25. Published online August 7, 2026; DOI: https://doi.org/10.3352/jeehp.2026.23.25 [Epub ahead of print]

85 View
15 Download

Abstract PDF: Purpose
This study aimed to evaluate a structured basic radiology course for Family Medicine residents delivered in a 3-dimensional (3D) virtual environment (Second Life). We hypothesized that participation would be associated with higher post-course knowledge test scores and high learner satisfaction.
Methods
A quasi-experimental multi-cohort pretest–posttest study was conducted across 3 consecutive cohorts of Family Medicine residents in Spain in 2019. Ninety-six participants engaged in a 15-day course combining synchronous and asynchronous activities. Sixty-five participants provided paired pre- and post-intervention knowledge assessments, which were analyzed using paired t-tests. Learner satisfaction was evaluated using a structured questionnaire with Likert-scale items, numerical ratings (0–10), and open-ended responses. Pre- and post-test scores and ratings were compared using paired t-tests, and Mann-Whitney U tests were used for Likert-scale data. Qualitative data from open-ended responses were analyzed using thematic coding.
Results
Participants had significantly higher post-course knowledge test scores, increasing from 47.4±11.6 to 58.2±11.9 (mean difference, 10.8; P<0.001; paired-sample Cohen’s d [dz]=0.67). High agreement was observed across most satisfaction items, with median scores ranging from 4 to 5. Content relevance, usefulness for clinical practice, and instructor performance received the highest ratings. Lower scores were observed for peer interaction and platform usability.
Conclusion
A structured radiology course delivered in a 3D virtual environment was associated with higher immediate post-course knowledge test scores and high learner satisfaction among Family Medicine residents. The findings support the feasibility of repeated course delivery, although controlled studies are warranted.

Educational/Faculty development material

Radiotorax.es: a web-based tool for formative self-assessment in chest X-ray interpretation: Verónica Illescas-Megías, Jorge Manuel Maqueda-Pérez, Dolores Domínguez-Pinos, Teodoro Rudolphi Solero, Francisco Sendra-Portero; J Educ Eval Health Prof. 2025;22:17. Published online June 9, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.17

7,789 View
2,147,483,865 Download

Abstract PDF Supplementary Material: Radiotorax.es is a free, non-profit web-based tool designed to support formative self-assessment in chest X-ray interpretation. This article presents its structure, educational applications, and usage data from 11 years of continuous operation. Users complete interpretation rounds of 20 clinical cases, compare their reports with expert evaluations, and conduct a structured self-assessment. From 2011 to 2022, 14,389 users registered, and 7,726 completed at least one session. Most were medical students (75.8%), followed by residents (15.2%) and practicing physicians (9.0%). The platform has been integrated into undergraduate medical curricula and used in various educational contexts, including tutorials, peer and expert review, and longitudinal tracking. Its flexible design supports self-directed learning, instructor-guided use, and multicenter research. As a freely accessible resource based on real clinical cases, Radiotorax.es provides a scalable, realistic, and well-received training environment that promotes diagnostic skill development, reflection, and educational innovation in radiology education.

Research article

Evaluation of a virtual objective structured clinical examination in the metaverse (Second Life) to assess the clinical skills in emergency radiology of medical students in Spain: a cross-sectional study: Alba Virtudes Perez-Baena, Teodoro Rudolphi-Solero, Rocio Lorenzo-Alvarez, Dolores Dominguez-Pinos, Miguel Jose Ruiz-Gomez, Francisco Sendra-Portero; J Educ Eval Health Prof. 2025;22:12. Published online April 21, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.12

6,507 View
2,147,483,941 Download
3 Web of Science
5 Crossref

Abstract PDF Supplementary Material

Purpose
The objective structured clinical examination (OSCE) is an effective but resource-intensive tool for assessing clinical competence. This study hypothesized that implementing a virtual OSCE in the Second Life (SL) platform in the metaverse as a cost-effective alternative will effectively assess and enhance clinical skills in emergency radiology while being feasible and well-received. The aim was to evaluate a virtual radiology OSCE in SL as a formative assessment, focusing on feasibility, educational impact, and students’ perceptions.
Methods
Two virtual 6-station OSCE rooms dedicated to emergency radiology were developed in SL. Sixth-year medical students completed the OSCE during a 1-hour session in 2022–2023, followed by feedback including a correction checklist, individual scores, and group comparisons. Students completed a questionnaire with Likert-scale questions, a 10-point rating, and open-ended comments. Quantitative data were analyzed using the Student t-test and the Mann-Whitney U test, and qualitative data through thematic analysis.
Results
In total, 163 students participated, achieving mean scores of 5.1±1.4 and 4.9±1.3 (out of 10) in the 2 virtual OSCE rooms, respectively (P=0.287). One hundred seventeen students evaluated the OSCE, praising the teaching staff (9.3±1.0), project organization (8.8±1.2), OSCE environment (8.7±1.5), training usefulness (8.6±1.5), and formative self-assessment (8.5±1.4). Likert-scale questions and students’ open-ended comments highlighted the virtual environment’s attractiveness, case selection, self-evaluation usefulness, project excellence, and training impact. Technical difficulties were reported by 13 students (8%).
Conclusion
This study demonstrated the feasibility of incorporating formative OSCEs in SL as a useful teaching tool for undergraduate radiology education, which was cost-effective and highly valued by students.

Citations

Citations to this article as recorded by

Effectiveness of VR and traditional training in medical education for mass casualty management: an OSCE-based randomized controlled trial
Zhe Li, Wan Chen, Guozheng Qiu, Lei Shi, Yutao Tang, Xibin Xu, Sanshan Zhu, Liwen Lyu
BMC Medical Education.2026;[Epub] CrossRef
ECOE virtual de radiología en el metaverso Second Life®: comparación de estudiantes de tercer y sexto curso
Francisco Sendra-Portero, Alba Virtudes Pérez-Baena, Teodoro Rudolphi-Solero, Rocío Lorenzo-Álvarez, Dolores Domínguez-Pinos, Miguel José Ruiz-Gómez
Educación Médica.2026; 27(3): 101167. CrossRef
A roadmap to implement Metaverse in education field based on ADDIE model: A systematic review
Yu Shi, Wei Wei Goh, N.Z. Jhanjhi
Computers and Education Open.2026; 10: 100365. CrossRef
Metaverse-based objective structured clinical examinations: an exploratory approach to advancing clinical competency assessment
Yeon-Ju Huh, Joon Sung Shin, Narae Yoon, Ju Whi Kim, Do Hoon Kim, Chanwoong Kim, Seoi Jeong, Yejin Yoon, Soyeon Shin, Hyoun-Joong Kong, Sun Jung Myung
Korean Journal of Medical Education.2026; 38(2): 139. CrossRef
An AI‐Driven H5P Training for Epilepsy Emergency Management Preparedness in Dental Education
İlkem Gökçe, Özlem Sürel Karabilgin Öztürkçü, Ozan Karaca, Cihan Varol, Mukadder İnci Başer Kolcu
European Journal of Dental Education.2026;[Epub] CrossRef

First
Prev
Page of 1
Next
Last

Search