Research article
-
Students’ performance of and perspective on an objective structured practical examination for the assessment of preclinical and practical skills in biomedical laboratory science students in Sweden: a 5-year longitudinal study
-
Catharina Hultgren
, Annica Lindkvist
, Sophie Curbo
, Maura Heverin
-
J Educ Eval Health Prof. 2023;20:13. Published online April 6, 2023
-
DOI: https://doi.org/10.3352/jeehp.2023.20.13
-
-
Abstract
PDF
Supplementary Material
- Purpose
It aims to find students’ performance of and perspectives on an objective structured practical examination (OSPE) for assessment of laboratory and preclinical skills in biomedical laboratory science (BLS). It also aims to investigate the perception, acceptability, and usefulness of OSPE from the students’ and examiners’ point of view.
Methods
This was a longitudinal study to implement an OSPE in BLS. The student group consisted of 198 BLS students enrolled in semester 4, 2015–2019 at Karolinska University Hospital Huddinge, Sweden. Fourteen teachers evaluated the performance by completing a checklist and global rating scales. A student survey questionnaire was administered to the participants to evaluate the student perspective. To assess quality, 4 independent observers were included to monitor the examiners.
Results
Almost 50% of the students passed the initial OSPE. During the repeat OSPE, 73% of the students passed the OSPE. There was a statistically significant difference between the first and the second repeat OSPE (P<0.01) but not between the first and the third attempt (P=0.09). The student survey questionnaire was completed by 99 of the 198 students (50%) and only 63 students responded to the free-text questions (32%). According to these responses, some stations were perceived as more difficult, albeit they considered the assessment to be valid. The observers found the assessment protocols and examiner’s instructions assured the objectivity of the examination.
Conclusion
The introduction of an OSPE in the education of biomedical laboratory scientists was a reliable, and useful examination of practical skills.
Review
-
Factors associated with medical students’ scores on the National Licensing Exam in Peru: a systematic review
-
Javier Alejandro Flores-Cohaila
-
J Educ Eval Health Prof. 2022;19:38. Published online December 29, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.38
-
-
Abstract
PDF
Supplementary Material
- Purpose
This study aimed to identify factors that have been studied for their associations with National Licensing Examination (ENAM) scores in Peru.
Methods
A search was conducted of literature databases and registers, including EMBASE, SciELO, Web of Science, MEDLINE, Peru’s National Register of Research Work, and Google Scholar. The following key terms were used: “ENAM” and “associated factors.” Studies in English and Spanish were included. The quality of the included studies was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).
Results
In total, 38,500 participants were enrolled in 12 studies. Most (11/12) studies were cross-sectional, except for one case-control study. Three studies were published in peer-reviewed journals. The mean MERSQI was 10.33. A better performance on the ENAM was associated with a higher-grade point average (GPA) (n=8), internship setting in EsSalud (n=4), and regular academic status (n=3). Other factors showed associations in various studies, such as medical school, internship setting, age, gender, socioeconomic status, simulations test, study resources, preparation time, learning styles, study techniques, test-anxiety, and self-regulated learning strategies.
Conclusion
The ENAM is a multifactorial phenomenon; our model gives students a locus of control on what they can do to improve their score (i.e., implement self-regulated learning strategies) and faculty, health policymakers, and managers a framework to improve the ENAM score (i.e., design remediation programs to improve GPA and integrate anxiety-management courses into the curriculum).
Educational/Faculty development material
-
Common models and approaches for the clinical educator to plan effective feedback encounters
-
Cesar Orsini
, Veena Rodrigues
, Jorge Tricio
, Margarita Rosel
-
J Educ Eval Health Prof. 2022;19:35. Published online December 19, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.35
-
-
Abstract
PDF
Supplementary Material
- Giving constructive feedback is crucial for learners to bridge the gap between their current performance and the desired standards of competence. Giving effective feedback is a skill that can be learned, practiced, and improved. Therefore, our aim was to explore models in clinical settings and assess their transferability to different clinical feedback encounters. We identified the 6 most common and accepted feedback models, including the Feedback Sandwich, the Pendleton Rules, the One-Minute Preceptor, the SET-GO model, the R2C2 (Rapport/Reaction/Content/Coach), and the ALOBA (Agenda Led Outcome-based Analysis) model. We present a handy resource describing their structure, strengths and weaknesses, requirements for educators and learners, and suitable feedback encounters for use for each model. These feedback models represent practical frameworks for educators to adopt but also to adapt to their preferred style, combining and modifying them if necessary to suit their needs and context.
Research articles
-
Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study
-
Do-Hwan Kim
, Ye Ji Kang
, Hoon-Ki Park
-
J Educ Eval Health Prof. 2022;19:33. Published online December 12, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.33
-
-
467
View
-
74
Download
-
1
Citations
-
Abstract
PDF
Supplementary Material
- Purpose
This study aims to apply the yes/no Angoff and Hofstee methods to actual Korean Medical Licensing Examination (KMLE) 2022 written examination data to estimate cut scores for the written KMLE.
Methods
Fourteen panelists gathered to derive the cut score of the 86th KMLE written examination data using the yes/no Angoff method. The panel reviewed the items individually before the meeting and shared their respective understanding of the minimum-competency physician. The standard setting process was conducted in 5 rounds over a total of 800 minutes. In addition, 2 rounds of the Hofstee method were conducted before starting the standard setting process and after the second round of yes/no Angoff.
Results
For yes/no Angoff, as each round progressed, the panel’s opinion gradually converged to a cut score of 198 points, and the final passing rate was 95.1%. The Hofstee cut score was 208 points out of a maximum 320 with a passing rate of 92.1% at the first round. It scored 204 points with a passing rate of 93.3% in the second round.
Conclusion
The difference between the cut scores obtained through yes/no Angoff and Hofstee methods did not exceed 2% points, and they were within the range of cut scores from previous studies. In both methods, the difference between the panelists decreased as rounds were repeated. Overall, our findings suggest the acceptability of cut scores and the possibility of independent use of both methods.
-
Citations
Citations to this article as recorded by

- Issues in the 3rd year of the COVID-19 pandemic, including computer-based testing, study design, ChatGPT, journal metrics, and appreciation to reviewers
Sun Huh
Journal of Educational Evaluation for Health Professions.2023; 20: 5. CrossRef
-
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
-
Ying-Ying Yang
, Pin-Hsiang Huang
, Ling-Yu Yang
, Chia-Chang Huang
, Chih-Wei Liu
, Shiau-Shian Huang
, Chen-Huan Chen
, Fa-Yauh Lee
, Shou-Yen Kao
, Boaz Shulruf
-
J Educ Eval Health Prof. 2022;19:27. Published online October 17, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.27
-
-
Abstract
PDF
Supplementary Material
- Purpose
Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method.
Methods
The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station.
Results
On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts.
Conclusion
The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.
-
Is it possible to introduce an interview to the Korean Medical Licensing Examination to assess professional attributes?: a survey-based observational study
-
Seung-Joo Na
, HyeRin Roh
, Kyung Hee Chun
, Kyung Hye Park
, Do-Hwan Kim
-
J Educ Eval Health Prof. 2022;19:10. Published online May 10, 2022
-
DOI: https://doi.org/10.3352/jeehp.2022.19.10
-
-
Abstract
PDF
Supplementary Material
- Purpose
This study aimsed to gather opinions from medical educators on the possibility of introducing an interview to the Korean Medical Licensing Examination (KMLE) to assess professional attributes. Specifically following topics were dealt with: the appropriate timing and tool to assess unprofessional conduct; ; the possiblity of prevention of unprofessional conduct by introducing an interview to the KMLE; and the possibility of implementation of an interview to the KMLE.
Methods
A cross-sectional study approach based on a survey questionnaire was adopted. We analyzed 104 pieces of news about doctors’ unprofessional conduct to determine the deficient professional attributes. We derived 24 items of unprofessional conduct and developed the questionnaire and surveyed 250 members of the Korean Society of Medical Education 2 times. Descriptive statistics, cross-tabulation analysis, and Fisher’s exact test were applied to the responses. The answers to the open-ended questions were analyzed using conventional content analysis.
Results
In the survey, 49 members (19.6%) responded. Out of 49, 24 (49.5%) responded in the 2nd survey. To assess unprofessional conduct, there was no dominant timing among basic medical education (BME), KMLE, and continuing professional development (CPD). There was no overwhelming assessment tool among written examination, objective structured clinical examination, practice observation, and interview. Response rates of “impossible” (49.0%) and “possible” (42.9%) suggested an interview of the KMLE prevented unprofessional conduct. In terms of implementation, “impossible” (50.0%) was selected more often than “possible” (33.3%).
Conclusion
Professional attributes should be assessed by various tools over the period from BME to CPD. Hence, it may be impossible to introduce an interview to assess professional attributes to the KMLE, and a system is needed such as self-regulation by the professional body rather than licensing examination.
Review
-
Educational applications of metaverse: possibilities and limitations
-
Bokyung Kye
, Nara Han
, Eunji Kim
, Yeonjeong Park
, Soyoung Jo
-
J Educ Eval Health Prof. 2021;18:32. Published online December 13, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.32
-
-
23,377
View
-
2,111
Download
-
104
Citations
-
Abstract
PDF
Supplementary Material
- This review aims to define the 4 types of the metaverse and to explain the potential and limitations of its educational applications. The metaverse roadmap categorizes the metaverse into 4 types: augmented reality, lifelogging, mirror world, and virtual reality. An example of the application of augmented reality in medical education would be an augmented reality T-shirt that allows students to examine the inside of the human body as an anatomy lab. Furthermore, a research team in a hospital in Seoul developed a spinal surgery platform that applied augmented reality technology. The potential of the metaverse as a new educational environment is suggested to be as follows: a space for new social communication; a higher degree of freedom to create and share; and the provision of new experiences and high immersion through virtualization. Some of its limitations may be weaker social connections and the possibility of privacy impingement; the commission of various crimes due to the virtual space and anonymity of the metaverse; and maladaptation to the real world for students whose identity has not been established. The metaverse is predicted to change our daily life and economy beyond the realm of games and entertainment. The metaverse has infinite potential as a new social communication space. The following future tasks are suggested for the educational use of the metaverse: first, teachers should carefully analyze how students understand the metaverse; second, teachers should design classes for students to solve problems or perform projects cooperatively and creatively; third, educational metaverse platforms should be developed that prevent misuse of student data.
-
Citations
Citations to this article as recorded by

- A scoping review of metaverse in emergency medicine
Tzu-Chi Wu, Chien-Ta Bruce Ho
Australasian Emergency Care.2023; 26(1): 75. CrossRef - A new universe in Dermatology: From metaverse to Dermoverse
Miriam Fernández‐Parrado, Héctor Perandones‐González
Journal of the European Academy of Dermatology and Venereology.2023;[Epub] CrossRef - Who really needs a Metaverse in anatomy education? A review with preliminary survey results
Joe Iwanaga, Edward C. Muo, Yoko Tabira, Koichi Watanabe, Susan J. Tubbs, Anthony V. D'Antoni, Mathangi Rajaram‐Gilkes, Marios Loukas, Mohammed K. Khalil, R. Shane Tubbs
Clinical Anatomy.2023; 36(1): 77. CrossRef - Social rather than physical crowding reduces the required interpersonal distance in virtual environments
Ming Han, Xue‐Min Wang, Shu‐Guang Kuai
PsyCh Journal.2023; 12(1): 34. CrossRef - Blockchain‐based asset storage and service mechanism to metaverse universe: Metarepo
Mevlüt Ersoy, Remzi Gürfidan
Transactions on Emerging Telecommunications Technologies.2023;[Epub] CrossRef - A Bodies‐On Museum: The Transformation of Museum Embodiment through Virtual Technology
Siyi Wang
Curator: The Museum Journal.2023; 66(1): 107. CrossRef - A trustless architecture of blockchain-enabled metaverse
Minghui Xu, Yihao Guo, Qin Hu, Zehui Xiong, Dongxiao Yu, Xiuzhen Cheng
High-Confidence Computing.2023; 3(1): 100088. CrossRef - Facing the challenges of metaverse: a systematic literature review from Social Sciences and Marketing and Communication
Verónica Crespo-Pereira, Eva Sánchez-Amboage, Matías Membiela-Pollán
El Profesional de la información.2023;[Epub] CrossRef - Utilizing the metaverse in anatomy and physiology
Christian Moro
Anatomical Sciences Education.2023;[Epub] CrossRef - A systematic review on the metaverse-based blended English learning
Ming Li, Zhonggen Yu
Frontiers in Psychology.2023;[Epub] CrossRef - The Medical Metaverse, Part 1: Introduction, Definitions, and New Horizons for Neuropsychiatry
Wilfredo López-Ojeda, Robin A. Hurley
The Journal of Neuropsychiatry and Clinical Neurosciences.2023; 35(1): A4. CrossRef - DİJİTAL OYUNLARIN GELECEĞİNDE METAVERSE ETKİSİ
Mevlüt Hürol METE
TRT Akademi.2023;[Epub] CrossRef - The Use of Virtual Worlds in the Field of Education: A Bibliometric Study
Ali BATTAL, Abdulkadir TAŞDELEN
Participatory Educational Research.2023; 10(1): 408. CrossRef - Metaverse in Healthcare Integrated with Explainable AI and Blockchain: Enabling Immersiveness, Ensuring Trust, and Providing Patient Data Security
Sikandar Ali, Abdullah, Tagne Poupi Theodore Armand, Ali Athar, Ali Hussain, Maisam Ali, Muhammad Yaseen, Moon-Il Joo, Hee-Cheol Kim
Sensors.2023; 23(2): 565. CrossRef - Metaverse: A Potential Virtual-Physical Ecosystem for Innovative Blended Education and Training
Susanta MİTRA
Journal of Metaverse.2023;[Epub] CrossRef - A Second Life for Educators: A Hybrid Extended Reality Education Between Zuckerberg’s Vision and Educational Researchers’ Imaginary
Mandi Lİ
Journal of Metaverse.2023;[Epub] CrossRef - Security and Privacy in Metaverse: A Comprehensive Survey
Yan Huang, Yi Joy Li, Zhipeng Cai
Big Data Mining and Analytics.2023; 6(2): 234. CrossRef - Envisioning Architecture of Metaverse Intensive Learning Experience (MiLEx): Career Readiness in the 21st Century and Collective Intelligence Development Scenario
Eman AbuKhousa, Mohamed Sami El-Tahawy, Yacine Atif
Future Internet.2023; 15(2): 53. CrossRef - Training Scientific Communication Skills on Medical Imaging within the Virtual World Second Life: Perception of Biomedical Engineering Students
Andrés Lozano-Durán, Teodoro Rudolphi-Solero, Enrique Nava-Baro, Miguel José Ruiz-Gómez, Francisco Sendra-Portero
International Journal of Environmental Research and Public Health.2023; 20(3): 1697. CrossRef - An Empirical Study of A Smart Education Model Enabled by the Edu-Metaverse to Enhance Better Learning Outcomes for Students
Xiaoyang Shu, Xiaoqing Gu
Systems.2023; 11(2): 75. CrossRef - Conception of metaverse training room for cardiovascular interventional surgery
Tai-Cheng Liu, Ai-Shi Liu, Zhi-Gang Bai, Lei Zhao
Asian Journal of Surgery.2023;[Epub] CrossRef - Metaverse!
E. Syed Mohamed, Tawseef Ahmad Naqishbandi, Guido Veronese
International Journal of E-Adoption.2023; 15(2): 1. CrossRef - How do Plastic Surgeons use the Metaverse: A Systematic Review
Pengfei Sun, Shanbaga Zhao, Yang Yang, Chao Liu, Bo Pan
Journal of Craniofacial Surgery.2023; 34(2): 548. CrossRef - Metaverse as a Learning Environment: Some Considerations
Maria José Sá, Sandro Serpa
Sustainability.2023; 15(3): 2186. CrossRef - BEDEN EĞİTİMİ ÖĞRETMENLERİNİN METAVERSE BİLGİ DÜZEYLERİNİN ÇEŞİTLİ DEĞİŞKENLERE GÖRE İNCELENMESİ
Murat TURAN, Muhammet MAVİBAŞ, Buğra Çağatay SAVAŞ, Harun ÇETİN
The Online Journal of Recreation and Sports.2023; 12(1): 25. CrossRef - Time to Think “Meta”: A Critical Viewpoint on the Risks and Benefits of Virtual Worlds for Mental Health
Vincent Paquin, Manuela Ferrari, Harmehr Sekhon, Soham Rej
JMIR Serious Games.2023; 11: e43388. CrossRef - Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse
Juan M. Román-Belmonte, E. Carlos Rodríguez-Merchán, Hortensia De la Corte-Rodríguez
Postgraduate Medicine.2023; : 1. CrossRef - Metaverse for Healthcare: A Survey on Potential Applications, Challenges and Future Directions
Rajeswari Chengoden, Nancy Victor, Thien Huynh-The, Gokul Yenduri, Rutvij H. Jhaveri, Mamoun Alazab, Sweta Bhattacharya, Pawan Hegde, Praveen Kumar Reddy Maddikunta, Thippa Reddy Gadekallu
IEEE Access.2023; 11: 12765. CrossRef - The rising trend of Metaverse in education: challenges, opportunities, and ethical considerations
Sanaa Kaddoura, Fatima Al Husseiny
PeerJ Computer Science.2023; 9: e1252. CrossRef - When Internet of Things Meets Metaverse: Convergence of Physical and Cyber Worlds
Kai Li, Yingping Cui, Weicai Li, Tiejun Lv, Xin Yuan, Shenghong Li, Wei Ni, Meryem Simsek, Falko Dressler
IEEE Internet of Things Journal.2023; 10(5): 4148. CrossRef - Emergence of the metaverse and ChatGPT in journal publishing after the COVID-19 pandemic
Sun Huh
Science Editing.2023; 10(1): 1. CrossRef - Improving Oral Presentation Skills for Radiology Residents through Clinical Session Meetings in the Virtual World Second Life
Alberto Pino-Postigo, Dolores Domínguez-Pinos, Rocío Lorenzo-Alvarez, José Pavía-Molina, Miguel J. Ruiz-Gómez, Francisco Sendra-Portero
International Journal of Environmental Research and Public Health.2023; 20(6): 4738. CrossRef - Metaverse Çağında Öğretmenlik Mesleğinin Geleceğini Düşünmek
Zeynep KAYA
Mevzu – Sosyal Bilimler Dergisi.2023;[Epub] CrossRef - Virtual neurosurgery anatomy laboratory: A collaborative and remote education experience in the metaverse
Nicolas I. Gonzalez-Romo, Giancarlo Mignucci-Jiménez, Sahin Hanalioglu, Muhammet Enes Gurses, Siyar Bahadir, Yuan Xu, Grant Koskay, Michael T. Lawton, Mark C. Preul
Surgical Neurology International.2023; 14: 90. CrossRef - Metaverse for climbing the ladder toward ‘Industry 5.0’ and ‘Society 5.0’?
Ahmed Tlili, Ronghuai Huang, Kinshuk
The Service Industries Journal.2023; 43(3-4): 260. CrossRef - NeuroVerse: neurosurgery in the era of Metaverse and other technological breakthroughs
Mrinmoy Kundu, Jyi Cheng Ng, Wireko Andrew Awuah, Helen Huang, Rohan Yarlagadda, Aashna Mehta, Esther Patience Nansubuga, Riaz Jiffry, Toufik Abdul-Rahman, Brian M Ou Yong, Vladyslav Sikora, Arda Isik
Postgraduate Medical Journal.2023;[Epub] CrossRef - Future of virtual education and telementoring
Ian Seddon, Eric Rosenberg, Steve K. Houston
Current Opinion in Ophthalmology.2023; 34(3): 255. CrossRef - Improving Humanization through Metaverse-Related Technologies: A Systematic Review
Maria Gonzalez-Moreno, Paula Andrade-Pino, Carlos Monfort-Vinuesa, Antonio Piñas-Mesa, Esther Rincon
Electronics.2023; 12(7): 1727. CrossRef - Exploring problem-based learning curricula in the metaverse: The hospitality students' perspective
Namhee Lee, Mina Jo
Journal of Hospitality, Leisure, Sport & Tourism Education.2023; 32: 100427. CrossRef - Considering the Consequences of Cybersickness in Immersive Virtual Reality Rehabilitation: A Systematic Review and Meta-Analysis
Xin Li, Ding-Bang Luh, Ruo-Hui Xu, Yi An
Applied Sciences.2023; 13(8): 5159. CrossRef - Beyond Your Sight Using Metaverse Immersive Vision With Technology Behaviour Model
Poh Soon JosephNg, Xiaoxue Gong, Narinderjit Singh, Toong Hai Sam, Hua Liu, Koo Yuen Phan
Journal of Cases on Information Technology.2023; 25(1): 1. CrossRef - Students’ Perception of Metaverses for Online Learning in Higher Education: Hype or Hope?
Elisa Rojas, Xenia Hülsmann, Rosa Estriegana, Frank Rückert, Soraya Garcia-Esteban
Electronics.2023; 12(8): 1867. CrossRef - Current Perspective of Metaverse Application in Medical Education, Research and Patient Care
Irene Suh, Tess McKinney, Ka-Chun Siu
Virtual Worlds.2023; 2(2): 115. CrossRef - Metaverse for education – Virtual or real?
Sajjad Hussain
Frontiers in Education.2023;[Epub] CrossRef - A Bibliometric Analysis of the Use of the Metaverse in Education Over Three Decades
Wentao Chen, Jinyu Zhang, Zhonggen Yu
International Journal of Information and Communication Technology Education.2023; 19(1): 1. CrossRef - Exploring the Potential of Metaverse for Higher Education: Opportunities, Challenges, and Implications
Amrita Prakash, Alimul Haque, Farheen Islam, Deepa Sonal
Metaverse Basic and Applied Research.2023;[Epub] CrossRef - Immersive time (ImT): Conceptualizing time spent in the metaverse
Emmanuel Mogaji, Jochen Wirtz, Russell W. Belk, Yogesh K. Dwivedi
International Journal of Information Management.2023; 72: 102659. CrossRef - Effects of metaverse-based career mentoring for nursing students: a mixed methods study
Yujeong Kim, Mi Young Kim
BMC Nursing.2023;[Epub] CrossRef - Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef - The Metaverse—An Alternative Education Space
Sharon Mistretta
AI, Computer Science and Robotics Technology.2022; 2022: 1. CrossRef - The Metaverse in Cardiovascular Medicine: Applications, Challenges, and the Role of Non-Fungible Tokens
Ioannis Skalidis, Olivier Muller, Stephane Fournier
Canadian Journal of Cardiology.2022; 38(9): 1467. CrossRef - UTAUT in Metaverse: An “Ifland” Case
Un-Kon Lee, Hyekyung Kim
Journal of Theoretical and Applied Electronic Commerce Research.2022; 17(2): 613. CrossRef - Sağlık Hizmetlerinin Geleceğinde Metaverse Ekosistemi ve Teknolojileri: Uygulamalar, Fırsatlar ve Zorluklar
Faruk YILMAZ, Anı Hande METE, Buse FİDAN TÜRKÖN, Özgür İNCE
Eurasian Journal of Health Technology Assessment.2022;[Epub] CrossRef - Role of Technology in Medical Education: SWOC Analysis
Shruti Jha
SBV Journal of Basic, Clinical and Applied Health Science.2022; 5(1): 19. CrossRef - CardioVerse: The cardiovascular medicine in the era of Metaverse
Ioannis Skalidis, Olivier Muller, Stephane Fournier
Trends in Cardiovascular Medicine.2022;[Epub] CrossRef - Definition, roles, and potential research issues of the metaverse in education: An artificial intelligence perspective
Gwo-Jen Hwang, Shu-Yun Chien
Computers and Education: Artificial Intelligence.2022; 3: 100082. CrossRef - METAVERSE IN THE CONTEXT OF EDUCATION
Ahmet GÖÇEN
Uluslararası Batı Karadeniz Sosyal ve Beşeri Bilimler Dergisi.2022;[Epub] CrossRef - METAVERSE VE SAĞLIK HİZMETLERİ ÜZERİNE BİR DEĞERLENDİRME
Ferhat Onur AĞAOĞLU, Lokman Onur EKİNCİ, Nurperihan TOSUN
Erzincan Binali Yıldırım Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi.2022;[Epub] CrossRef - Is Metaverse in education a blessing or a curse: a combined content and bibliometric analysis
Ahmed Tlili, Ronghuai Huang, Boulus Shehata, Dejian Liu, Jialu Zhao, Ahmed Hosny Saleh Metwally, Huanhuan Wang, Mouna Denden, Aras Bozkurt, Lik-Hang Lee, Dogus Beyoglu, Fahriye Altinay, Ramesh C. Sharma, Zehra Altinay, Zhisheng Li, Jiahao Liu, Faizan Ahma
Smart Learning Environments.2022;[Epub] CrossRef - CardioVerse: Buying the stairway to heaven
Antonio Sánchez-Puente, P. Ignacio Dorado-Díaz, Pedro L Sánchez
Trends in Cardiovascular Medicine.2022;[Epub] CrossRef - The Metaverse as a Virtual Form of Smart Cities: Opportunities and Challenges for Environmental, Economic, and Social Sustainability in Urban Futures
Zaheer Allam, Ayyoob Sharifi, Simon Elias Bibri, David Sydney Jones, John Krogstie
Smart Cities.2022; 5(3): 771. CrossRef - Metaverse phenomenon and its impact on health: A scoping review
Ali Garavand, Nasim Aslani
Informatics in Medicine Unlocked.2022; 32: 101029. CrossRef - A novel brain-controlled wheelchair combined with computer vision and augmented reality
Kaixuan Liu, Yang Yu, Yadong Liu, Jingsheng Tang, Xinbin Liang, Xingxing Chu, Zongtan Zhou
BioMedical Engineering OnLine.2022;[Epub] CrossRef - The Effectiveness of Serious Games in Improving Memory Among Older Adults With Cognitive Impairment: Systematic Review and Meta-analysis
Alaa Abd-alrazaq, Dari Alhuwail, Eiman Al-Jafar, Arfan Ahmed, Farag Shuweihdi, Shuja Mohd Reagu, Mowafa Househ
JMIR Serious Games.2022; 10(3): e35202. CrossRef - Evolution of Medical Conferences for Congenital Heart Disease Imagers in the Era of COVID-19: From Onsite to Virtual Meetings
I-Chen Tsai, Hyun Woo Goo, Haifa Abdul Latiff, Seon Young Goo, Sang Joon Park
Cardiovascular Imaging Asia.2022; 6(3): 82. CrossRef - Future era of techno-economic analysis: Insights from review
Slyvester Yew Wang Chai, Frederick Jit Fook Phang, Lip Siang Yeo, Lock Hei Ngu, Bing Shen How
Frontiers in Sustainability.2022;[Epub] CrossRef - Gastroenterology in the Metaverse: The dawn of a new era?
Chi Zhang, Shuyan Feng, Ruonan He, Yi Fang, Shuo Zhang
Frontiers in Medicine.2022;[Epub] CrossRef - Into the Metaverse – Perspectives on a New Reality
Tariq Rahaman
Medical Reference Services Quarterly.2022; 41(3): 330. CrossRef - Factors Affecting Learners’ Adoption of an Educational Metaverse Platform: An Empirical Study Based on an Extended UTAUT Model
Zhuoqi Teng, Yan Cai, Yu Gao, Xiying Zhang, Xinlong Li, Jungmin Shin
Mobile Information Systems.2022; 2022: 1. CrossRef - Virtual reality techniques for trauma education
Micha Holla, Maarten van den Berg
Injury.2022; 53: S64. CrossRef - The Metaverse: A New Challenge for the Healthcare System: A Scoping Review
Luca Petrigna, Giuseppe Musumeci
Journal of Functional Morphology and Kinesiology.2022; 7(3): 63. CrossRef - A Study on Analyzing Teachers' Perception and Needs of Using Metaverse in Elementary Online Learning Environment
Hyeongjong Han, Sumin Hong
Journal of Digital Contents Society.2022; 23(8): 1383. CrossRef - Athlete experiences of communication strategies in applied sports nutrition and future considerations for mobile app supportive solutions
David Mark Dunne, Carmen Lefevre-Lewis, Brian Cunniffe, Samuel George Impey, David Tod, Graeme Leonard Close, James P. Morton, Rebecca Murphy
Frontiers in Sports and Active Living.2022;[Epub] CrossRef - Use of The World of Metaverse in Education and Its Reflections on Accounting Education
Işık ALTUNAL
Selçuk Üniversitesi Sosyal Bilimler Meslek Yüksekokulu Dergisi.2022;[Epub] CrossRef - Exploration of Educational Possibilities by Four Metaverse Types in Physical Education
Ji-Eun Yu
Technologies.2022; 10(5): 104. CrossRef - The metaverse in education: Definition, framework, features, potential applications, challenges, and future research topics
Xinli Zhang, Yuchen Chen, Lailin Hu, Youmei Wang
Frontiers in Psychology.2022;[Epub] CrossRef - The adoption of the metaverse concepts in Romania
Cătălina Chinie, Marian Oancea, Steluta Todea
Management & Marketing. Challenges for the Knowledge Society.2022; 17(3): 328. CrossRef - Exploring the application scenarios and issues facing Metaverse technology in education
Zhisheng Chen
Interactive Learning Environments.2022; : 1. CrossRef - Public interest in the digital transformation accelerated by the COVID-19 pandemic and perception of its future impact
Joo-Young Park, Kangsun Lee, Doo Ryeon Chung
The Korean Journal of Internal Medicine.2022; 37(6): 1223. CrossRef - The Arrival of the Metaverse in Neurorehabilitation: Fact, Fake or Vision?
Rocco Salvatore Calabrò, Antonio Cerasa, Irene Ciancarelli, Loris Pignolo, Paolo Tonin, Marco Iosa, Giovanni Morone
Biomedicines.2022; 10(10): 2602. CrossRef - The paradigm and future value of the metaverse for the intervention of cognitive decline
Hao Zhou, Jian-Yi Gao, Ying Chen
Frontiers in Public Health.2022;[Epub] CrossRef -
Novel pathway regarding good cosmetics brands by
NFT
in the metaverse world
Jinkyung Lee, Ki Han Kwon
Journal of Cosmetic Dermatology.2022; 21(12): 6584. CrossRef - The significant transformation of life into health and beauty in metaverse era
Jinkyung Lee, Ki Han Kwon
Journal of Cosmetic Dermatology.2022; 21(12): 6575. CrossRef - Advances in Metaverse Investigation: Streams of Research and Future Agenda
Mariapina Trunfio, Simona Rossi
Virtual Worlds.2022; 1(2): 103. CrossRef - Dynamics of Metaverse and Medicine: A Review Article
Mrudul A Kawarase, Ashish Anjankar
Cureus.2022;[Epub] CrossRef - METAVERSE SOCIETY: IDENTITY, SPACE AND NEW COMMUNITY
Filiz GÜVEN, İlkim GÜVEN
Erciyes Akademi.2022;[Epub] CrossRef - Empirical Research on the Metaverse User Experience of Digital Natives
Han Jin Lee, Hyun Hee Gu
Sustainability.2022; 14(22): 14747. CrossRef - When Digital Economy Meets Web3.0: Applications and Challenges
Chuan Chen, Lei Zhang, Yihao Li, Tianchi Liao, Siran Zhao, Zibin Zheng, Huawei Huang, Jiajing Wu
IEEE Open Journal of the Computer Society.2022; 3: 233. CrossRef - Metaverse as Future Promising Platform Business Model: Case Study on Fashion Value Chain
Saravanan Periyasami, Aravin Prince Periyasamy
Businesses.2022; 2(4): 527. CrossRef - Into the RetinaVerse: A New Frontier of Retina in the Metaverse
Joshua Ong, Seenu M. Hariprasad, Jay Chhablani
Ophthalmic Surgery, Lasers and Imaging Retina.2022; 53(11): 595. CrossRef - Metaverse and education: the pioneering case of Minecraft in immersive digital learning
Iván Sánchez-López, Rosabel Roig-Vila, Amor Pérez-Rodríguez
El Profesional de la información.2022;[Epub] CrossRef - Sustainable and Safe Consumer Experience NFTs and Raffles in the Cosmetics Market after COVID-19
Jinkyung Lee, Ki Han Kwon
Sustainability.2022; 14(23): 15718. CrossRef - Metaverso: el futuro de la medicina en un mundo virtual
Carlos Miguel Campos Sánchez, Laura Adalys Guillén León, Rossio Cristina Acosta Yanes, Marcos Antonio Gil Oloriz
Metaverse Basic and Applied Research.2022; 1: 4. CrossRef - A Review of Metaverse’s Definitions, Architecture, Applications, Challenges, Issues, Solutions, and Future Trends
Abbas M. Al-Ghaili, Hairoladenan Kasim, Naif Mohammed Al-Hada, Zainuddin Bin Hassan, Marini Othman, Jakir Hussain Tharik, Rafiziana Md. Kasmani, Ibraheem Shayea
IEEE Access.2022; 10: 125835. CrossRef - Using Cinematic Virtual Reality to Get Acquainted with the Metaverse
Ermo Säks
Baltic Screen Media Review.2022; 10(2): 252. CrossRef - A study of factors influencing Chinese college students’ intention of using metaverse technology for basketball learning: Extending the technology acceptance model
Longfei Ren, Fangfang Yang, Chao Gu, Jie Sun, Yunfeng Liu
Frontiers in Psychology.2022;[Epub] CrossRef - Touch IoT enabled by wireless self-sensing and haptic-reproducing electronic skin
Dengfeng Li, Jingkun Zhou, Kuanming Yao, Sitong Liu, Jiahui He, Jingyou Su, Qing’ao Qu, Yuyu Gao, Zhen Song, Chunki Yiu, Chuanlu Sha, Zhi Sun, Binbin Zhang, Jian Li, Libei Huang, Chenyu Xu, Tsz Hung Wong, Xingcan Huang, Jiyu Li, Ruquan Ye, Lei Wei, Zhengy
Science Advances.2022;[Epub] CrossRef - What the Literature on Medicine, Nursing, Public Health, Midwifery, and Dentistry Reveals: An Overview of the Rapidly Approaching Metaverse
Muhammet DAMAR
Journal of Metaverse.2022; 2(2): 62. CrossRef - REFLECTION OF VIRTUAL REALITY ON ACCOUNTING EDUCATION: TRANSFORMATION OF UNIVERSITY TO METAVERSITY
Şebnem YAŞAR
Journal of Business in The Digital Age.2022;[Epub] CrossRef - Influencing Factors of Usage Intention of Metaverse Education Application Platform: Empirical Evidence Based on PPM and TAM Models
Gaofeng Wang, Changhoon Shin
Sustainability.2022; 14(24): 17037. CrossRef - El futuro de la salud en el metaverso
Lee Yang Díaz-Chieng, Jhossmar Cristians Auza-Santiváñez, Jose Ignacio Robaina Castillo
Metaverse Basic and Applied Research.2022; 1: 1. CrossRef - Is online objective structured clinical examination teaching an acceptable replacement in post-COVID-19 medical education in the United Kingdom?: a descriptive study
Vashist Motkur, Aniket Bharadwaj, Nimalesh Yogarajah
Journal of Educational Evaluation for Health Professions.2022; 19: 30. CrossRef - What Is Metaverse?—A Definition Based on Qualitative Meta-Synthesis
Markus Weinberger
Future Internet.2022; 14(11): 310. CrossRef - Training in lung cancer surgery through the metaverse, including extended reality, in the smart operating room of Seoul National University Bundang Hospital, Korea
Huilyung Koo
Journal of Educational Evaluation for Health Professions.2021; 18: 33. CrossRef
Brief report
-
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
-
Sun Kim
, A Ra Cho
, Chul Woon Chung
-
J Educ Eval Health Prof. 2021;18:28. Published online November 5, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.28
-
-
3,232
View
-
150
Download
-
1
Citations
-
Abstract
PDF
Supplementary Material
- This study aimed to investigate the degree to which newly appointed medical faculty members at the Catholic University of Korea are aware of Harden and Crosby’s 12 educational roles and to identify their preferred educational roles. A 12-item survey questionnaire was distributed to 110 participants, and 100 responses were included in the analysis. The respondents gave the highest score to “clinical or practical teacher” and the lowest score to “curriculum planner” for their current personal competencies. For their preferred personal future competencies, they assigned the highest score to “on the job role model” and the lowest score to “student assessor.” They gave almost equally high values to all 12 roles. However, individual faculty members had different preferences for educational roles. Accordingly, medical schools need to plan and implement customized faculty development programs, and efforts to provide appropriate educational roles according to individual faculty members’ preferences are needed.
-
Citations
Citations to this article as recorded by

- Self-directed learning quotient and common learning types of pre-medical students in Korea by the Multi-Dimensional Learning Strategy Test 2nd edition: a descriptive study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2022; 19: 32. CrossRef
Research articles
-
Definition of character for medical education based on expert opinions in Korea
-
Yera Hur
-
J Educ Eval Health Prof. 2021;18:26. Published online September 29, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.26
-
-
3,723
View
-
222
Download
-
2
Citations
-
Abstract
PDF
Supplementary Material
- Purpose
This follow-up study focused on 3 overarching questions: what keywords can be extracted from experts’ definitions of character?; what is the operational definition of character for medical students?; and what possible solutions can be suggested to address the issues of character education that were identified in the previous study?
Methods
Sixty-three medical education experts recruited through expert sampling and 19 non-medical education experts recruited through snowball sampling answered a questionnaire that addressed the 3 major questions of the study. The responses were analyzed for descriptive statistics with supplementary keyword extraction tools, including the Cortical and Monkey keyword extractors.
Results
A total of 93 definitional statements were counted, and 138 keyword terms were extracted. The top 5 keyword terms mentioned by the medical education experts were “patient”, “empathy”, “qualities”, “attitude”, and “ability”. These keyword terms were quite different from those mentioned by the non-medical education experts. Based on the extracted keywords, an operational definition of character education by the medical education expert group was presented as follows: the basic qualities and ability to empathize with patients affected by illness based on respect for patients and others. Various methods were proposed to solve the issue of character education, and many of them pointed to curriculum development, such as improvements in teaching and learning methods and evaluation methods, including role modeling.
Conclusion
A clear statement of the concept of character education is the start to resolve issues of character education. Character education improvements will be possible at the institutional level according to the above results.
-
Citations
Citations to this article as recorded by

- Medical students’ self-evaluation of character, and method of character education
Yera Hur, Sanghee Yeo, Keumho Lee
BMC Medical Education.2022;[Epub] CrossRef - The role of mentoring, supervision, coaching, teaching and instruction on professional identity formation: a systematic scoping review
Rachelle Qi En Toh, Kai Kee Koh, Jun Kiat Lua, Ruth Si Man Wong, Elaine Li Ying Quah, Aiswarya Panda, Chong Yao Ho, Nicole-Ann Lim, Yun Ting Ong, Keith Zi Yuan Chua, Victoria Wen Wei Ng, Sabine Lauren Chyi Hui Wong, Luke Yu Xuan Yeo, Sin Yee See, Jolene J
BMC Medical Education.2022;[Epub] CrossRef
-
Changes in academic performance in the online, integrated system-based curriculum implemented due to the COVID-19 pandemic in a medical school in Korea
-
Do-Hwan Kim
, Hyo Jeong Lee
, Yanyan Lin
, Ye Ji Kang
-
J Educ Eval Health Prof. 2021;18:24. Published online September 23, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.24
-
-
4,510
View
-
284
Download
-
6
Citations
-
Abstract
PDF
Supplementary Material
- Purpose
This study examined how students’ academic performance changed after undergoing a transition to online learning during the coronavirus disease 2019 (COVID-19) pandemic, based on the test results of 16 integrated courses conducted in 3 semesters at Hanyang University College of Medicine in Korea.
Methods
For the 16 required courses that formed an integrated system-based curriculum running for 3 semesters, the major examinations’ raw scores were collected for each student. Percent-correct scores were used in the subsequent analysis. We used the t-test to compare grades between 2019 and 2020, and the Cohen D was calculated as a measure of effect size. The correlation of scores between courses was calculated using Pearson correlation coefficients.
Results
There was a significant decrease in scores in 2020 for 10 courses (62.5%). While most of the integrated system-based curriculum test scores showed strong correlations, with coefficients of 0.6 or higher in both 2019 and 2020, the correlation coefficients were generally higher in 2020. When students were divided into low, middle, and high achievement groups, low-achieving students consistently showed declining test scores in all 3 semesters.
Conclusion
Our findings suggest that the transition to online classes due to COVID-19 has led to an overall decline in academic performance. This overall decline, which may occur when the curriculum is centered on recorded lectures, needs to be addressed. Further, medical schools need to consider establishing a support system for the academic development of low-achieving students.
-
Citations
Citations to this article as recorded by

- The nationwide impact of COVID-19 on life support courses. A retrospective evaluation by Resuscitation Council UK
C.J. Thorne, P.K. Kimani, S. Hampshire, I. Hamilton-Bower, S. Begum-Ali, A. Benson-Clarke, K. Couper, J. Yeung, A. Lockey, G.D. Perkins, J. Soar
Resuscitation Plus.2023; 13: 100366. CrossRef - COVID-19 and Living Situation: Effects on University of Michigan Students During the 2020-2021 Academic Year
Barbara Tan, Alyssa Cadez-Martin, Sarah Fox Fox, Samir Gadepalli
University of Michigan Undergraduate Research Journal.2023;[Epub] CrossRef - How successful the online assessment techniques in distance learning have been, in contributing to academic achievements of management undergraduates?
Hiruni Thathsarani, Dinushika Kaushalya Ariyananda, Chalani Jayakody, Kerthiga Manoharan, A.A.S.N Munasinghe, Nilmini Rathnayake
Education and Information Technologies.2023;[Epub] CrossRef - The impact of asynchronous online anatomy teaching and smaller learning groups in the anatomy laboratory on medical students’ performance during the Covid‐19 pandemic
Ming‐Fong Chang, Meng‐Lin Liao, June‐Horng Lue, Chi‐Chuan Yeh
Anatomical Sciences Education.2022; 15(3): 476. CrossRef - Educational impact of an active learning session with 6-lead mobile electrocardiography on medical students’ knowledge of cardiovascular physiology during the COVID-19 pandemic in the United States: a survey-based observational study
Alexandra Camille Greb, Emma Altieri, Irene Masini, Emily Helena Frisch, Milton Leon Greenberg
Journal of Educational Evaluation for Health Professions.2022; 19: 12. CrossRef - Coronavirus Disease 2019 Cases at Universities and Colleges in Seoul Metropolitan Area
Young June Choe, Yun-Kyung Kim
Journal of Korean Medical Science.2021;[Epub] CrossRef
-
No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand
-
Chaowanan Khundam
, Naparat Sukkriang
, Frédéric Noël
-
J Educ Eval Health Prof. 2021;18:22. Published online August 18, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.22
-
-
3,957
View
-
315
Download
-
3
Citations
-
Abstract
PDF
Supplementary Material
- Purpose
We developed a virtual reality (VR) endotracheal intubation training that applied 2 interaction modalities (hand-tracking or controllersIt aimed to investigatedthe differences of usuability between using hand tracking and controllers during the VR intervention for intubation training for medical students from February 2021 to March 2021 in Thailand.
Methods
Forty-five participants were divided into 3 groups: video only, video with VR controller training, and video with VR hand tracking training. Pre-test, post-test, and practice scores were used to assess learning outcomes. The System Usability Scale (SUS) and User Satisfaction Evaluation Questionnaire (USEQ) questionnaires were used to evaluate the differences between the VR groups. The sample comprised 45 medical students (undergraduate) who were taking part in clinical training at Walailak University in Thailand.
Results
The overall learning outcomes of both VR groups were better than those of the video group. The post-test scores (P=0.581) and practice scores (P=0.168) of both VR groups were not significantly different. Similarly, no significant between-group differences were found in the SUS scores (P=0.588) or in any aspects of the USEQ scores.
Conclusion
VR enhanced medical training. Interactions using hand tracking or controllers were not significantly different in terms of the outcomes measured in this study. The results and interviews provided a better understanding of support learning and training, which will be further improved and developed to create a self-learning VR medical training system in the future.
-
Citations
Citations to this article as recorded by

- Influence of Hand Tracking in Immersive Virtual Reality for Memory Assessment
José Varela-Aldás, Jorge Buele, Irene López, Guillermo Palacios-Navarro
International Journal of Environmental Research and Public Health.2023; 20(5): 4609. CrossRef - Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef - Virtual Simulation in Undergraduate Medical Education: A Scoping Review of Recent Practice
Qingming Wu, Yubin Wang, Lili Lu, Yong Chen, Hui Long, Jun Wang
Frontiers in Medicine.2022;[Epub] CrossRef
Brief report
-
Feasibility of clinical performance assessment of medical students on a virtual sub-internship in the United States
-
John Woller
, Sean Tackett
, Ariella Apfel
, Janet Record
, Danelle Cayea
, Shannon Walker
, Amit Pahwa
-
J Educ Eval Health Prof. 2021;18:12. Published online June 22, 2021
-
DOI: https://doi.org/10.3352/jeehp.2021.18.12
-
-
Abstract
PDF
Supplementary Material
- We aimed to determine whether it was feasible to assess medical students as they completed a virtual sub-internship. Six students (out of 31 who completed an in-person sub-internship) participated in a 2-week virtual sub-internship, caring for patients remotely. Residents and attendings assessed those 6 students in 15 domains using the same assessment measures from the in-person sub-internship. Raters marked “unable to assess” in 75/390 responses (19%) for the virtual sub-internship versus 88/3,405 (2.6%) for the in-person sub-internship (P=0.01), most frequently for the virtual sub-internship in the domains of the physical examination (21, 81%), rapport with patients (18, 69%), and compassion (11, 42%). Students received complete assessments in most areas. Scores were higher for the in-person than the virtual sub-internship (4.67 vs. 4.45, P<0.01) for students who completed both. Students uniformly rated the virtual clerkship positively. Students can be assessed in many domains in the context of a virtual sub-internship.
Research article
-
Development and validation of a portfolio assessment system for medical schools in Korea
-
Dong Mi Yoo
, A Ra Cho
, Sun Kim
-
J Educ Eval Health Prof. 2020;17:39. Published online December 9, 2020
-
DOI: https://doi.org/10.3352/jeehp.2020.17.39
-
-
3,779
View
-
179
Download
-
3
Citations
-
Abstract
PDF
Supplementary Material
- Purpose
Consistent evaluation procedures based on objective and rational standards are essential for the sustainability of portfolio-based education, which has been widely introduced in medical education. We aimed to develop and implement a portfolio assessment system, and to assess its validity and reliability.
Methods
We developed a portfolio assessment system from March 2019 to August 2019 and confirmed its content validity through expert assessment by an expert group comprising 2 medical education specialists, 2 professors involved in education at medical school, and a professor of basic medical science. Six trained assessors conducted 2 rounds of evaluation of 7 randomly selected portfolios for the “Self-Development and Portfolio II” course from January 2020 to July 2020. These data are used inter-rater reliability was evaluated using intra-class correlation coefficients (ICCs) in September 2020.
Results
The portfolio assessment system is based on the following process; assessor selection, training, analytical/comprehensive evaluation, and consensus. Appropriately trained assessors evaluated portfolios based on specific assessment criteria and a rubric for assigning points. In the analysis of inter-rater reliability, the first round of evaluation grades was submitted, and all assessment areas except “goal-setting” showed a high ICC of 0.81 or higher. After the first round of assessment, we attempted to standardize objective assessment procedures. As a result, all components of the assessments showed close correlations, with ICCs of 0.81 or higher.
Conclusion
We confirmed that when assessors with an appropriate training conduct portfolio assessment based on specified standards through a systematic procedure, the results are reliable.
-
Citations
Citations to this article as recorded by

- Development of an electronic learning progression dashboard to monitor student clinical experiences
Hollis Lai, Nazila Ameli, Steven Patterson, Anthea Senior, Doris Lunardon
Journal of Dental Education.2022; 86(6): 759. CrossRef - Medical Student Portfolios: A Systematic Scoping Review
Rei Tan, Jacquelin Jia Qi Ting, Daniel Zhihao Hong, Annabelle Jia Sing Lim, Yun Ting Ong, Anushka Pisupati, Eleanor Jia Xin Chong, Min Chiam, Alexia Sze Inn Lee, Laura Hui Shuen Tan, Annelissa Mien Chew Chin, Limin Wijaya, Warren Fong, Lalit Kumar Radha K
Journal of Medical Education and Curricular Development.2022; 9: 238212052210760. CrossRef - Development of Teaching and Learning Manual for Competency-Based Practice for Meridian & Acupuncture Points Class
Eunbyul Cho, Jiseong Hong, Yeonkyeong Nam, Haegue Shin, Jae-Hyo Kim
Korean Journal of Acupuncture.2022; 39(4): 184. CrossRef
Reviews
-
A proposal for the future of medical education accreditation in Korea
-
Ki-Young Lim
-
J Educ Eval Health Prof. 2020;17:32. Published online October 21, 2020
-
DOI: https://doi.org/10.3352/jeehp.2020.17.32
-
-
3,745
View
-
111
Download
-
4
Citations
-
Abstract
PDF
Supplementary Material
- For the past 20 years, the medical education accreditation program of the Korean Institute of Medical Education and Evaluation (KIMEE) has contributed significantly to the standardization and improvement of the quality of basic medical education in Korea. It should now contribute to establishing and promoting the future of medical education. The Accreditation Standards of KIMEE 2019 (ASK2019) have been adopted since 2019, with the goal of achieving world-class medical education by applying a learner-centered curriculum using a continuum framework for the 3 phases of formal medical education: basic medical education, postgraduate medical education, and continuing professional development. ASK2019 will also be able to promote medical education that meets community needs and employs systematic assessments throughout the education process. These are important changes that can be used to gauge the future of the medical education accreditation system. Furthermore, globalization, inter-professional education, health systems science, and regular self-assessment systems are emerging as essential topics for the future of medical education. It is time for the medical education accreditation system in Korea to observe and adopt new trends in global medical education.
-
Citations
Citations to this article as recorded by

- Accreditation standards items of post-2nd cycle related to the decision of accreditation of medical schools by the Korean Institute of Medical Education and Evaluation
Kwi Hwa Park, Geon Ho Lee, Su Jin Chae, Seong Yong Kim
Korean Journal of Medical Education.2023; 35(1): 1. CrossRef - Continuing Professional Development of Pharmacists and The Roles of Pharmacy Schools
Hyemin Park, Jeong-Hyun Yoon
Korean Journal of Clinical Pharmacy.2022; 32(4): 281. CrossRef - Definition of character for medical education based on expert opinions in Korea
Yera Hur
Journal of Educational Evaluation for Health Professions.2021; 18: 26. CrossRef - Special reviews on the history and future of the Korean Institute of Medical Education and Evaluation to memorialize its collaboration with the Korea Health Personnel Licensing Examination Institute to designate JEEHP as a co-official journal
Sun Huh
Journal of Educational Evaluation for Health Professions.2020; 17: 33. CrossRef
-
Is accreditation in medical education in Korea an opportunity or a burden?
-
Hanna Jung
, Woo Taek Jeon
, Shinki An
-
J Educ Eval Health Prof. 2020;17:31. Published online October 21, 2020
-
DOI: https://doi.org/10.3352/jeehp.2020.17.31
-
-
3,793
View
-
103
Download
-
4
Citations
-
Abstract
PDF
Supplementary Material
- The accreditation process is both an opportunity and a burden for medical schools in Korea. The line that separates the two is based on how medical schools recognize and utilize the accreditation process. In other words, accreditation is a burden for medical schools if they view the accreditation process as merely a formal procedure or a means to maintain accreditation status for medical education. However, if medical schools acknowledge the positive value of the accreditation process, accreditation can be both an opportunity and a tool for developing medical education. The accreditation process has educational value by catalyzing improvements in the quality, equity, and efficiency of medical education and by increasing the available options. For the accreditation process to contribute to medical education development, accrediting agencies and medical schools must first be recognized as partners of an educational alliance working together towards common goals. Secondly, clear guidelines on accreditation standards should be periodically reviewed and shared. Finally, a formative self-evaluation process must be introduced for institutions to utilize the accreditation process as an opportunity to develop medical education. This evaluation system could be developed through collaboration among medical schools, academic societies for medical education, and the accrediting authority.
-
Citations
Citations to this article as recorded by

- Accreditation standards items of post-2nd cycle related to the decision of accreditation of medical schools by the Korean Institute of Medical Education and Evaluation
Kwi Hwa Park, Geon Ho Lee, Su Jin Chae, Seong Yong Kim
Korean Journal of Medical Education.2023; 35(1): 1. CrossRef - Internal evaluation in the faculties affiliated to zanjan university of medical sciences: Quality assurance of medical science education based on institutional accreditation
Alireza Abdanipour, Farhad Ramezani‐Badr, Ali Norouzi, Mehdi Ghaemi
Journal of Medical Education Development.2022; 15(46): 61. CrossRef - Development of Mission and Vision of College of Korean Medicine Using the Delphi Techniques and Big-Data Analysis
Sanghee Yeo, Seong Hun Choi, Su Jin Chae
Journal of Korean Medicine.2021; 42(4): 176. CrossRef - Special reviews on the history and future of the Korean Institute of Medical Education and Evaluation to memorialize its collaboration with the Korea Health Personnel Licensing Examination Institute to designate JEEHP as a co-official journal
Sun Huh
Journal of Educational Evaluation for Health Professions.2020; 17: 33. CrossRef