Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions



Page Path
HOME > J Educ Eval Health Prof > Volume 18; 2021 > Article
Training in lung cancer surgery through the metaverse, including extended reality, in the smart operating room of Seoul National University Bundang Hospital, Korea
Huilyung Koo*orcid

Published online: December 31, 2021
  • 259 Download
  • 14 Crossref
  • 16 Scopus
The coronavirus disease 2019 (COVID-19) pandemic has made it difficult to provide medical training across borders. In particular, it has become virtually impossible to see high-tech medical equipment from other countries and observe surgery to learn. However, educational methods involving the “metaverse” are also being introduced in the medical field to meet the growing demand for non-face-to-face education, as medical staff from around the world who visited Korea to gain expertise in medical technology and medical students who need to practice have had fewer opportunities to work with patients directly due to COVID-19. Efficient surgical training is also challenging using available video-conferencing systems such as Zoom. In order to resolve these limitations, new digital methods using metaverse technology are emerging in the Korean medical community (Supplement 1). In this editorial, I would like to introduce a training course in the metaverse held in Korea and describe expectations about how this technology will be used in the medical field in the future.
On May 29, 2021, the 6th Outreach program using an extended reality (XR) technology platform was held under the supervision of the Asian Thoracic Surgery Education Group at the 29th Online Conference of the Asian Heart and Thoracic Surgery Society (Supplement 1). More than 200 thoracic surgeons from Asian countries attended the Outreach program and received training. Surgeons from Manchester University Hospital in the United Kingdom and National University Hospital in Singapore also accessed the virtual environment to visit the system and had active discussions.
The participants in the program wore a head-mounted display (HMD) in their respective laboratories or experienced a real place in a virtual environment with their laptops. The 360° environment was implemented with HMDs and laptops through recent platform upgrades. After participants set up their individual avatars as in a game, they entered a virtual classroom where they viewed lectures on lung cancer surgery techniques and trends in virtual and mixed technology (Fig. 1). They also continued discussions in real-time while observing the surgical process in a virtual environment. Lung cancer surgery education was conducted with high-resolution virtual reality cameras broadcasting all surgical scenes in 360°. The virtual space was decorated to resemble a conference venue.
Surgery was broadcast in the smart operating room of Seoul National University (SNU) Bundang Hospital. Participants indicated that it seemed like they were observing the procedure in the actual operating room because they could see the surgeon, the surgical nurse, and the environment in the operating room as desired through the 360°-8K-3D camera built in the operating room (Figs. 2, 3). The platform is characterized by a virtual environment and high-quality voice conversation through 3-dimensional (3D) XR immersive sound technology. Another advantage is that smooth real-time voice support and various screens such as the actual environment can be implemented. The surgical scene is more visible than when the observer enters the physical operating room and watches the procedure. Participants can also see the surgeon’s monitor and how the operating room nurses hand over surgical tools, how the forceps move, and even the sweat while they suture the wound. As participants move the mouse, they can see every corner of the operating room from the angle that the observer wants. If they wear a 3D headset, the visible scene changes every time they turn their heads, and the feeling of being in the operating room becomes more palpable than when a headset is not used.
Accomplishing this training was possible because SNU Bundang Hospital’s smart operating room and metaverse environment are combined. The term “metaverse” combines “meta,” which means “virtual and transcendent,” and “universe,” denoting the world [1]. The metaverse is a reproduction of reality in a virtual space. This concept can be intuitively understood by thinking of virtual spaces using avatars such as Roblox [2] and Fortnite [3]. SNU Bundang Hospital created a smart operating room in 2019 that contains 6 lenses in a virtual reality camera that shoots 360° in all directions, a high-resolution camera, and fluorescent imaging equipment that can visualize lymph nodes in 1 place in the operating room. Advanced imaging equipment has become critical with the increasing frequency of surgery to minimize laparotomy and leverage the power of endoscopy. Surgeons wear 3D glasses and observe high-resolution 3D images from laparoscopic cameras.
Using this technology, an observer can watch the process more extensively and precisely than when a surgeon opens the stomach and performs surgery. The operating room camera or lighting has a voice recognition function. A surgeon can operate with both hands and turn off the camera or light directly with a voice command. Medical staff may have a remote conversation about the biopsy results during surgery. For instance, if a surgeon removes tissue during surgery and sends it to a pathologist, it will be possible for the pathologist to display microscopic images on the large screen of the operating room after the biopsy. While watching the video, the surgeon would listen to the pathologic findings in real-time and share opinions. A control room where an observer can look into the smart operating room transparently is attached right next to it, allowing them to transmit videos or adjust cameras there.
After the COVID-19 pandemic, the importance of smart operating rooms has increased. Surgeons from the United States and Europe previously came to SNU Bundang Hospital to observe state-of-the-art surgery, but these visits have become impossible since COVID-19. However, through 360° video, surgeons located anywhere in the world can see the procedures as vividly as if they were in the operating room. There is no need to come to Korea. Dr. Sang-Hoon Ahn, a professor of surgery at SNU Bundang Hospital, said that “Video education using the metaverse is more effective than any other educational method available so far.” An observer can only see the abdominal cavity through a typical video broadcast, but the 360° video shows the entire situation in the operating room. For example, in Professor Ahn’s training on the use of articulated forceps for laparoscopic surgery, it is difficult to know precisely how to use the forceps only by looking at images of them moving in the abdominal cavity. However, through the 360° video, if Professor Ahn changes the wrist’s angle of movement, the observers can see how the forceps move inside the body. They can learn more accurately than from direct observation in the operating room [4]. Furthermore, the number of people who can physically enter an operating room is limited. In addition, in the case of endoscopic surgery, the monitor angle is tailored to the doctor who is operating, so even if someone enters the operating room, they often cannot see the surgical scene correctly. However, videos from the smart operating room do not have this drawback, and they have therefore been used for surgeons, nurses, and medical student education. Dr. So Hyun Kang, an SNU Bundang Hospital fellow, said that this educational system benefits medical residents: “Residents and fellows are always busy. I cannot run to the operating room to observe while working far away. It is only seen in medical dramas that medical doctors look down at the surgical scene from above.” Even if residents cannot watch a surgical broadcast in real-time, they can study by watching videos recorded from various angles later.
This demonstration at SNU Bundang Hospital is an example of using the metaverse in clinical education [4]. Among the various types of metaverse applications, this is an example of XR implemented by mixing augmented reality (AR) and virtual reality (VR). XR refers to all VR technologies ranging from VR to mixed reality and AR [5]. With the prolonged COVID-19 situation, the importance of medical education using smart operating rooms and the metaverse is growing. A technical leap is expected, such as higher camera resolution and the ability to deliver haptic input reflecting the surgeon’s tactile sensations. Thus, the metaverse is expected to be actively used in medical education or education for residents and students in the future. The use of the metaverse through tailored education and training in the COVID-19 era will be accelerated even in the post-COVID-19 period. Once these cutting-edge technologies are introduced into the medical field, they will contribute to the health of Koreans and people around the world.

Authors’ contributions

All the work was done by Huilyung Koo.

Conflict of interest

No potential conflict of interest relevant to this article was reported.



Data availability


Data files are available from Harvard Dataverse:
Supplement 1. [Public report] Medical education in a virtual space, metaverse that is realistic.
Fig. 1.
Avatars of participants in the virtual conference of the Asian Heart and Thoracic Surgery Society in 2021 (use of the photo was permitted by Seoul National University Bundang Hospital).
Fig. 2.
Surgical scene in the smart operating room, Seoul National University Bundang Hospital (use of the photo was permitted by Seoul National University Bundang Hospital).
Fig. 3.
Avatars watching a surgical scene in the smart operating room, Seoul National University Bundang Hospital (use of the photo was permitted by Seoul National University Bundang Hospital).

Figure & Data



    Citations to this article as recorded by  
    • Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
      Sun Huh
      Journal of Educational Evaluation for Health Professions.2022; 19: 2.     CrossRef
    • The Metaverse in Cardiovascular Medicine: Applications, Challenges, and the Role of Non-Fungible Tokens
      Ioannis Skalidis, Olivier Muller, Stephane Fournier
      Canadian Journal of Cardiology.2022; 38(9): 1467.     CrossRef
    • CardioVerse: The cardiovascular medicine in the era of Metaverse
      Ioannis Skalidis, Olivier Muller, Stephane Fournier
      Trends in Cardiovascular Medicine.2022;[Epub]     CrossRef
    • Metaverse phenomenon and its impact on health: A scoping review
      Ali Garavand, Nasim Aslani
      Informatics in Medicine Unlocked.2022; 32: 101029.     CrossRef
    • Provision of surgical pre-operative patient counseling services through the Metaverse technology
      Anusha Anwer, Yumna Jamil, Maham Bilal
      International Journal of Surgery.2022; 104: 106792.     CrossRef
    • Evolution of Medical Conferences for Congenital Heart Disease Imagers in the Era of COVID-19: From Onsite to Virtual Meetings
      I-Chen Tsai, Hyun Woo Goo, Haifa Abdul Latiff, Seon Young Goo, Sang Joon Park
      Cardiovascular Imaging Asia.2022; 6(3): 82.     CrossRef
    • Gastroenterology in the Metaverse: The dawn of a new era?
      Chi Zhang, Shuyan Feng, Ruonan He, Yi Fang, Shuo Zhang
      Frontiers in Medicine.2022;[Epub]     CrossRef
    • The Metaverse: A New Challenge for the Healthcare System: A Scoping Review
      Luca Petrigna, Giuseppe Musumeci
      Journal of Functional Morphology and Kinesiology.2022; 7(3): 63.     CrossRef
    • Who really needs a Metaverse in anatomy education? A review with preliminary survey results
      Joe Iwanaga, Edward C. Muo, Yoko Tabira, Koichi Watanabe, Susan J. Tubbs, Anthony V. D'Antoni, Mathangi Rajaram‐Gilkes, Marios Loukas, Mohammed K. Khalil, R. Shane Tubbs
      Clinical Anatomy.2022;[Epub]     CrossRef
    • The metaverse in education: Definition, framework, features, potential applications, challenges, and future research topics
      Xinli Zhang, Yuchen Chen, Lailin Hu, Youmei Wang
      Frontiers in Psychology.2022;[Epub]     CrossRef
    • Novel pathway regarding good cosmetics brands by NFT in the metaverse world
      Jinkyung Lee, Ki Han Kwon
      Journal of Cosmetic Dermatology.2022;[Epub]     CrossRef
    • Virtual hospitals and digital doctors: how far are we from the CardioVerse?
      Ioannis Skalidis, Stephane Fournier, Emmanouil Skalidis, Niccolo Maurizi
      European Heart Journal.2022;[Epub]     CrossRef
    • Advances in Metaverse Investigation: Streams of Research and Future Agenda
      Mariapina Trunfio, Simona Rossi
      Virtual Worlds.2022; 1(2): 103.     CrossRef
    • Dynamics of Metaverse and Medicine: A Review Article
      Mrudul A Kawarase, Ashish Anjankar
      Cureus.2022;[Epub]     CrossRef

    Country-specific access statistics

    United States 37
    Excel Download
    We recommend

    JEEHP : Journal of Educational Evaluation for Health Professions