INTRODUCTION

The direction of the future of e-learning in medical education is heavily influenced by three major trends: (1) the rapid adoption of emerging communication, simulation, and information technology in undergraduate, graduate, and continuing medical education; (2) a national call for competency-based, patient outcome-oriented training across the continuum of education; and (3) the rapidly changing health care environment including advances in the biomedical sciences as well as in the diagnoses and management of diseases, organization, financing, and delivery of health care services, and changes in the societal expectations [1, 2]. This paper provides an overview of the current state of e-learning in medical education and examines whether the current trend in e-learning can adequately serve the needs of medical education in the 21st century.

E-learning is defined as learning mediated by technology, such as the World Wide Web, intranet, and multi-media based computer applications [3, 4]. In recent years, the emergence of virtual universities promises a revolutionary approach to training medical doctors using cutting edge e-learning technologies. The International Virtual Medical School (IVIMEDS) (http://www.ivimeds.org/) and the Virtual Campus of the King s College of University of London (http://gktvc1.kcl.ac.uk/) are examples of e-learning training at the undergraduate, residency, and continuing professional levels [5]. The IVIMEDS consists of more than 30 partners in 15 countries, who agree to share (1) curriculum maps that link learning content and assessment, (2) learning resources including illustrations, video clips, animated diagrams, medical images, and (3) virtual patients that simulate authentic, high fidelity patient problems. The Virtual Campus of the King’s College offers Web-based systems that provide learning and administrative support to medical, dental, and health sciences students. As more and more institutions are seeking cost-effective approaches to optimizing the capacity of e-learning in medical training, there is no doubt that these virtual universities will have an increasing appeal in the coming years.

As new technology is developed and deployed in learning settings at a rapid pace, the question that begs an answer is: what specific contributions can technology make towards improving the quality of medical education? Even with today’s extensive and pervasive use of technology in medical education, some of the basic questions related to the role of e-learning remain unanswered [3, 6], such as:

1. What is an effective approach to integrating technology into pre-clinical vs. clinical training?

2. What evidence exists regarding the type and format of e-learning technology suitable for medical specialties and clinical settings?

3. Which design features are known to be effective in designing on-line patient simulation cases, tutorials, or clinical exams?

4. What guidelines exist for determining an appropriate blend of instructional strategies, including on-line learning, face-to-face instruction, and performance-based skill practices?

The central tenet of this paper is three fold. First, technology will continue to dominate the way we train future physicians. Second, there exists an untapped potential for synchronous delivery and simulation technology to help meet training needs in emerging competencies [7]. Third, we have an opportunity to build a knowledge base that can guide both practitioners and researchers in developing effective technology-based learning using evidence-based findings. This paper is organized around three main questions:

1. What is the current trend of e-learning in medical education?

2. What do we know about the effective use of e-learning?

3. What is the role of e-learning in facilitating newly emerging competency-based training?

What is the Current Trend of e-Learning in Medical Education?

The Liaison Committee on Medical Education in the U.S. conducts an annual survey of medical schools, in which several questions are asked about the use of technology in the medical curriculum [8]. One item asks whether educational software applications are used in the required basic sciences courses and clinical clerkships. Fig. 1 shows the percentage of medical schools that report the use of biological modeling software, clinical problem solving software, question banks software and exam software in their basic sciences courses. Data collected in 1998 are compared with 2002 survey results. As shown in Fig. 1, a greater proportion of the surveyed 125 US Medical Schools report that the use of educational software programs has increased in 2002 compared to 1998. Although to a smaller degree, Fig. 2 shows a similar trend in the percentage of schools reporting the increased use of educational software programs in their clinical clerkships.

At the CME (continuing medical education) level, Curran and Fleet [9] report that over one-year period between 2000 and 2001, the number of available CME Web sites increased from 96 to more than 200 Web sites. It is not clear the degree to which e-learning is integrated in residency training, but randomized control trials examining the effectiveness of Web-based learning on residents’ knowledge and satisfaction attest to the value of e-learning in training residents [10, 11]. In addition, the recently mandated ACGME (Accreditation of Council for Graduate Medical Education) competencies call for an increased use of information technology for competency-based teaching and assessment (http://www.acgme.org/Outcome/).

At the national and international levels, a number of initiatives have emerged with the purpose of creating a digital repository of peer-reviewed electronic resources for public dissemination [3]. Some of the examples include: MedEd Portal by Association of American Medical Colleges (http://www.aamc.org/mededportal), End of Life/Palliative Education Resource Center by Medical College of Wisconsin (http://www.eperc.mcw.edu/), The Health Education Assets Library (HEAL, http://www.healcentral.org/), Multimedia Educational Resource for Learning and Online Teaching (MERLOT, http://www.merlot.org), and Family Medicine Digital Resource Library (http://fmdrl.org). These initiatives recognize the need to create a mechanism for sharing quality e-learning resources across institutions and to reward the works of faculty and staff through peer reviewed processes.

Technology is Here to Stay: Do We Know What Works?

In understanding the impact of e-learning on learning, Kirkpatrick’s work has been cited as a useful model [12]. The model consists of four dimensions, including learner satisfaction, learning outcomes, performance improvement, and patient/health outcomes (Fig. 3).

Learner satisfaction mainly encompasses participants’ perceptions and satisfaction with learning objectives, content, format, and instructor’s effectiveness. Learning outcomes include assessment of learners’ knowledge, attitudes, and skills. Performance improvement targets changes in practice behaviors as a direct result of the newly acquired knowledge, attitudes, and skills. Lastly, patient and health outcomes include changes in patients’ behaviors and health indicators as a result of trainees’ improved practice patterns. For example, in a study by Curran and Fleet [9], 10 which examined CME-related e-learning studies, 81% of the reviewed studies included evaluation of learner’s satisfaction, followed by 52% targeting learning outcomes and 7% evaluating student performance change in clinical practice. No studies included patient or health outcomes as part of the evaluation.

A number of systematic reviews have been conducted to examine the effectiveness of e-learning across the continuum of medical training covering medical students, residents, and practicing physicians. Appendix 1 summarizes results from the recently published studies [7, 9, 13–16]. Using Kirkpatrick’s model as a guide for understanding the trend of studies involving e-learning in medical education, several conclusions can be drawn from the systematic reviews. First, most of the reported studies are descriptive in nature with little evaluative data. They tend to describe the development and implementation processes involving e-learning applications without concrete data to demonstrate the impact of e-learning on learning outcomes, trainees’ behaviors, or patient outcomes. Second, most of the reported evaluation focuses on multiple-choice questions assessing trainees’ knowledge using pre-and post-tests. Few studies examined other outcome measures to assess areas of competencies that are difficult to evaluate using multiple-choice questions, such as communication skills or decision-making skills. Third, reported data tend to focus on trainees’ subjective impression, mostly their satisfaction with e-learning, rather than using validated outcome measures. Lastly, the majority of the studies showed weak or inappropriate study design with few randomized controlled trials. As a result of these trends in how e-learning applications are evaluated in medical education, the knowledge base for how to design effective e-learning systems for targeting trainees’ satisfaction, learning, performance behavior, and patient outcomes remains underdeveloped.

One example of a novel approach to incorporating Kirkpatrick’s model in assessing an e-learning application involves the Case for Change tool developed at the University of Washington (http://fammed.washington.edu/predoctoral/clerkship/casedemo.html). The purpose of the Case for Change is to teach third-year medical students how to conduct a patient-centered communication targeting a patient’s behavioral change. This Web-based tool is required of all students to complete during their 6-weeks of Family Medicine clerkship rotation. These rotations take place at 24 training sites in the five-state region (Washington, Wyoming, Alaska, Montana, Idaho). The main components of Case for Change include: (1) video cases that simulate a provider-patient interaction using a scenario of reducing risky sexual behavior; (2) free-text input by students what they would say to the patient after viewing the video segments; and (3) multiple choice options selected by students that best match their free-text inputs. Multiple video segments are available to students that are associated with key stages of patient-centered behavioral change discussions, including building rapport, eliciting patient concerns, negotiating agenda, determining risk patterns, etc. Our evaluation involved coding of students’ free-text responses and scoring of their multiple choice options using the expert’s approach as the gold standard. Four categories of coding were used in analyzing students’ free-text responses:

1. Pre-determined Desired Themes: Students’ input that matched instructor’s learning goals and objectives for individual video segment.

2. Student-initiated Acceptable Themes: Positive comments offered by students that are indirectly related to learning goals and objectives.

3. Pre-determined Undesired Themes: Students’ input contradictory to learning goals and objectives.

4. Student-initiated Unacceptable Themes: Comments that are not acceptable, such as comments that display unprofessional behaviors on a student’s part.

For example, under negotiating agenda, students’ comments pertaining to summarizing the patient’s concern, mentioning time constraint in the encounter, and helping patient prioritize agenda were considered to be pre-determined desired theme. On the other hand, comments that suggested physician-directed agenda were coded as pre-determined undesired theme. Our preliminary evaluation based on 112 students’ performance shows that in most categories of the case segment, fewer students received correct scores on their free-text responses compared to their multiple choice options, with the exception of building rapport (Table 1). Particularly, these differences were notable with statistical significance in the categories of eliciting patient concerns, determining risk patterns, and behavior change discussions.

From this evaluation, we identified several areas in students’ behaviors that need explicit teaching in the future. These areas included students’ tendencies to dive into premature diagnostic questioning, to ask for a symptom list before eliciting a patient’s concerns, determining the agenda without the patient’s input, and using close-ended statements of diagnostic nature. Our future evaluation will attempt to correlate student’s performance in Case for Change with faculty’s observation of students interacting with patients during their clerkship rotations.

What is the Role of Technology in New Competency-Based Training?

Training of physicians in the 21st century requires a new focus on emerging competencies. With the ACGMEs (Accreditation Council of Graduate Medical Education) mandate required of all U.S. residency training programs, residents have to demonstrate their competencies in six core areas, including: (1) patient care, (2) medical knowledge, (3) practice-based learning and improvement, (4) interpersonal and communication skills, (5) professionalism, and (6) systems-based practice. There is an increasing call at the national level to (1) restructure the undergraduate and continuing medical education using the residency competencies [17]; and (2) to link competency-based training with patient outcomes [1].

So the question is: what is the role of technology in teaching and assessing competencies across undergraduate, graduate, and continuing medical education. How do we adapt the current e-learning applications for targeting the following competency skills in future physicians:

• Patient-centered communication skills

• Competency in providing culturally sensitive care

• Exhibiting professionalism in all aspects of a physician’s life

• Exercising evidence-based decision making

• Patient safety/medical error reduction

• Inter-professional team care

• Life-long learning

• Continuous self-assessment

• Improving practice performance

• Evidence-based critical thinking and clinical reasoning

There are three e-learning modalities that promise a great potential for innovative training in the future. These modalities include: (1) simulation technology; (2) synchronous learning delivery; and (3) Web-based or videoconferencing for standardized patient-based training.

Simulation Technology

The state of the art simulation centers exist in many U.S. medical institutions. These centers not only support performance-based training of surgery and anesthesiology trainees, but also internists and family physicians who are required to demonstrate a wide range of procedural skills. These skills encompass difficult airway management, cardiac life support, bronchoscopy, endoscopy, and suturing, etc. Goals of the simulation centers are to provide trainees with multiple opportunities to practice a wide range of procedural skills and to reduce preventable medical errors, thereby ensuring patient safety.

Some of the notable centers include: (1) National Capital Area Medical Simulation Center (http://simcen.usuhs.mil/home.html); (2) Harvard Center for Medical Simulation (http://www.harvardmedsim.org/); (3) Peter Winter Institute for Simulation, Education, Research at University of Pittsburgh (http://www.wiser.pitt.edu/); (4) Bristol Simulation Center (http://www.bris.ac.uk/Depts/BMSC/); (5) The Simulation Group at Massachusetts General Hospital (http://www.thesimgroup.org/); and (6) SimSuite from Medical Simulation Corporation (http://www.medsimulation.com/education_system/centers.asp). Typically, these centers use full mannequins or models connected to various display units that guide the trainees’ performance during simulation sessions. Evaluating trainees’ skills are usually conducted via observation by faculty members, who complete checklist forms for assessing trainees’ psychomotor and technical skills. Depending on the scenarios developed for trainees’ interactions with simulators, evaluation can also include trainees’ skills in patient assessment, management of critical events, communication, and interpersonal relationship. Although expensive and required of highly skilled personnel to operate, simulation technologies will certainly be on the leading edge of e-learning applications in medical education. These technologies can serve as effective modalities for delivering competency-training in future physicians, which is difficult to deliver using conventional teaching methods.

Synchronous Learning Delivery

The advancement in technology and access to broadband connectivity from remote training sites have made a synchronous learning delivery a possibility. The synchronous learning modality, such as Webcast, consists of a live video/audio broadcast of training sessions and archival of training materials for later access by participants. Many benefits include: (a) connecting learners from distant sites to live training sessions; (b) creating opportunities for trainers and participants to interact in real time; (c) fostering peer-to-peer feedback; (d) interacting with learning resources such as lecture notes or simulated cases; and (e) accessing training materials for self-paced review. The product developed by Macromedia, Breeze, offers one example of how a synchronous e-learning technology may be used in medical education (see http://www.adobe.com/products/breeze/ for demonstration of system features). Breeze integrates a wide range of features for providing both instructors and learners a high level of flexibility. Instructors and learners can view each other via video streaming during live lectures, instructors can create on the fly on-line quizzes or surveys for learners to complete, and learning resources, such as Powerpoint slides and lecture notes, can be archived for students’ self-paced learning. The entire Breeze session can be video or audio taped and archived for later access by learners as well. At University of Washington, third year students complete their clerkship at remote training sites in a five-state region that encompasses three-time zones. Breeze can be used to connect students or faculty members at clerkship sites to receive didactic sessions on commonly seen conditions in outpatient settings and to discuss interesting or rare cases that may not be frequently encountered at other sites.

Web-based/Videoconferencing of Standardized Patients

The use of standardized patients has been an integral part of medical education for both teaching and assessment purposes. In recent years, Web-based OSCEs (Objective Structured Clinical Exams) and video technology have been piloted to test whether performance-based skills, such as decision making or error disclosure skills, can be taught and evaluated. One study by Clever, et al. [18] examined whether standardized patients (SPs) in Philadelphia can accurately evaluate informed decision making skills by an orthopedic surgeon connected via videoconferencing technology in Chicago. They concluded that SP-physician interaction was feasible in long-distance assessment of a variety of learners. Similarly, Chan, et al. [19] studied how effectively standardized patients were able to rate a surgeon’s skills in disclosing medical errors. In this study, standardized patients were located in Toronto, Canada with surgeons based in St. Louis, Missouri, U.S.A. They concluded that videoconferencing was effective in assessing a physician’s communication skills. In addition, a pilot study showed that medical students whose skills were assessed by SPs via the Web OSCEs, compared to students who interacted face-to-face with SPs, performed equally well in the category of physical exam and information giving skills [20].

CONCLUSION

This paper presented a general overview of the current trend in e-learning with a focus on the U.S. medical education, main findings from the recent systematic reviews of studies involving e-learning that show many gaps in the way the effectiveness of e-learning is being examined, and a review of emerging technologies that have potentials for meeting new requirements for competency-based training. The paper also provided examples of emerging consortiums of institutions that have created common e-learning experiences for their medical trainees. As e-learning continues to be widely integrated in the training of future physicians, it is critical that our efforts in conducting evaluative studies should target specific e-learning features that can best mediate intended learning goals and objectives. Without an evolving knowledge base on how best to design e-learning applications, the gap between what we know about technology use and how we deploy e-learning in training settings will continue to widen.

Acknowledgments

Fig. 1.

Comparison of percentages of 125 US medical schools reporting the use of eductional software program in basic sciences curriculum in 1998 and 2002.

Fig. 2.

Comparison of percentages of 125 US medical schools reporting the use of eductional software program in clinical clerkships in 1998 and 2002.

Fig. 3.

Kirkpatrick s model of summative evaluation.

References

• 1. The Ad Hoc Committee of Deans. Educating doctors to provide high quality medical care: a vision for medical education in the United States [Internet]. Washington, DC: Association of American Medical Colleges; c2004. [cited 2006 Jul 20]. Available from: https://services.aamc.org/Publications/showfile.cfm?file=version27.pdf&prd_id=115&prv_id=130&pdf_id=27 PubMed
• 2. Whitcomb ME. More on competency-based education. Acad Med 2004;79:493-4. ArticlePubMed
• 3. Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med 2006;81:207-12. ArticlePubMed
• 4. McKimm J, Jollie C, Cantillon P. ABC of learning and teaching: Web based learning. BMJ 2003;326:870-3. ArticlePubMedPMC
• 5. Smith SR. Is there a Virtual Medical School on the horizon. Med Health R I 2003;86:272-5. PubMed
• 6. Walsh K. Blended learning. BMJ 2005;330:829.ArticlePMC
• 7. Lau F, Bates J. A review of e-learning practices for undergraduate medical education. J Med Syst 2004;28:71-87. ArticlePubMed
• 8. Moberg TF, Whitcomb ME. Educational technology to facilitate medical students’ learning: background paper 2 of the medical school objectives project. Acad Med 1999;74:1146-50. ArticlePubMed
• 9. Curran VR, Fleet L. A review of evaluation outcomes of web-based continuing medical education. Med Educ 2005 Jun 39(6):561-7. ArticlePubMed
• 10. Bell DS, Fonarow GC, Hays RD, Mangione CM. Self-study from web-based and printed guideline materials. A randomized, controlled trial among resident physicians. Ann Intern Med 2000;132:938-46. ArticlePubMed
• 11. Cook DA, Dupras DM, Thompson WG, Pankratz VS. Web-based learning in residents’ continuity clinics: a randomized, controlled trial. Acad Med 2005;80:90-7. ArticlePubMed
• 12. Kirkpatrick DL. Evaluating training programs: the four levels. San Francisco: Berrett-Koehler; 1994.
• 13. Adler MD, Johnson KB. Quantifying the literature of computer-aided instruction in medical education. Acad Med 2000;75:1025-8. ArticlePubMed
• 14. Chumley-Jones HS, Dobbie A, Alford CL. Web-based learning: sound educational method or hype? A review of the evaluation literature. Acad Med 2002;77(10 Suppl):S86-93. ArticlePubMed
• 15. Letterie GS. Medical education as a science: the quality of evidence for computer-assisted instruction. Am J Obstet Gynecol 2003;188:849-53. ArticlePubMed
• 16. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005;27:10-28. ArticlePubMed
• 17. Whitcomb ME. More on improving the education of doctors. Acad Med 2003;78:349-50. ArticlePubMed
• 18. Clever SL, Novack DH, Cohen DG, Levinson W. Evaluating surgeons’ informed decision making skills: pilot test using a videoconferenced standardised patient. Med Educ 2003;37:1094-9. ArticlePubMed
• 19. Chan DK, Gallagher TH, Reznick R, Levinson W. How surgeons disclose medical errors to patients: a study using standardized patients. Surgery 2005;138:851-8. ArticlePubMed
• 20. Novack DH, Cohen D, Peitzman SJ, Beadenkopf S, Gracely E, Morris J. A pilot test of WebOSCE: a system for assessing trainees’ clinical skills via teleconference. Med Teach 2002;24:483-7. ArticlePubMed

Appendix

Figure & Data

References

Citations

Citations to this article as recorded by  

• Teachers and managers experiences of virtual learning during the COVID-19 pandemic: A qualitative study
  Monireh Faghir Ganji, Azam Jafari Malvajerd, Ahmad Moradi, Alireza Amanollahi, Alireza Ansari-Moghaddam, Hamed Basir Ghafouri
  Heliyon.2024; 10(2): e24118.     CrossRef
• An Investigation of the Impact of Online and In-Person Delivery of Undergraduate Biology Instruction
  Kevin M. Bonney
  The American Biology Teacher.2024; 86(5): 289.     CrossRef
• Evaluating Operative Exposure for Medical Students in the Era of Virtual Learning: A Single-Institution Experience
  Rachel Rivero, Leanne Brown, Emily Flom, Claire Morton, C. Jayson Esdaille, Ebony Jernigan, Felix Lui, David H. Stitelman
  Journal of Surgical Education.2024; 81(10): 1346.     CrossRef
• Online anatomy education during the Covid‐19 pandemic: Opinions of medical, speech therapy, and BSc Anatomy students
  Johara Khan, Karin J. Baatjes, Jodie I. Layman‐Lemphane, Janine Correia
  Anatomical Sciences Education.2023; 16(5): 892.     CrossRef
• Experience of Sudden Shift from Traditional to Virtual Problem-Based Learning During COVID-19 Pandemic at a Medical College in Saudi Arabia
  Faisal Alsaif, Lina Neel, Saleh Almuaiqel, Abdulaziz Almuhanna, Jude Feda, Nouf Alrumaihi, Omar Alanazi, Mohammed Almansour, Majda Fuad Saeed, Mona Soliman
  Advances in Medical Education and Practice.2023; Volume 14: 453.     CrossRef
• The Role of E-Content Development in Medical Teaching: How Far Have We Come?
  Maithili N Bankar, Nandkishor J Bankar, Brij Raj Singh, Gulshan R Bandre , Yogendra P Shelke
  Cureus.2023;[Epub]     CrossRef
• Medical students’ knowledge and attitude towards tele-education and associated factors at University of Gondar, Ethiopia, 2022: mixed method
  Rorisa Tadele Hailemariam, Araya Mesfin Nigatu, Mequannent Sharew Melaku
  BMC Medical Education.2023;[Epub]     CrossRef
• e-Learning Evaluation Framework and Tools for Global Health and Public Health Education: Protocol for a Scoping Review
  Awsan Bahattab, Michel Hanna, George Teo Voicescu, Ives Hubloue, Francesco Della Corte, Luca Ragazzoni
  JMIR Research Protocols.2023; 12: e49955.     CrossRef
• Advantages and Disadvantages, Concerns, and Solutions for Emergency Remote Teaching During COVID-19: Portuguese Lecturers’ Perspectives
  José Paulo Marques dos Santos, Carla Serrão, Teresa Sofia Amorim-Lopes, Ana Rita Rodrigues, Silvia Marina, Andreia Teixeira, Luísa Castro, Ivone Duarte
  SAGE Open.2023;[Epub]     CrossRef
• Accelerated Implementation of a Virtual Neurology Clerkship Amid a Global Crisis
  Raghav Govindarajan, Anh-Thu N. Vu, Rachel Marie E. Salas, Alexandra Michelle Miller, David J. Sandness, Rana R. Said, Andrew M. Southerland, Andres Fernandez, Sofia Romano, Brianna J. Sennott, Jorge Patino-Murillas, Madhu Soni
  Neurology.2022; 98(7): 279.     CrossRef
• Factors Influencing the Acceptance of Online Teaching Among Dental Students During COVID-19 Crisis in India
  Mansi Atri, Sukhvinder Singh Oberoi, Nilima Sharma
  Journal of Indian Association of Public Health Dentistry.2022; 20(1): 49.     CrossRef
• Asynchronous online lecture may not be an effective method in teaching cardiovascular physiology during the COVID-19 pandemic
  Weerapat Kositanurit, Sarocha Vivatvakin, Kasiphak Kaikaew, Pachara Varachotisate, Chuti Burana, Maneerat Chayanupatkul, Sekh Thanprasertsuk, Danai Wangsaturaka, Onanong Kulaputana
  BMC Medical Education.2022;[Epub]     CrossRef
• Perceived Impacts of Educational Technologies on Learning among Students in Selected Schools of Nursing in Ogun State
  Sodimu J.O., Dele-Alonge O.I., Odutayo P.O., Aminu S.O., Temitayo O.A., Alake O.M., Ayedun M.K.
  African Journal of Health, Nursing and Midwifery.2022; 5(3): 67.     CrossRef
• Survey of Ophthalmology Training Experiences Among Young Ophthalmologists in the Asia-Pacific
  Andrew S.H. Tsai, Brian S.Y. Yeo, Roberto Anaya Alaminos, Chee Wai Wong, Clement C. Tham, Seng Kheong Fang, Dennis S.C. Lam, Miguel González-Andrades, Marcus Ang
  Asia-Pacific Journal of Ophthalmology.2022; 11(5): 434.     CrossRef
• Advances in e-learning in undergraduate clinical medicine: a systematic review
  T. Delungahawatta, S. S. Dunne, S. Hyde, L. Halpenny, D. McGrath, A. O’Regan, C. P. Dunne
  BMC Medical Education.2022;[Epub]     CrossRef
• ‘Learning from home’: role of e-learning methodologies and tools during novel coronavirus pandemic outbreak
  Velusami Deepika, Krishnamurthy Soundariya, Kaliaperumal Karthikeyan, Ganapathy Kalaiselvan
  Postgraduate Medical Journal.2021; 97(1151): 590.     CrossRef
• Effect of e-learning on health sciences education: a protocol for systematic review and meta-analysis
  Krishna Regmi, Linda Jones
  Higher Education Pedagogies.2021; 6(1): 22.     CrossRef
• Aydın Adnan Menderes Üniversitesi Tıp Fakültesi’nde Pandemi Döneminde Eğitim
  Selcen ONCU
  Tıp Eğitimi Dünyası.2021; 20(60-1): 63.     CrossRef
• Barriers to Online Learning in the Time of COVID-19: A National Survey of Medical Students in the Philippines
  Ronnie E. Baticulon, Jinno Jenkin Sy, Nicole Rose I. Alberto, Maria Beatriz C. Baron, Robert Earl C. Mabulay, Lloyd Gabriel T. Rizada, Christl Jan S. Tiu, Charlie A. Clarion, John Carlo B. Reyes
  Medical Science Educator.2021; 31(2): 615.     CrossRef
• A comparative study regarding distance learning and the conventional face-to-face approach conducted problem-based learning tutorial during the COVID-19 pandemic
  Chi-chung Foo, Billy Cheung, Kent-man Chu
  BMC Medical Education.2021;[Epub]     CrossRef
• Impact of COVID-19 on orthopaedic residents—an Indian perspective
  Prasanna Kumar GS, Amit Kumar Yadav, Abhishek Harsoor, Kantharaju H, Akash V Mane, Nikhil D. Palange
  OTA International: The Open Access Journal of Orthopaedic Trauma.2021; 4(2): e096.     CrossRef
• Optimizing e-learning in oncology during the COVID-19 pandemic and beyond
  Monica Malik, Deepthi Valiyaveettil, Deepa Joseph
  Radiation Oncology Journal.2021; 39(1): 1.     CrossRef
• Lessons from the impact of COVID-19 on medical educational continuity and practices
  Camille Vatier, Alain Carrié, Marie-Christine Renaud, Noémie Simon-Tillaux, Alexandre Hertig, Isabelle Jéru
  Advances in Physiology Education.2021; 45(2): 390.     CrossRef
• Prioritising topics for developing e-learning resources in healthcare curricula: A comparison between students and educators using a modified Delphi survey
  Hooi Min Lim, Chirk Jenn Ng, Chin Hai Teo, Ping Yein Lee, Puteri Shanaz Jahn Kassim, Nurul Amelina Nasharuddin, Phelim Voon Chen Yong, Renukha Sellappans, Wei Hsum Yap, Yew Kong Lee, Zahiruddin Fitri Abu Hassan, Kuhan Krishnan, Sazlina Shariff Ghazali, Fa
  PLOS ONE.2021; 16(6): e0253471.     CrossRef
• Medical students’ perception towards E-learning during COVID 19 pandemic in a high burden developing country
  Mohamed Daffalla-Awadalla Gismalla, Mohamed Soud Mohamed, Omaima Salah O Ibrahim, Moawia Mohammed Ali Elhassan, Mohamed NaserEldeen Mohamed
  BMC Medical Education.2021;[Epub]     CrossRef
• The efficacy of virtual distance training of intensive therapy and anaesthesiology among fifth-year medical students during the COVID-19 pandemic: a cross-sectional study
  Enikő Kovács, András Kállai, Gábor Fritúz, Zsolt Iványi, Vivien Mikó, Luca Valkó, Balázs Hauser, János Gál
  BMC Medical Education.2021;[Epub]     CrossRef
• PECULIARITIES OF DISTANCE MEDICAL LEARNING DURING THE COVID 2019 LOCKDOWN: PRACTICAL EXPERIENCE OF TEACHING MEDICAL ENGLISH
  Lesya Lymar, Khrystyna Storozhuk
  Wiadomości Lekarskie.2021; 74(8): 1964.     CrossRef
• Sharing a Preliminary Experience of an Effective Online Teaching Strategy for Physiology Practicals
  Anindita Mahanta, L Sundareswaran, Krishnan S, Abhishek Sinha, Naveen P, Manasi Bhattacharjee
  Cureus.2021;[Epub]     CrossRef
• Perception of E-Resources on the Learning Process among Students in the College of Health Sciences in King Saud University, Saudi Arabia, during the (COVID-19) Outbreak
  Reham AlJasser, Lina Alolyet, Daniyah Alsuhaibani, Sarah Albalawi, Md. Dilshad Manzar, Abdulrhman Albougami
  Healthcare.2021; 10(1): 40.     CrossRef

• Exploring Adult Learners’ Viewpoints and Motivation Regarding Distance Learning in Medical Education

  
  Haifa Fahad Bin Mubayrik
  Advances in Medical Education and Practice.2020; Volume 11: 139.     CrossRef
• A systematic review of the factors – enablers and barriers – affecting e-learning in health sciences education
  Krishna Regmi, Linda Jones
  BMC Medical Education.2020;[Epub]     CrossRef
• Analyse des Stellenwertes von „eLearning“ in der Augenheilkunde und Evaluierung einer „eLearning-App“
  E. Grabowski, F. Alten, J. Termühlen, P. Heiduschka, V. Brücher, N. Eter, C. R. Clemens
  Der Ophthalmologe.2020; 117(12): 1218.     CrossRef
• Novel Coronavirus and Orthopaedic Surgery
  Zhen Chang Liang, Wilson Wang, Diarmuid Murphy, James Hoi Po Hui
  Journal of Bone and Joint Surgery.2020; 102(9): 745.     CrossRef
• What orthopedic surgeons need to know about Covid-19 pandemic
  Khaled Emara, Ahmed K. Emara, Mona Farhan, Shady Mahmoud
  Journal of Orthopaedics.2020; 21: 275.     CrossRef
• How the COVID-19 pandemic is affecting paediatric orthopaedics practice: A preliminary report
  Alejandro Peiro-Garcia, Laura Corominas, Alexandre Coelho, Lidia DeSena-DeCabo, Ferran Torner-Rubies, Cesar G. Fontecha
  Journal of Children's Orthopaedics.2020; 14(3): 154.     CrossRef
• Impact of COVID-19 pandemic on residency and fellowship training programs in Saudi Arabia: A nationwide cross-sectional study
  Ameera Balhareth, Mohammed Abdulrazzaq AlDuhileb, Fozan A Aldulaijan, Mohammed Yousef Aldossary
  Annals of Medicine and Surgery.2020; 57: 127.     CrossRef
• The Pedagogical Shift During COVID 19 Pandemic: Online Medical Education, Barriers and Perceptions in Central Kerala
  Aboobacker Mohammed Rafi, Pulikkottil Raphael Varghese, Praveenlal Kuttichira
  Journal of Medical Education and Curricular Development.2020; 7: 238212052095179.     CrossRef
• “Virtual” Boot Camp: Orthopaedic Intern Education in the Time of COVID-19 and Beyond
  Abhiram R. Bhashyam, George S. M. Dyer
  Journal of the American Academy of Orthopaedic Surgeons.2020; 28(17): e735.     CrossRef
• Pandemics and Their Impact on Medical Training: Lessons From Singapore
  Zhen Chang Liang, Shirley Beng Suat Ooi, Wilson Wang
  Academic Medicine.2020; 95(9): 1359.     CrossRef
• Perception and experience of academic Jordanian ophthalmologists with E-Learning for undergraduate course during the COVID-19 pandemic
  Noor M. Alqudah, Hisham M Jammal, Omar Saleh, Yousef Khader, Nail Obeidat, Jumana Alqudah
  Annals of Medicine and Surgery.2020; 59: 44.     CrossRef
• Geospatial Mapping of Orthopaedic Surgeons Age 60 and Over and Confirmed Cases of COVID-19
  Tarun K. Jella, Alexander J. Acuña, Linsen T. Samuel, Taral K. Jella, Thomas E. Mroz, Atul F. Kamath
  Journal of Bone and Joint Surgery.2020; 102(12): 1022.     CrossRef
• Medical Education, Pre- and Post-Pandemic Era: A Review Article
  Aldanah Althwanay, Farah Ahsan, Federico Oliveri, Harshit K Goud, Zainab Mehkari, Lubna Mohammed, Moiz Javed, Ian H Rutkofsky
  Cureus.2020;[Epub]     CrossRef
• Is Digital Transformation Possible Beyond the 20th Century Theories in Education?
  Sevgi TURAN
  Tıp Eğitimi Dünyası.2020; 19(59): 5.     CrossRef
• The Online Learning in Medical Education
  Fouad Ayoub, Mohamad Moussa, Athanasios G Papatsoris, Mohamad Abou Chakra, Nazih Bou Chahine, Youssef Fares
  Hellenic Urology.2020; 32(2): 89.     CrossRef
• Evaluating E-Learning Maturity from the viewpoints of Medical Sciences Students
  MH Ronaghi, F Hosseini
  Research in Medical Education.2019; 11(1): 29.     CrossRef
• Parsian as a Model for Employing Patient Simulation in the Learning Management System
  Shirin Ayani, Khadijeh Moulaei, Ashraf Alimadadi, Mahmoud Bakhtiari, Rafat Bayat, Faezeh Sadeghi, Samaneh Nematolahi, Mohammad Shahrabadi
  Iranian Red Crescent Medical Journal.2018;[Epub]     CrossRef
• Evaluation of an E-Learning Course for Clubfoot Treatment in Tanzania: A Multicenter Study
  Silvia D Vaca, Nicholus M Warstadt, Isidor H Ngayomela, Rachel Nungu, Emmanuel S Kowero, Sakti Srivastava
  Journal of Medical Education and Curricular Development.2018; 5: 238212051877191.     CrossRef
• E-learning in graduate medical education: survey of residency program directors
  Christopher M. Wittich, Anoop Agrawal, David A. Cook, Andrew J. Halvorsen, Jayawant N. Mandrekar, Saima Chaudhry, Denise M. Dupras, Amy S. Oxentenko, Thomas J. Beckman
  BMC Medical Education.2017;[Epub]     CrossRef
• Aprendizagem Híbrida na Educação Médica: uma Revisão Sistemática
  Ekaterini Goudouris, Miriam Struchiner
  Revista Brasileira de Educação Médica.2015; 39(4): 620.     CrossRef
• Developmental-Behavioral Pediatric Teaching of Medical Students: A National COMSEP Survey
  Neelkamal Soares, Qishan Wu, Shibani Kanungo
  Teaching and Learning in Medicine.2014; 26(4): 366.     CrossRef
• Attitude to e-learning among newly qualified doctors
  Jason Goh, Michael Clapham
  The Clinical Teacher.2014; 11(1): 20.     CrossRef
• Clinical decision making: a pilot e-learning study
  Martin Abendroth, Sigrid Harendza, Martin Riemer
  The Clinical Teacher.2013; 10(1): 51.     CrossRef
• Can computerized tests be introduced to the Korean Medical Licensing Examination?
  Sun Huh
  Journal of the Korean Medical Association.2012; 55(2): 124.     CrossRef
• Provision of electronic learning resources by UK medical schools for final year students
  Andrew Baldwin, Richard Webb, Nicola Gainsborough, David Howlett, Celine Inglis
  Medical Teacher.2011; 33(4): 325.     CrossRef
• Surgical Videos Online: A Survey of Prominent Sources and Future Trends
  Amanda Dinscore, Amy Andres
  Medical Reference Services Quarterly.2010; 29(1): 10.     CrossRef