, Fithriyah Cholifatul Ummah2,3*
, Cecilia Felicia Chandra2,3
, Nooreen Adnan4,5
1Department of Neurology, Universitas Airlangga Hospital, Surabaya, Indonesia
2Department of Medical Education, Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia
3Medical Education, Research, and Staff Development Unit, Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia
4Dow Institute of Health Professionals Education, Dow University of Health Sciences, Karachi, Pakistan
5University of South Wales, Pontypridd, UK
© 2026 Korea Health Personnel Licensing Examination Institute
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Authors’ contributions
Conceptualization: JPS, NA. Data curation: JPS, FCU, CFC. Methodology/formal analysis/validation: JPS, NA. Project administration: JPS. Visualization: JPS, FCU. Writing–original draft: JPS. Writing–review & editing: JPS, FCU, CFC, NA.
Conflict of interest
The work was completed in partial fulfillment of an MSc in Medical Education from the University of South Wales. No potential conflict of interest relevant to this article was reported.
Funding
None.
Data availability
Not applicable.
Acknowledgments
Indah Rachma Cahyani, S.IIP, M.A., Librarian Staff of Universitas Airlangga, Surabaya, Indonesia helped us in the literature search process and retrieving the full text of the article.
| Authors (year) | Country | Study design | Population | Study focusa) | MMERSQI | |||
|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | |||||
| Dickinson et al. [21] (2009) | Australia | Literature review (consensus paper) | NA | ✔ | ✔ | 0.72 | ||
| Roy et al. [22] (2016) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.68 | |
| Audetat et al. [11] (2017) | Canada, Switzerland | Literature review (consensus paper) | NA | ✔ | ✔ | ✔ | 0.69 | |
| Nadir et al. [23] (2019) | USA | Literature review (consensus paper) | NA | ✔ | ✔ | ✔ | 0.68 | |
| Jensen et al. [24] (2021) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.24 | |
| Ekpenyong et al. [25] (2024) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.84 | |
| Yan et al. [26] (2022) | USA | Meta-analysis | NA | ✔ | ✔ | 0.91 | ||
| Bond et al. [27] (2008) | USA | Qualitative focus groups | Consensus group from the 2008 Academic Emergency Medicine Consensus Conference | ✔ | ✔ | ✔ | 0.56 | |
| Audetat et al. [28] (2012) | Canada, Belgium, Switzerland | Qualitative focus groups | Four focus groups with 26 clinical educators in general practice, internal medicine, and emergency medicine (multidisciplinary) | ✔ | ✔ | ✔ | 0.81 | |
| Melia et al. [29] (2020) | USA | Qualitative focus groups | Members of the Infectious Diseases Society of America Training Program Directors’ Committee (internal medicine) | ✔ | ✔ | ✔ | 0.56 | |
| Aram et al. [30] (2013) | Australia | Quantitative, retrospective cross-sectional | 189 interns who took part in clinical rotations at Royal Brisbane and Women’s Hospital (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.84 |
| Parsons et al. [31] (2024) | USA | Quantitative, retrospective cross-sectional | 114 residents and fellows with performance concerns; 38 with deficiency in clinical reasoning (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.62 |
| Guerrasio et al. [32] (2014) | USA | Quantitative, prospective cohort | 151 learners (including medical students, residents, fellows, and attending physicians) either self-referred or were referred to the remediation program director (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.89 |
| Guerrasio and Aagard [12] (2014) | USA | Quantitative, prospective cohort | 151 learners (including medical students, residents, fellows, and attending physicians) either self-referred or were referred to the remediation program director; 53 with clinical reasoning deficits (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.89 |
| Yao and Wright [33] (2000) | USA | Quantitative, prospective cross-sectional | 404 internal medicine program directors | ✔ | ✔ | ✔ | 0.83 | |
| Bhatti et al. [34] (2016) | USA | Quantitative, prospective cross-sectional | 106 otorhinolaryngology program directors | ✔ | ✔ | ✔ | ✔ | 0.59 |
| Warburton et al. [35] (2017) | USA | Quantitative, prospective cross-sectional | 14 graduate medical education learners referred to the early intervention remediation committee (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.73 |
| Naude and Burch [36] (2018) | South Africa | Quantitative, prospective cross-sectional | 88 medical residents and 30 clinician-educators involved in the examination (internal medicine) | ✔ | ✔ | ✔ | 0.81 | |
| Boyle et al. [37] (2024) | USA | Quantitative, prospective cross-sectional, instrument validation and testing | 76 nephrology fellows (internal medicine) | ✔ | ✔ | ✔ | 0.59 | |
| Audetat et al. [38] (2015) | Canada, Switzerland | Mixed-methods | 21 family medicine residents in academic difficulty | ✔ | ✔ | ✔ | 0.73 | |
MMERSQI, Modified Medical Education Research Study Quality Instrument; NA, not applicable.
a) Study focus: (1) identification of residents with clinical reasoning skill deficits; (2) remediation of clinical reasoning deficits; (3) outcomes of clinical reasoning skill remediation; and (4) enablers and barriers of successful remediation of clinical reasoning skill deficits.
| Stakeholders | References |
|---|---|
| Allied health professionals | [34] |
| Educators and assessors (e.g., faculty, supervisors, examiners) | [11,12,22-24,26-37] |
| Peers | [33,34] |
| Program directors | [12,23,29,31-34] |
| Remediation assessment committee | [25,26,35] |
| Self-identified or self-referred | [12,22,31,32] |
| Methods | References |
|---|---|
| Examination-based | |
| Oral | |
| Case-based assessments | [11,24,29,31,33] |
| Think-aloud exercises | [27,31] |
| Written | |
| Script concordance tests | [12,21] |
| Written simulated case evaluations | [37] |
| Performance-based | |
| Objective structured clinical examinations | [34] |
| Direct observations | [11,12,27,28,33,35,36] |
| Simulation exercises | [21,23,27] |
| Non–examination-based | |
| Interviews to explore reasoning gaps | [12,22,26,32,35] |
| Chart reviews | [12,26,30,32,35,37] |
| Performance evaluations during ward rounds | [24] |
| Retrospective video reviews of clinical interactions | [21] |
| Intuitive recognition of poor performance cues | [28,33] |
| Monitoring of critical incidents | [33] |
| Multisource feedback | [21] |
| Stakeholders | References |
|---|---|
| Program directors | [23,37] |
| Remediation specialist or committee | [22,25,26,31,32,35] |
| Supervisors and faculty members | [11,12,22-32,36,38] |
| Facilitator role | References |
|---|---|
| Guide or coach | [11,12,22,26,29-32,35-38] |
| Role model | [11,24,28] |
| Supervisor or assessor | [23,24,27,33,35,38] |
| Remediation strategies | References |
|---|---|
| Pedagogical approach | |
| Case-based coaching or case reviews | [24,26,29,31,38] |
| Deliberate practice exercises | [11,26,29,31,37] |
| Guided reflective practice | [11,12,26,29] |
| Think-aloud or verbalization of reasoning processes | [11,28,32] |
| Structured reasoning frameworks or diagnostic algorithms | [11,26,29,32,38] |
| Delivery modalities | |
| Simulation-based training or exercises | [23,26,38] |
| Supplementary reading and learning resources | [24,29] |
| Video-assisted clinical reasoning reviews | [11,26] |
| Written case analysis or management worksheets | [26] |
| Enablers | References |
|---|---|
| Tutor- or faculty-related factors | |
| Identification of specific clinical reasoning microskills | [11,29,31,34] |
| Use of effective feedback techniques | [29] |
| Institutional- or policy-related factors | |
| Separation of the coaching role from formal assessment responsibilities | [31] |
| Implementation of structured or standardized remediation programs | [11,35,38] |
| Reduction of clinical responsibilities during remediation | [24,32] |
| Transparency regarding remediation program details provided in advance | [23,32] |
| Early enrolment in remediation programs | [29,32] |
| Assessment and reassessment conducted by faculty members not directly involved in remediation | [24] |
| Appointment of a dedicated remediation coordinator | [38] |
| Collaboration among key stakeholders | [23] |
| Adequate training for faculty involved in remediation programs | [28] |
| Barriers | References |
|---|---|
| Learner-related factors | |
| Poor baseline clinical knowledge | [37] |
| High clinical workload | [28,29] |
| Reluctance to seek help and resistance to feedback | [30] |
| Tutor- or faculty-related factors | |
| Limited capacity or willingness of teaching staff | [11] |
| Difficulty distinguishing between minor errors and deficits requiring remediation | [11,27] |
| Lack of a strong theoretical foundation for remediation strategies | [38] |
| Inappropriate use of diagnostic or intervention tools for reasoning deficits | [30,38] |
| High clinical workload | [28,29] |
| Institutional- or policy-related factors | |
| Time constraints and prolonged remediation periods | [12,22,23,25,27,29,30,32,34-37] |
| Absence of structured or standardized remediation programs | [28] |
| Concerns among program directors regarding potential legal implications | [35] |
| Inadequate training of clinical educators in remediation | [28] |
| PICOS categories | Inclusion criteria | Exclusion criteria |
|---|---|---|
| Population | Residents or physicians in training—defined as fully licensed physicians who have completed pre-registration requirements and are currently enrolled in formal training programs. | • Specialists who have completed their training. |
| • Physicians who have completed or withdrawn from training programs. | ||
| • Physicians not enrolled in a formal training program. | ||
| • Undergraduate medical students. | ||
| • Allied health professionals (e.g., pharmacists, dietitians, chiropractors, midwives, podiatrists, speech-language therapists, occupational therapists, physiotherapists). | ||
| • Individuals from non-clinical or non-medical disciplines (e.g., clinical and translational research). | ||
| • Practitioners of complementary, traditional, veterinary, or dental medicine. | ||
| Intervention | Remediation programs conducted in academic, clinical, or professional settings within a training program that specifically address clinical reasoning skills. | • Remediation processes that are poorly described or lack sufficient detail. |
| • Interventions that do not explicitly target clinical reasoning skills. | ||
| Comparison | Comparison of various practices in remediation programs, including remediation approaches, modalities, objectives, processes, and the presence of enabling factors or barriers. | |
| Outcome | The main outcome of interest is the effectiveness of remediation programs in improving clinical reasoning skills among residents. | |
| Study design | • Articles published in English or translated into English. | • Descriptive papers, opinion pieces, and grey literature. |
| • Study designs including: mixed methods research, meta-analyses, systematic reviews, review articles, randomized controlled trials, cohort studies, case-control studies, and cross-sectional studies. | ||
| • Publication years: 2000–2024 | ||
| • Databases: PubMed, Scopus, Medline, Web of Science, SpringerLink, ProQuest and EBSCOhost. |
| Authors (year) | Country | Study design | Population | Study focus |
MMERSQI | |||
|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | |||||
| Dickinson et al. [21] (2009) | Australia | Literature review (consensus paper) | NA | ✔ | ✔ | 0.72 | ||
| Roy et al. [22] (2016) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.68 | |
| Audetat et al. [11] (2017) | Canada, Switzerland | Literature review (consensus paper) | NA | ✔ | ✔ | ✔ | 0.69 | |
| Nadir et al. [23] (2019) | USA | Literature review (consensus paper) | NA | ✔ | ✔ | ✔ | 0.68 | |
| Jensen et al. [24] (2021) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.24 | |
| Ekpenyong et al. [25] (2024) | USA | Literature review | NA | ✔ | ✔ | ✔ | 0.84 | |
| Yan et al. [26] (2022) | USA | Meta-analysis | NA | ✔ | ✔ | 0.91 | ||
| Bond et al. [27] (2008) | USA | Qualitative focus groups | Consensus group from the 2008 Academic Emergency Medicine Consensus Conference | ✔ | ✔ | ✔ | 0.56 | |
| Audetat et al. [28] (2012) | Canada, Belgium, Switzerland | Qualitative focus groups | Four focus groups with 26 clinical educators in general practice, internal medicine, and emergency medicine (multidisciplinary) | ✔ | ✔ | ✔ | 0.81 | |
| Melia et al. [29] (2020) | USA | Qualitative focus groups | Members of the Infectious Diseases Society of America Training Program Directors’ Committee (internal medicine) | ✔ | ✔ | ✔ | 0.56 | |
| Aram et al. [30] (2013) | Australia | Quantitative, retrospective cross-sectional | 189 interns who took part in clinical rotations at Royal Brisbane and Women’s Hospital (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.84 |
| Parsons et al. [31] (2024) | USA | Quantitative, retrospective cross-sectional | 114 residents and fellows with performance concerns; 38 with deficiency in clinical reasoning (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.62 |
| Guerrasio et al. [32] (2014) | USA | Quantitative, prospective cohort | 151 learners (including medical students, residents, fellows, and attending physicians) either self-referred or were referred to the remediation program director (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.89 |
| Guerrasio and Aagard [12] (2014) | USA | Quantitative, prospective cohort | 151 learners (including medical students, residents, fellows, and attending physicians) either self-referred or were referred to the remediation program director; 53 with clinical reasoning deficits (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.89 |
| Yao and Wright [33] (2000) | USA | Quantitative, prospective cross-sectional | 404 internal medicine program directors | ✔ | ✔ | ✔ | 0.83 | |
| Bhatti et al. [34] (2016) | USA | Quantitative, prospective cross-sectional | 106 otorhinolaryngology program directors | ✔ | ✔ | ✔ | ✔ | 0.59 |
| Warburton et al. [35] (2017) | USA | Quantitative, prospective cross-sectional | 14 graduate medical education learners referred to the early intervention remediation committee (multidisciplinary) | ✔ | ✔ | ✔ | ✔ | 0.73 |
| Naude and Burch [36] (2018) | South Africa | Quantitative, prospective cross-sectional | 88 medical residents and 30 clinician-educators involved in the examination (internal medicine) | ✔ | ✔ | ✔ | 0.81 | |
| Boyle et al. [37] (2024) | USA | Quantitative, prospective cross-sectional, instrument validation and testing | 76 nephrology fellows (internal medicine) | ✔ | ✔ | ✔ | 0.59 | |
| Audetat et al. [38] (2015) | Canada, Switzerland | Mixed-methods | 21 family medicine residents in academic difficulty | ✔ | ✔ | ✔ | 0.73 | |
| Stakeholders | References |
|---|---|
| Allied health professionals | [34] |
| Educators and assessors (e.g., faculty, supervisors, examiners) | [11,12,22-24,26-37] |
| Peers | [33,34] |
| Program directors | [12,23,29,31-34] |
| Remediation assessment committee | [25,26,35] |
| Self-identified or self-referred | [12,22,31,32] |
| Methods | References |
|---|---|
| Examination-based | |
| Oral | |
| Case-based assessments | [11,24,29,31,33] |
| Think-aloud exercises | [27,31] |
| Written | |
| Script concordance tests | [12,21] |
| Written simulated case evaluations | [37] |
| Performance-based | |
| Objective structured clinical examinations | [34] |
| Direct observations | [11,12,27,28,33,35,36] |
| Simulation exercises | [21,23,27] |
| Non–examination-based | |
| Interviews to explore reasoning gaps | [12,22,26,32,35] |
| Chart reviews | [12,26,30,32,35,37] |
| Performance evaluations during ward rounds | [24] |
| Retrospective video reviews of clinical interactions | [21] |
| Intuitive recognition of poor performance cues | [28,33] |
| Monitoring of critical incidents | [33] |
| Multisource feedback | [21] |
| Stakeholders | References |
|---|---|
| Program directors | [23,37] |
| Remediation specialist or committee | [22,25,26,31,32,35] |
| Supervisors and faculty members | [11,12,22-32,36,38] |
| Facilitator role | References |
|---|---|
| Guide or coach | [11,12,22,26,29-32,35-38] |
| Role model | [11,24,28] |
| Supervisor or assessor | [23,24,27,33,35,38] |
| Remediation strategies | References |
|---|---|
| Pedagogical approach | |
| Case-based coaching or case reviews | [24,26,29,31,38] |
| Deliberate practice exercises | [11,26,29,31,37] |
| Guided reflective practice | [11,12,26,29] |
| Think-aloud or verbalization of reasoning processes | [11,28,32] |
| Structured reasoning frameworks or diagnostic algorithms | [11,26,29,32,38] |
| Delivery modalities | |
| Simulation-based training or exercises | [23,26,38] |
| Supplementary reading and learning resources | [24,29] |
| Video-assisted clinical reasoning reviews | [11,26] |
| Written case analysis or management worksheets | [26] |
| Enablers | References |
|---|---|
| Tutor- or faculty-related factors | |
| Identification of specific clinical reasoning microskills | [11,29,31,34] |
| Use of effective feedback techniques | [29] |
| Institutional- or policy-related factors | |
| Separation of the coaching role from formal assessment responsibilities | [31] |
| Implementation of structured or standardized remediation programs | [11,35,38] |
| Reduction of clinical responsibilities during remediation | [24,32] |
| Transparency regarding remediation program details provided in advance | [23,32] |
| Early enrolment in remediation programs | [29,32] |
| Assessment and reassessment conducted by faculty members not directly involved in remediation | [24] |
| Appointment of a dedicated remediation coordinator | [38] |
| Collaboration among key stakeholders | [23] |
| Adequate training for faculty involved in remediation programs | [28] |
| Barriers | References |
|---|---|
| Learner-related factors | |
| Poor baseline clinical knowledge | [37] |
| High clinical workload | [28,29] |
| Reluctance to seek help and resistance to feedback | [30] |
| Tutor- or faculty-related factors | |
| Limited capacity or willingness of teaching staff | [11] |
| Difficulty distinguishing between minor errors and deficits requiring remediation | [11,27] |
| Lack of a strong theoretical foundation for remediation strategies | [38] |
| Inappropriate use of diagnostic or intervention tools for reasoning deficits | [30,38] |
| High clinical workload | [28,29] |
| Institutional- or policy-related factors | |
| Time constraints and prolonged remediation periods | [12,22,23,25,27,29,30,32,34-37] |
| Absence of structured or standardized remediation programs | [28] |
| Concerns among program directors regarding potential legal implications | [35] |
| Inadequate training of clinical educators in remediation | [28] |
MMERSQI, Modified Medical Education Research Study Quality Instrument; NA, not applicable. Study focus: (1) identification of residents with clinical reasoning skill deficits; (2) remediation of clinical reasoning deficits; (3) outcomes of clinical reasoning skill remediation; and (4) enablers and barriers of successful remediation of clinical reasoning skill deficits.