Journal of Educational Evaluation for Health Professions

Research articles

ChatGPT (GPT-4) passed the Japanese National License Examination for Pharmacists in 2022, answering all items including those with diagrams: a descriptive study: Hiroyasu Sato, Katsuhiko Ogasawara; J Educ Eval Health Prof. 2024;21:4. Published online February 28, 2024; DOI: https://doi.org/10.3352/jeehp.2024.21.4

2,223 View
274 Download
3 Web of Science
3 Crossref

Purpose
The objective of this study was to assess the performance of ChatGPT (GPT-4) on all items, including those with diagrams, in the Japanese National License Examination for Pharmacists (JNLEP) and compare it with the previous GPT-3.5 model’s performance.
Methods
The 107th JNLEP, conducted in 2022, with 344 items input into the GPT-4 model, was targeted for this study. Separately, 284 items, excluding those with diagrams, were entered into the GPT-3.5 model. The answers were categorized and analyzed to determine accuracy rates based on categories, subjects, and presence or absence of diagrams. The accuracy rates were compared to the main passing criteria (overall accuracy rate ≥62.9%).
Results
The overall accuracy rate for all items in the 107th JNLEP in GPT-4 was 72.5%, successfully meeting all the passing criteria. For the set of items without diagrams, the accuracy rate was 80.0%, which was significantly higher than that of the GPT-3.5 model (43.5%). The GPT-4 model demonstrated an accuracy rate of 36.1% for items that included diagrams.
Conclusion
Advancements that allow GPT-4 to process images have made it possible for LLMs to answer all items in medical-related license examinations. This study’s findings confirm that ChatGPT (GPT-4) possesses sufficient knowledge to meet the passing criteria.

Citations

Citations to this article as recorded by

Potential of ChatGPT to Pass the Japanese Medical and Healthcare Professional National Licenses: A Literature Review
Kai Ishida, Eisuke Hanada
Cureus.2024;[Epub] CrossRef
Performance of Generative Pre-trained Transformer (GPT)-4 and Gemini Advanced on the First-Class Radiation Protection Supervisor Examination in Japan
Hiroki Goto, Yoshioki Shiraishi, Seiji Okada
Cureus.2024;[Epub] CrossRef
Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination
Osamu Uehara, Tetsuro Morikawa, Fumiya Harada, Nodoka Sugiyama, Yuko Matsuki, Daichi Hiraki, Hinako Sakurai, Takashi Kado, Koki Yoshida, Yukie Murata, Hirofumi Matsuoka, Toshiyuki Nagasawa, Yasushi Furuichi, Yoshihiro Abiko, Hiroko Miura
Journal of Dental Education.2024;[Epub] CrossRef

Definition of professionalism and tools for assessing professionalism in pharmacy practice: a systematic review: Huda Dubbai, Barbara-Ann Adelstein, Silas Taylor, Boaz Shulruf; J Educ Eval Health Prof. 2019;16:22. Published online August 21, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.22

19,494 View
476 Download
23 Web of Science
18 Crossref

Abstract PDF Supplementary Material

Purpose
In contemporary pharmacy, the role of pharmacists has become more multifaceted, as they now handle a wider range of tasks and take more responsibility for providing patient care than 20 years ago. This evolution in pharmacists’ responsibilities has been accompanied by the need for pharmacists to display high-quality patient-centred care and counselling, and to demonstrate professionalism, which now needs to be taught and assessed as part of pharmacy education and practice. This study aimed at identifying definitions of professionalism in pharmacy practice and critically evaluating published instruments for assessing professionalism in pharmacy practice.
Methods
We searched the medical literature listed in Scopus, MEDLINE, and PsycINFO databases from 1 January 2000 to 31 December 2018. All papers meeting our selection criteria were reviewed and summarised into a clear review of professionalism requirements in pharmacy practice. Details of the instruments measuring professionalism were reviewed in detail.
Results
There is no accepted simple definition of professionalism, although we identified several theoretical and policy frameworks required for professional pharmaceutical practice. We identified 4 instruments (the Behavioural Professionalism Assessment Instrument, Lerkiatbundit’s instrument, the Pharmacy Professionalism Instrument, and the Professionalism Assessment Tool that build on these frameworks and measure professional practice in pharmacy students. These were found to be reliable and valid, but had only been used and tested in student populations.
Conclusion
Given the increasingly broad role of community pharmacists, there is a need for assessments of professionalism in practice. Professionalism is a complex concept that is challenging to measure because it has no standardised definition and the existing literature related to the topic is limited. Currently available instruments focus on measuring the development of the elements of professionalism among pharmacy students, rather than pharmacists.

Citations

Citations to this article as recorded by

Integrating professional identity formation into experiential pharmacy education and training
Lisa M Richter, Mate M Soric, Michelle L Hilaire, Nancy E Kawahara, Nathaniel Eraikhuemen
American Journal of Health-System Pharmacy.2024; 81(1): e49. CrossRef
Perceptions of formal pharmacy leadership on the social role of the profession and its historical evolution: A qualitative study
Fernando de Castro Araújo-Neto, Aline Santana Dosea, Francielly Lima da Fonseca, Thaís Maria Araújo Tavares, Douglas de Menezes Santos, Déborah Mônica Machado Pimentel, Alessandra Rezende Mesquita, Divaldo Pereira de Lyra Jr
Exploratory Research in Clinical and Social Pharmacy.2024; 13: 100405. CrossRef
Assessment of Professionalism among Postgraduate Medical Students: A Cross-Sectional Study from Patna, Bihar
Nidhi Prasad, Sundhareshwaran Chandrasekaran, Binay Kumar, Sanjay Kumar
Cureus.2024;[Epub] CrossRef
Ethical conflicts in patient care situations of community pharmacists: a cross-sectional online survey
Kathrin Wernecke, Stephan Nadolny, Jan Schildmann, Susanne Schiek, Thilo Bertsche
International Journal of Clinical Pharmacy.2024; 46(6): 1500. CrossRef
Dress codes written for dietetics education programs: A Foucauldian discourse analysis
Michele A “Shelly” DeBiasse, Shannon M Peters, Baderha Bujiriri
Feminism & Psychology.2023; 33(2): 276. CrossRef
Preceptor Perceptions of Pharmacy Student Performance Before and After a Curriculum Transformation
Catherine A. Forrester, Da Sol Lee, Ethel Hon, Kai Ying Lim, Tina P. Brock, Daniel T. Malone, Simon G. Furletti, Kayley M. Lyons
American Journal of Pharmaceutical Education.2023; 87(2): ajpe8575. CrossRef
Physicians’ professionalism from the patients’ perspective: a qualitative study at a single-family practice in Saudi Arabia
Eiad AlFaris, Farhana Irfan, Noura Abouammoh, Nasriah Zakaria, Abdullah MA Ahmed, Omar Kasule, Dina M Aldosari, Nora A AlSahli, Mohammed Ghatar Alshibani, Gominda Ponnamperuma
BMC Medical Ethics.2023;[Epub] CrossRef
Behaviours that contribute to pharmacist professionalism: a scoping review
Deanna Mill, Amy Theresa Page, Jacinta Johnson, Renae Lloyd, Sandra Salter, Kenneth Lee, Liza Seubert, Rhonda Marise Clifford, Danielle D’Lima
BMJ Open.2023; 13(6): e070265. CrossRef
Estamos preparando os futuros médicos para atendimentos de situações de violência com enfoque em gênero e em sexualidades não heterossexuais? Relato de uma “experiência” educacional diagnóstica
Beatriz Angélica Cruz, Ana Flávia Azevedo Querichelli, Lucas Uback, Alba Regina de Abreu Lima, Júlio César André
Interface - Comunicação, Saúde, Educação.2023;[Epub] CrossRef
Are we preparing future doctors for assistance in situations of violence with a focus on gender and non-heterosexual sexualities? Report of a diagnostic educational “experience”
Beatriz Angélica Cruz, Ana Flávia Azevedo Querichelli, Lucas Uback, Alba Regina de Abreu Lima, Júlio César André
Interface - Comunicação, Saúde, Educação.2023;[Epub] CrossRef
Cross-cultural adaptation and psychometric evaluation of the “Modification of Hall’s professionalism scale for use with pharmacists”
Fernando de Castro Araújo Neto, Thaís Maria Araújo Tavares, Douglas de Menezes Santos, Francielly Lima da Fonseca, Dyego Carlos Souza Anacleto de Araújo, Alessandra Rezende Mesquita, Divaldo Pereira de Lyra
BMC Medical Education.2023;[Epub] CrossRef
Professional tress code: I look like a pharmacist
Natalie Rosario, Joshua Wollen
Journal of the American Pharmacists Association.2022; 62(2): 424. CrossRef
Exploration of changes in pharmacy students’ perceptions of and attitudes towards professionalism: outcome of a community pharmacy experiential learning programme in Taiwan
Yen-Ming Huang, Hsun-Yu Chan, Ping-Ing Lee, Yun-Wen Tang, Ta-Wei Chiou, Karin C.S. Chen Liu, Yunn-Fang Ho
BMC Medical Education.2022;[Epub] CrossRef
Medical students’ self-evaluation of character, and method of character education
Yera Hur, Sanghee Yeo, Keumho Lee
BMC Medical Education.2022;[Epub] CrossRef
Professionalism development and assessment in the pre-registration pharmacist placement in England: transformative moments and maturation periods
Helen Ireland, Julie Sowter, Rebecca O’Rourke
International Journal of Pharmacy Practice.2022; 30(4): 367. CrossRef
Tatted not tattered
Natalie Rosario, Joshua Wollen
Journal of the American Pharmacists Association.2022; 62(5): 1538. CrossRef
Evaluation of an Instrument to Assess Students’ Personal and Professional Development During the Faculty Advising Process
Justine S. Gortney, Minakshi Lahiri, Chris Giuliano, Heba Saleem, Mehvish Khan, Francine Salinitri, Richard Lucarotti
American Journal of Pharmaceutical Education.2021; 85(3): 8201. CrossRef
Pharmacists’ clinical knowledge and practice in the safe use of contraceptives: real knowledge vs. self-perception and the implications
Ana Golić Jelić, Ljiljana Tasić, Ranko Škrbić, Valentina Marinković, Svjetlana Stoisavljević Šatara, Nataša Stojaković, Vanda Marković Peković, Brian Godman
BMC Medical Education.2021;[Epub] CrossRef

Palestinian pharmacists’ knowledge of issues related to using psychotropic medications in older people: a cross-sectional study: Ramzi Shawahna, Mais Khaskiyyi, Hadeel Abdo, Yasmen Msarwe, Rania Odeh, Souad Salame; J Educ Eval Health Prof. 2017;14:8. Published online April 24, 2017; DOI: https://doi.org/10.3352/jeehp.2017.14.8

34,937 View
329 Download
17 Web of Science
16 Crossref

Abstract PDF

Purpose
The purpose of this study was to assess the knowledge of pharmacists practicing in Palestine of issues related to using psychotropic medications in older people.
Methods
The study was conducted with a cross-sectional observational design using a questionnaire. A total of 400 pharmacists responded to a 19-statement knowledge test related to the use of psychotropic medications in older people. The study was conducted from July 2016 to February 2017. The reliability and internal consistency of the study tool was assessed using the test-retest method and the Cronbach alpha. Categorical groups were compared using the chi-square test and the Spearman rank correlation.
Results
On the 19-statement knowledge test, the median score was 55.3% with an interquartile range of 21.9%. In a comparison of the demographic and practice-related variables of the pharmacists who scored ≥ 50% on the 19-statement knowledge test with those who scored < 50%, age, gender, and having taken a course on psychotropic medications were found to be significantly associated with performance, as shown by the chi-square test and Spearman correlation.
Conclusion
Pharmacists practicing in Palestine possess less than optimal knowledge of issues related to the use of psychotropic medications in older people. Continuing educational interventions and/or training might be helpful in improving pharmacists’ knowledge of issues related to using psychotropic medications in older people.

Citations

Citations to this article as recorded by

Epilepsy knowledge and attitudes: A large observational study among the Palestinian general public
Ramzi Shawahna
Heliyon.2024; 10(1): e23707. CrossRef
Hospital Pharmacy Professionals and Cardiovascular Care: A Cross-Sectional Study Assessing Knowledge, Attitudes, and Practices in Saudi Arabia
Fahad Alzahrani, Reem A. Alhusayni, Nosaiba B. Khairi, Ammar A. Bahauddin, Shadi Tamur
Healthcare.2024; 12(6): 630. CrossRef
Community pharmacists’ knowledge, attitudes toward epilepsy and availability of antiepileptic drugs in Ouagadougou (Burkina Faso)
Alfred Anselme Dabilgou, Emile Ouédraogo, Alassane Dravé, Julie Marie Adeline Wendlamita Kyelem, Wendémi Jean-Noël Wendbénédo Savadogo, Christian Napon, Athanase Millogo, Kapouni Karfo, Jean Kaboré
The Egyptian Journal of Neurology, Psychiatry and Neurosurgery.2023;[Epub] CrossRef
Factors influencing community pharmacists’ knowledge about women’s issues in epilepsy
Ammar Abdulrahman Jairoun, Sabba Saleh Al-himyari, Moyad Shahwan, Nageeb Hassan, Saleh AL-Tamimi, Maimona Jairoun, Saed H. Zyoud, Abdullah S. Alshehri, Mustfa Faisal Alkhanani, Reem Hasaballah Alhasani, Adnan S. Alharbi, Fahad S. Alshehri, Ahmed M. Ashour
Frontiers in Public Health.2023;[Epub] CrossRef
Knowledge, attitude, and practice of patients with type 2 diabetes mellitus with regard to their disease: a cross-sectional study among Palestinians of the West Bank
Ramzi Shawahna, Saed Samaro, Zaid Ahmad
BMC Public Health.2021;[Epub] CrossRef
Are medical students adequately prepared to provide quality care for patients with epilepsy? A cross-sectional study of their knowledge and attitude
Ramzi Shawahna, Mohammad Jaber, Iyad Maqboul, Hatim Hijaz, Majd Abu-Issa, Faris Radwan, Mohammad Dweik
Epilepsy & Behavior.2021; 120: 107976. CrossRef
Pharmacists’ knowledge, attitudes, beliefs, and barriers toward breast cancer health promotion: a cross-sectional study in the Palestinian territories
Ramzi Shawahna, Hiba Awawdeh
BMC Health Services Research.2021;[Epub] CrossRef
Awareness of Beers criteria and potentially inappropriate medications among physicians and pharmacists in Palestine
Abdallah Damin Abukhalil, Abdelrazzaq Yahia Shaloudi, Niveen Mohammad Shamasneh, Asil Maher Aljamal
Journal of Pharmacy Practice and Research.2021; 51(5): 381. CrossRef
Development of consensus-based aims, contents, intended learning outcomes, teaching, and evaluation methods for a history of medicine and pharmacy course for medical and pharmacy students in the Arab world: a Delphi study
Ramzi Shawahna
BMC Medical Education.2021;[Epub] CrossRef
Knowledge, attitudes, and practices of physiotherapists with regard to epilepsy and patients with epilepsy: A systematic scoping review
Mosab Amoudi, Qais Nairat, Ramzi Shawahna
Epilepsy & Behavior.2021; 124: 108367. CrossRef
Assessing knowledge and attitudes of Palestinian undergraduate nursing students toward epilepsy and patients with epilepsy: A cross-sectional study
Ramzi Shawahna, Mohammad Jaber
Epilepsy & Behavior.2020; 102: 106811. CrossRef
Crossword puzzles improve learning of Palestinian nursing students about pharmacology of epilepsy: Results of a randomized controlled study
Ramzi Shawahna, Mohammad Jaber
Epilepsy & Behavior.2020; 106: 107024. CrossRef
Agreement of Palestinian nursing students with recommendations to eliminate epilepsy stigma and change perception of the general public about epilepsy: A cross-sectional study
Ramzi Shawahna
Epilepsy & Behavior.2020; 109: 107126. CrossRef
Prevalence and factors associated with depressive and anxiety symptoms among Palestinian medical students
Ramzi Shawahna, Suhaib Hattab, Rami Al-Shafei, Mahmoud Tab’ouni
BMC Psychiatry.2020;[Epub] CrossRef
Therapeutic monitoring of antiepileptic drugs: Recommendations to improve care of patients with epilepsy in the Palestinian practice
Ramzi Shawahna, Basel Abdelfattah, Mohammad Shafei, Saad Ruzzeh
Epilepsy & Behavior.2020; 111: 107215. CrossRef
Pharmacists’ Knowledge and Practice of Issues Related to Using Psychotropic Medication in Elderly People in Ethiopia: A Prospective Cross-Sectional Study
Gashaw Binega Mekonnen, Alemante Tafese Beyna
BioMed Research International.2020; 2020: 1. CrossRef

History Article

History of the national licensing examination for the health professions under the Japanese Government-General of Korea (1910-1945): In-Soon Park; J Educ Eval Health Prof. 2015;12:21. Published online May 31, 2015; DOI: https://doi.org/10.3352/jeehp.2015.12.21

35,674 View
187 Download
1 Web of Science
1 Crossref

Abstract PDF

During the reign of Japanese Government-General of Korea (Joseon) from 1910 to 1945, the main health professionals who were educated about modern medicine were categorized into physicians, dentists, pharmacists, midwives, and nurses. They were clearly distinguished from traditional health professionals. The regulations on new health professionals were enacted, and the licensing system was enforced in earnest. There were two kinds of licensing systems: the license without examination through an educational institution and the license with the national examination. The Japanese Government-General of Korea (Joseon) combined education with a national examination system to produce a large number of health professionals rapidly; however, it was insufficient to fulfill the increasing demand for health services. Therefore, the government eased the examination several times and focused on quantitative expansion of the health professions. The proportion of professionals licensed through national examination had increased. This system had produced the maximum number of available professionals at low cost. Furthermore, this system was significant in three respects: first, the establishment of the framework of the national licensing examination still used today for health professionals; second, the protection of people from the poor practices of unqualified practitioners; and third, the standardization of the quality of health.

Citations

Citations to this article as recorded by

How to romanize Korean characters in international journals
Sun Huh
Science Editing.2017; 4(2): 80. CrossRef

Research Article

Revised Subjects of the Current Korean Oriental Pharmacists' Licensing Examination: Jong-Pil Lim, Seon-Pyo Hong, Young-Mi Lee, Hoon Jeon; J Educ Eval Health Prof. 2007;4:4. Published online December 20, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.4

28,931 View
156 Download

Abstract PDF: This study is designed to draw out new integrated subjects of the Korean Oriental Pharmacists??Licensing Examination (KOPLE). In 2004, for the revision of subjects, we have analyzed the curriculums of the Oriental Pharmacy department, the oriental pharmacist?占퐏 (OP?占퐏) job description book, and the elementary items of KOPLE. We also examined the system of the Chinese Herb Pharmacists??Examination and other health personnel licensing examinations and studied the data of items and compared them with KOPLE. We heard the public opinion on the present KOPLE. We developed a subfield of 18 subjects, a middle category of 188 items, and a small category of 1,026 items. We proposed a new KOPLE that consists of three subjects: basic oriental pharmacy, applied oriental pharmacy, and laws and regulations.

First
Prev
Page of 1
Next
Last

Search