KHPLEI
Search
- Page Path
- HOME > Search
Review article
-
The impacts of computer adaptive testing from a variety of perspectives
-
Tetsuo Kimura
- J Educ Eval Health Prof. 2017;14:12. Published online May 29, 2017
- DOI: https://doi.org/10.3352/jeehp.2017.14.12
- 39,478 View
- 374 Download
- 16 Web of Science
- 16 Crossref
-
Abstract
PDF - Computer adaptive testing (CAT) is a kind of tailored testing, in that it is a form of computer-based testing that is adaptive to each test-taker’s ability level. In this review, the impacts of CAT are discussed from different perspectives in order to illustrate crucial points to keep in mind during the development and implementation of CAT. Test developers and psychometricians often emphasize the efficiency and accuracy of CAT in comparison to traditional linear tests. However, many test-takers report feeling discouraged after taking CATs, and this feeling can reduce learning self-efficacy and motivation. A trade-off must be made between the psychological experiences of test-takers and measurement efficiency. From the perspective of educators and subject matter experts, nonstatistical specifications, such as content coverage, content balance, and form length are major concerns. Thus, accreditation bodies may be faced with a discrepancy between the perspectives of psychometricians and those of subject matter experts. In order to improve test-takers’ impressions of CAT, the author proposes increasing the target probability of answering correctly in the item selection algorithm even if doing so consequently decreases measurement efficiency. Two different methods, CAT with a shadow test approach and computerized multistage testing, have been developed in order to ensure the satisfaction of subject matter experts. In the shadow test approach, a full-length test is assembled that meets the constraints and provides maximum information at the current ability estimate, while computerized multistage testing gives subject matter experts an opportunity to review all test forms prior to administration.
-
Citations
Citations to this article as recorded by
- The administration of the paper and electronic versions of the Manual Ability Measure-36 (MAM-36) and Fatigue Severity Scale (FSS) is equivalent in people with multiple sclerosis
Andrea Tacchino, Rachele Di Giovanni, Erica Grange, Maria Marcella Spirito, Michela Ponzio, Mario Alberto Battaglia, Giampaolo Brichetto, Claudio Marcello Solaro
Neurological Sciences.2024; 45(3): 1155. CrossRef - The Effect of Computerized Adaptive Testing on Motivation and Anxiety: A Systematic Review and Meta-Analysis
Hanif Akhtar, Silfiasari, Boglarka Vekety, Kristof Kovacs
Assessment.2023; 30(5): 1379. CrossRef - Stealth Literacy Assessments via Educational Games
Ying Fang, Tong Li, Linh Huynh, Katerina Christhilf, Rod D. Roscoe, Danielle S. McNamara
Computers.2023; 12(7): 130. CrossRef - Patient-reported outcome measures in cancer care: Integration with computerized adaptive testing
Minyu Liang, Zengjie Ye
Asia-Pacific Journal of Oncology Nursing.2023; 10(12): 100323. CrossRef - On Measuring Adaptivity of an Adaptive Test
Zhongmin Cui
Measurement: Interdisciplinary Research and Perspectives.2022; 20(1): 21. CrossRef - Performance Decline as an Indicator of Generalized Test-Taking Disengagement
Steven L. Wise, G. Gage Kingsbury
Applied Measurement in Education.2022; 35(4): 272. CrossRef - A content validity evaluation of the PEDI-CAT Speedy Mobility domain
Helene M. Dumas, Maria A. Fragala-Pinkham, Elaine L. Rosen, Pengsheng Ni
Physiotherapy Theory and Practice.2021; 37(4): 517. CrossRef - Item Parameter Estimation in Multistage Designs: A Comparison of Different Estimation Approaches for the Rasch Model
Jan Steinfeld, Alexander Robitzsch
Psych.2021; 3(3): 279. CrossRef - Adaptive Practice Quizzing in a University Lecture: A Pre-Registered Field Experiment
Svenja Heitmann, Niklas Obergassel, Stefan Fries, Axel Grund, Kirsten Berthold, Julian Roelle
Journal of Applied Research in Memory and Cognition.2021; 10(4): 603. CrossRef - Development and Test-Item Analysis of a Freely Available 1900-Item Question Bank for Rheumatology Trainees
Bharat Kumar, Manish Suneja, Melissa L Swee
Cureus.2021;[Epub] CrossRef - Investigating the Viability of Alternating Model Tree As An Item Selection Algorithm for Constructing Computerized Adaptive Psychological Testing
Jeong-Han Youn, Taehun Lee
The Korean Journal of Psychology: General.2021; 40(4): 539. CrossRef - Adaptive practice quizzing in a university lecture: A pre-registered field experiment.
Svenja Heitmann, Niklas Obergassel, Stefan Fries, Axel Grund, Kirsten Berthold, Julian Roelle
Journal of Applied Research in Memory and Cognition.2021; 10(4): 603. CrossRef - Development of an Item Bank to Measure Medication Adherence: Systematic Review
Yu Heng Kwan, Livia Jia Yi Oo, Dionne Hui Fang Loh, Jie Kie Phang, Si Dun Weng, Dan V Blalock, Eng Hui Chew, Kai Zhen Yap, Corrinne Yong Koon Tan, Sungwon Yoon, Warren Fong, Truls Østbye, Lian Leng Low, Hayden Barry Bosworth, Julian Thumboo
Journal of Medical Internet Research.2020; 22(10): e19089. CrossRef - Development of a Computerized Adaptive Version of the Turkish Driving Licence Exam
Nukhet CIKRIKCI, Seher YALÇIN, İlker KALENDER, Emrah GÜL, Cansu AYAN, Gizem UYUMAZ, Merve ŞAHİN KÜRŞAD, Omer KAMIS
International Journal of Assessment Tools in Education.2020; 7(4): 570. CrossRef - Plus ça change, plus c’est pareil: Making a continued case for the use of MCQs in medical education
Debra Pugh, André De Champlain, Claire Touchie
Medical Teacher.2019; 41(5): 569. CrossRef - Review: Patient-reported outcomes in multiple sclerosis care
Emanuele D'Amico, Rocco Haase, Tjalf Ziemssen
Multiple Sclerosis and Related Disorders.2019; 33: 61. CrossRef
- The administration of the paper and electronic versions of the Manual Ability Measure-36 (MAM-36) and Fatigue Severity Scale (FSS) is equivalent in people with multiple sclerosis
First
Prev
