Office of Medical and Health Education, Faculty of Medicine and Health, The University of New South Wales, Sydney, NSW, Australia
© 2022 Korea Health Personnel Licensing Examination Institute
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Authors’ contributions
Conceptualization: BS, GV, SK. Data curation: BS. Formal analysis: BS. Funding acquisition: not available. Methodology: BS. Project administration: BS. Visualization: BS. Writing–original draft: BS, GV, SK. Writing–review & editing: BS, GV, SK.
Conflict of interest
Boaz Shulruf has been an associate editor of the Journal of Educational Evaluation for Health Professions since 2017, but had no role in the decision to publish this review. No other potential conflict of interest relevant to this article was reported.
Funding
None.
Data availability
Data files are available from Harvard Dataverse: https://doi.org/10.7910/DVN/K1NLXS
Dataset 1. Administrative data for student selection of 5 cohorts of students (2014–2018), including one cohort for a new process and the other 4 cohorts for an old process at the University of New South Wales, Australia.
Dataset 2. Results from the interview of the new selection process including all interviewers’ marks.
Variable | Selection year |
Total | ||||
---|---|---|---|---|---|---|
2014 | 2015 | 2016 | 2017 | 2018 | ||
Men | ||||||
Count | 97 | 77 | 81 | 80 | 91 | 426 |
% Within gender | 22.8 | 18.1 | 19.0 | 18.8 | 21.4 | 100.0 |
% Within selection year | 49.0 | 42.8 | 46.0 | 44.0 | 53.8 | 47.1 |
Women | ||||||
Count | 101 | 103 | 95 | 102 | 78 | 479 |
% Within gender | 21.1 | 21.5 | 19.8 | 21.3 | 16.3 | 100.0 |
% Within selection year | 51.0 | 57.2 | 54.0 | 56.0 | 46.2 | 52.9 |
Total | ||||||
Count | 198 | 180 | 176 | 182 | 169 | 905 |
% Within gender | 21.9 | 19.9 | 19.4 | 20.1 | 18.7 | 100.0 |
% Within selection year | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 |
Variable | Sum of squares | df | Mean square | F-value | Significance |
---|---|---|---|---|---|
UAC Rank | |||||
Between groups | 11.481 | 4 | 2.870 | 0.987 | 0.414 |
Within groups | 2,618.439 | 900 | 2.909 | ||
Total | 2,629.921 | 904 | |||
UMAT mean | |||||
Between groups | 215.756 | 4 | 53.939 | 1.741 | 0.139 |
Within groups | 27,885.126 | 900 | 30.983 | ||
Total | 28,100.882 | 904 | |||
SES decile | |||||
Between groups | 16.367 | 4 | 4.092 | 0.521 | 0.720 |
Within groups | 6,929.136 | 883 | 7.847 | ||
Total | 6,945.503 | 887 |
Selection process | Unstand. Coeff |
Stand. Coeff |
t-value | Significance | 95% CI for B | R2 | |
---|---|---|---|---|---|---|---|
B | Standard error | Beta | |||||
Old selection process | 0.084 | ||||||
(Constant) | 46.546 | 5.411 | 8.602 | 0.000 | 35.923 to 57.170 | ||
Gender | -0.277 | 0.374 | -0.028 | -0.741 | 0.459 | -1.011 to 0.457 | |
Socioeconomic decile | 0.037 | 0.078 | 0.021 | 0.473 | 0.636 | -0.116 to 0.190 | |
Selection pathway (local/rural) | -0.967 | 0.723 | -0.085 | -1.338 | 0.181 | -2.387 to 0.452 | |
UAC Rank standardized score | 0.147 | 0.050 | 0.145 | 2.950 | 0.003 | 0.049 to 0.244 | |
UMAT standardized score | 0.040 | 0.051 | 0.039 | 0.781 | 0.435 | -0.060 to 0.140 | |
Interview standardized score | -0.115 | 0.040 | -0.116 | -2.855 | 0.004 | -0.194 to -0.036 | |
New selection process | 0.178 | ||||||
(Constant) | 19.744 | 7.636 | 2.586 | 0.011 | 4.663 to 34.824 | ||
Gender | -1.469 | 0.721 | -0.147 | -2.039 | 0.043 | -2.892 to -0.046 | |
Socioeconomic decile | 0.091 | 0.172 | 0.048 | 0.528 | 0.598 | -0.249 to 0.430 | |
Selection pathway (local/rural) | 1.071 | 1.291 | 0.096 | 0.830 | 0.408 | -1.478 to 3.620 | |
UAC Rank standardized score | 0.351 | 0.088 | 0.351 | 3.972 | 0.000 | 0.177 to 0.526 | |
UMAT standardized score | 0.139 | 0.093 | 0.139 | 1.497 | 0.136 | -0.044 to 0.322 | |
Interview standardized score | 0.109 | 0.073 | 0.109 | 1.499 | 0.136 | -0.035 to 0.253 |
Selection process | Unstand. Coeff |
Stand. Coeff,hr/> | t-value | Significance | 95% CI for B | R2 | |
---|---|---|---|---|---|---|---|
B | Standard error | Beta | |||||
Old selection process | 0.030 | ||||||
(Constant) | 43.490 | 5.563 | 7.818 | 0.000 | 32.568 to 54.412 | ||
Gender | 1.331 | 0.384 | 0.133 | 3.461 | 0.001 | 0.576 to 2.086 | |
Socioeconomic decile | 0.067 | 0.080 | 0.037 | 0.828 | 0.408 | -0.091 to 0.224 | |
Selection pathway (local/rural) | 1.451 | 0.744 | 0.128 | 1.952 | 0.051 | -0.009 to 2.911 | |
UAC Rank standardized score | 0.080 | 0.051 | 0.079 | 1.572 | 0.117 | -0.020 to 0.181 | |
UMAT standardized score | -0.009 | 0.052 | -0.009 | -0.174 | 0.862 | -0.112 to 0.094 | |
Interview standardized score | 0.026 | 0.041 | 0.026 | 0.632 | 0.527 | -0.055 to 0.108 | |
New selection process | 0.094 | ||||||
(Constant) | 26.628 | 8.018 | 3.321 | 0.001 | 10.792 to 42.464 | ||
Gender | 1.437 | 0.757 | 0.144 | 1.900 | 0.059 | -0.057 to 2.932 | |
Socioeconomic decile | 0.264 | 0.180 | 0.140 | 1.465 | 0.145 | -0.092 to 0.621 | |
Selection pathway (local/rural) | 0.836 | 1.355 | 0.075 | 0.616 | 0.538 | -1.841 to 3.512 | |
UAC Rank standardized score | 0.152 | 0.093 | 0.152 | 1.637 | 0.104 | -0.031 to 0.335 | |
UMAT standardized score | 0.082 | 0.097 | 0.082 | 0.844 | 0.400 | -0.110 to 0.274 | |
Interview standardized score | 0.175 | 0.077 | 0.175 | 2.291 | 0.023 | 0.024 to 0.327 |
Selection process | Unstand. Coeff |
Stand. Coeff |
t-value | Significance | 95% CI for B | R2 | |
---|---|---|---|---|---|---|---|
B | Standard error | Beta | |||||
Old selection process | 0.015 | ||||||
(Constant) | 43.232 | 5.610 | 7.706 | 0.000 | 32.217 to 54.246 | ||
Gender | 0.905 | 0.388 | 0.090 | 2.334 | 0.020 | 0.144 to 1.666 | |
Socioeconomic decile | 0.052 | 0.081 | 0.029 | 0.641 | 0.522 | -0.107 to 0.211 | |
Selection pathway (local/rural) | 0.333 | 0.750 | 0.029 | 0.444 | 0.657 | -1.139 to 1.805 | |
UAC Rank standardized score | 0.096 | 0.052 | 0.095 | 1.865 | 0.063 | -0.005 to 0.197 | |
UMAT standardized score | 0.026 | 0.053 | 0.025 | 0.487 | 0.626 | -0.078 to 0.130 | |
Interview standardized score | -0.006 | 0.042 | -0.006 | -0.138 | 0.890 | -0.088 to 0.076 | |
New selection process | 0.116 | ||||||
(Constant) | 34.655 | 7.919 | 4.376 | 0.000 | 19.015 to 50.296 | ||
Gender | 1.167 | 0.747 | 0.117 | 1.562 | 0.120 | -0.309 to 2.643 | |
Socioeconomic decile | 0.394 | 0.178 | 0.209 | 2.209 | 0.029 | 0.042 to 0.746 | |
Selection pathway (local/rural) | -0.496 | 1.339 | -0.044 | -0.371 | 0.711 | -3.140 to 2.148 | |
UAC Rank standardized score | 0.171 | 0.092 | 0.172 | 1.870 | 0.063 | -0.010 to 0.353 | |
UMAT standardized score | -0.051 | 0.096 | -0.051 | -0.529 | 0.598 | -0.241 to 0.139 | |
Interview standardized score | 0.118 | 0.076 | 0.118 | 1.561 | 0.121 | -0.031 to 0.268 |
UAC, Universities Admissions Centre; UMAT, Undergraduate Medicine and Health Sciences Admission Test; SES, socioeconomic status; df, degrees of freedom.
Unstand. Coeff, unstandardized canonical discriminant function coefficient; Stand. Coeff, standardized canonical discriminant function coefficient; CI, confidence interval; UAC, Universities Admissions Centre; UMAT, Undergraduate Medicine and Health Sciences Admission Test.
Unstand. Coeff, unstandardized canonical discriminant function coefficient; Stand. Coeff, standardized canonical discriminant function coefficient; CI, confidence interval; UAC, Universities Admissions Centre; UMAT, Undergraduate Medicine and Health Sciences Admission Test.
Unstand. Coeff, unstandardized canonical discriminant function coefficient; Stand. Coeff, standardized canonical discriminant function coefficient; CI, confidence interval; UAC, Universities Admissions Centre; UMAT, Undergraduate Medicine and Health Sciences Admission Test.