. Mostafa Dehghani Poudeh; . Aeen Mohammadi; . Rita Mojtahedzadeh; . Nikoo Yamani; . Ali Delavar
Volume 11, Issue 9 , October 2021, , Pages 1-13
Abstract
BACKGROUND: Kane’s validity framework examines the validity of the interpretation of a test at thefour levels of scoring, generalization, extrapolation, and implications. No model ...
Read More
BACKGROUND: Kane’s validity framework examines the validity of the interpretation of a test at thefour levels of scoring, generalization, extrapolation, and implications. No model has been yet proposedto use this framework particularly for a system of assessment. This study provided a model for thevalidation of the internal medicine residents’ assessment system, based on the Kane’s framework.MATERIALS AND METHODS: Through a five stages study, first, by reviewing the literature, themethods used, and the study challenges, in using Kane’s framework, were extracted. Then, possibleassumptions about the design and implementation of residents’ tests and the proposed methods fortheir validation at each of their four inferences of Kane’s validity were made in the form of two tables.Subsequently, in a focus group session, the assumptions and proposed validation methods werereviewed. In the fourth stage, the opinions of seven internal medicine professors were asked aboutthe results of the focus group. Finally, the assumptions and the final validation model were prepared.RESULTS: The proposed tables were modified in the focus group. The validation table was developedconsisting of tests, used at each Miller’s pyramid level. The results were approved by five professorsof the internal medicine. The final table has five rows, respectively, as the levels of Knows and KnowsHow, Shows How, Shows, Does, and the fifth one for the final scores of residents. The columnsof the table demonstrate the necessary measures for validation at the four levels of inferences ofKane’s framework.CONCLUSION: The proposed model ensures the validity of the internal medicine specialty residencyassessment system based on Kane’s framework, especially at the implication level.
