Eliciting preferences of professors and medical group students for evaluation methods of theoretical courses: An application of discrete choice experiment analysis
Pages 1-9
. Ali Kazemi Karyan, . Satar Rezaei, . Shokooh Etesami, . Leyla Pezhman, . Behzad Karami Matin, . Sajad Delavari
Abstract BACKGROUND: Evaluation has become an inseparable part of education process which gives
feedback to students and professors to improve education quality. This study aimed to elicit
preferences of professors and students about attributes of evaluation methods in theoretical courses
in Kermanshah University of Medical Sciences, Iran, in 2018.
MATERIALS AND METHODS: Discrete choice experiment (DCE) method used for eliciting preferences
of participants of the study. A narrative literature review and interview with eight professors and ten
students conducted to determine attributes and levels of evaluation methods in the university. Furthermore,
experimental design used for making final choice sets of the evaluation methods. We included 213
students and 30 professors in the study. Conditional logistic regression model performed to data analysis.
RESULTS: Most of the professors (36.67%) preferred to allocate up to 30% of evolution scores to
midterm examination. However, the most percentage of students (30.45%) were agree to include
midterm examination up to 15% of total scores. The majority of students prefer to examination
questions compromise just presented materials, while 70% of professors prefer to include additional
texts for evaluation examinations. In case of quiz examination, professors in comparison with students
prefer that quiz should have higher proportion of total scores. DCE analysis indicated that professors
and students preferred a mix of questions in examinations. In addition, additional resources beyond
what is taught in class made utility for professors and disutility for students. Quiz, also, increased
the utility of an evaluation package in professors.
CONCLUSION: The findings showed that there is a gap between preferences of professors and
students regarding some attributes of evaluation methods such as student’s discipline, examination
materials, and quiz. Further studies are needed to examining other attributes of evaluation methods
in theatrical and practical courses in Iran and other contexts.
