Document Type : Original Article
Authors
1 Departments of Medical Education
2 Department of Medical Education, Edge Hill University Medical School, Edge Hill University, Ormskirk, UK
3 Departments of Medical Education Education Development Center, Zanjan University of Medical Sciences, Zanjan, Iran
4 Health Professions Education Research Center, Tehran University of Medical Sciences Departments of Medical Education and Internal Medicine, School of Medicine, Tehran University of Medical Sciences
5 Departments of Medical Education Education Development Center, Tehran University of Medical Sciences, Tehran, Iran
Abstract
BACKGROUND: Organizational capacity development is an important outcome of faculty
development programs, but there is a lack of an appropriate instrument for its evaluation.
AIMS AND OBJECTIVES: The aim of this study was to develop a questionnaire to evaluate the
organizational capacity development for faculty development programs and to test its psychometrics.
MATERIALS AND METHODS: The initial capacity development for faculty development
questionnaire (CDQ‑FD) of 26 items was developed based on a literature review and opinion
of experts. Content validity ratio (CVR), content validity index (CVI), content validity index for
items (I‑CVI), and the content validity index for scales (S‑CVI) were computed for content validity.
Confirmatory factor analysis (CFA) and exploratory factor analysis (EFA) were performed for construct
validation.
RESULTS: The score for CVR, CVI, I‑CVI, and S‑CVI was 0.71, 0.83, 0.87, and 0.90, respectively.
EFA resulted in a three‑factor model with total variance extraction of 64%. Cronbach’s alpha and
Spearman Brown coefficient were investigated for reliability assessment. The Cronbach’s alpha of
overall scale was 0.8 and the test‑retest reliability of the overall scale was 0.78. The final CDQ‑FD
contained 21 items and three categories.
CONCLUSIONS: The CDQ‑FD questionnaire appears to be a valid and reliable instrument for the
evaluation of organizational capacity development for faculty development in the medical education.
Keywords
Naismith L, et al. A systematic review of faculty development
initiatives designed to enhance teaching effectiveness: A 10‑year
update: BEME Guide No. 40. Med Teach 2016;38:769‑86.
2. Guraya SY, Chen S. The impact and effectiveness of faculty
development program in fostering the faculty’s knowledge,
skills, and professional competence: A systematic review and
meta‑analysis. Saudi J Biol Sci 2019;26:688‑97.
3. Sarikaya O, Kalaca S, Yegen BC, Cali S. The impact of a faculty
development program: Evaluation based on the self‑assessment
of medical educators from preclinical and clinical disciplines. Adv
Physiol Educ 2010;34:35‑40.
4. Moore P, Montero L, Triviño X, Sirhan M, Leiva L. Impact beyond
the objectives: A qualitative study of a faculty development
program in medical education. Rev Med Chil 2014;142:336‑43.
5. Abu‑Rish Blakeney E, Pfeifle A, Jones M, Hall LW, Zierler BK.
Findings from a mixed‑methods study of an interprofessional
faculty development program. J Interprof Care 2016;30:83‑9.
6. Julian K, Appelle N, O’Sullivan P, Morrison EH, Wamsley M. The
impact of an objective structured teaching evaluation on faculty
teaching skills. Teach Learn Med 2012;24:3‑7.
7. Abigail LK. Do communities of practice enhance faculty
development? Health Prof Educ 2016;2:61‑74.
8. Saiki T, Imafuku R, Pickering J, Suzuki Y, Steinert Y. On‑site
observational learning in faculty development: Impact of an
international program on clinical teaching in medicine. J Contin
Educ Health Prof 2019;39:144‑51.
9. Nor MZ. Contribution of faculty development programs to
professional identity development of medical educators in
Malaysia: A phenomenological study. J Taibah Univ Med Sci
2019;14:324‑31.
10. Lee SS, Dong C, Yeo SP, Gwee MC, Samarasekera DD. Impact of
faculty development programs for positive behavioural changes
among teachers: A case study. Korean J Med Educ 2018;30:11‑22.
11. Steinert Y. Faculty development: From rubies to oak. Med Teach
2020;42:429‑35.
12. Olupeliyawa AM, Venkateswaran S, Wai N, Mendis K, Flynn E,
Hu W. Transferability of faculty development resources. Clin
Teach 2020;17:86‑91.
13. AmbarsarieR, MustikaR, Soemantri D. Formulating a need‑based
faculty development model for medical schools in Indonesia.
Malays J Med Sci 2019;26:90‑100.
14. Watkins KD. Faculty development to support interprofessional
education in healthcare professions: A realist synthesis. J Interprof
Care 2016;30:695‑701.
15. Fernandez N, Audétat MC. Faculty development program
evaluation: A need to embrace complexity. Adv Med Educ Pract
2019;10:191‑9.
16. Venner M. The concept of ‘capacity’in development assistance:
New paradigm or more of the same? Global Change Peace
Security 2015;27:85‑96.
17. MacKintosh R. Capacity in maritime archaeology: A framework
for analysis. J Maritime Archaeol 2019;14:391‑408.
18. Bezboruah KC. Community organizing for health care: An
analysis of the process. J Community Pract 2013;21:9‑27.
19. Haynes A, Rowbotham SJ, Redman S, Brennan S, Williamson A,
Moore G. What can we learn from interventions that aim to
increase policy‑makers’ capacity to use research? A realist scoping
review. Health Res Policy Syst 2018;16:31.
20. Frantz JM, Bezuidenhout J, Burch VC, Mthembu S, Rowe M,
Tan C, et al. The impact of a faculty development programme for
health professions educators in sub‑Saharan Africa: An archival
study. BMC Med Educ 2015;15:28.
21. Frantz J, Rhoda A, Sandars J, Murdoch‑Eaton DB, Marshall M,
Burch VC. Understanding faculty development as capacity
development: A case study from South Africa. Afr J Health Prof
Educ 2019;11:53‑6.
22. Salajegheh M, Gandomkar R, Mirzazadeh A, Sandars J. Capacity
development indicators for faculty development programs:
A narrative review. Annual Association for Medical Education
in Europe. Congress Center Basel, Switzerland; 25‑29, August,
2018.
23. Salajegheh M, Gandomkar R, Mirzazadeh A, Sandars J.
Identification of capacity development indicators for faculty
development programs: A nominal group technique study. BMC
Med Educ 2020;20:1‑8.
24. Kääriäinen M, Mikkonen K, Kyngäs H. Instrument development
based on content analysis. In: The Application of Content Analysis
in Nursing Science Research. Cham: Springer; 2020. p. 85‑93.
25. Glasberg SB. Scientific comparison and validity requires
appropriate use. Plast Reconstr Surg 2017;140:750e‑1e.
26. Yusoff MS. ABC of content validation and content validity index
calculation. Educ Med J 2019;11 (2):49–54. .
27. Schmitt TA. Current methodological considerations in
exploratory and confirmatory factor analysis. J Psychoeduc Assess
2011;29:304‑21.
28. Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample size
requirements for structural equation models: An evaluation
of power, bias, and solution propriety. Educ Psychol Meas
2013;76:913‑34.
29. Vallejo B, Wehn U. Capacity development evaluation: The
challenge of the results agenda and measuring return on
investment in the global south. World Dev 2016;79:1‑3.
30. Lim LA, Choy LF. Preparing staff for problem‑based learning:
Outcomes of a comprehensive faculty development program.
IJRSE 2014;3:53‑68.
31. Zheng M, Bender D, Nadershahi N. Faculty professional
development in emergent pedagogies for instructional innovation
in dental education. Eur J Dent Educ 2017;21:67‑78.
32. Jones M, Schuer KM, Ballard JA, Taylor SA, Zephyr D, Jones MD.
Outcomes of an immersive pilot faculty development program for interprofessional facilitation: A mixed methods study. J Interprof
Educ Pract 2015;1:83‑9.
33. Branch WT Jr., Chou CL, Farber NJ, Hatem D, Keenan C,
Makoul G, et al. Faculty development to enhance humanistic
teaching and role modeling: A collaborative study at eight
institutions. J Gen Intern Med 2014;29:1250‑5.
34. Fleming GM, Simmons JH, XuM, Gesell SB, BrownRF, CutrerWB,
et al. A facilitated peer mentoring program for junior faculty to
promote professional development and peer networking. Acad
Med 2015;90:819‑26.
35. Khoshhal KI, Guraya SY. Leaders produce leaders and
managers produce followers. A systematic review of the desired
competencies and standard settings for physicians’ leadership.
Saudi Med J 2016;37:1061‑7.
36. Burdick WP, Diserens D, Friedman SR, Morahan PS, Kalishman S,
Eklund MA, et al. Measuring the effects of an international
health professions faculty development fellowship: The FAIMER
Institute. Med Teach 2010;32:414‑21.
37. Jacobs JA, Duggan K, Erwin P, Smith C, Borawski E, Compton J,
et al. Capacity building for evidence‑based decision making
in local health departments: Scaling up an effective training
approach. Implement Sci 2014;9:124.
)