Journal of Education and Health Promotion

Development and assessment of validity and reliability of a checklist to evaluate the Circulating and Scrub Skills of Operating Room Novices (CSSORN checklist)

Document Type : Original Article

Authors

. Morteza Nasiri 1
. Shahrzad Yektatalab 2
. Marzieh Momennasab 2
. Fatemeh Vizeshfar 2

1 Shiraz University of Medical Sciences

2 Community‑Based Psychiatric Care Research Center, School of Nursing and Midwifery, Shiraz University of Medical Sciences, Shiraz, Iran

Abstract
BACKGROUND: Assessment of circulating and scrub skills is an important issue in operating
room (OR) programs. However, there is a lack of well‑designed tools that are specifically developed
for this purpose. Hence, this study aimed to develop and determine the validity and reliability of a
checklist to measure the circulating and scrub skills of OR novices.
MATERIALS AND METHODS: This cross‑sectional methodological study was conducted among 124
OR technology students who were selected during three consecutive academic years (2019–2020 to
2021–2022). The developed checklist was evaluated with face validity, content validity (quantitative
and qualitative), construct validity  (known‑groups validity), criterion‑related validity  (concurrent
and predictive validities), internal consistency  (Kuder–Richardson 20, KR‑20), and inter‑rater
reliability (intra‑class correlation coefficient, ICC). Known‑groups validity was evaluated by comparing
the difference between the checklist scores of first‑semester and third‑semester students using
independent samples t‑test. Additionally, concurrent and predictive validities were evaluated by ICC
through measuring the correlation between the total score of checklist and grades of a multiple‑choice
test and two clinical apprenticeship courses, respectively. Data were analyzed in the Statistical
Package for Social Sciences software.
RESULTS: After reconciling the preliminary checklist in terms of face and content validities, a
checklist with 17 sub‑scales and 340 items called “Circulating and Scrub Skills of Operating Room
Novices (CSSORN)” was developed. Regarding the known‑groups validity, the third‑semester
students had higher scores compared to the first‑semester students (p < 0.001 in most sub‑scales).
Besides, the total score of checklist showed a significant correlation with the criteria of concurrent
and predictive validities (ICC = 0.64, ICC = 0.72; P < 0.001). The KR‑20 for the entire checklist was
0.90 (range: 0.60–0.93). The ICC for inter‑rater reliability was also 0.96 for the entire checklist (range:
0.76–0.99, P < 0.001 in all sub‑scales).
CONCLUSION: The CSSORN had appropriate validity and reliability to be used for measuring the
circulating and scrub skills of OR novices. To shed light on the findings, further testing of this checklist
on larger populations and in different contexts is suggested.

Keywords

Checklist
clinical competence
operating room nursing
psychometrics
students 
1. Christiansen B, Averlid G, Baluyot C, Blomberg K, Eikeland A,
Strand Finstad IR, et al. Challenges in the assessment of nursing
students in clinical placements: Exploring perceptions among
nurse mentors. Nurs Open 2021;8:1069‑76.
2. Heidarpoor P, Yazdani S, Sadati L. Non‑technical skill assessment
tools for surgical team members in the operating room: A critical
review. Shiraz E‑Med J 2021;22:e101291.
3. Ten Cate O, Carraccio C, Damodaran A, Gofton W, Hamstra SJ,
Hart DE, et al. Entrustment Decision Making: Extending Miller’s
Pyramid. Acad Med 2021;96:199‑204.
4. Bui AH, Guerrier S, Feldman DL, Kischak P, Mudiraj S,
Somerville D, et al. Is video observation as effective as live
observation in improving teamwork in the operating room?
Surgery 2018;163:1191‑6.
5. Schreyer J, Koch A, Herlemann A, Becker A, Schlenker B,
Catchpole K, et al. RAS‑NOTECHS: Validity and reliability of a
tool for measuring non‑technical skills in robotic‑assisted surgery
settings. Surg Endosc 2022;36:1916‑26.
6. Vaidya A, Aydin A, Ridgley J, Raison N, Dasgupta P, Ahmed K.
Current status of technical skills assessment tools in surgery:
A systematic review. J Surg Res 2020;246:342‑78.
7. Fahim C, Wagner N, Nousiainen MT, Sonnadara R. Assessment
of technical skills competence in the operating room: A systematic
and scoping review. Acad Med 2018;93:794‑808.
8. Hannani S, Arbkhazaie A, Sadati L, Arbkhazaie A. Determining
operating room technologists’ clinical competence in educational
care hospitals of Iran University of Medical Sciences in the year
is 2017. J Adv Pharm Edu Res 2019;9:70‑5.
9. Kalantari R, Zamanian Z, Hasanshahi M, Jamali J, Faghihi AA,
Niakan H, et al. Development and psychometric evaluation of a
behavioral marker system for circulating nurse’s non‑technical
skills. Perioper Care Oper Room Manag 2021;23:100167.
10. Zardosht R, Karimi Moonaghi H, Etezad Razavi M, Ahmady S.
Educational concern of surgical technology students in the
operating room: A grounded theory study. J Educ Health Promot
2020;9:58.
11. SCPMS. B.Sc. of Operating Room Technology Curriculum. Tehran,
Iran: Ministery of Health and Medical Education of Iran; 2014.
12. Mirbagher Ajorpaz N, Tafreshi MZ, Mohtashami J, Zayeri F,
Rahemi Z. Psychometric testing of the Persian version of the
perceived perioperative competence scale‑revised. J Nurs Meas
2017;25:162‑72.
13. Yazdimoghaddam H, Samadipour E, Ghardashi F, Borzoee F,
Akbarzadeh R, Zardosht R, et al. Designing a comprehensive
clinical competency test for operating room technology student:
Using Delphi technique and CIPP model evaluation. JEduc Health Promot 2021;10:240.
14. Mohammadi S, Tolyat M, Roshanzadeh M. Clinical evaluation
tool for operating room students: Development and measurement
of reliability and validity. Iran J Med Educ 2015;15:98‑110.
15. Mahdavi R, Pooladi S, Bahreini M, Motamed N, Hajinezhad F.
Designing and determining the psychometric properties of the
clinical skills questionnaire for operating room nursing students.
Strides Dev Med Educ 2017;14:e68126.
16. AST. Surgical Technology for the Surgical Technologist: A Positive
Care Approach. Fifth ed. Cengage Learning; 2017.
17. Phillips NF. Berry and Kohn’s Operating Room Technique.
Thirteen ed. Elsevier Mosby; 2017.
18. Rothrock JC. Alexander’s Care of the Patient in Surgery. Sixteenth
ed. Elsevier Health Sciences; 2018.
19. Waltz C, Strickland OL, Lenz E. Measurement in Nursing and
Health Research. 5th ed. New York: Springer Publishing Company;
2016.
20. Lawashe CH. A quantitative approach to content validity. Pers
Psychol 1975;28:563‑75.
21. Waltz CF, Bausell RB. Nursing Research: Design, Statistics, and
Computer Analysis. Philadelphia: F.A. Davis Company; 1983.
22. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator
of content validity? Appraisal and recommendations. Res Nurs
Health 2007;30:459‑67.
23. Torabizadeh C, Yousefinya A, Zand F, Rakhshan M, Fararooei M.
A nurses’ alarm fatigue questionnaire: Development and
psychometric properties. J Clin Monit Comput 2017;31:1305‑12.
24. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data
Analysis. Eight ed. Pearson Education Limited; 2018.
25. Polit DF, Yang F. Measurement and the Measurement of Change.
Philadelphia, PA: Wolters Kluwer; 2016.
26. Kasujja R, Bangirana P, Chiumento A, Hasan T, Jansen S,
Kagabo DM, et al. Translating, contextually adapting, and pilot
testing of psychosocial and mental health assessment instruments for
Congolese refugees in Rwanda and Uganda. Confl Health 2022;16:17.
27. Nasiri M, EslamiJ, Rashidi N, Paim CPP, Akbari F, Torabizadeh C,
et al. “Playing with Surgical Instruments (PlaSurIn)” game to train
operating room novices how to set up basic surgical instruments:
A validation study. Nurse Educ Today 2021;105:105047.
28. Koo TK, Li MY. A guideline of selecting and reporting intraclass
correlation coefficients for Reliability Research. J Chiropr Med
2016;15:155‑63.
29. Parandeh A, Rahmati‑Najarkolaei F, Isfeedvajani MS. Health
literacy knowledge and experience survey: Cross‑cultural
adaptation and the psychometric properties of the Iranian nurse
version. J Educ Health Promot 2020;9:244.
30. Mirbagher Ajorpaz N, Zagheri Tafreshi M, Mohtashami J,
Zayeri F, Rahemi Z. The effect of mentoring on clinical
perioperative competence in operating room nursing students.
J Clin Nurs 2016;25:1319‑25.
31. Hasty BN, Lau JN, Tekian A, Miller SE, Shipper ES,
Bereknyei Merrell S, et al. Validity evidence for a knowledge
assessment tool for a mastery learning scrub training curriculum.
Acad Med 2020;95:129‑35.
Journal of Education and Health Promotion
Volume 13, Issue 2
February 2023
Pages 1-9

Home

Guide for Authors

Submit Manuscript

Reviewers

Contact Us