Journal of Education and Health Promotion

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review

Document Type : Original Article

Authors

. Hojjat Sheikhbardsiri
. Mohammad H Yarmohammadian
. Hamid Reza Khankeh 1
. Mahmoud Nekoei-Moghadam 2
. Ahmad Reza Raeisi

1 Research Center in Emergency and Disaster Health, University of Social Welfare and Rehabilitation Sciences, Tehran

2 Research Center for Health Services Management, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran

Abstract
OBJECTIVE: Exercise evaluation is one of the most important steps and sometimes neglected in
designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and
interpreting related information to indicate how an exercise has fulfilled its objectives. The present
study aimed to assess the most important evaluation techniques applied in evaluating health exercises
for emergencies and disasters.
METHODS: This was meta-evaluation study through a systematic review. In this research, we
searched papers based on specific and relevant keywords in research databases including ISI web
of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian
database such as ISC and SID. The search keywords and strategies are followed; “simulation,”
“practice,” “drill,” “exercise,” “instrument,” “tool,” “questionnaire,” “ measurement,” “checklist,” “scale,”
“test,” “inventory,” “battery,” “evaluation,” “assessment,” “appraisal,” “emergency,” “disaster,” “cricise,”
“hazard,” “catastrophe,: “hospital”, “prehospital,” “health centers,” “treatment centers,” were used in
combination with Boolean operators OR and AND.
RESULTS: The research findings indicate that there are different techniques and methods for data
collection to evaluate performance exercises of health centers and affiliated organizations in disasters
and emergencies including debriefing inventories, self‑report, questionnaire, interview, observation,
shooting video, and photographing, electronic equipment which can be individually or collectively
used depending on exercise objectives or purposes.
CONCLUSION: Taking exercise in the health sector is one of the important steps in preparation and
implementation of disaster risk management programs. This study can be thus utilized to improve
preparedness of different sectors of health system according to the latest available evaluation
techniques and methods for better implementation of disaster exercise evaluation stages.

Keywords

Disaster
emergency
evaluation
exercise
health
preparedness
1. Khankeh H, Khorasani‑Zavareh D, Masoumi G. Why the
prominent improvement in prehospital medical response in Iran
couldn’t decrease the number of death related road traffic injuries.
J Trauma Treat 2012;1:2167.
2. Sheikhbardsiri H, Raeisi AR, Nekoei‑Moghadam M, Rezaei F.
Surge capacity of hospitals in emergencies and disasters with a
preparedness approach: A Systematic review. Disaster Med Public
Health Prep 2017;11:612‑20.
3. Tavakoli N, Yarmohammadian MH, Safdari R, Keyvanara M.
Designing a model of patient tracking system for natural disaster
in Iran. J Educ Health Promot 2017;6:77.
4. Arab M, Zeraati H, Akbari Haghighi F, Ravangard R. A study
on the executive managers’ knowledge and performance, and
their hospitals preparedness against earthquake events and their
relationships at public hospitals (affiliated by Tehran University of
Medical Sciences (TUMS) 2005‑2006). J Health Adm 2009;11:7‑14.
5. Ejeta LT, Ardalan A, Paton D. Application of behavioral
theories to disaster and emergency health preparedness:
A Systematic review. PLoS Curr 2015;7: pii: ecurrents.dis.
31a8995ced321301466db400f1357829.
6. Khankeh H. Disaster Hospital Preparedness, National Plan.
Tehran: University of Social Welfare and Rehabilitation; 2012.
7. Yarmohammadian MH, Rezaei F, Haghshenas A, Tavakoli N.
Overcrowding in emergency departments: A review of strategies
to decrease future challenges. J Res Med Sci 2017;22:23.
8. Khademipour G, Nakhaee N, Anari SMS, Sadeghi M,
Ebrahimnejad H, Sheikhbardsiri H, et al. Crowd simulations and
determining the critical density point of emergency situations.
Disaster Med Public Health Prep 2017:1‑7.
9. Parsons E, McAdams T. MDH Homeland Security Exercise and
Evaluation Program (HSEEP) Training Activity: OEP‑Minnesota
Department Of Health. Secur TDH; 2013.
10. Radi D, McAdams T. MDH Homeland Security Exercise and
Evaluation Program (HSEEP) Training Activity: EPR‑Minnesota
Department Of Health; 2007.
11. Henstra D. Evaluating local government emergency management
programs: What framework should public managers adopt?
Public Adm Rev 2010;70:236‑46.
12. Adib HM, mousavi MS, Lotfi MS, Aminolroayaee E. Evaluating
the quality of lesson plans by nursing and midwifery faculty
members of selected nursing schools in Iran. Educational
development of jundishapur 2013; 4:25‑33.
13. Jencks SF, Williams MV, Coleman EA. Rehospitalizations among
patients in the Medicare fee‑for‑service program. N Engl J Med
2009;360:1418‑28.
14. Wang L, Antoun C, Sanders R, Nichols E, Olmsted‑Hawala EL,
Falcone B, et al. Experimentation for Developing Evidence‑Based
UI Standards of Mobile Survey Questionnaires. In Proceedings of
the 2017 CHI Conference Extended Abstracts on Human Factors
in Computing Systems. ACM; 2017.
15. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA
Group. Preferred reporting items for systematic reviews and
meta‑analyses: The PRISMA statement. Ann Intern Med
2009;151:264‑9, W64.
16. Singh J. Critical appraisal skills programme. J Pharmacol
Pharmacother 2013;4:76.
17. Djalali A, Carenzo L, Ragazzoni L, Azzaretto M, Petrino R,
Della Corte F, et al. Does hospital disaster preparedness predict
response performance during a full‑scale exercise? A pilot study.
Prehosp Disaster Med 2014;29:441‑7.
18. Gebbie KM, Valas J, Merrill J, Morse S. Role of exercises and drills
in the evaluation of public health in emergency response. Prehosp
Disaster Med 2006;21:173‑82.
19. Savoia E, Testa MA, Biddinger PD, Cadigan RO, Koh H,
Campbell P, et al. Assessing public health capabilities during
emergency preparedness tabletop exercises: Reliability and
validity of a measurement tool. Public Health Rep 2009;124:138‑48.
20. Ablah E, Scanlon E, Konda K, Tinius A, Gebbie KM. A large‑scale
points‑of‑dispensing exercise for first responders and first receivers
in Nassau County, New York. Biosecur Bioterror 2010;8:25‑35.
21. Agboola F, McCarthy T, Biddinger PD. Impact of emergency
preparedness exercise on performance. J Public Health Manag
Pract 2013;19 Suppl 2:S77‑83.
22. Kaji AH, Lewis RJ. Assessment of the reliability of the Johns
Hopkins/Agency for Healthcare Research and Quality hospital
disaster drill evaluation tool. Ann Emerg Med 2008;52:204‑10,
210.e1‑8.
23. Savoia E, Biddinger PD, Burstein J, Stoto MA. Inter‑agency
communication and operations capabilities during a hospital
functional exercise: Reliability and validity of a measurement
tool. Prehosp Disaster Med 2010;25:52‑8.
24. Thomas TL, Hsu EB, Kim HK, Colli S, Arana G, Green GB, et al.
The incident command system in disasters: Evaluation methods
for a hospital‑based exercise. Prehosp Disaster Med 2005;20:14‑23.
25. Haverkort JJM, Leenen LPH. Developing the fourth evaluation
dimension: A Protocol for evaluation of video from the patient’s
perspective during major incident exercises. Disaster Med Public
Health Prep 2017;11:594‑9.
26. Curnin S, Heumüller E. Evaluating emergency management
capability of a water utility: A pilot study using exercise metrics.
Utilities Policy 2016;39:36‑40.
27. Greenberg B, Voevodsky P, Gralla E. A capabilities‑based
framework for disaster response exercise design and evaluation:
Findings from oil spill response exercises. J Homel Secur Emerg
Manag 2017;13:1‑17.
28. Jenkins JL, Kelen GD, Sauer LM, Fredericksen KA, McCarthy ML.
Review of hospital preparedness instruments for national incident
management system compliance. Disaster Med Public Health
Prep 2009;3:S83‑9.
29. Kaji AH, Langford V, Lewis RJ. Assessing hospital disaster
preparedness: A comparison of an on‑site survey, directly
observed drill performance, and video analysis of teamwork.
Ann Emerg Med 2008;52:195‑201, 201.e1‑12.
30. McCarthy ML, Brewster P, Hsu EB, Macintyre AG, Kelen GD.
Consensus and tools needed to measure health care emergency
management capabilities. Disaster Med Public Health Prep
2009;3:S45‑51.
Journal of Education and Health Promotion
Volume 8, Issue 1
January 2018
Pages 1-10

Home

Guide for Authors

Submit Manuscript

Reviewers

Contact Us