DEVELOPING THE FIRST VERSION QUANTITATIVE SCALE IN EVALUATION OF QUALITY IMPROVEMENT PROJECTS AND REPORTS

Văn Niệm Đỗ, Thanh Tuấn Đặng, Thị Thu Thúy Lê

##plugins.themes.vojs.article.main##

Abstract

Introduction: An appropriate evaluation tool is a necessary condition for supporting quality improvement teams & ensuring the quality of initiative activities. Objectives: To design a quantitative scale for evaluation of quality improvement (QI) projects and reports. Methods: To integrate literature review with expert’s focus-group discussion for developing evaluation scales and testing their content and face validities. Content validity ratio (CVR) and item impact score (IIS) for every item were analyzed to make decision on items retained. Results: All of 22 items from QI-project evaluation scale met the requirement of CVR > 0.6. IIS of items 1.6, 2.1b, 3.3 and 3.5 were just below the threshold of 1.5 on “importance” criterion. The similar thing was found for item 2.1c on “necessary” criterion. In QI-report evaluation scale, 3 items of 3.3, 3.4 and 3.5 did not meet requirements of CVR > 0.49 and IIS > 1.5 on “importance” and “necessary” criterion (item 3.3 and 3.5). Although three aforementioned items did not meet face validity criterion, they were still kept in the final scales because of mandatory requirements from the Vietnam authorities. Conclusion: The QI-project and QI-report evaluation scales met basic requirements of content validity for application in practice. Further studies are needed to improve face validity and test construct validity.

##plugins.themes.vojs.article.details##

References

1. Goodman D, Ogrinc G, Davies L et al (2016). Explanation and elaboration of the SQUIRE (Standards for Quality Improvement Reporting Excellence) Guidelines, V. 2.0: examples of SQUIRE elements in the healthcare improvement literature. BMJ Qual Saf; 25:7
2. Heather C Kaplan, Lloyd P Provost, Craig M Froehle, Peter A Margolis (2012). The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf; 21:13e20. doi:10.1136/bmjqs-2011-000010.
3. Leviton LC, Khan LK, Rog D et al (2010). Evaluability assessment to improve public health policies, programs, and practices. Annu Rev Public Health; 31:213-33.
4. Coly A, Parry G (2017). Evaluating Complex Health Interventions: A Guide to Rigorous Research Designs. Academy Health. http://www.academyhealth.org/evaluationguide.
5. Gareth Parry, Astou Coly, Don Goldmann, Alexander K. Rowe, Vijay Chattu Loiudice, Mihajlo Rabrenovic, and Bejoy Nambiar (2018). Practical recommendations for the evaluation of improvement initiatives. International Journal for Quality in Health Care, 30 (S1), 29–36. doi: 10.1093/intqhc/mzy021.
6. Đỗ Huân (2016). Phụ lục 12: Mẫu đánh giá đề án, trong: Nhà đào tạo sành sỏi. Nxb Lao động, tr. 446-449.
7. C. H. Lawshe (1975). A quantitative approach to content validity. Personel Psychology, 28: 563-575.
8. Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, et al (2015). Design and Implementation Content Validity Study: development of an instrument for measuring Patient-Centered Communication. Journal of Caring Sciences, 4(2): 165-178. DOI: 10.15171/jcs.2015.107.