Charles Darwin University

CDU eSpace
Institutional Repository

CDU Staff and Student only

Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change

Schierhout, Gillian, Hains, Jennifer, Si, Damin, Kennedy, Catherine, Cox, Rhonda, Kwedza, Ru, O'Donoghue, Lynette R., Fittock, Marea T., Brands, Jenny, Lonergan, Katrina, Dowden, Michelle C. and Bailie, Ross S. (2013). Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implementation Science,8:119-1-119-15.

Document type: Journal Article
Attached Files (Some files may be inaccessible until you login with your CDU eSpace credentials)
Name Description MIMEType Size Downloads
Download this reading Schierhout_40646.pdf Published version application/pdf 355.23KB 244
Reading the attached file works best in Firefox, Chrome and IE 9 or later.

IRMA ID cmartelxPUB104
NHMRC Grant No. 545267
Title Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change
Author Schierhout, Gillian
Hains, Jennifer
Si, Damin
Kennedy, Catherine
Cox, Rhonda
Kwedza, Ru
O'Donoghue, Lynette R.
Fittock, Marea T.
Brands, Jenny
Lonergan, Katrina
Dowden, Michelle C.
Bailie, Ross S.
Journal Name Implementation Science
Publication Date 2013
Volume Number 8
ISSN 1748-5908   (check CDU catalogue open catalogue search in new window)
Scopus ID 2-s2.0-84884995428
Start Page 119-1
End Page 119-15
Total Pages 15
Place of Publication United Kingdom
Publisher BioMed Central Ltd.
HERDC Category C1 - Journal Article (DIISR)
Abstract Background
Variation in effectiveness of continuous quality improvement (CQI) interventions between services is commonly reported, but with little explanation of how contextual and other factors may interact to produce this variation. Therefore, there is scant information available on which policy makers can draw to inform effective implementation in different settings. In this paper, we explore how patterns of change in delivery of services may have been achieved in a diverse range of health centers participating in a wide-scale program to achieve improvements in quality of care for Indigenous Australians.

We elicited key informants’ interpretations of factors explaining patterns of change in delivery of guideline-scheduled services over three or more years of a wide-scale CQI project, and inductively analyzed these interpretations to propose fine-grained realist hypotheses about what works for whom and in what circumstances. Data were derived from annual clinical audits from 36 health centers operating in diverse settings, quarterly project monitoring reports, and workshops with 12 key informants who had key roles in project implementation. We abstracted potential context-mechanism-outcome configurations from the data, and based on these, identified potential program-strengthening strategies.

Several context-specific, mechanism-based explanations for effectiveness of this CQI project were identified. These were collective valuing of clinical data for improvement purposes; collective efficacy; and organizational change towards a population health orientation. Health centers with strong central management of CQI, and those in which CQI efforts were more dependent on local health center initiative and were adapted to resonate with local priorities were both favorable contexts for collective valuing of clinical data. Where health centers had prior positive experiences of collaboration, effects appeared to be achieved at least partly through the mechanism of collective efficacy. Strong community linkages, staff ability to identify with patients, and staff having the skills and support to take broad ranging action, were favorable contexts for the mechanism of increased population health orientation.

Our study  provides evidence to support strategies for program strengthening described in the literature, and extends the understanding of mechanisms through which strategies may be effective in achieving particular outcomes in different contexts.
Keywords Quality improvement
Evaluation science
Realist evaluation
Primary health care
Program theory
DOI   (check subscription with CDU E-Gateway service for CDU Staff and Students  check subscription with CDU E-Gateway in new window)
Additional Notes This is an Open Access article distributed under the terms of the Creative Commons Attribution License 2.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Description for Link Link to CC Attribution 2.0 License

© copyright

Every reasonable effort has been made to ensure that permission has been obtained for items included in CDU eSpace. If you believe that your rights have been infringed by this repository, please contact

Version Filter Type
Access Statistics: 203 Abstract Views, 244 File Downloads  -  Detailed Statistics
Created: Thu, 07 Aug 2014, 17:18:50 CST