Вы находитесь на странице: 1из 12

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/260023421

A Review of Health governance: definition, dimentions and tools to govern

Article  in  Health Policy · January 2014


DOI: 10.1016/j.healthpol.2014.01.007 · Source: PubMed

CITATIONS READS

78 1,312

2 authors, including:

Erica Barbazza
Academisch Medisch Centrum Universiteit van Amsterdam
17 PUBLICATIONS   121 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

HealthPros – Innovative Training Network for Healthcare Performance Intelligence Professionals View project

PHC IMPACT View project

All content following this page was uploaded by Erica Barbazza on 08 January 2019.

The user has requested enhancement of the downloaded file.


Health Policy 116 (2014) 1–11

Contents lists available at ScienceDirect

Health Policy
journal homepage: www.elsevier.com/locate/healthpol

Review

A review of health governance: Definitions, dimensions


and tools to govern
Erica Barbazza ∗ , Juan E. Tello
WHO Regional Office for Europe, Marmorvej 51, DK-2100 Copenhagen, Denmark

a b s t r a c t
a r t i c l e i n f o
Background: The premise that good governance will ultimately lead to better health out-
Article history:
comes has been central to the proliferation of work in this area over the past decade.
Received 2 July 2013
Received in revised form Objective: To consolidate and align literature on governance by presenting an overview of
11 December 2013 efforts to define, describe and operationalize the health governance function.
Accepted 7 January 2014 Methods: A targeted review of governance literature.
Results: (1) A variety of terms have been assigned to precede health governance definitions.
These terms commonly describe governance ideals (e.g. good, democratic) or characteris-
Keywords: tics of the organization of actors in governance arrangements (e.g. hierarchical, networked).
Health governance (2) Dimensions of governance are defined from different perspectives and in varied combi-
Stewardship
nations, capturing values, sub-functions and/or outcomes of governance. (3) Tools used to
Health systems
govern remain to be cataloged, however, measures can be aligned according to dimensions
of governance or their ability to create specific relationships between actors.
Discussion: Resolving the conceptual confusion around health governance requires recog-
nition for the differences in the premise and approaches taken to defining governance, as
well as specifying core dimensions and aligning applicable tools.
Conclusion: Despite a growing literature base, a concerted effort is needed for a more acces-
sible understanding of health governance that is both practical at present and actionable
for policy-makers.
© 2014 Elsevier Ireland Ltd. All rights reserved.

1. Introduction actors in health [6–10] has allowed for the function to


mature and evolve, characterized at various stages as ‘stew-
Governance – either in terms of leadership, stew- ardship’, ‘leadership’ and/or ‘governance’ [hereafter ‘health
ardship, regulation, oversight or governance itself – has governance’]. Complemented by a continuously growing
repeatedly been asserted as a core function in theories literature base, there is now clear and compelling consen-
and frameworks on health system [1,2]. The World Health sus about the importance of the health governance function
Organization (WHO) first framed the concept as ‘stew- and its role in ensuring that priorities for population health
ardship’ in the World Health Report 2000, defined as “the and well-being are realized.1
careful and responsible management of the well-being
of the population” [3, p. 45]. Later iterations of WHO’s
systems-thinking [4,5] and work from other dominant
1
A chronological account of health stewardship and governance has
been detailed in other literature (see [1,8]). Pertaining to the WHO, this
includes the endorsement of leadership and governance in its framework
∗ Corresponding author at: WHO Regional Office for Europe, DSP-HSD, for strengthening health systems in 2007 [4]. In the European Region, this
Marmorvej 51, DK-2100 Copenhagen, Denmark. Tel.: +45 45 33 69 09; has also included an affirmed commitment to the stewardship function
fax: +45 45 33 70 01; mobile: +45 91 67 96 57. in 2008 at a ministerial conference in Tallinn, Estonia. More recently, the
E-mail addresses: est@euro.who.int (E. Barbazza), adoption in the European Region of the guiding policy framework, Health
jet@euro.who.int (J.E. Tello). 2020, has prioritized improving leadership and participatory governance

0168-8510/$ – see front matter © 2014 Elsevier Ireland Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.healthpol.2014.01.007
2 E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11

While solidified in its importance, the health gover- introduction as ‘stewardship’ in the year 2000. Earlier liter-
nance function itself remains an elusive concept to define, ature on governance in the public and development sector
assess, and operationalize [11–13]. This has historically is considered more generally, recognizing this as a start-
been attributed to an absence of conceptual thinking ing point for much thinking on governance in the health
[11,14]. However, the premise that ‘good’ governance will domain. Consideration has been given exclusively from a
ultimately lead to improved health outcomes has been the national health systems perspective, seeing the purview,
presumption motivating the study of health governance potential influence and formal application of governance
with renewed vigor over the past decade [4,6,15,16]. The tools taking a unique quality at this level, and thus, meriting
conceptual chaos that has followed can be viewed as an a targeted reflection. In chronicling the growing body of lit-
effect of the lack of consensus on nomenclature, mod- erature on health governance among leading international
els and measures for governance in the health domain. In organizations that have contributed to this field overtime,
the absence of conceptual agreement, the comparability of we hope to contribute to an understanding of health gov-
literature and the extent to which findings obviously con- ernance that is most meaningful and accessible to those in
verge toward a common understanding of the concept has a national stewardship role. This is seen here as a necessary
been compromised [11]. prerequisite to then position further study on health gov-
Adding to the conceptual challenges is the changing ernance that is also responsive to the context of the 21st
context of government and society, which has necessitated century.
the continued evolution of the health governance function. To this end, the review attempts to consolidate the
Global trends – such as changing population demograph- findings around the following key questions: how is gov-
ics and epidemiology, widening social inequalities, and a ernance defined; what dimensions are commonly used to
context of financial uncertainty [7,10,11] – has influenced describe governance; and what are the common tools used
health system priorities and subsequently the setting of to govern?
the health governance function. A shift in the general
architecture of health systems can also be observed, as sys- 3. Methods
tems move toward increasingly decentralized structures,
engaging diverse and heterogeneous networks of actors2 A restricted review of literature was conducted. The
for generating resources, delivering services and financing perspective of governance taken here is that of a national
care [7,17]. The emerging consensus that health is a prop- public steward and the governance function is framed
erty of many complex systems and dynamic networks has according to this role. The work of international organiza-
demanded new and formal interactions with varied actors, tions in health governance was deemed most relevant for
found often beyond the domain of health itself [10]. this perspective. While giving focus to the work of primar-
Faced with such trends, the boundaries of the health ily international organizations has narrowed the breadth
sector appear to be less clearly defined and the collec- of literature, this inclusion criteria is felt merited by the
tive interaction needed across ministries, including social unique mandate of such actors; supporting the process of
services and education for example, is importantly real- translating more conceptual thinking into policy tools and
ized. In effect, the health governance function has become instruments and with the work of such actors speaking to
increasingly diffused and the relationships between actors, an audience of policy-makers and system stewards with
largely ambiguous. A concerted effort is thus needed to national public officials as the target.
resolve conceptual confusion on health governance, while As the work of these organizations is primarily pub-
also attempting to evolve earlier notions of governance to lished outside of academic literature, the websites of these
respond to health and health systems of the 21st century. key actors were searched, namely: WHO and the works of
Ultimately, a clearly (re)defined vision for the health gov- its Regional Offices, the World Bank, the United Nations
ernance function must be seen a means rather than an end Development Programme (UNDP), the Organization for
in itself, to then address an arguably more pressing agenda: Economic Cooperation and Development (OECD), the Euro-
the needed arsenal of policy tools and instruments to then pean Commission, the Council of Europe, Management
create the conditions for improving the health and well- Sciences for Health (MSH) and the United States Agency
being of populations [10]. for International Development (USAID).
Additional searches were conducted using PubMed and
2. Purpose and rationale Google Scholar to identify scientific literature on gover-
nance in general and pertaining to health in particular.
In this review, we aim to consolidate and align the liter- Governance in the health domain was considered from
ature on health governance by presenting an overview of varied orientations, including the following: health gov-
governance literature pertaining to health since its initial ernance, stewardship or leadership and management;
governance of specific health system functions (e.g. gov-
ernance of medicines and technology); or frameworks
for health as one of two main strategic objectives toward improved health for overall health system strengthening. Online searches
and well-being of populations [9]. included various combinations of the following key
2
Actors in health are broadly characterized here as those individ- words: ‘health’, ‘health systems’, ‘governance’, ‘steward-
uals, organizations, groups or coalitions that have the capacity to exert
influence over policy or decision-making or are mandated with the
ship’, ‘framework’, ‘mechanisms’ and ‘tools’. Experts in the
responsibility to carry out a particular aspect of a given health system field were consulted in order to gain further access to rel-
function [64]. evant sources of literature. The reference lists of literature
E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11 3

deemed relevant for analysis were each additionally con- Table 1


Governance frameworks reviewed.
sulted and relevant works distilled.
In selecting literature, preference was given to those Area of study Number (n = 39)
that have offered a definition of governance and/or have A. Health
described the governance function according to a dis- I. Stewardship 5
crete combination of dimensions. Attention was given II. Governance 13
here seeing these efforts as attempts to position a III. Health system function-specific 3
IV. Health system performance/strengthening 6
more operationalized governance function by making its
assessment
characteristics more accessible to those in stewardship V. Management 3
and leadership roles. While health governance has been
B. Public sector
informed by the study of related fields, such as the broader I. Stewardship 1
political sciences sphere, this review has aimed to remain, II. Governance 8
as far as possible, to work related to health and health sys-
Note: The publications considered here are exclusively those that were
tems. As discussions surrounding health governance are identified to have reviewed or defined a discrete number of governance
formally considered at the national level, we again take dimensions. This literature is felt to allow a unique synthesis of concep-
this orientation and have thus excluded work pertaining to tual thinking for defining and operationalizing the governance function.
Notably, this is to the exclusion of additional governance literature that
governance in the context of regional or local health care
has been reviewed and informs the findings and discussion to follow.
settings.
The process of data collection and review took place
engagement, accountability, power and institutional
between the months of September 2012 and March 2013.
authority, ownership, political stability and the rule of law
Aside from two exceptions [18,19] literature has been con-
– has posed a challenge to find a universally accepted def-
sidered from 2000 and onwards.
inition both within and beyond the health domain [36].
Despite the complexities and multidimensionality inher-
4. Findings
ent to governance, there does however appear to be general
consensus that the governance function characterizes a
In total, 39 publications were deemed relevant for
set of processes (customs, policies or laws) that are for-
review; 30 publications either defined the health gov-
mally or informally applied to distribute responsibility or
ernance (stewardship) function according to a discrete
accountability among actors of a given [health] system
number of principles, dimensions, elements or attributes
[4,6,13,14,19].
or to operationalize the function according to specific
Among international organizations, definitions of gov-
indicators and a further 9 publications defined gover-
ernance commonly frame these processes in terms of
nance (stewardship) within the public or development
strategies to reduce corruption and make government
sector [18–26]. While outside of the health domain, these
more efficient (Table 2). An initial departure from this gen-
works were found to have influenced the development
eral governance discourse to governance as it pertains to
and conceptualization of literature pertaining to health
health has been notably marked by the World Health Report
governance when considered chronologically. The objec-
2000 – retraced in a chronological account of health sys-
tives, how dimensions have been described and the specific
tems thinking as a response of WHO to calls for better
dimensions identified pertaining to each can be found in
governance from the World Bank [1]. The term ‘stew-
a web appendix (Table w1). The publications themselves
ardship’ was then introduced to define the steering and
should be further consulted to appreciate the specific def-
regulation role of national stewards within health systems
initions and the orientation taken.
toward improved performance and related gains in health
Supplementary material related to this article can be
outcomes [1,3]. This notion of health stewardship impor-
found, in the online version, at http://dx.doi.org/10.1016/
tantly distinguished health governance as a domain in itself
j.healthpol.2014.01.007.
which has since been refined and characterized through a
Additional publications were identified to take a nar-
number of efforts (such as [2,4,8,13,14,17,37–39]).
rower approach to governance, specifying an element of
The challenge to establish a universally accepted defini-
governance (e.g. accountability [27–30]), or the governance
tion of governance has been met with further confusion as
of a specific health system function (e.g. pharmaceuticals
to the distinction between the concept of stewardship from
[31,32] or human resources [33]). We could identify two
that of leadership and governance. While related, the par-
other reviews exclusively on governance applied to the
ticularities of each demand their specific use, despite their
health sector [34,35]. These works are felt to differ in con-
more common application as synonymous terms. Efforts
text and scope from that taken here, offering limited insight
to differentiate the stewardship function in the literature
into the congruence (or lack of) in prevailing approaches
appeal to its key element of direction – a central tenet to
taken to define and operationalize the health governance
the stewardship function that has been captured through
function overtime. A summary of the literature reviewed is
a number of images and analogies3 [8]. The task of system
found in Table 1.

4.1. How is governance defined? 3


The Institute for Government (2011) illustrates the stewardship func-
tion using an analogy to the game of football: like a steward, a football
The intrinsically broad concept of governance – manager sets an overall goal for the team [actors] to be guided by; a set of
encompassing systems of representation and citizen basic rules are put in place (e.g. do not use hands), defining the boundaries
4 E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11

Table 2 Table 3
Governance defined according to international organizations. Common values and descriptive terms preceding governance definitions.

Organization Governance defined Values Descriptions

European Commission “The rules, processes, and behaviour by Democratic [45–47] Horizontal (shared) [48,49]
which interests are articulated, resources Good [18,22,50–53] Networked [10,21,42,54]
are managed, and power is exercised in Good enough [44] Hierarchical [21,41,42,55]
society” [40, p. 3] Smart [10,56] Market-based [21,42]
World Bank “The traditions and institutions by which
authority in a country is exercised. This
includes the process by which
governments are selected, monitored and terms weighs on the interpretation of how governance is
replaced; the capacity of the government defined. In doing so, we categorize these terms accord-
to effectively formulate and implement ing to two groupings: (1) values of governance (e.g. ‘good’
sound policies; and the respect of citizens
and the state for the institutions that
governance), depicting not what is governance, but rather
govern economic and social interactions what governance ought to be; and (2) descriptions of gover-
among them” [19, p. 1] nance, characterizing terms used to capture varied types of
UNDP “The exercise of political, economic and arrangements in order to carry out the governance function
administrative authority in the
(e.g. ‘horizontal’ versus ‘vertical’ governance) (Table 3).
management of a country’s affairs at all
levels” [18, Sec. Executive Summary] The use of values including ‘democratic’, ‘smart’ and
USAID “The ability of government to develop an most frequently – ‘good’ – in defining governance, take a
efficient, effective, and accountable public similar approach to describe a governance ideal [44]. While
management process that is open to defining governance according to these values appears
participation and that strengthens rather
than weakens a democratic system of
common, the added value of the approach itself remains
government” [13, p. 1] contested. For example, Savedoff [39] noted definitions are
WHO Leadership and governance “involves more useful analytically and for policy if assessed in terms
ensuring that strategic policy frameworks of impact on performance rather than a set of normative
exist and are combined with effective
principles. Similarly, as Grindle describes, the overwhelm-
oversight, coalition building, regulation,
attention to system-design and ing agenda of ‘good’ governance fails to support priority
accountability” [4, p. 3] setting or practical efforts in defining a sequence of actions
and is ultimately limiting in the ability to separate “an ideal
state of good governance from one that is ‘good enough”’
stewardship can then be said to include defining an over- [44].
arching vision for the health system and establishing the These normative notions can be distinguished from
boundaries in which the system’s actors operate [41–43]. terms of a more descriptive quality, which are found
Characterizing stewardship according to its unique to connote a type or arrangement to approaching gover-
quality of direction, the governance function then distinctly nance. This approach considers more so the architecture of
describes the specific efforts and processes that are applied relationships, being attentive to the interactions between
to steer the system toward this given priority. This includes, actors (how authority and responsibility is distributed)
for example, the use of different tools to establish a set of and the spaces between them (how authority and respon-
rules and incentives for a system of regulation [8]. Taking sibility is applied) [36]. The use of descriptive terms to
this example further, the quality of leadership would then capture this structure appears increasingly common, as tra-
characterize the capacity of the system to initiate, imple- ditionally centralized, hierarchical notions of governance
ment and monitor a regulatory system, as well as the ability do not sufficiently capture the context of contemporary
to organize and manage the alignment of all relevant actors government and society [48]. ‘Horizontal’ or ‘networked’
and actions engaged in processes pertaining to this. governance for example, appreciate the need for gover-
Further discussion of common governance (stew- nance arrangements that take into account multiple nodes
ardship, leadership) definitions and their underlying of power, interests and activity among an increasingly
assumptions and implications has been addressed else- diverse arrangement of actors [10,29,48]. This is in con-
where [12,13,35,39,43,44]. In place of this, consideration trast to more traditional, linear notions of ‘hierarchical’ or
is given now to common terms assigned to preface gov- ‘ministerial’ governance where decisions over policy devel-
ernance definitions, characteristic of a prefix added before opment and implementation were characterized by more
the term to introduce a new meaning or concept. By first centralized processes [48].
cataloging the terms frequently used in combination with As the governance function becomes increasingly
governance, we then examine the basis on which each have dynamic and diffused, the utility of more descriptive
been derived and how the underlying premise of these terms capturing the numerous actors and the sophistica-
tion of their arrangement appears evident. However, as
Kettl [57] cautions, arrangements or approaches to gover-
by which players [actors] must perform; the manager watches the game ning are not mutually exclusive and require contextualized
to assess overall performance; and in response, the manager may change interpretation. For example, while ‘horizontal’ governance
the team’s tactics or formation. Analogies have also been drawn between
the stewardship function and the role of a steersman, using cybernetic-
arranagements may be observed to a greater extent at
systems (derived from the Greek word kybernetes – a steersman), whereby present, these relations have not necessarily superseded
stewards hold the responsibility for ‘steering the ship of state’ [41]. more traditional, hierarchical governance arranagements
E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11 5

and rather, reflect the addition of hortizontal linkages to further classification to rectify qualitative differences has
those of more a top-down, veritical orientation [25,57]. been acknowledged in a number of works [2,12,17,39].
As Baez-Camargo and Jacobs argue, “categorizing these
4.2. What dimensions are commonly used to describe dimensions and providing theoretically informed pre-
governance? sumptions about causality links among them is a first step
to give governance analysis greater explanatory power
The composition of the governance function within and and to therefore increase its potential for having empirical
beyond the health sector has been conceptualized accord- applicability” [12].
ing to a number of dimensions – synonymous here with Across the literature, a number of categorizations have
components, elements, principles or attributes of gover- been proposed, grouping dimensions of governance into
nance. Drawing on a subset of the literature reviewed, we the following: governance inputs, processes, and outputs
map those dimensions of governance most frequently cited [12,58]; principles of governance and core governance
in the various attempts at characterizing the health gov- concerns [21,22]; governance performance, governance
ernance function (Table 4). Only those dimensions that determinants and governance context [39]; enablers, out-
have been explicitly defined are shown, as the exercise has comes and core values of governance [17]. In keeping
given priority to understanding the aspects deemed most with the characteristics of these earlier groupings, we have
inherent to the governance function. It is recognized that aligned the common dimensions of governance identified
a number of additional dimensions may be alluded to or according to three distinct types: (1) those characterizing
included in the context of others. However, capturing the the primary concerns of the governance function, serv-
intricacies of more implicit dimensions was seen to extend ing as the guiding values or principles expected of ‘good’
beyond the intended general overview across the litera- governance; (2) those operationalizing the function of
ture. Thus, the table should be read as merely the discrete governance itself, specifying subsidiary (sub-)functions as
dimensions of governance defined and further attention to actionable processes for which the system’s steward has
their respective definitions should be considered in order oversight; and (3) those specifying outcomes or goals of
to draw conclusions beyond the following observations. strengthened governance, serving as potential indicators
From this mapping a considerable degree of variability for measuring improvements (Table 4).
in the specific dimensions used to define the governance Grouped in this way, the comparability across dimen-
function is clear. For example, some dimensions such sions is improved further and consensus on a subset of
as ‘accountability’, ‘regulation’ or ‘formulating policy and core dimensions of governance – slightly strengthened.
defining a strategic direction’ are included fairly consis- For example, fundamental values of governance, such as
tently across frameworks, while others, such as ‘rule of ‘conflict prevention’ and ‘control of corruption’, while not
law’, ‘conflict prevention’ and improvements in ‘quality’ explicit in each framework, are arguably underpinning
or ‘sustainability’ are less so. Additionally, looking to the ‘good’ governance universally. Similarly, outcomes of gov-
frameworks themselves, the number of dimensions varies, ernance, such as ‘effectiveness’, ‘efficiency’, ‘quality’ and
from a comprehensive arrangement of dimensions (e.g. ultimately ‘improved health’ can be viewed as implicit to
Council of Europe [17]; HealthGovMonitor [53]), to sim- each of the definitions of governance, irrespective of how
plistic groupings of three or four (e.g. Lewis and Pettersson they have been explicitly described. Sub-functions of gov-
[38]; Smith et al. [42]). ernance then uniquely describe the processes of governing
At closer examination, further observations can be and related actions, such as enabling partnerships among
made. Firstly, while arranged chronologically, the inclu- actors and ensuring organization adequacy or the appro-
sion/exclusion of dimensions appears variable, lacking priateness of the system’s design. Understanding further
an accumulation of insights toward a refined number the sub-functions of governance is then of great relevance
and combination of governance dimensions at present. to governance strengthening, recognizing the operational
However, attributing these fluctuations to differences in quality of these dimensions which lends itself best to a
the orientation or purpose of a given approach, there practical assessment of current governance processes and
then appears to be further consensus around what might opportunities for improvement.
constitute ‘core’ governance dimensions from a given per- Finally, while an in-depth review of the specific dimen-
spective. For example, in the 2009 framework of the WHO sions themselves has not been reflected in the mapping
Regional Office for the Eastern Mediterranean [14], ‘rule of of frameworks, we do observe variability in the scope
law’ is reintroduced as a dimension [principle] of gover- and core qualities of the dimensions themselves. Tak-
nance, despite related earlier works excluding this same ing ‘accountability’ as an example, despite being one of
principle, such as WHO [4] and WHO Regional Office for the most commonly cited dimensions of governance, an
Europe [8]. The inclusion of this dimension of governance equally common definition itself appears to be lacking.
in the 2009 framework better aligns with the explicit con- Most simply stated, accountability is characterized as the
nection to more political dimensions similar to the earlier state of being answerable for one’s decisions and actions.
work of the World Bank [19] and UNDP [18]. However, the institutional relationship of accountability
Secondly, the compatibility of grouping the dimen- is described according to a variety of different compo-
sions into one-like concept of governance appears to be nents. This has been found to include; (1) processes of
limited in recognition of fundamental differences in their accountability, defined according to sequential steps such
frame of reference or unit of analysis. This variability as standard setting or delegation, resource allocation, per-
in dimensions themselves and the importance of their formance, investigation or information about performance,
6
Table 4
Common dimensions of governance across literature reviewed.

Authors chronologically

World Bank (1999)

HealthGovMonitor
UNDP (1997) [18]

Smith et al. (2012)


Jacobs (2011) [12]

Wendt (2012) [58]


Council of Europe
WHO (2000)* [3]

Islam (2007) [21]

Mikkelsen-Lopez
Pettersson (2009)

Baez-Camargo &

MSH (2013) [45]


WHO (2007) [4]

Savedoff (2009)

Gleicher (2012)
et al. (2011) [2]
WHO/EURO

Siddiqi et al.

Kaplan et al.
Kickbush &
Travis et al.
(2002)* [6]

(2008)* [8]

(2009) [14]

(2011) [37]

(2012) [24]

(2013) [43]
Dimensions of governance

Lewis &
[20]

[22]

[23]

[10]

[39]
Fundamental values
Control of corruption

E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11


Democracy
Human rights
Ethics and integrity
Conflict prevention
Public good
Rule of law
Sub-functions
Accountability
Partnerships
Formulating policy/strategic direction
Generating information/intelligence
Organizational adequacy/system design
Participation and consensus
Regulation
Transparency
Outcomes
Effectiveness
Efficiency
Equity
Quality
Responsiveness
Sustainability
Financial and social risk protection
Improved health

Note: A shaded box is used to identify the explicit reference to a given element in the work of the corresponding author(s). The three groupings applied (fundamental values; sub-functions; outcomes) are the
authors’ own and therefore may not be explicitly used to characterize dimensions in the respective works.
*Refer to health stewardship.
E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11 7

and enforceability with rewards or sanctions [27,30,60]; Box 1: Common tools used to enable sub-
(2) accountability arrangements, such as ‘horizontal’, ‘ver- functions of governance.
tical’, or ‘networked’ accountability [27,29,48,61–63]; and Accountability
(3) types of accountability, including financial, performance Performance-based contracts [38]
and political/democratic [11,15] accountable-relations. Fair competitive elections, systems of judicial redress, procedures to
In seeking to operationalize the governance function combat corruption [28]
Pay-for-performance techniques [8]
according to a discrete number of dimensions, there
Partnerships
remains work to define these variables and give greater Inter-ministerial and interdepartmental committees [10,66,67]
consistency to the scope and processes for each. Furthering Public-private task force [67]
this practical aspect of health governance will additionally Integrated budgets and accounting, co-funding arrangements or
require measurable indicators validated through first-hand earmarked grants [10]
Cross-cutting information education systems [10,58]
country experiences. Common workforce training, qualifications, support and advice [10]
Ad-hoc, initiative-specific committees [68,69]
4.3. What are the common tools used to govern? Formulating policy/strategic direction
National health plan [43]
National targets, goals and performance measures [43,70]
Actors of health systems do not behave in random
Multi-year strategic plan [7,70,71]
ways [64]. Their performance and interactions are indeed Policies, operational guidelines, training manuals, protocols [43]
shaped by strategic leadership and management. Those in Medium-term expenditure frameworks and national health accounts
an oversight role must be equipped with applicable tools – [8,66]
instruments, mechanisms, measures – that exist to enable Targets- and priority-setting techniques (e.g. WHO-CHOICEa ) [8]
Generating information/intelligence
the governance function and to steer the system toward Commissioned reports by independent researchers [64]
defined goals [8,64]. These tools used to govern have been Interministerial fact-finding commissions or task force;
characterized as catalysts that facilitate or rather, ‘enable parliamentary investigations [5,59]
the conditions’ for aligned action by setting out a frame- Periodic audits, public expenditure and performance reviews [6,17]
Health technology assessments [17]
work and making explicit the ways in which actors of
Internationally recognized tools for conducting a situation analysis
the health system are expected to perform and interact (e.g. HMNb Health Information Systems Situation Assessment Tool)
[6,8,65]. They do so, as described in the World Health Report [71]
2000 [3], by defining the ‘rules of the game’ – the formal or Health impact assessment; environmental impact assessment;
informal rules that determine the boundaries within which geographic information systems, or health needs assessment [8,68]
Patient reported outcome measures (PROMs) [17]
the system’s actors operate [25].
Organizational adequacy/system design
Despite the growing literature base on conceptual Implementation or annual operational plan [72]
notions of health governance, thoughtful study of the tools Monitoring and evaluation plan [7,58,71]
needed to govern remains underdeveloped. We find there Training/personnel manuals [69,70]
Mission/vision statement, organizational chart [7,17,53,72]
is then an absence of a clear, consistent evidence-base of
On-the-spot training measures [66]
tools that is accessible to support health system stewards Peer-to-peer learning programs [73]
in carrying out their role. Understanding the tools available Participation and consensus
and their uses is of particular relevance for public stew- Open meetings, public workshops, national forums, citizen advisory
ards in the context of modern health systems – a setting committees, citizen juries [10,59,69,71]
Satisfaction surveys [74]
of diffused, pluralistic relations with actors from different
Sector-wide approaches [8]
sectors and levels and with varied interests and functions – Consensus conferences [8,68]
where new or different combinations of existing tools is National health forums [8]
necessitated [10]. Formal consultations in drafting legislation [68]
Regulation
Nevertheless, varied tools can be identified in the lit-
Rules, procedures, decrees [6]
erature, which are commonly applied when carrying out Codes of conduct [8,58,59,69]
the governance function. A non-exhaustive list is shown Performance standards, accreditation, licensing/certification [7,69]
in Boxes 1 and 2 where these tools to govern have been Statutory bodies (e.g. national regulatory agency) [32]
aligned to distinguish two different orientations to thinking ‘Hard laws’ (binding legislation); ‘soft laws’ (non-binding
recommendations) [68]
of their use.
Transparency
The first (Box 1) aligns tools according to the common Watch dog committees (facility boards, health authority,
dimensions of governance that have been identified and ombudsman, parliamentary committees) [6,8,10,21]
characterized here as ‘sub-functions’ (see Table 4). In doing Releasing performance information to providers and the public [8]
Inspectorates, fact finding commissions [64]
so, this approach recognizes that tools, as enablers for car-
Publically available budgetary and financial information [10]
rying out the governance function, vary according to the Citizen report cards [10]
processes of a given sub-function itself [8,17,29,64]. For Conflict-of-interest boards [10]
example, taking ‘participation and consensus’ as a dimen-
Note: The tools presented is a non-exhaustive list; tools may apply
sion of governance, then the processes to carry out this to more than one of the noted dimensions, however, their inclusion
function may involve ‘generating dialogue’ and ‘receiv- is shown only once to minimize repetition.
ing feedback’ among varied health system actors including a
WHO-CHOICE: the WHO project on Choosing Interventions that
importantly, providers and the public [2,14,58]. The spe- are Cost-Effective.
b
cific tools to generate participation along these lines may HMN: Health Metrics Network.

then include national health forums [8], open meetings [10],


8 E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11

Box 2: Common tools used to enable types of authority and contribute to inefficiencies. Similarly, think-
relationships. ing to tools for varied dimensions of governance, public
Control
stewards have the challenge to identify the ideal combina-
Contracts [38] tion of tools which, given the variability in their functions,
Laws and declarations [10] is no easy task. For example, as Travis et al. describe,
Market-based instruments (taxes, charges, fees) [10] there is a delicate balance between ‘too much’ and ‘too
Regular internal/external audits (financial, clinical, quality)
little’ formal, regulatory measures. Moreover, it is recog-
Capacity to reward or sanction performance of individuals and
organizations [64] nized the same instruments can have different effects in
Coordination different settings [6,8,10]. There is also the potential for
Common workforce training, qualifications, support and advice [10] conflicts and contradictions between tools used in com-
Professional advisory committees (national, regional, local and bination, thus demanding very strategic considerations to
institutional) [6,8,10,21]
Joint strategic planning [64]
ensure their agreement. Moreover, other tools may require
Financial measures such as cost-sharing, resource pooling or their combined use to achieve a given end (for example,
integrated budgets [7,10] accountability arrangements may require both the gener-
Collaboration ation of information through tools such as auditing but
National partnership platforms [10]
also the enforceability of findings through tools such as
Inter-ministerial and interdepartmental committees [10]
Co-funding agreements and earmarked grants [10] performance-based contracting).
Ad-hoc committees on specific initiatives [68,69] Ultimately, the strategic and purposive use of tools
Partnerships with civil society or NGOs [75] to govern is an essential component for carrying out
Communication the health governance function and is central to the
Opportunities for public consultation or feedback [10,59,69,71]
User-friendly complaint system [17]
effectiveness of the public stewardship role. From either
Satisfaction surveys [74] orientation – tools to enable specific dimensions of gover-
Publically available budgetary and financial information [10] nance or tools to enable a given relationship – the steward
Watchdog committees (political, non-governmental, mass media) faces the same challenge to distinguish the ideal circum-
[10]
stances and boundaries for the system’s actors that will best
Consensus conferences [8,68]
define their collective and aligned performance.
Note: This Box reflects a sub set of the tools of Box 1 arranged
according to the relationships that may be enabled. This too is a
5. Discussion
non-exhaustive list.

Following the introduction of stewardship as a core


citizen juries [10], and consensus conferences [8,68], among health system function there has been an initially slow but
others. steady increase of literature in this field. This is driven at
A second orientation considers tools according to differ- present by the priority given to health system strength-
ent types of relationships or networks among actors that ening toward improved population health and well-being.
they can be used to enable (Box 2). These are commonly Despite this interest and activity, there remains a persisting
characterized in the literature as relationships of control, challenge to communicate with greater consensus a clear
coordination, collaboration and communication [10,29,64]. and actionable health governance function.
Relationships of control describe more authoritative, com- While not necessarily pursuing an ultimate, universal
mand and control interactions, whereby stewards have model or definition to health governance – recognizing
direct capacity to enforce accountable-relations, for varied worldviews and applications that may deem this
example, through formal laws or administrative rules irrelevant – there does appear to be the important need for
[25,29]. Relationships of coordination (cooperation) share improvements in the accumulation of insights by adopting
in a similar use of more formal tools however, they a shared frame of reference when speaking of definitions,
differ in that they do not require direct command and dimensions and tools to govern. For example, governance
control linkages. Rather, relations of coordination are often defined as an ideal (e.g. ‘good’ governance) and governance
intended to enable interactions that are supportive of the defined by the structure of its institutional relationships
joint management of activities through processes that are (e.g. ‘networked’ governance) offer very different insights
formalized and built on mutual dependence [64]. Relation- into an understanding of the function. Acknowledging
ships of collaboration may be established on shared values these differences is necessary to resolve the chaos that pre-
and goals or mutual interests but without formalized mea- vents health governance from becoming a more accessible
sures that are characteristic of control and coordination health system function for those in stewardship and lead-
[29]. As a more informal interaction, it is recognized that ership roles.
collaboration has less enforceability and maintaining such Moving forward, with this understanding of where we
interactions requires greater attention and use of tools are in the current literature, we note the following points
overtime [64]. Finally, relationships of communication for consideration in future study in the health governance
have been commonly characterized as the most informal domain.
relationship between actors, intending to simply allow What is the utility of terms assigned to precede gover-
dialog and improve the exchange of information. nance definitions? Further efforts to define governance must
In contemporary health systems, it is unrealistic that acknowledge the fundamental differences in terms that can
one type of relationship will suffice. For example, solely be used as a prefix to introduce governance with greater
enabling relationships of control may create centralized consideration given to the implications of each. This is of
E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11 9

particular importance when prescribing a value to describe governance and related works of particular relevance in the
an ideal state of governance as the added value of this development of this field from the perspective of national
remains contested. Reflecting on the differences in the health stewards. In doing so, the challenges to define gov-
approach to definitions, it may then be possible to better ernance, characterize the function according to specific
communicate their intentions and facilitate their accurate dimensions and catalog the available tools to govern have
interpretation. been noted. This review has attempted to give order to the
How can governance dimensions be further classified? The thinking behind the different approaches that have been
operational quality of the ‘sub-functions’ identified as com- taken across these key aspects in the development of health
mon dimensions of governance are of particular relevance governance discourse overtime.
for unpacking the governance function. However, the lack- Moving from a state-centered governance function,
ing consensus within each of these dimensions regarding organized on vertical lines of accountability to increasingly
their scope and purpose requires further attention and decentralized systems with multiple actors and levels of
refection on each to resolve if they are in fact mutu- authority, has given rise to an increasingly sophisticated
ally exclusive and their respective characteristics. Seeing context for the health governance function. As a central
the function of governance as a process, there is also the tenet to health system strengthening, a concerted effort
opportunity to consider a potential sequencing to core to resolve conceptual confusions and transform the gov-
dimensions of governance identified. ernance function to ensure its congruence in the context of
How can a common platform for the exchange of gover- modern health systems is of great importance.
nance tools best be defined? Identifying tools to govern is
arguably the most needed effort to the study of health gov- Acknowledgements
ernance in order to support public stewards in carrying out
the governance function [42,59,68,76]. To arrive at com- This paper was developed to support earlier health gov-
mon denominator tools and instruments for governance, ernance work of the WHO Regional Office for Europe and
a concerted effort is needed to best differentiate tools its partners by providing a review and synthesis of liter-
and describe their application. Needed also are practical ature in this area of study and by extension, a common
assessment resources that allow a diagnostic assessment platform for more conceptual thinking and country appli-
of existing governance arrangements. This is necessary to cations. An earlier version of this paper was presented at an
first develop an understanding of the existing institutional authors’ workshop convened by the European Observatory
context to then identify governance gaps – a misalign- on Health Systems and Policies in Brussels (October, 2012)
ment between the actions of actors across and within the to stimulate discussions for a related project.
dimensions of the governance function – in order to be This work has been shaped by collaborations and
in a position to strategize applicable tools that may rec- thoughtful discussions with the following experts: Claudia
tify this. Consideration must also be given to the variability Baez-Camargo (Basel Institute on Governance); Alejan-
in tools at different levels (national, regional, institutions) dra Gonzalez (WHO Regional Office for Europe); Merilee
where the tools accessible may differ by the authority and Grindle (Harvard University); and Maria Skarphedinsdot-
mandate of those in stewardship roles. tir (WHO Regional Office for Europe). The authors would
As a modest attempt to systematize the state of the like to thank Hans Kluge (WHO Regional Office for Europe),
art on health governance, this review did not intend to Christine Brown (WHO European Office for Investment
tackle debates like that of leadership versus stewardship. for Health and Development) and Peter Smith (Imperial
Moreover, in taking the perspective of a national health College London) for their valuable review and detailed
system steward, we have not given consideration to the comments. The authors thank also the reviewers of the
related concept of governance for health and well-being. journal for their very constructive input that has impor-
Nevertheless, this concept is of great importance to extend tantly informed revisions to finalize this work.
thinking beyond the health system itself, calling for inter-
sectoral action to tackle the multifaceted determinants
References
of health and reduce persisting health inequities. While
related, the two concepts – health governance and gov- [1] van Olmen J, Marchal B, Van Damme W, Kegels G, Hill PS. Health
ernance for health and well-being – remain distinct, giving systems frameworks in their political context: framing divergent
emphases to different dimensions of governance and appli- agendas. BMC Public Health 2012;12(774).
[2] Mikkelsen-Lopez I, Wyss K, de Savingy D. An approach to addressing
cable tools. Through the continued refinement of the health governance from a health system framework perspective. BMC Inter-
governance concept, aligned with the broader study of gov- national Health and Human Rights 2011;11(13).
ernance for health and well-being, great strides can be [3] WHO. The World health report 2000: health systems: improving per-
formance. Geneva, Switzerland: World Health Organization; 2000.
made to ensure both concepts are accessible to those in [4] WHO. Everybody’s business: strengthening health systems to
leadership roles. improve health outcomes: WHO’s framework for action. Geneva,
Switzerland: World Health Organization; 2007.
[5] Systems thinking for health system strengthening. Geneva,
6. Conclusion Switzerland: World Health Organization; 2009.
[6] Travis P, Egger D, Davies P, Mechbal A. Towards better steward-
Understanding the body of literature on health ship: concepts and critical issues. Geneva, Switzerland: World Health
Organization; 2002.
governance is necessary to effectively apply governance
[7] PAHO. Steering role of the national health authority: performance
theories to contemporary government and society. This and strengthening. Washington, DC: Pan American Health Organiza-
work has aligned the growing body of literature on health tion; 2007.
10 E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11

[8] RC/EURO. Stewardship/governance of health systems in the WHO [36] Fattore G, Tediosi F. Attaining universal health coverage: the role
European Region. Tbilisi, Georgia: WHO Regional Office for Europe; of governance and management. In: Missoni E, editor. A research
2008. initiative to support evidence-based advocacy and policy-making.
[9] RC/EURO. Resolution: Health 2020 – the European policy framework Milano: Global Health Group, Cergas Bocconi University; 2010.
for health and well-being, Regional Committee for Europe, 62nd [37] Islam M. Health systems assessment approach: a how-to manual.
session, Malta, EUR/RC62/R4; 2012. Arlington, VA: Management Sciences for Health; 2007.
[10] Kickbusch I, Gleicher D. Governance for health in the 21st century. [38] Lewis M, Pettersson G. Governance in health care delivery: rais-
Copenhagen, Denmark: WHO Regional Office for Europe; 2012. ing performance. Policy Research Working Paper 5074. The World
[11] Alliance for health policy and systems research, neglected health Bank Development Economics Department and Human Develop-
systems research: governance and accountability. World Health ment Department; 2009.
Organization; 2008. [39] Savedoff WD. Governance in the health sector: a strategy for mea-
[12] Baez-Camargo C, Jacobs E. A framework to assess governance of suring determinants and performance. Portland, ME, USA: Social
health systems in low income countries. Basel: Basel Institute on Insight; 2009.
Governance; 2011. [40] European Commission. Governance and development. Brussels:
[13] Brinkerhoff DW, Bossert T. Health governance: concepts, expe- Commission of the European Communities; 2003.
riences, and programming options. United States Agency for [41] Kooiman J. Governing as governance. London: SAGE Publications
International Development; 2008. Ltd.; 2003.
[14] Siddiqi S, Masud TI, Nishtar S, Peters DH, Sabri B. Framework for [42] Smith PC, Anell A, Busse R, Crivelli L, Healy J, Lindahl AK, et al. Lead-
assessing governance of the health system in developing countries: ership and governance in seven developed health systems. Health
gateway to good governance. Health Policy 2009;90:13–25. Policy 2012;106(June (1)):37–49.
[15] Council of Europe. Recommendation CM/Rec(2010)6 of the Commit- [43] Veillard JH, Brown AD, Baris E, Permanand G, Klazinga NS. Health
tee of Ministers to member states on good governance in health system stewardship of National Health Ministries in the WHO Euro-
systems. Council of Europe; 2010. pean Region: concepts, functions and assessment framework. Health
[16] Lewis M. Governance and corruption in public health care systems Policy 2011;103:191–9.
Washington, DC: Center for Global Development; 2006. [44] Grindle M. Good enough governance: poverty reduction and reform
[17] Council of Europe. Recommendation CM/Rec(2012)8 of the Commit- in developing countries. Governance 2004;17(4).
tee of Ministers to member states on the implementation of good [45] Brinkerhoff DW. Democratic governance and sectoral policy reform:
governance principles in health systems. In: 1149 meeting of the tracing linkages and exploring synergies. World Development
Ministers’ Deputies. Council of Europe; 2012. 2000;28(4):601–15.
[18] UNDP. Governance for sustainable human development. United [46] Mainwaring S, Scully TR. Latin America: eight lessons for governance.
Nations Development Programme; 1997. Journal of Democracy 2008;19(3).
[19] Kaufmann D, Kraay A, Zoido-Lobaton P. Governance matters. Wash- [47] United Nations. Governance, global issues; 2012. Available from:
ington, DC: The World Bank; 1999. http://www.un.org/en/globalissues/governance/ [online].
[20] Commission of the European Communities. European governance: a [48] Ferguson D. Understanding horizontal governance. Quebec: The Cen-
white paper, 428 final. Brussels: European Union; 2001. tre for Literacy of Quebec; 2009.
[21] European Commission. Analyzing and addressing governance in sec- [49] Ruger JP. Shared health governance. The American Journal of
tor operations. Luxemburg: Office for Official Publications of the Bioethics 2011;11(7):32–45.
European Communities; 2008. [50] USAID. Promoting more transparent and accountable govern-
[22] European Commission. Handbook on promoting good governance in ment institutions; 2005. Available from: http://transition.usaid.gov/
EC development and co-operation. Brussels: European Commission; our work/democracy and governance/gov.html [online].
2004. [51] OECD. Participatory development and good governance. Paris:
[23] Langlands SA. The good governance standard for public services. Lon- Organisation for Economic Co-operation and Development; 1995.
don: Office for Public Management and the Chartered Institute of [52] Munshi S. Concern for good governance in comparative perspective.
Public Finance and Accountability; 2004. New Delhi: Sage Publications; 2004.
[24] SDC. Governance as a transversal theme: an implementation guide. [53] HealthGovMonitor. Good governance in healthcare; 2011. Available
Berne, Switzerland: Swiss Agency for Development and Cooperation; from: http://healthgovmonitor.org/ [online].
2007. [54] Braithwaite J, Healy J, Dwan K. The governance of health safety and
[25] Hallsworth M. System stewardship: the future of policy making? quality: a discussion paper. Canberra, Australia: Commonwealth of
London: Institute for Government; 2011. Australia; 2005.
[26] Fazekas M, Burns T. Exploring the complex interaction between [55] Hill CJ, Lynn LE. Is hierarchical governance in decline? Evidence from
governance and knowledge in education. OECD Education Working empirical research. Journal of Public Administration Research and
Papers, No. 67. OECD Publishing; 2012. Theory 2004;15(2).
[27] Moore M, Teskey G. The CAR framework: capability, accountability, [56] Willke H. Smart governance: governing the global knowledge soci-
responsiveness. What do these terms mean, individually and collec- ety. Frankfurt, Germany: Deutsche Nationalbibliografie; 2007.
tively? A discussion note for DFID governance and conflict advisers. [57] Kettl DR. The transformation of governance public administration for
DFID; 2006. the twenty-first century America. Baltimore, MD: The John Hopkins
[28] Brinkerhoff D. Accountability and health systems: toward con- University Press; 2002.
ceptual clarity and policy relevance. Health Policy and Planning [58] Wendt D. Health system rapid diagnostic tool: framework, opera-
2004;19(6):371–9. tional guide and metrics: to measure the strength of priority health
[29] Boston J, Gill D. Joint or shared accountability: issues and options. system functions. Durham, HC: FHI 360; 2012.
Wellington, New Zealand: Institute of Policy Studies; 2011. [59] Management Sciences for Health. How to govern the health sector
[30] Baez-Camargo C. Accountability for better healthcare provision: a and its institutions effectively. The eManager No. 1. Arlington, VA:
framework and guidelines to define, understand and assess account- Management Sciences for Health; 2013.
ability in health systems. Basel: Basel Institute on Governance; [60] World Bank. World development report 2004: making services work
2011. for poor people. Washington, DC: The International Bank for Recon-
[31] WHO. Good governance for medicines. Assessment instrument. struction and Development/The World Bank; 2003.
Geneva, Switzerland: World Health Organization; 2007. [61] Jones G, Stewart J. New development: accountability in public part-
[32] Strengthening pharmaceutical systems (SPS). Pharmaceuticals and nerships – the case of local strategic partnerships. Public Money and
the public interest: the importance of good governance. Arlington, Management 2009:59–64.
VA: U.S. Agency for International Development by the SPS Program; [62] Institute of Medicine. For the public’s health: the role of measure-
2011. ment in action and accountability. Washington, DC: The National
[33] Kaplan AD, Dominis S, Palen JG, Quain E. Human resource gover- Academies Press; 2011.
nance: what does governance mean for the health workforce in [63] Anderson B, Dovey L. Whither accountability? Wellington, New
low- and middle-income countries? Human Resources for Health Zealand: State Services Commission; 2003.
2013;11(6). [64] DSP-HSD. The steward’s dilemma: building capacity for governance
[34] USAID. Governing for better health: a targeted literature review. in real world health systems. Copenhagen, Denmark: World Health
Cambridge, MA: USAID; 2012. Organization Regional Office for Europe [unpublished].
[35] Boffin N. Stewardship of health systems: review of the literature. [65] Tello J, Barbazza E. Coordination and governance mechanisms to
Antwerp: Institute of Tropical Medicine; 2002. enable the conditions for integrated care of chronic conditions.
E. Barbazza, J.E. Tello / Health Policy 116 (2014) 1–11 11

Berlin: Presented at the International Conference on Integrated Care; [72] MSH. Menu of indicators on management and leadership capac-
2013. ity development. Cambridge, MA: Management Sciences for
[66] WHO. Implementing the WHO stop TB strategy: a handbook for Health Leadership, Management and Sustainability Program;
national tuberculosis control programmes. WHO/HTM/TB/2008.401. 2006.
Geneva, Switzerland: World Health Organization; 2008. [73] UNDP and GF. Capacity development toolkit to strengthen national
[67] Kirigia JM, Kirigia DG. The essence of governance in health develop- entities to implement national disease responses for HIV and AIDS,
ment. International Archives of Medicine 2011;4(11). tuberculosis and malaria; 2012. Available from: http://www.undp-
[68] Ritsatakis A, Jarvisalo J. Opportunities and challenges for includ- globalfund-capacitydevelopment.org/ [online].
ing health components in the policy-making process. In: Stahl T, [74] WHO. Health system governance: toolkit on monitoring health
Wismar M, Ollila E, Lahtinen E, Leppo K, editors. Health in all poli- systems strengthening. Geneva, Switzerland: World Health Organi-
cies: prospects and potentials. Finland: Ministry of Social Affairs and zation; 2008.
Health; 2006. [75] Kickbusch I, Behrendt T. Interim report supporting health 2020: gov-
[69] Health Systems 20/20. The health system assessment approach: a ernance for health in the 21st century. Copenhagen, Denmark: WHO
how-to manual, version 2.0; 2012. Regional Office for Europe; 2012.
[70] MSH. Management and organizational sustainability tool (MOST): a [76] Saltman R, Jakubowski E. Part 1: Comparative governance themes
guide for users and facilitator, 3rd ed. Cambridge, MA: Management and issues. In: Jakubowski E, Saltman R, editors. The changing
Sciences for Health; 2010. national role in health system governance: a case-based study of
[71] Health Metrics Network. Framework and standards for country 11 European countries and Australia. Copenhagen: WHO Regional
health information systems, 2nd ed. Geneva: World Health Orga- Office for Europe; 2013.
nization; 2008.

View publication stats

Вам также может понравиться