Skip to content
World Health Systems Facts

WHO World Health Report 2000: Limitations

Overview
Results

Methodology
Limitations


“Undoubtedly, many of the concepts and measures used in the report require further refinement and development. To date, our knowledge about health systems has been hampered by the weakness of routine information systems and insufficient attention to research. This report has thus required a major effort to assemble data, collect new information, and carry out the required analysis and synthesis. It has also drawn on the views of a large number of respondents, within and outside WHO, concerning the interpretation of data and the relative importance of different goals. The material in this report cannot provide definitive answers to every question about health systems performance. It does though bring together the best available evidence to date. It demonstrates that, despite the complexity of the topic and the limitations of the data, it is possible to get a reasonable approximation of the current situation, in a way that provides an exciting agenda for future work.”

Source: Message from the Director-General of the World Health Organization, Dr Gro Harlem Brundtland, in the introduction to The World Health Report 2000: Health Systems : Improving Performance. Geneva: World Health Organization, 2000.


“First, the WHO research team should have been sure that their estimates are robust. Can they, in good conscience, make that claim? An artificially high ranking, for example, could take the wind out of the sails of desirable health-reform efforts. Similarly, an artificially low ranking could assign a bad grade to past reform efforts that were actually commendable. Rumour in the health services research community has it that France’s no.1 rank was driven in part by a flawed measure of national educational attainment. Under the methodology used by WHO, the more the level of educational attainment or of health spending is underestimated for a country, the higher will be the ratio of actual to ideal performance for that country and the higher will be the nation’s ranking.

“Second, if the report is addressed to policy-makers, one must judge it poorly written. To be sure, it has a number of fascinating, if chatty, chapters; but these are only loosely connected to the actual work underlying this study. To see what was actually done, one must plough through the cryptic commentary that accompanies the tables in the Annex or dig up and read sundry sources cited in the references. Few policymakers and even fewer journalists will go to that trouble.

“To be useful as a policy analysis, the report ought to have started with the crisp executive summary that is now de rigueur among policy analysts, certainly in the United States. That summary would have presented the main conclusions emerging from the study and described, in layman’s terms, the methodology that was used to reach these conclusions. Most important of all, the executive summary should have contained the many caveats that must, in good conscience, accompany ambitious analyses of this sort.”

Source: Reinhardt, U., and T. Cheng. “The world health report 2000 – Health systems: improving performance.” Bulletin of the World Health Organization vol. 78,8 (2000): 1064.


“The main criticisms were, however, of technical aspects of the methods used to assess performance. By common consent those undertaking this exercise faced a major problem if they were to include all 192 WHO Member States, some of which barely functioned as states and certainly lacked control over all of their territory. Many lacked even the most basic of information. Only a minority had any functioning system of vital registration, so if measures such as health outcomes were to be included they had to be modelled. This would be complicated enough if only the simplest of measures, such as life expectancy, was used. In many countries, there were established methods to calculate this by applying data from surveys of child mortality to standard life tables, but both inputs incorporated many assumptions. Yet a more complex measure, Disability Adjusted Life Years (Murray et al. 2000; Mathers et al. 2001) was used, even though even fewer data on disability were available and their application required highly contentious assumptions about valuations of different health states (Anand and Hanson 1997). The estimates of distribution of health outcomes also attracted criticism; derived from data from only a few countries and involving complex modelling, the measure was essentially the sum of intra-individual differences in outcome. This takes no account of the social and ethnic patterning of health whereby a summary measure may designate a system as reasonably fair even though there was systematic discrimination against a minority (Braveman et al. 2000).

“The problems in assessing responsiveness were even greater, with data being modelled on the basis of results from a survey of 1791 respondents in 35 countries, many of whom were WHO staff (Williams 2001). The modelling process did exclude those results for which ‘no rational explanation’ could be found and adjusted them for the tendency of those living in dictatorships to score their systems especially highly, but, even after this process, others showed poor correlation between the opinions of key informants and those surveys that existed (Blendon et al. 2001).

“Other criticisms were levelled at the measures of fairness of financing, for not taking account of the greater needs of the poor or the scale of redistribution, the use of a composite index of quite different parameters whose meaning was difficult to visualise, and the lack of external peer review (Almeida et al. 2001). The WHO has responded to these criticisms, for example by asking whether there was an alternative to modelling data where none exist (Murray et al. 2001) and highlighting the uncertainty levels around the estimates (Murray et al. 2000b), although even now, a decade later, these different views have not been resolved.

“Finally, to assess performance, it was necessary to estimate how much a health system could reasonably expect to achieve, given the myriad other influences on health. This estimate was derived from years of education, which, as Williams (2001) has noted, is an extreme over-simplification.”

Source: Martin McKee, The World Health Report 2000: 10 years on, Health Policy and Planning, Volume 25, Issue 5, September 2010, Pages 346–348, doi.org/10.1093/heapol/czq032

  • Home
  • About Health Systems Facts
    • Contact Us
    • Join Our Email List
  • Breaking News & Opinion
  • Upcoming Events
  • Seventeen National Health Systems
    • Austria
    • Canada
    • Costa Rica
    • Czech Republic
    • Denmark
    • France
    • Germany
    • Hungary
    • Italy
    • Japan
    • Netherlands
    • South Korea
    • Spain
    • Sweden
    • Switzerland
    • United Kingdom
    • United States
  • Comparing National Health Systems
    • Healthcare Access and Quality Index
    • Sustainable Development Goals Health Index
    • Mirror Mirror 2021
    • World Health Report 2000
    • International Health Systems In Perspective
    • Lessons for US Health Reform
  • Aging
  • Health System Outcomes
  • Healthcare Spending
  • Healthcare Workers
    • Health System Personnel
    • Health Workforce Training
  • Information and Communications Technologies
  • Long-Term Services and Supports
  • People With Disabilities
  • Pharmaceutical Pricing and Regulation
  • Social Determinants & Health Equity
  • Wasteful Spending
  • Various US Health System Proposals
    • Affordable Care Act
    • All Payer
    • Public Option
    • Single Payer / “Medicare For All”
    • Universal Health Coverage
  • Recommended Resources
  • Privacy Policy
    • Cookie Policy
  • Facebook
  • LinkedIn
  • Twitter

© 2019-2022 Real Reporting Foundation | Theme by WordPress Theme Detector

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
_GRECAPTCHA5 months 27 daysThis cookie is set by Google. In addition to certain standard Google cookies, reCAPTCHA sets a necessary cookie (_GRECAPTCHA) when executed for the purpose of providing its risk analysis.
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_UA-71314304-21 minuteThis is a pattern type cookie set by Google Analytics, where the pattern element on the name contains the unique identity number of the account or website it relates to. It appears to be a variation of the _gat cookie which is used to limit the amount of data recorded by Google on high traffic volume websites.
_gcl_au3 monthsThis cookie is used by Google Analytics to understand user interaction with the website.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
CookieDurationDescription
IDE1 year 24 daysUsed by Google DoubleClick and stores information about how the user uses the website and any other advertisement before visiting the website. This is used to present users with ads that are relevant to them according to the user profile.
test_cookie15 minutesThis cookie is set by doubleclick.net. The purpose of the cookie is to determine if the user's browser supports cookies.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
Powered by CookieYes Logo