Hierarchy of evidence

A typical evidence pyramid used to describe a hierarchy of evidence

Poetry of reality Science

We must know. We will know.

Physics Chemistry Biology Astronomy Geology

A view from the shoulders of giants.

Philosophical naturalism Politicization of science Absence of evidence Doppler effect Gerry Soffen Extremely low frequency FAQ on radioactivity and nuclear technology A comparative guide to science denial v - t - e

A hierarchy of evidence is a ranking of the quality of evidence used in evidence-based medicine. There is variation among hierarchies, with more than 80 documented, but they follow a basic pattern of attempting to rank evidence based on:

• Relevance to the target population (usually humans, but potentially also animals in veterinary medicine), e.g. studies on humans are more relevant to humans than studies on rodents
• Throwing out bad studies entirely. This can be for lots of reasons, and is done in quality reviews and meta-analyses. Common reasons for ignoring studies include:
  • poor design
  • lack of peer review
  • insufficient control for biases
  • having research funding from a party (such as an industry) that has an interest in the outcome.

It is important to recognize and remove bad studies from reviews and meta-analyses (and it is important to keep in mind that bad studies can appear in peer-reviewed journals) because bad studies can taint the outcomes of the reviews/meta-analyses.

• Statistical power, e.g. all other things being equal, studies on more individuals have more statistical power (and can therefore potentially give results with greater statistical significance) than studies on fewer individuals
• Predictive power, that the evidence shows causation rather than just correlation — e.g., some epidemiological studies can show evidence of causation

The Canadian Task Force on the Periodic Health Examination first described an explicit hierarchy of evidence in 1979. Implicit hierarchies of evidence can be inferred from literature reviews that predate 1979, however, such as the monograph series of the International Agency for Research on Cancer (IARC) that began in 1972.

A generally-accepted hierarchy of evidence is:

1. Systematic reviews and meta-analyses
2. Randomized controlled trials with definitive results
3. Randomized controlled trials with non-definitive results
4. Cohort studies
5. Case-control studies
6. Cross-sectional surveys
7. Case reports

IARC Monographs, particularly the more recent ones, use a hierarchy that resembles the following, where evidence at the bottom can be used to support evidence at the top for overall evaluations:

1. systematic reviews and meta-analyses
2. randomized controlled trials in humans
3. cohort studies in humans
4. case-control studies in humans
5. chronic studies in animals
6. acute studies in animals, in vitro studies, and mechanistic studies

Criticisms

“”Hierarchies are a poor basis for the application of evidence in clinical practice. The Evidence-Based Medicine movement should move beyond them and explore alternative tools for appraising the overall evidence for therapeutic claims.

—Christopher J. Blunt

Hierarchies of evidence are not without criticism, but the criticism has come from within the philosophy of science and has generally been ignored within evidence-based medicine.

Problems with evidence hierarchies include:

• There is no method for evaluating which of the many different hierarchies is better for a given problem.
• Hierarchies of evidence are at best a heuristic and lack both empirical and theoretical justification.
• Studies with high internal validity (well-controlled and with a homogeneous study group) might have low external validity for a heterogeneous population.

Although there are serious criticisms of the hierarchy of evidence in evidence-based medicine, there has been no serious proposal for replacing this type of methodology in dealing with prioritization of the sometimes massive amounts of evidence relevant to a given problem.