Primary care and prevention
How ACIP Turns Vaccine Evidence Into a Recommendation
ACIP converts vaccine evidence into a recommendation using two linked tools. GRADE rates how certain the science is about benefits and harms, sorting evidence into four levels. The Evidence to Recommendations framework then weighs seven domains, from public health problem to equity, before the full committee votes in public and the CDC Director reviews the result.
The Advisory Committee on Immunization Practices does not move straight from a clinical trial to a vote. It runs the evidence through two linked tools: GRADE, which rates how certain the science is about a vaccine's benefits and harms, and the Evidence to Recommendations (EtR) framework, which asks a structured set of questions about whether a recommendation makes sense in the real world. Only after a work group has weighed the public health problem, the balance of benefits and harms, patient values, acceptability, feasibility, resource use, and equity does the full committee cast a public vote. The recommendation that results is a judgment about all of those domains together, not the trial data alone.
Two tools doing two different jobs
It helps to separate the two questions ACIP is really answering. The first is a question about evidence: how confident can we be in what the studies show? The second is a question about policy: given that confidence, and given everything else that matters, should this vaccine be recommended, and for whom? GRADE handles the first. The EtR framework handles the second. ACIP formally adopted GRADE in 2010 and, by a unanimous vote at its February 2018 meeting, adopted a modified EtR framework tailored to its needs, as the committee's published framework update describes.
Keeping these separate is what stops a strong-looking dataset from automatically becoming a strong recommendation, and it also stops weak data from being quietly dressed up as certainty.
How GRADE rates the evidence
GRADE, short for Grading of Recommendations, Assessment, Development and Evaluation, is a system for rating certainty rather than a way of counting studies. A work group begins by defining the specific outcomes that matter, such as symptomatic disease, hospitalization, or serious adverse events. For each outcome, it assesses the body of evidence and assigns one of four certainty levels: high, moderate, low, or very low, which ACIP's earlier GRADE tables numbered as evidence types 1 through 4. Randomized trials generally start high and can be rated down for problems like risk of bias, inconsistency between studies, indirectness, imprecision, or signs of publication bias. Observational data usually starts lower.
The output is honest about its own limits. A rating of "low certainty" for a harm does not mean the harm is real or unreal; it means the current studies cannot settle the question with confidence. That distinction carries directly into the next stage.
Seven questions before a vote
The EtR framework turns the graded evidence into a decision by requiring a work group to answer a fixed set of questions, each its own domain. ACIP adopted six of these domains with its 2018 framework and added a seventh, equity, in 2020.
- Public health problem. Is the disease a public health priority in the population being considered?
- Benefits and harms. How large are the desirable effects, how large are the undesirable ones, and does the balance favor vaccination?
- Values. How much do the people affected value the outcomes, and how much does that valuation vary?
- Acceptability. Is the recommendation acceptable to key stakeholders, including clinicians and the public?
- Feasibility. Can the recommendation actually be implemented in practice?
- Resource use. Is the vaccine a reasonable and efficient use of resources, informed by cost-effectiveness analysis?
- Equity. Would the recommendation widen, narrow, or leave unchanged existing differences in health across groups?
Each domain gets an explicit work group judgment, supported by the graded evidence and by additional inputs such as economic models and provider surveys. Writing them down is the point: a reader can later see where the case was strong and where it rested on assumption.
From work group to a public vote
Most of this labor happens inside a work group, a smaller body that gathers and analyzes the evidence and builds the EtR assessment. The work group does not make policy. It brings its evidence tables and domain judgments to the full ACIP at a public meeting, where members discuss them, hear public comment, and then vote. A recommendation passes on a majority of voting members. If important information is missing, the committee can defer rather than force a decision.
A vote is still not the final step in federal guidance. Under the committee's described process, recommendations approved by ACIP are reviewed by the Director of the CDC and, if adopted, published in the Morbidity and Mortality Weekly Report, at which point they become official CDC recommendations.
Reading the wording of a recommendation
The framework also shapes how a recommendation is phrased, and the phrasing carries meaning. A routine or risk-based recommendation sets the default to vaccinate: unless there is a contraindication, the patient in that group should be offered the vaccine. A decision not to recommend sets the opposite default.
A third category, shared clinical decision-making, sets no default at all. ACIP uses it, as the CDC explains, when some individuals may benefit but vaccinating the whole group is unlikely to produce clear population-level benefit. In that situation the decision is meant to be made between a person and their clinician, informed by individual characteristics, values, and preferences rather than a blanket rule. Recognizing which category you are looking at tells you how much of the decision the committee intended to leave open.
Why the structure is the point
The value of this machinery is that it is visible. Anyone can read the GRADE tables and the EtR judgments that sit behind a given vaccine recommendation and see which domains drove it. That does not remove judgment from the process; benefit, harm, values, and equity cannot be reduced to a single number, and reasonable experts can weigh them differently. What the framework does is make the reasoning legible, so that both agreement and disagreement can be located in specific evidence rather than in the general authority of a committee.
This article is educational and is not medical advice; decisions about any vaccine should be made with a qualified clinician.
References and sources
How this was researched. This explainer is built from the primary sources listed above and reflects Dr. Tojjar's own critical appraisal of that evidence. It explains and evaluates research and does not provide medical care.
This article is for general education and is not medical or professional advice. For guidance about your own health, talk with a qualified clinician.
Cite this article
Tojjar, D. (2023). How ACIP Turns Vaccine Evidence Into a Recommendation. Dr. Damon Tojjar. https://readingtheevidence.org/articles/how-acip-turns-vaccine-evidence-into-a-recommendation/
This article is part of Dr. Tojjar's guide to Primary care and prevention.