The standard answer to how many reviewers for screening is two independent reviewers at both the title and abstract stage and the full-text stage, with a third reviewer available to resolve disagreements. Two reviewers working blind to each other is the method that protects a systematic review from the errors and biases a single screener inevitably introduces.
Why one reviewer is not enough
Screening is repetitive judgement made thousands of times, and a single reviewer is fallible in two directions. Fatigue causes eligible studies to be missed, and an individual’s expectations about what the review should find can quietly tilt borderline calls. Studies of single-reviewer screening consistently show that a meaningful fraction of eligible records are wrongly excluded. Because a missed study is invisible and unrecoverable, the only reliable guard is a second independent pair of eyes on the same records. This is why duplicate screening is treated as a methodological requirement rather than a nicety in guidance such as the PRISMA 2020 guideline.
What “in duplicate” actually requires
Independent and blind
The two reviewers must screen independently, each unaware of the other’s decision until both are done. If one reviewer can see the other’s vote, the second judgement is anchored and the benefit of duplication is lost. Purpose-built screening tools for systematic reviews enforce this blinding automatically and reveal conflicts only once both reviewers have committed.
Calibrated against shared criteria
Two reviewers only agree when they are applying the same rules, so a pilot round on a sample of records is essential before the full screen. The pilot is where you tune your inclusion and exclusion criteria until both reviewers interpret them the same way. Measuring inter-rater reliability in screening during the pilot tells you whether the criteria are operational or still ambiguous.
The role of the third reviewer
The third reviewer is not a tie-breaker who screens everything; they adjudicate only the records where the first two disagree. Their job is part of the wider practice of resolving screening conflicts, and it is usually a senior team member with the strongest grasp of the eligibility rules. Keeping adjudication with one consistent person stops the resolution itself from becoming a source of variation.
What two reviewers cost in effort
Duplicate screening doubles the human reading at each stage, and being honest about that up front prevents the mid-project surprise that derails timelines. If a search returns 6,000 de-duplicated records and a reviewer averages, say, one or two abstracts a minute, each reviewer faces tens of hours at the first pass alone, and the full texts that survive add more. The two ways to keep this manageable are a tight, well-framed question that limits the record count, and parallelism: two reviewers working simultaneously clear the same set in the wall-clock time of one, even though the total person-hours double. Active-learning prioritisation inside a dedicated screening platform can shorten the queue further, but it speeds the human screen rather than replacing the second reviewer.
Variations on the two-reviewer model
Two fully independent screeners across the whole set is the default, but a few defensible variants exist for resource-limited teams. In single-screening with verification, one reviewer screens everything and a second independently checks a substantial sample; emerging evidence suggests this can be acceptable for the abstract pass when paired with a validated tool, though it is weaker than full duplication. In liberal-accelerated screening, one reviewer can include a record at the abstract stage but two are needed to exclude one, which front-loads sensitivity. These are compromises to declare in the methods, not silent shortcuts, and none of them removes the need for two reviewers at the decisive full-text stage.
When the team is small
Not every project has three people, and the honest position is that the two-reviewer standard still holds even then. A supervisor, a co-author, or a methodologist can serve as the second screener for a sample, and at minimum a second reviewer should independently check a proportion of one person’s decisions. Where a sole researcher truly cannot find a second screener, that limitation must be stated plainly in the methods, because it changes how much weight readers can place on the selection. It is one of the reasons solo reviews take longer and are viewed less favourably, as we note in how long a systematic review takes.
How error accumulates with a single screener
The case for two reviewers is not abstract caution; it follows from how misses compound. A single screener who wrongly excludes even a small proportion of eligible records removes those studies permanently, because nothing downstream ever looks at an excluded abstract again. Two independent reviewers fail differently: a study is only lost if both miss it, and the probability of two people independently making the same wrong exclusion is far lower than either making it alone. That is the entire statistical argument for duplication, and it is why the second reviewer adds the most value precisely on the borderline records a tired solo screener would wave through in the wrong direction. The same reasoning explains why a second reviewer who merely rubber-stamps the first adds little: the protection comes from genuine independence, which is why blinding inside a purpose-built platform matters as much as having two names on the team.
Reviewers across the wider review
The two-reviewer principle does not stop at screening. The same duplication is the standard for data extraction and for risk of bias assessment, because each of those stages also depends on repeated human judgement. Planning reviewer roles for the whole pipeline in your protocol up front, rather than improvising mid-project, is what keeps the labour manageable and the method defensible. Where a team simply does not have a second qualified screener, supplying one is exactly what our independent screening and extraction service provides, so the two-reviewer standard is met without stalling the project.