Skill Guide

Systematic review methodology (PRISMA, Cochrane, GRADE evidence frameworks)

A rigorous, multi-phase process for identifying, evaluating, and synthesizing all available evidence on a specific research question, governed by standardized reporting and quality-assessment frameworks to minimize bias.

It transforms fragmented evidence into actionable, high-certainty conclusions, directly informing clinical guidelines, health policy, and strategic R&D investments. This reduces decision-making risk and resource waste in evidence-dependent sectors like healthcare, pharma, and public policy.

1 Careers

1 Categories

9.0 Avg Demand

25% Avg AI Risk

How to Learn Systematic review methodology (PRISMA, Cochrane, GRADE evidence frameworks)

1. Understand the PRISMA 2020 flow diagram and checklist to grasp the mandatory reporting structure. 2. Learn to formulate a precise research question using the PICO framework (Population, Intervention, Comparison, Outcome). 3. Master basic database search syntax (Medline/PubMed, Embase) and the concept of a search protocol.

Apply skills to a focused topic. Execute a real search across 3+ databases, manage citations in Endnote/Zotero, and perform risk of bias assessment using a Cochrane RoB 2 tool on 5-10 RCTs. Common mistake: Poorly defined inclusion/exclusion criteria leading to inconsistent study selection.

Lead a full review or serve as methodological advisor. This involves: 1) Complex evidence synthesis (network meta-analysis, overviews of reviews), 2) Applying the GRADE framework to rate certainty of evidence for each outcome and construct 'Summary of Findings' tables, 3) Developing and justifying deviations from standard protocols for highly complex questions.

Practice Projects

Beginner

Case Study/Exercise

PRISMA Checklist Mapping Exercise

Scenario

You are given a published systematic review with intentional omissions (e.g., missing search strategy details, no study selection flow diagram).

How to Execute

1. Print the PRISMA 2020 checklist. 2. Go through the paper line-by-line, marking each item as 'Reported,' 'Not Reported,' or 'Poorly Reported.' 3. Draft a concise report summarizing the compliance gaps and their potential impact on the review's credibility.

Intermediate

Case Study/Exercise

Cochrane Risk of Bias Assessment & Discrepancy Resolution

Scenario

A team of three reviewers has independently assessed the risk of bias for 15 RCTs using RoB 2. Significant discrepancies exist in the 'randomization process' and 'measurement of the outcome' domains.

How to Execute

1. Convene a consensus meeting. 2. Re-read the relevant sections of each disputed study against the RoB 2 signaling questions. 3. Refer to the Cochrane Handbook for interpretation guidance. 4. Reach a consensus judgment and document the rationale for each decision.

Advanced

Project

GRADE Evidence Profile and Summary of Findings Table Construction

Scenario

You have completed meta-analyses for 5 critical outcomes in a review of a new antihypertensive drug vs. standard care. You must now present the certainty of evidence to a guideline development group.

How to Execute

1. For each outcome, construct a GRADE Evidence Profile, rating the certainty based on Risk of Bias, Inconsistency, Indirectness, Imprecision, and Publication Bias. 2. Assess and document any reasons for rating up (e.g., large magnitude of effect). 3. Synthesize this into a concise Summary of Findings table, translating statistical results into plain language statements of effect and certainty.

Tools & Frameworks

Reporting & Methodological Standards

PRISMA 2020 Statement & ChecklistCochrane Handbook for Systematic Reviews of InterventionsGRADE Handbook (for assessing certainty of evidence)

PRISMA ensures transparent, complete reporting. The Cochrane Handbook is the definitive procedural guide. GRADE is the international standard for rating evidence certainty and moving from evidence to recommendations.

Software & Digital Platforms

Covidence or Rayyan (screening & data extraction)RevMan (Cochrane's review management software)Stata/R (for advanced meta-analysis)GRADEpro GDT (for creating Evidence Profiles and Summary of Findings tables)

Covidence/Rayyan streamline screening. RevMan is standard for Cochrane reviews. Stata/R handle complex analyses. GRADEpro is the dedicated tool for implementing the GRADE framework.

Interview Questions

Answer Strategy

The interviewer is testing the candidate's nuanced application of GRADE, specifically the principle of rating up for large magnitude of effect. Use the 'balance of factors' approach. Sample answer: 'I would rate it as LOW certainty. Starting at HIGH for RCTs, I would downgrade twice: once for serious risk of bias and once for serious imprecision. While the large effect (e.g., RR>2) is a strong reason to consider rating up, I would not do so here because the initial downgrades are severe. The large effect is noted but does not overcome the fundamental limitations in the evidence base.'

Answer Strategy

Tests conflict resolution and adherence to a pre-defined protocol, a core tenet of systematic reviews. Sample answer: 'In a review on surgical techniques, the team disagreed on whether a study's follow-up duration met our protocol's 'minimum 12-month' outcome criterion. I halted the debate and directed everyone to the exact protocol wording. We re-read the study's methods section together, noting the follow-up was described as '6-18 months.' Since the protocol required a *minimum* of 12 months for the primary outcome, and this study's data couldn't be disaggregated, we reached consensus to exclude it. This reinforced that the protocol is the final arbiter.'