Skip to Main Content

Systematic Reviews: Types of reviews

A guide to assist staff and students undertaking systematic reviews

Systematic literature reviews

Using a systematic approach in conducting a literature review

A literature review may be undertaken in a systematic way using a rigorous and structured search strategy in order to be comprehensive, without necessarily attempting to include all available research on a particular topic, as in a systematic review.

Why be systematic? This approach can:

  • Provide a robust overview of the available literature on your topic
  • Ensure relevant literature is identified and key publications are not overlooked
  • Reduce irrelevant search results through search planning
  • Help you to create a reproducible search strategy.

In addition, applying a systematic approach will allow you to work more efficiently.

Not every review is a systematic review. Be sure to select the review type that matches the purpose and scope of your project. All reviews should be methodical and done in a careful and deliberate manner with a defined protocol. 

Questions to ask yourself:

  • What is the purpose of this review? 
  • What is the research question?
  • How long do I have to complete it?
  • Am I doing it alone or part of a team?
  • How much of the literature do I need to capture?
  • Does my literature search have to be transparent and replicable?
  • Are there standard methods that need to be followed

Types of reviews

A systematic review attempts to identify, appraise and synthesize all the empirical evidence that meets pre-specified eligibility criteria to answer a given research question. Researchers conducting systematic reviews use explicit methods aimed at minimizing bias in order to produce more reliable findings that can be used to inform decision making.

An essential step in the early development of a systematic review is the development of a review protocol. A protocol pre-defines the objectives and methods of the systematic review which allows transparency of the process. It must be done prior to conducting the systematic review as it is important in restricting the presence of reporting bias. The protocol is a completely separate document to the systematic review report.

Adapted from: JBI Manual for Evidence Synthesis

In summary, a systematic review:

  • Addresses a specific question
  • Uses specified methodology
  • Assesses quality of the literature
  • Requires a team and long term commitment

What is a rapid review?

The Cochrane Rapid Reviews Methods Group has proposed the following definition: “A form of knowledge synthesis that accelerates the process of conducting a traditional systematic review through streamlining or omitting specific methods to produce evidence for stakeholders in a resource-efficient manner.”

Rapid reviews are usually undertaken when decision makers have urgent and emerging needs which require evidence produced on a short time frame. Typically, to compensate for the short time frame of a rapid review, methodological rigour may be sacrificed. For example, the grey literature may not be sought and preference may be given to the more readily available research published and written in English. 

A rapid review follows most of the principle steps of a systematic review, using systematic and transparent methods to identify, select, critically appraise and analyze data from relevant research. However, to provide timely evidence, some of the components of a systematic review process are either simplified or omitted. There are various approaches for simplifying the review components, such as by reducing the number of databases, assigning a single reviewer in each step while another reviewer verifies the results, excluding or limiting the use of grey literature, or by narrowing the scope of the review. In general, a rapid review takes about four months or less.

Adapted from: Health Evaluation and Applied Research Development (HEARD).  (June 25th, 2018). Rapid reviews versus systematic reviews. https://www.heardproject.org/news/rapid-review-vs-systematic-review-what-are-the-differences/

 

Umbrella reviews are sometimes referred to as a "review of reviews". They are an attempt to identify and appraise, extract and summarise all the evidence from research syntheses related to a topic or question. 

Umbrella reviews may:

  • Include analyses of different interventions for the same problem or condition.
  • Analyse the same intervention and condition, but different outcomes.
  • Analyse the same intervention but different conditions, problems or populations.

Umbrella reviews offer the possibility to address a broad scope of issues related to the topic of interest.

Adapted from: JBI Manual for Evidence Synthesis

In summary, an umbrella review:

  • Is a systematic review of systematic reviews 
  • Synthesizes systematic reviews of the same topic
  • Assesses scope and quality of individual systematic reviews

Scoping review

"Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps"  (Tricco, et al., 2018).

"Scoping reviews conducted as precursors to systematic reviews may enable authors to identify the nature of a broad field of evidence so that ensuing reviews can be assured of locating adequate numbers of relevant studies for inclusion" (Munn, Z., Peters, M., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E., 2018).

A scoping review may be undertaken as a preliminary exercise prior to the conduct of a systematic review, or as a stand alone review.

A scoping review may be used:

  • As a precursor to a systematic review.
  • To identify the types of available evidence in a given field.
  • To identify and analyse knowledge gaps.
  • To clarify key concepts/ definitions in the literature.
  • To examine how research is conducted on a certain topic or field.
  • To identify key characteristics or factors related to a concept.

Adapted from: JBI Manual for Evidence Synthesis, chapter 11 Scoping reviews. https://doi.org/10.46658/JBIMES-20-01

 

Getting started:
Cochrane: Scoping reviews: what they are and how you can do them

 

Reporting:
The PRISMA extension for scoping reviews was published in 2018. The checklist contains 20 essential reporting items and 2 optional items to include when completing a scoping review. Scoping reviews serve to synthesize evidence and assess the scope of literature on a topic. Among other objectives, scoping reviews help determine whether a systematic review of the literature is warranted.

 

A traditional literature review or narrative review examines and evaluates the scholarly literature on a topic. Literature reviews often do not answer one specific question, rather they usually bring together a summary of the literature in a qualitative manner.

A literature review may be undertaken in a systematic way in order to be comprehensive, without being a systematic review. It is important to recognise the differences between the two and determine which type of review is best suited to your needs - or whether one of the other reviews detailed here is more applicable.

Narrative reviews:

  • provide a (generally qualitative) summary of the relevant literature, as determined by the author.
  • do not necessarily provide an analysis of the literature or its quality.
  • usually do not include a description of the methodology of the search process.
  • refer to key journal literature without going into the grey literature.
  • don't always answer a specific research question.
  • are not protocol driven.

References

Barnard, M. (2015). Research essentials: How to undertake a literature review. Nursing Children and Young People, 27(10), 12-12. doi:10.7748/ncyp.27.10.12.s15

Bettany-Saltikov, J. (2010). Learning how to undertake a systematic review: Part 1. Nursing Standard, 24(40): 47-55.

Grant, M.J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologiesHealth Information and Libraries Journal, 26(2), 91-108. doi:10.1111/j.1471-1842.2009.00848.x

Kowalczyk, N., & Truluck, C. (2013). Literature reviews and systematic reviews: What is the difference? Radiologic Technology, 85(2), 219-222.

Munn, Z., Peters, M., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 1-7. doi:10.1186/s12874-018-0611-x

Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018). What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences. BMC Medical Research Methodology, 18(1), 5. https://doi-org.ezproxy.ecu.edu.au/10.1186/s12874-017-0468-4

Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy, 10(3), 21-34. https://doi.org/10.1258/1355819054308530

Robinson, P., & Lowe, J. (2015). Literature reviews vs systematic reviews. Australian and New Zealand Journal of Public Health, 39(2), 103-103. doi:10.1111/1753-6405.12393

Tricco, A., Lillie, E., Zarin, W., O'Brien, K., Colquhoun, H., Levac, D., . . . Straus, S. (2018). Prisma extension for scoping reviews (prisma-scr): Checklist and explanation. Annals of Internal Medicine, 169(7), 467-467.