Systematic Reviews & Evidence Synthesis

At an absolute minimum you will need:

• a word processor
• a spreadsheet program
• a citation manager
• a review management / screening application (optional but highly recommended)

Every member of your research team should be able to access and collaborate using the same software, and you should have a plan for where drafts and materials will be saved and how versions will be labeled for identification. Accurate documentation is essential!

Find More Tools

Zotero, EndNote or Something Else?

Not all citation managers are equipped to cover all your needs in an evidence synthesis project. Sometimes you can get around that by using other tools to supplement the citation manager, but the CSU Libraries will only offer support for Zotero and EndNote.

CSU Libraries will provide support for Mendeley users, but it is currently not recommended for evidence synthesis.

What is Screening & Data Extraction Software?

There are a variety of programs designed to guide you through the evidence synthesis process. Some of these programs focus on just the process of screening results while other programs are more comprehensive, including data extraction and analysis.

Using one of these programs rather than spreadsheets is becoming a standard for publication of evidence synthesis in some fields. It also significantly improves the ease of reporting for the PRISMA flow diagram.

How Does This Work?

To use these programs, you:

• select one, create an account and invite all other screeners (and data extractors, if relevant) to the project
• set up the basic parameters of your project such as which keywords you want highlighted in the records, your inclusion/exclusion criteria, which person is assigned to screen which articles, and how screening decisions will be blinded (or not)
• upload the raw exports of results from your database searches or from your citation manager (generally in .ris format)
• each screener accesses the project and is systematically shown one record at a time and asked to make a decision
• after all screeners are done, you can unblind decisions or have another screener review any decisions that do not match
• after retrieving full text pdfs and uploading them, the same process can be repeated for full text screening and/or data extraction
• the software will track all decisions made and provide you with the numbers for your PRISMA flow diagram

How Do I Select Review Management / Screening Applications?

CSU Libraries does not currently offer or promote any specific systematic review screening management software. General assistance can be provided in setting up the process, but detailed technical support must be arranged with the vendor or through online support guides.

Criteria to consider include:

• cost
• ease of access
• ease of use / learning curve / technical support
• process needs, such as process tracking/management, deduplication, pilot screening, screening, data extraction, data coding, critical appraisal, data analysis/synthesis
• inclusion if automation / AI
• documentation outputs

How Do I Find These Tools?

Many validated tools exist to assist researchers and practitioners in conducting critical appraisal or risk of bias assessment processes. In general, evidence synthesis projects are aiming to do a risk of bias assessment of all included studies, when necessary for that project type.

While there is a difference between risk of bias and critical appraisal, tools are not consistently labeled accurately to represent this difference, and often can be readily adapted to both uses (though this does have potential risks relating to the validation of the tool).