Skip to Main Content

Nursing: NEW! Nursing Research

NEW! Nursing Research

What is a PICO(T) question?

PICO(T) is a mnemonic - a pattern of letters that helps us to remember something. The letters in PICO(T) each stand for an element of a clinical research question. The School of Nursing at Duquesne University has a great summary of the elements of a PICO(T) question:

  • P (Patient, population or problem): Who or what is the patient, population or problem in question?
  • I (Intervention): What is the intervention (action or treatment) being considered?
  • C (Comparison or control): What other interventions should be considered?
  • O (Outcome or objective): What is the desired or expected outcome or objective?
  • T (Time frame): How long will it take to reach the desired outcome?

It is important to remember that not all topics will work with all of the PICO(T) categories, and not all PICO(T) questions will address each element. This is okay! If you are unsure about your PICO(T) question, check with your instructor. 

How do I write a PICO(T) question?

The Learning Portal has templates that can be used for developing a good PICO(T) question. These templates show how the PICO(T) framework can be applied to different types of questions and situations. Remember! The elements of a PICO(T) question do not have to appear in a specific order.
 

Therapy
Template: In [P]______, do/does [I] ______ result in [O] _______ when compared with [C] ______ over [T] _______?

Example: In nursing home residents with osteoporosis, do hip protectors result in fewer injuries from slips, trips, and falls when compared with standard osteoporosis drug therapy over the course of their stay?

Etiology
Template: Are [P] ______ with [I] ______ over [T] ________ more likely to [O] _______ when compared with [C] ______?

Example: Are female non-smokers with daily exposure to second-hand smoke over a period of ten years or greater more likely to develop breast cancer when compared with female non-smokers without daily exposure to second-hand smoke?

Diagnosis
Template: Is/are [I] ______ performed on [P] ______ more effective than [C] ______ over [T] _______in [O] _______?

Example: Are self-reporting interviews and parent reports performed on children aged 5-10 more effective than parent reports alone over a four-week consultation process in diagnosing depression?

Prevention
Template:
In [P] ______, do/does [I] ______ result in [O] _______ when compared with [C] ______ over [T] _______?

Example: In emergency room visitors, do hand sanitizing stations result in fewer in-hospital infections when compared with no hand sanitizing stations over a year-long pilot period?

Prognosis
Template:
Do/does [I] ______ performed on [P] ______ lead to [O]______ over [T] _______compared with [C] _______?

Example: Do regular text message reminders performed on patients recently diagnosed with diabetes lead to a lower occurrence of forgotten insulin doses over the first six months of treatment compared with no reminders?


The video below gives more information about using PICO(T) questions for research.

PICO(T) Best Practices

The Oncology Nursing Society provides an outline for writing a PICO(T) question, including best practices:

  • There may or may not be a comparison (C) or a timeframe (T), depending on the question.
  • PICO(T) questions are meant to guide your research. The question should be specific and unbiased.
  • A PICO(T) question is only a starting point. It is not the whole research project.
  • PICO(T) questions do not have directional terms like "improve" or "decrease".

I still need help! What should I do?

Email or visit the Library, or ask your instructor for help.

What is a search strategy? Why do I need one?

A search strategy is an organized group of words that are used to look for information in a library catalog or database. A good search strategy will help you to find useful information that is relevant to the topic of your assignment.


How do I create a search strategy?

There are four steps to creating a good search strategy:


Step 1: Summarizing

Read the assignment carefully. Make notes of what you are being asked to find, and any other requirements related to the sources of information you will need. Write down the research topic into one to two sentences, and make notes about the additional requirements.

Example

Research Question: Do women of childbearing age who take folic acid supplements have reduced neural tube defects in their infants compared to those who do not take these supplements?

Additional Requirements: peer reviewed articles published in the last 20 years.


Step 2: Finding Search Terms

Look at the research question, and underline or highlight the most important words and ideas. In the example below, these words are highlighted in yellow.

Example

Do women of childbearing age who take folic acid supplements have reduced neural tube defects in their infants compared to those who do not take these supplements?


Step 3: Make a List

Write down the words you identified in a list - this is your first search strategy! You can type these words into a library catalogue or database to start searching.

Example

  • women of childbearing age

  • folic acid

  • supplements 

  • infants

  • neural tube defects 


Step 4: Brainstorm

Next, brainstorm alternative words that you can use in place of your search terms. This can be synonyms - words or phrases that means exactly or nearly the same as another word or phrase in the same language - broader or narrower terms, and even alternative spellings.

Example

  • women of childbearing age > pregnancy, maternal, prenatal, 

  • folic acid > folate, vitamin B9, folacin, 

  • supplements > supplementation, 

  • infants > newborns, neonates, 

  • neural tube defects > NTDs, spina bifida, anencephaly, 


Some search terms will have many alternative, and others may only have one or two. This is okay! At this stage, you are brainstorming and trying new ideas. This does not have to be perfect, and there are no right or wrong words.


How do I find these words?

There are a few things you can do to help with the brainstorming process in step 4:

  • Work in a group and share ideas

  • Use a dictionary, thesaurus or encyclopedia - in print or online

  • Do a Google search for synonyms of your word - try typing "synonyms for", followed by your word

  • Use the Library's search - type in your first search strategy and look at the results. See what other words are being used by researchers and add the relevant ones to your list.

Most importantly, be patient with yourself! Brainstorming is one of the most challenging parts of research, and it takes time and work. This is okay!


What do I do with these words?

Combine these words in different ways in a library catalogue or database to find information. Make sure that you have one word for each idea in your research question.

Examples

  • women of childbearing age folic acid supplements infants neural tube defects

  • prenatal folic acid supplementation newborns NTDs

  • pregnancy folate supplementation infants neural tube defects 

There is no right or wrong way to combine these words, as long as you have one word for each idea.


What's next?

Look at the tabs labelled Basic Searching and Advanced Searching for more help with using search terms in the Library's search or in a database.

What is basic searching?
When you are using a library search or searching a database, “basic searching” means that you are using one search box and a few carefully selected words to find information. The Catalyst search box on the Library’s homepage is used for a basic search:

A screenshot from the Loyalist Library website. Pictured is the homepage and the Library's search, which is called Catalyst. A red arrow points to the single search box.

What is Catalyst?
Catalyst is the Library’s search tool. It searched all of the Library’s resources all at once, including the physical books on the shelves and the electronic content in all of the Library’s databases. 

What is a database?
A database is an organized collection of information that can be searched. Databases can hold different kinds of information, including journal articles, newspaper articles, eBooks, and streaming videos.

How do I do a basic search?
A basic search is done using the following steps:

Step 1: Preparing to Search
Before you search, you need to create a search strategy. A search strategy is an organized group of words that are used to look for information in a library catalog or database. A good search strategy will help you to find useful information that is relevant to the topic of your assignment. You can learn more about this process in the tab labelled Creating a Search Strategy.

Step 2: The First Search
Visit www.loyalistlibrary.com and find Catalyst. Take the words you brainstormed when you created your search strategy, and start typing them into Catalyst. Use only one word for each idea in your research question: 

A screenshot from the Loyalist Library website. Pictured is the homepage and the Library's search, which is called Catalyst. A red arrow points to the single search box. The words typed into the box are, "prenatal folic acid supplementation newborns neural tube defects".

HINT! Do not include words like "journal", "article", "peer-reviewed", "scholarly", or the name of the program or course. Including these words will provide a lot of results that are not relevant.

Step 3: The Search Results
On the next screen are the results. In the centre of the screen are the resources that Catalyst has found that include your search words. On the right side of the screen are filters that allow you to narrow down the list of results. At the top of the screen is a reminder to sign into your library account. 

A screenshot from the Loyalist College library. In the centre of the screen are a list of articles, books, and other library resources. On the right side are options to filter by format and data of publication. A box that reads, "sign in" is highlighted.

Why should I sign in?
Signing in helps in two ways:

  1. Signing in gives you access to electronic resources, including journal articles, eBooks, and streaming videos. If you are off campus and cannot access what you need, make sure you are signed in.
  2. Signing in gives you access to all of the extra features in Catalyst that help you with your research.


What is my library login information?
Your library login is the same as your MyLoyalist login. When you are signed in, your name shows up in the top right corner of the screen:

A screenshot from the Loyalist College library. In the top right corner is text that reads, "your name here!" with a red arrow.
 

Step 4: Filtering
It is very common to get a large number of results the first time you search, especially if the search terms are very broad. Narrow down the list of results by using the filters located on the left side of the screen. These include publication date, peer-reviewed articles, formats, subjects and more. The filters you pick might depend on the requirements of the assignment, so make sure to verify what the requirements of the assignment are. Pick as many or as few filters as you need and click the green button that reads Apply Filters to add them to your search:

A screenshot from the Loyalist Library website. The image focuses on the filters used to narrow down search results. Red arrows point to filters for peer reviewed content, the date of publication, articles, and the button to apply any selected filters.
 

Step 5: Reading
To access any resource in the list of results, click on the title. This will open a new page with more information, including a call number for printed books, or a link for any electronic resources:

A screenshot from the Loyalist Library website. The screenshot focuses on one article titled, " Acid folic and pregnancy: A mandatory supplementation". A red arrow points to the title.

A screenshot from the Loyalist Library website. The screenshot focuses on the details of an article titled, "Acid folic and pregnancy: A mandatory supplementation". A red arrow points to two links to the full text of the article.


Step 6: Saving, Sharing and Citing
Save any library resource or the search itself, including any filters, by using the pin icon and Save Query feature. You will need to sign in to your library account to use this feature.

A screenshot from the Loyalist Library. The screenshot focuses on an article titled, "Acid folic and pregnancy: A mandatory supplementation". Red arrows point to a button that reads, "save query" and to small blue icons shaped like thumbtacks.

Once a resource or a search have been saved, click on your name in the top right corner and choose My Favourites. This opens a new page where you can see any saved resources and saved searches. Clicking on a saved search causes Catalyst to run the search again, with all search words and filters in place:

A screenshot from the Loyalist Library. The screenshot focuses on the "My Favourites" link and shows both saved records and saved searches.

 

There are also tools to email, print, and share this screen, which are a great way to share resources for a group project

Finally, there is a tool to help with citations. Click the Citation button and choose the citation style required by the course or program. Catalyst will give a sample of a citation for the chosen resource in the chosen style. Remember! These citations may have formatting errors. This is because of the way publishers add information. For example, if they publish an article with a title all in capital letters, Catalyst’s citation generator will not correct this to lowercase. Always check citations using another source to make sure everything is accurate.

A screenshot from the Loyalist Library. The screenshot focuses on the options to email, print, link to and cite a library resource. Red arrows point to each of these options.

Need more information?
Use the handout and video below.

What’s the difference between a basic search and an advanced search?
A basic search uses a small number of carefully selected words typed into one search box to look for information. You can learn more about basic searching in the tab labelled Basic Searching. The phrase “advanced search” can mean one of two things: 

1. Advanced Search Screens
An advanced search screen has multiple search boxes, and it includes filters like format and date. Often, the advanced search screen also allows you to specify where you want a search term to be located - in the title of the resource, the subject headings, and so on. This combination of multiple search boxes and filters allow you to create a more focused search.

A screenshot from the Loyalist Library website. The screenshot shows three search boxes. Red arrows highlight the boxes, additional filters for dates and the type of resource, and the option to add more search boxes.


This is an image of the advanced search screen in Catalyst. Individual databases, like PubMed and CINHAL, also have the option to use an advanced search screen.

2. Advanced Search Techniques
There are three advanced searching techniques that can be used to create a more focused search:

  • Boolean searching
  • Truncation
  • Quotation marks


What is Boolean searching?
Boolean searching uses three different words to give the search software a specific instruction. These three words - also called Boolean operators - are AND, OR and NOT.

Hint! Boolean operators are always typed in capital letters.

How do I use AND in a search?
Using AND between words tells the search software to find results that include both or all of the words; you can use AND to connect more than two words. AND focuses and narrows down the search by combining words. AND is often a default in many library databases, and it is often added behind the scenes in internet search engines like Google.

In the example below, the search software is being told to find results that include the words prenatal AND folic acid AND neural tube defects. Results must include all of the search words.


A screenshot from the Loyalist College Library website. The screenshot shows an advanced search screen with multiple search boxes. In the first search box, the following words appear: prenatal AND folic acid AND neural tube defects



How do I use OR in a search?
Using OR between words tells the search software to find results that include either the first word OR the second - or the third; you can connect more than two words with OR. OR broadens the search, and can be very helpful when you are searching for a topic that has several synonyms, like those brainstormed when you create a search strategy. (See the tab labelled Creating a Search Strategy for more.) 
In the example below, the search software is being told to find results that include folic acid OR folate OR vitamin B9 OR folacin. Results must include one or several of the search words.
 

A screenshot from the Loyalist College Library website. The screenshot shows an advanced search screen with multiple search boxes. In the first search box, the following words appear: folic acid OR folate OR vitamin B9 OR folacin


How do I use NOT in a search?
If there is a term you want to omit from the search results, include that word in the search, preceded by the word NOT. NOT narrows the search by removing or ignoring elements of a topic. NOT can be challenging to use, and it is important to remember that including it in a search may mean that useful information.

In the example below, the search software is being told to find results that include the word dementia, but NOT the word Alzheimer's.

A screenshot from the Loyalist College Library website. The screenshot shows an advanced search screen with multiple search boxes. In the first search box, the following words appear: dementia NOT Alzheimer's



What is truncation?
When truncation is used, a word ending is replaced by a symbol. Different databases use different truncation symbols so it is important to know which symbol to use. This information can often be found on the database’s “Help” screen - but if you are unsure, ask the Library. One of the most common symbols used is the asterisk. Using truncation tells the search software to search for different forms simultaneously. It increases the number of search results found, and can be very useful when you’re looking for different variations on a word.

In the example below, the use of the asterisk means that the search software will find variations on words beginning with “nurs”, like “nurse”, “nurses”, and “nursing”.
 

A screenshot from the Loyalist College Library website. The screenshot shows an advanced search screen with multiple search boxes. In the first search box, the following appears: the letters n u r s, followed by an astrisk.


Truncation can be challenging to use! It can bring unexpected or irrelevant results, especially if the truncation symbol is placed too soon. Using the example above, if “nur*” was typed in, the search software will find results that include any words starting with the letters, “nur” - like “nursery” or “nurture”. 

How do I use quotation marks in a search?
Unlike using AND, which means that the search terms could be anywhere in the results in any order, using quotation marks tells the search software to find results with exactly those words in exactly that order. This is sometimes called an Exact Phrase search. 
 

A screenshot from the Loyalist College Library website. The screenshot shows an advanced search screen with multiple search boxes. In the first search box, the following appears: "Canadian fundamentals of nursing". These words are in quotation marks.



What’s next?
These advanced search techniques can be combined into one search to build a more specific search. 

Hint! Put the synonyms for each search term on a line and separate them with OR. The drop-downs on the left supply the AND that connects each group of synonyms.




Need more information?
Use the handout and video below.

What is a PRISMA Flow Diagram?

PRISMA stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses. The PRISMA flow diagram is a tool that researchers can use to summarize their research, and the process they use for deciding what information resources to include in that research. The diagram starts by recording the number of articles found in a search. Next, it outlines the decisions that are made at each stage of reviewing those articles, including the reasons for excluding particular resources. (Reasons for exclusions are explained later in this section.) The number of articles is recorded at each of these different stages. This process is one way to ensure that you are finding resources that meet the needs of an assignment. You can learn more about the PRISMA flow diagram on the PRISMA website at prisma-statement.org.

There are two columns in a PRISMA flow diagram:

  • On the left side of the page, there is a column labelled Identification of studies via databases and registers.

  • On the right side of the page, there is a column labelled Identification of studies via other methods.

A screenshot of the header in a PRISMA flow diagram. There are two columns. On the left side of the page, there is a column labelled Identification of studies via databases and registers. On the right side of the page, there is a column labelled Identification of studies via other methods.


Each of these columns has three sections:

  • Included

  • Screening

  • Identification

A screenshot of the PRISMA flow diagram. This screenshot includes the names of the three main sections - Identification, Screening and Included.

Please Note! This image is rotated. These section names appear vertically on the left side of the PRISMA flow diagram.


Which PRISMA Flow Diagram should I use?

There are different versions of the 2020 PRISMA flow diagram. The version you use depends on the kind of research being done and the types of sources you are asked to use.

How do I use a PRISMA Flow Diagram?

Step 1: Preparation and Planning

  • Decide what search terms to use; the resources in the tab titled “Creating a Search Strategy” are a useful guide for this step. Create a list of search terms to work from, and build on this list while searching.

  • Decide which databases to search, based on the research question and the requirements of the assignment. Databases in the Loyalist College Library have descriptions that can help you to decide which ones will be the most useful.

  • Decide what filters to use, such as date of publication or peer-review.

     

Step 2: Database Searching

Search each database individually using the search terms you decided on in step 1. Apply any filters you chose. Try basic searches - adding terms into one search box - and advanced searches - using multiple search boxes, Boolean operators, and truncation. You can learn more about these in the tabs titled "Basic Searching" and "Advanced Searching".

Once all of the searches are complete, add up the number of results from each search, including any duplicates. This is your total number of articles or records. Put this number into the first box in the Identification section of the PRISMA flow chart. This box is labelled Records Identified from*: Databases (n=)

A screenshot of the first part of the PRISMA flow diagram. Two boxes appear on the screen. The first reads, "Records identified from*: Databases (n = ) Registers (n = )". The second reads, "Records removed before screening: Duplicate records removed  (n = ) Records marked as ineligible by automation tools (n = ) Records removed for other reasons (n = )".
 

What about registers?

On the PRISMA flow chart, the word "registers" refers to trial registries. These are online databases where researchers conducting clinical trials can register their trial. According to the World Health Organization, trial registration is " a scientific, ethical and moral responsibility" for several reasons. These include:

  • ensuring that decisions about health care are informed by all of the available evidence

  • reducing publication bias and selective reporting of data

  • improving awareness of similar or identical trials to avoid unnecessary duplication

  • identifying gaps in clinical research

  • enabling collaboration between researchers around the world

More information about the benefits of registering a clinical trial can be found on the WHO website at who.int/clinical-trials-registry-platform/network/trial-registration. Try searching of of the registers linked below:

Do I need to use registers?

Whether or not you search trial registers as a part of your research depends on the assignment or the requirements of the research. If your instructor has not asked you to use trial registers as a part of your assignment, leave this section blank.


Step 3: Remove Duplicates

Remove any articles that appear more than once in your results. 

Hint! Duplicate records are more challenging to identify if you are only using Catalyst. Catalyst groups duplicates together under one search result; this is why you will sometimes see multiple links to the same article when you click on a title in your list of results. 

Identifying duplicates is most important when you are searching individual databases; the same article may appear in more than one database. Use the features in the database to export the articles you want into RefWorks or into an Excel file. Then, use the tools built into RefWorks or Excel to identify and remove duplicate articles.

If you are search individual databases, the feature to export may not be available, or it may look different depending on the database. If you need help, contact the Library at library@loyalistcollege.com.
 


 


How do I find and remove duplicates in RefWorks?

  1. You must have a RefWorks account set up. Use your Loyalist College email to create an account; this makes connecting your library account and your RefWorks account easier.

  2. Once you have uploaded the records from Catalyst into your RefWorks account, click Last Imported on the left side of the screen. This opens a list of the records you imported.

  3. Click Duplicates on the left side of the screen. This allows you to tell RefWorks how to identify duplicates, and you can customize this criteria by title, author, year, etc. 

  4. RefWorks will remove duplicate records. This process can take time.

     

How do I find and remove duplicates in Excel?

  1. Click the Data tab at the top of the screen.

  2. Find the group labelled Data Tools.

  3. Click Remove Duplicates.

Count how many duplicate articles or records were found and/ or removed. Enter this number in the second box in the Identification section. This box is labelled Records removed before screening: Duplicate records removed  (n = )


A screenshot of the first part of the PRISMA flow diagram. Two boxes appear on the screen. The first reads, "Records identified from*: Databases (n = ) Registers (n = )". The second reads, "Records removed before screening: Duplicate records removed  (n = ) Records marked as ineligible by automation tools (n = ) Records removed for other reasons (n = )".



What about the other two numbers in this box?

There are two other sections in this box - Records marked as ineligible by automation tools and Records removed for other reasons. If you are using automation tools to help you evaluate the relevance of citations in your results, you enter that number here. If you are not using these tools, leave this section blank. For research done in the nursing programs at Loyalist College, you will probably leave these two sections blank, unless you are told to do otherwise by your instructor.


I don't see any duplicates! What happened?

If you are searching in Catalyst only, it is very unlikely that you will see duplicates. Catalyst searches all of the databases at once, and it sorts duplicates for you; this is why you will sometimes see multiple links to the same article:


A screenshot from the Loyalist Library search. There are two links to the same article, each in different databases.


In this example, the highlighted titles - Academic Search Premier and Wiley Online Library - are the names of databases. They are both searched by Catalyst, and Catalyst has grouped these results together are one result. If this case, they are not considered duplicates. However, if you searched each of these databases on their own and found the same article in both searched, then they would be considered duplicates.


Step 4: Records Screened- Title/Abstract Screening

Add the number of articles that you will screen in the next box. Here, "screen" means to evaluate or analyze for appropriateness - i.e.: is the article likely to be useful for the assignment or project? Subtract the number from the Duplicate records removed box pictured in step 3 from the number of records identified. Enter this number into the first box in the Screening section. This box is labelled Records screened (n =).

A screenshot of a PRISMA flow chart. The two highlighted boxes read, "Records screened (n =)" and "Records excluded (n =)".



Step 5: Records Excluded- Title/Abstract Screening

Evaluate - or "screen" - the article titles and abstracts and identify articles that are relevant to your research question. Any articles you think will be useful for answering the research question should be included. Count how many articles you have identified and enter this number into the second box of the Screening section. This box is labelled Records excluded (n =). You can add the reasons for exclusion at this level, but this is not required until full text screening in step 9.

A screenshot of a PRISMA flow chart. The two highlighted boxes read, "Records screened (n =)" and "Records excluded (n =)".



Step 6: Reports Sought for Retrieval

This is the number of articles you identify for full text screening. Subtract the number of excluded records (step 5) from the total number screened (step 4). Enter this number into the third box in the Screening section. This box is labelled Reports sought for retrieval (n =)


Why does it say "reports" instead of "articles"?

In this step, PRISMA uses "reports" instead of "articles", but they mean the same thing. In the PRISMA 2020 Explanation and Elaboration, a report is defined as, "a document (paper or electronic) supplying information about a particular study. It could be a journal article, preprint, conference abstract, study register entry, clinical study report, dissertation, unpublished manuscript, government report, or any other document providing relevant information". A link to the full article can be found here: https://www.bmj.com/content/372/bmj.n160


Step 7: Reports Not Retrieved

Count the number of articles for which you are unable to find the full text, and enter this number into the fourth box in the Screening section. This box is labelled Reports not retrieved (n = ).

Remember! If you do want full text for any of these articles later, ask the Library about interlibrary loan.


Step 8: Reports Assessed for Eligibility- Full Text Screening

This is the number of reports sought for retrieval step 6) minus the number of reports not retrieved (step 7). Review these articles to assess their appropriateness. Do they meet the needs of the research question? Enter this number into the fifth box in the Screening section. This box is labelled Reports assessed for eligibility (n = ).


Step 9: Reports Excluded

After reviewing the full text of all the articles identified in step 8, enter the total number of articles that you will exclude into the sixth box of the Screening section. This box is labelled Reports excluded.

A screenshot of the PRISMA flow diagram. Two boxes are highlighted. The first reads, "Reports assessed for eligibility (n = )". The second box reads, "Reports excluded: Reason 1 (n = ) Reason 2 (n = ) Reason 3 (n = ) etc." 

In this box, you will also list the reasons for excluding the articles, and the number of records excluded for each reason. Only count an excluded article once in the list even if it meets multiple exclusion criteria. Examples of reasons for excluding articles can include - but are not limited to:

  • duplicate articles

  • insufficient qualitative analysis or data

  • insufficient participant data

  • a small sample size

  • failure of the study to report patient outcomes

  • lack of peer review

You can decide on your own exclusion criteria, and this criteria can be as simple or complex as you want.


Step 10: Included Studies 

The final step is to subtract the number of records excluded in step 9 from the total number of articles in step 8. Enter this number into the box in the Included section. This box is labeled Studies included in review (n =) and Reports of included studies (n = )

A screenshot of the PRISMA flow diagram. The box is labelled, "Studies included in review (n =) Reports of included studies (n = )".


What's the difference between "studies" and "reports"?

Remember that PRISMA uses "reports" instead of "articles". This means that the number of scholarly articles found using databases will be entered where it says Studies included in review (n =). If you have been asked to include grey literature, include the number of resources where it says Reports of included studies (n = ).

Remember! Always confirm with your instructor that grey literature is permitted in your essay or assignment.


How do I search for and screen grey literature?

There are two columns in a PRISMA flow diagram:

  • On the left side of the page, there is a column labelled Identification of studies via databases and registers.

  • On the right side of the page, there is a column labelled Identification of studies via other methods.

To screen grey literature, use the boxes under the second column - Identification of studies via other methods. This column works exactly as described in steps 1 to 10, but the sources of information are different. Instead of library databases and clinical trial registers, you will search websites, professional associations, and indexes like Google Scholar. Use the same methods to fill in each box:


 

I need help with this step!

No problem! Go to the tab labelled Documenting a Grey Literature Search with PRISMA for more information.


What's next?

Nothing! You have completed your PRISMA flow diagram!

What is grey literature?

Grey literature is published informally or non-commercially, and some remains unpublished. It can include government reports, statistics, patents, conference papers and even non-written resources such as posters and infographics. It is produced by a variety of sources, and it is usually not indexed or organized, which makes it difficult to locate with a library’s search. It is more easily found through a search engine like Google Scholar, or on the website of an organization or government department. Some examples of sources for grey literature include:

Grey literature is not usually peer reviewed and is not considered “scholarly”. However, it is still good quality, reliable information, and it can be an excellent way to supplement. It can sometimes be more current than literature published in scholarly journals and it can offer a fuller picture of the information available on a particular topic.

How do I search for and screen grey literature to include it in a PRISMA flow diagram?

There are two columns in a PRISMA flow diagram:

  • On the left side of the page, there is a column labelled Identification of studies via databases and registers.
  • On the right side of the page, there is a column labelled Identification of studies via other methods.

To screen grey literature, use the boxes under the second column - Identification of studies via other methods. This column works exactly as described in the steps described in the PRISMA Flow Diagrams tab, but the sources of information are different. Instead of library databases and clinical trial registers, you will search websites and professional associations, like the ones listed above, and indexes like Google Scholar.


Step 1: Records Identified

Enter the total number of records from each source type in the first box on the right side of the PRISMA flow diagram.

A screenshot of the PRISMA flow diagram for grey literature. The title reads, "Identification of studies via other methods". The text in the box reads, "Records identified from: Websites (n = ) Organisations (n = ) Citation searching (n = ) etc."

If you are unsure about where your source should be counted, ask your instructor or the Library for help.


Step 2: Reports Sought for Retrieval

This is the total number of reports you find from each grey literature source. To find this number, add up each of the numbers in the box in step 1.

A screenshot of the PRISMA flow diagram for grey literature. There are two boxes. The text in the first reads, "Reports sought for retrieval (n = )" and the text in the second box reads, "Reports not retrieved (n = )".


Step 3: Reports Not Retrieved

Count the number of articles for which you are unable to find the full text, and enter this number in the box labelled Reports not retrieved (n = ).

A screenshot of the PRISMA flow diagram for grey literature. There are two boxes. The text in the first reads, "Reports sought for retrieval (n = )" and the text in the second box reads, "Reports not retrieved (n = )".

Remember! If you do want full text for any of these articles later, ask the Library about interlibrary loan.


Step 4: Reports Assessed for Eligibility

Take the number of reports sought for retrieval in step 2 and subtract the number of reports not retrieved in step 3. Enter this number into the box labelled Reports assessed for eligibility (n = ). Then, review these reports to assess their appropriateness. Do they meet the needs of the research question?

A screenshot of the PRISMA flow diagram. There are two boxes. The text in the first box reads, "Reports assessed for eligibility (n = )", and the text in the second box reads, "Reports excluded: Reason 1 (n = ) Reason 2 (n = ) Reason 3 (n = ) etc.".


Step 5: Reports Excluded

After reviewing all of the reports for appropriateness, enter the total number of articles you will exclude in the box labelled Reports excluded. In this box, you will also list the reasons for excluding the articles, and the number of records excluded for each reason. Only count an excluded article once in the list even if if meets multiple exclusion criteria. Examples of reasons for excluding articles can include - but are not limited to:

  • duplicate articles
  • insufficient qualitative analysis or data
  • insufficient participant data
  • a small sample size
  • failure of the study to report patient outcomes
  • lack of peer review

You can decide on your own exclusion criteria, and this criteria can be as simple or complex as you want.


A screenshot of the PRISMA flow diagram. There are two boxes. The text in the first box reads, "Reports assessed for eligibility (n = )", and the text in the second box reads, "Reports excluded: Reason 1 (n = ) Reason 2 (n = ) Reason 3 (n = ) etc.". 



Step 6: Included Studies 

Subtract the number of Reports excluded from the number of Reports assessed for eligibility. Enter this number in the box at the very bottom of the PRISMA flow chart in the section labelled Reports of included studies.

Remember that PRISMA uses "reports" instead of "articles". This means that the number of scholarly articles found using databases will be entered where it says Studies included in review (n =) and grey literature resources will be entered where it says Reports of included studies (n = ).

Sources

Creating a PRISMA flow diagram: PRISMA 2020. (2024). Health Sciences Library at the University of North Carolina at Chapel Hill. https://guides.lib.unc.edu/prisma?utm

Dupuis, J. (2023). Research like a librarian: A how-to guide. Parrott Centre Library, Loyalist College of Applied Arts and Technology. https://loyalistcollege.primo.exlibrisgroup.com/discovery/delivery/01LOYALIST_INST:01LOYALIST/1269747200005116

Emon, D. (2020). OneSearch – surveying the literature – preparing to research. [Handout]. Parrott Centre Library, Loyalist College of Applied Arts and Technology.

The Learning Portal. (2023). How to research. College Libraries Ontario. https://tlp-lpa.ca/research/how-to-research

The Learning Portal. (2023). Using PICO to refine your question. College Libraries Ontario. https://tlp-lpa.ca/health-sciences/develop-topic

School of Nursing. (2020). Formulating a PICOT question. Duquesne University. https://onlinenursing.duq.edu/blog/formulating-a-picot-question

Oncology Nursing Society. (2024).  Writing a PICOT question. https://www.ons.org/sites/default/files/2023-06/Writing%20a%20PICOT%20Question%20_%20WebViewer.pdf 

Keep Us Current!

Found a link that isn't working? Is one of our resources out-of-date?   Get in touch with the library and let us know!

We can be reached by phone at 613-969-1913, Ext. 2249, or by email at library@loyalistcollege.com