Email this Page

Thank You

To send this page to a friend please fill in the following details:

Friends Email Address
Your Email Address

Critically appraise articles

Critical appraisal training

Library Services can provide training on critical appraisal to Trust staff.

We offer an interactive half day training session where we read a paper and decide how valid the results really are.  If you would like us to visit your department or journal club, please Contact Us

 

Books

To read more about critical appraisal try one of these books from the Trust Libraries

 

Useful links

 

Lancashire Care Library Services have a very useful webpage linking to several tools for critical appraisal

 

 

Why do you need to develop skills in critical appraisal?

Basing your clinical practice on good quality evidence is becoming increasingly important. But you can not simply take everything you read at face value.

 

Even articles published in reputable journals can be flawed. They may report research which is not relevant, or there may be errors in the research design which mean you cannot rely on the information given to change your practice.

 

This article (login with your NHS Athens account) explains how research papers often contain methodological errors, report results selectively, and draw unjustified conclusions; a review of 308 phase 2 trials in cancer (295 of which were single-arm studies) found that 250 (81%) did not report an identifiable statistical design.

 

Critical appraisal skills enable you to

 

 

What are critical appraisal skills?

These skills allow you to decide when you are reading a research article,

In other words,

To weigh up the evidence critically, to assess its validity and usefulness.”  Sackett, D.L, (2000) Evidence Based Medicine, Churchill Livingstone.

 

 

For a demonstration of the key points of the critical appraisal process, let’s put this into practice.

You are Head of Occupational Health at a large call centre.  You are worried about the health of your employees, especially as their jobs involve sitting at workstations all day.  They get little exercise and you feel they could have problems with obesity in the future.  Your Chief Executive tells you he has heard about an exciting new treadmill people can use while working at a computer.  He wants to order some tomorrow and asks you how many he should buy.  Read this article and tell him whether the researchers have proved that the treadmill is effective.  This video will help you consider the key points within the article

 

Next steps

Now that we have seen the principles of critical appraisal, let’s look at a clinical paper reporting on a randomised controlled trial.  Work through this tutorial

 

Now let’s look at statistics in more detail.

Critical Appraisal: statistics and results

Results are expressed in different ways using statistics in research articles. For example, statistics you will often see are –

  1. Relative risk

  2. Absolute risk

  3. Number needed to treat

For definitions of these terms, click HERE.


Let’s put this into context:

You have been told by your doctor that you need to reduce your cholesterol. Which of the following interventions would you choose to help to reduce your cholesterol?

1 An intervention which reduces your risk of having high cholesterol by 75%

2 An intervention which has an absolute risk reduction of 30%

3 An intervention which reduces your chances of having high cholesterol from 40% to 10%

4 A scheme which needs 3 people to take part to prevent one additional person from having high cholesterol

 

Intervention 1 looks by far the most impressive. However all of these statistics are different ways of expressing the same results! The figure used in Intervention 1 is a relative risk. Be aware when reading papers that relative risks can be misleading as they can make the results appear more striking.

 

 

Now let’s see how to work out these figures, using  this fictional trial.

 

 

Try out your skills:

 

 

We looked above at an article – Randomised controlled trial of specialist nurse intervention in heart failure (click HERE for the full article). Now let’s focus on the statistics used in this paper.

 

 

 Page under construction

More information coming soon

 

Congratulations! You now have the skills to critically appraise clinical papers. Now think about how you will maintain these skills and how you can use them to make your practice more evidence based.