Critical appraisal for speech and language therapists: expert opinion

The purpose of this tool is to provide a structured framework for reading and appraising literature which is not based on systematic research or which goes beyond the evidence base. It can be applied to a narrative or simple (non-systematic) review of intervention, management or decision-making for a specific clinical population, problem or issue. Use the following questions to assess the extent to which you feel there is support for the authors views and recommendations, and whether there are implications for your service. There is space for you to add your own notes. The prompts are there to highlight why an issue is important but they shouldnt limit your thinking. There is quite a lot of overlap between questions.

Study reference:

What is the experts training and experience?

You can try googling them!

Is the expert trained in EvidenceBased Practice?

If they are, there should be some evidence in the way they have written the article. They will also be more likely to adopt a cautious, measured approach to expressing their recommendations or opinions.

Has the treatment or other practice been published in peer-reviewed journals?

Check in the references, though you may need to follow this up with a literature search.

Adapted from Lass and Pannbacker (2008) The application of evidence-based practice to nonspeech oral motor treatments, in Language, Speech and Hearing Services in Schools, 39/3 pp.408-421 by Jennifer Reid, Speech and Language Therapy Service, NHS Fife. Cartoons by Fran commissioned by Speech & Language Therapy in Practice. Accompanies Reid, J. (2010) Journal club: expert opinion, Speech & Language Therapy in Practice Autumn, pp.17-21. Please attribute these sources if you use, distribute or adapt any of this material.

What is evidence is quoted?

Does the expert consider quality of the quoted evidence? (methodological quality; level in the evidence hierarchy)

Does the expert consider counter-evidence?

Does the expert provide up-to-date information?

Check dates of the references at the end of the article and/or within the text. Are there references or authors missing that you might have expected to see?

Is the experts opinion consistent with known facts, previous research, and theory?

Adapted from Lass and Pannbacker (2008) The application of evidence-based practice to nonspeech oral motor treatments, in Language, Speech and Hearing Services in Schools, 39/3 pp.408-421 by Jennifer Reid, Speech and Language Therapy Service, NHS Fife. Cartoons by Fran commissioned by Speech & Language Therapy in Practice. Accompanies Reid, J. (2010) Journal club: expert opinion, Speech & Language Therapy in Practice Autumn, pp.17-21. Please attribute these sources if you use, distribute or adapt any of this material.

Did the expert make full disclosure of any financial interests related to products such as materials and publications?

Its not that we dont want those who invent programmes to write about their own inventions; its just more credible when its done by those who have no commercial gains to make

Is the expert objective and free of bias?

Read between the lines and look for sources of bias or unspoken influence e.g. from institutional affiliations or personal beliefs.

Does the expert provide a comprehensive overview (i.e. both sides)?

Is there another interpretation or approach that the expert appears to have overlooked or ignored?

Does the expert mainly cite his or her own work?

Check the references and the text. Its okay to cite yourself so long as you cite other authorities as well.

Adapted from Lass and Pannbacker (2008) The application of evidence-based practice to nonspeech oral motor treatments, in Language, Speech and Hearing Services in Schools, 39/3 pp.408-421 by Jennifer Reid, Speech and Language Therapy Service, NHS Fife. Cartoons by Fran commissioned by Speech & Language Therapy in Practice. Accompanies Reid, J. (2010) Journal club: expert opinion, Speech & Language Therapy in Practice Autumn, pp.17-21. Please attribute these sources if you use, distribute or adapt any of this material.