Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations

Simple item page
dc.contributor.authorMunthe-Kaas, Heather
dc.contributor.authorBohren, Meghan A
dc.contributor.authorGlenton, Claire
dc.contributor.authorLewin, Simon
dc.contributor.authorNoyes, Jane
dc.contributor.authorTunçalp, Özge
dc.contributor.authorBooth, Andrew
dc.contributor.authorGarside, Ruth
dc.contributor.authorColvin, Christopher J
dc.contributor.authorWainwright, Megan
dc.contributor.authorRashidian, Arash
dc.contributor.authorFlottorp, Signe
dc.contributor.authorCarlsen, Benedicte
dc.date.accessioned2018-04-17T07:26:10Z
dc.date.available2018-04-17T07:26:10Z
dc.date.issued2018-01-25
dc.date.updated2018-04-09T15:05:22Z
dc.description.abstractAbstract Background The GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) coherence, (3) adequacy of data and (4) relevance. This paper is part of a series providing guidance on how to apply CERQual and focuses on CERQual’s methodological limitations component. Methods We developed the methodological limitations component by searching the literature for definitions, gathering feedback from relevant research communities and developing consensus through project group meetings. We tested the CERQual methodological limitations component within several qualitative evidence syntheses before agreeing on the current definition and principles for application. Results When applying CERQual, we define methodological limitations as the extent to which there are concerns about the design or conduct of the primary studies that contributed evidence to an individual review finding. In this paper, we describe the methodological limitations component and its rationale and offer guidance on how to assess methodological limitations of a review finding as part of the CERQual approach. This guidance outlines the information required to assess methodological limitations component, the steps that need to be taken to assess methodological limitations of data contributing to a review finding and examples of methodological limitation assessments. Conclusions This paper provides guidance for review authors and others on undertaking an assessment of methodological limitations in the context of the CERQual approach. More work is needed to determine which criteria critical appraisal tools should include when assessing methodological limitations. We currently recommend that whichever tool is used, review authors provide a transparent description of their assessments of methodological limitations in a review finding. We expect the CERQual approach and its individual components to develop further as our experiences with the practical implementation of the approach increase.
dc.identifier.apacitationMunthe-Kaas, H., Bohren, M. A., Glenton, C., Lewin, S., Noyes, J., Tunçalp, Ö., ... Carlsen, B. (2018). Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations. <i>Implementation Science</i>, http://hdl.handle.net/11427/27793en_ZA
dc.identifier.chicagocitationMunthe-Kaas, Heather, Meghan A Bohren, Claire Glenton, Simon Lewin, Jane Noyes, Özge Tunçalp, Andrew Booth, et al "Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations." <i>Implementation Science</i> (2018) http://hdl.handle.net/11427/27793en_ZA
dc.identifier.citationImplementation Science. 2018 Jan 25;13(Suppl 1):9
dc.identifier.ris TY - Journal Article AU - Munthe-Kaas, Heather AU - Bohren, Meghan A AU - Glenton, Claire AU - Lewin, Simon AU - Noyes, Jane AU - Tunçalp, Özge AU - Booth, Andrew AU - Garside, Ruth AU - Colvin, Christopher J AU - Wainwright, Megan AU - Rashidian, Arash AU - Flottorp, Signe AU - Carlsen, Benedicte AB - Abstract Background The GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) coherence, (3) adequacy of data and (4) relevance. This paper is part of a series providing guidance on how to apply CERQual and focuses on CERQual’s methodological limitations component. Methods We developed the methodological limitations component by searching the literature for definitions, gathering feedback from relevant research communities and developing consensus through project group meetings. We tested the CERQual methodological limitations component within several qualitative evidence syntheses before agreeing on the current definition and principles for application. Results When applying CERQual, we define methodological limitations as the extent to which there are concerns about the design or conduct of the primary studies that contributed evidence to an individual review finding. In this paper, we describe the methodological limitations component and its rationale and offer guidance on how to assess methodological limitations of a review finding as part of the CERQual approach. This guidance outlines the information required to assess methodological limitations component, the steps that need to be taken to assess methodological limitations of data contributing to a review finding and examples of methodological limitation assessments. Conclusions This paper provides guidance for review authors and others on undertaking an assessment of methodological limitations in the context of the CERQual approach. More work is needed to determine which criteria critical appraisal tools should include when assessing methodological limitations. We currently recommend that whichever tool is used, review authors provide a transparent description of their assessments of methodological limitations in a review finding. We expect the CERQual approach and its individual components to develop further as our experiences with the practical implementation of the approach increase. DA - 2018-01-25 DB - OpenUCT DO - 10.1186/s13012-017-0690-9 DP - University of Cape Town J1 - Implementation Science LK - https://open.uct.ac.za PB - University of Cape Town PY - 2018 T1 - Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations TI - Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations UR - http://hdl.handle.net/11427/27793 ER - en_ZA
dc.identifier.urihttp://dx.doi.org/10.1186/s13012-017-0690-9
dc.identifier.urihttp://hdl.handle.net/11427/27793
dc.identifier.vancouvercitationMunthe-Kaas H, Bohren MA, Glenton C, Lewin S, Noyes J, Tunçalp Ö, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations. Implementation Science. 2018; http://hdl.handle.net/11427/27793.en_ZA
dc.language.isoen
dc.publisherBioMed Central
dc.publisher.departmentDepartment of Public Health and Family Medicineen_ZA
dc.publisher.facultyFaculty of Health Sciencesen_ZA
dc.publisher.institutionUniversity of Cape Town
dc.rights.holderThe Author(s).
dc.sourceImplementation Science
dc.source.urihttps://implementationscience.biomedcentral.com/
dc.subject.otherQualitative research
dc.subject.otherQualitative evidence synthesis
dc.subject.otherSystematic review methodology
dc.subject.otherResearch design
dc.subject.otherMethodology
dc.subject.otherConfidence
dc.subject.otherGuidance
dc.subject.otherEvidence-based practice
dc.subject.otherMethodological limitations, GRADE
dc.subject.otherCritical appraisal
dc.titleApplying GRADE-CERQual to qualitative evidence synthesis findings—paper 3: how to assess methodological limitations
dc.typeJournal Article
uct.type.filetypeText
uct.type.filetypeImage
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Munthe-Kaas_2017_Article.pdf
Size:
883.14 KB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
1.72 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Journal Articles