Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods

dc.contributor.authorLombard, Martani J
dc.contributor.authorSteyn, Nelia P
dc.contributor.authorCharlton, Karen E
dc.contributor.authorSenekal, Marjanne
dc.date.accessioned2016-11-03T06:59:03Z
dc.date.available2016-11-03T06:59:03Z
dc.date.issued2015-04-22
dc.date.updated2016-10-06T18:03:05Z
dc.description.abstractBackground: Several statistical tests are currently applied to evaluate validity of dietary intake assessment methods. However, they provide information on different facets of validity. There is also no consensus on types and combinations of tests that should be applied to reflect acceptable validity for intakes. We aimed to 1) conduct a review to identify the tests and interpretation criteria used where dietary assessment methods was validated against a reference method and 2) illustrate the value of and challenges that arise in interpretation of outcomes of multiple statistical tests in assessment of validity using a test data set. Methods: An in-depth literature review was undertaken to identify the range of statistical tests used in the validation of quantitative food frequency questionnaires (QFFQs). Four databases were accessed to search for statistical methods and interpretation criteria used in papers focusing on relative validity. The identified tests and interpretation criteria were applied to a data set obtained using a QFFQ and four repeated 24-hour recalls from 47 adults (18–65 years) residing in rural Eastern Cape, South Africa. Results: 102 studies were screened and 60 were included. Six statistical tests were identified; five with one set of interpretation criteria and one with two sets of criteria, resulting in seven possible validity interpretation outcomes. Twenty-one different combinations of these tests were identified, with the majority including three or less tests. Coefficient of correlation was the most commonly used (as a single test or in combination with one or more tests). Results of our application and interpretation of multiple statistical tests to assess validity of energy, macronutrients and selected micronutrients estimates illustrate that for most of the nutrients considered, some outcomes support validity, while others do not. Conclusions: One to three statistical tests may not be sufficient to provide comprehensive insights into various facets of validity. Results of our application and interpretation of multiple statistical tests support the value of such an approach in gaining comprehensive insights in different facets of validity. These insights should be considered in the formulation of conclusions regarding validity to answer a particular dietary intake related research question.en_ZA
dc.identifier.apacitationLombard, M. J., Steyn, N. P., Charlton, K. E., & Senekal, M. (2015). Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. <i>Nutrition Journal</i>, http://hdl.handle.net/11427/22420en_ZA
dc.identifier.chicagocitationLombard, Martani J, Nelia P Steyn, Karen E Charlton, and Marjanne Senekal "Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods." <i>Nutrition Journal</i> (2015) http://hdl.handle.net/11427/22420en_ZA
dc.identifier.citationLombard, M. J., Steyn, N. P., Charlton, K. E., & Senekal, M. (2015). Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. Nutrition journal, 14(1), 40.en_ZA
dc.identifier.issn1475-2891en_ZA
dc.identifier.ris TY - Journal Article AU - Lombard, Martani J AU - Steyn, Nelia P AU - Charlton, Karen E AU - Senekal, Marjanne AB - Background: Several statistical tests are currently applied to evaluate validity of dietary intake assessment methods. However, they provide information on different facets of validity. There is also no consensus on types and combinations of tests that should be applied to reflect acceptable validity for intakes. We aimed to 1) conduct a review to identify the tests and interpretation criteria used where dietary assessment methods was validated against a reference method and 2) illustrate the value of and challenges that arise in interpretation of outcomes of multiple statistical tests in assessment of validity using a test data set. Methods: An in-depth literature review was undertaken to identify the range of statistical tests used in the validation of quantitative food frequency questionnaires (QFFQs). Four databases were accessed to search for statistical methods and interpretation criteria used in papers focusing on relative validity. The identified tests and interpretation criteria were applied to a data set obtained using a QFFQ and four repeated 24-hour recalls from 47 adults (18–65 years) residing in rural Eastern Cape, South Africa. Results: 102 studies were screened and 60 were included. Six statistical tests were identified; five with one set of interpretation criteria and one with two sets of criteria, resulting in seven possible validity interpretation outcomes. Twenty-one different combinations of these tests were identified, with the majority including three or less tests. Coefficient of correlation was the most commonly used (as a single test or in combination with one or more tests). Results of our application and interpretation of multiple statistical tests to assess validity of energy, macronutrients and selected micronutrients estimates illustrate that for most of the nutrients considered, some outcomes support validity, while others do not. Conclusions: One to three statistical tests may not be sufficient to provide comprehensive insights into various facets of validity. Results of our application and interpretation of multiple statistical tests support the value of such an approach in gaining comprehensive insights in different facets of validity. These insights should be considered in the formulation of conclusions regarding validity to answer a particular dietary intake related research question. DA - 2015-04-22 DB - OpenUCT DO - 10.1186/s12937-015-0027-y DP - University of Cape Town J1 - Nutrition Journal LK - https://open.uct.ac.za PB - University of Cape Town PY - 2015 SM - 1475-2891 T1 - Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods TI - Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods UR - http://hdl.handle.net/11427/22420 ER - en_ZA
dc.identifier.urihttp://dx.doi.org/10.1186/s12937-015-0027-y
dc.identifier.urihttp://hdl.handle.net/11427/22420
dc.identifier.vancouvercitationLombard MJ, Steyn NP, Charlton KE, Senekal M. Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. Nutrition Journal. 2015; http://hdl.handle.net/11427/22420.en_ZA
dc.languageengen_ZA
dc.language.rfc3066en
dc.publisherBioMed Centralen_ZA
dc.publisher.departmentDivision of Human Nutritionen_ZA
dc.publisher.facultyFaculty of Health Sciencesen_ZA
dc.publisher.institutionUniversity of Cape Town
dc.rightsCreative Commons Attribution 4.0 International (CC BY 4.0)*
dc.rights.holderLombard et al.
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en_ZA
dc.sourceNutrition Journalen_ZA
dc.source.urihttp://nutritionj.biomedcentral.com/
dc.subject.otherValidity
dc.subject.otherDietary intake assessment
dc.subject.otherFood frequency questionnaire
dc.subject.other24-hour recall
dc.subject.otherStatistical tests
dc.subject.otherAgreement
dc.subject.otherAssociation
dc.subject.otherBias
dc.titleApplication and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methodsen_ZA
dc.typeJournal Articleen_ZA
uct.type.filetypeText
uct.type.filetypeImage
uct.type.publicationResearchen_ZA
uct.type.resourceArticleen_ZA
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Lombard_Article_2015.pdf
Size:
534.1 KB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.72 KB
Format:
Item-specific license agreed upon to submission
Description:
Collections