Browsing by Subject "Validity"

Now showing 1 - 6 of 6
  • Thumbnail Image
    Item
    Open Access
    A systematic review investigating measurement properties of physiological tests in rugby
    (BioMed Central, 2017-12-28) Chiwaridzo, Matthew; Oorschot, Sander; Dambi, Jermaine M; Ferguson, Gillian D; Bonney, Emmanuel; Mudawarima, Tapfuma; Tadyanemhandu, Cathrine; Smits-Engelsman, Bouwien C M
    Background: This systematic review was conducted with the first objective aimed at providing an overview of the physiological characteristics commonly evaluated in rugby and the corresponding tests used to measure each construct. Secondly, the measurement properties of all identified tests per physiological construct were evaluated with the ultimate purpose of identifying tests with strongest level of evidence per construct. Methods: The review was conducted in two stages. In all stages, electronic databases of EBSCOhost, Medline and Scopus were searched for full-text articles. Stage 1 included studies examining physiological characteristics in rugby. Stage 2 included studies evaluating measurement properties of all tests identified in Stage 1 either in rugby or related sports such as Australian Rules football and Soccer. Two independent reviewers screened relevant articles from titles and abstracts for both stages. Results: Seventy studies met the inclusion criteria for Stage 1. The studies described 63 tests assessing speed (8), agility/change of direction speed (7), upper-body muscular endurance (8), upper-body muscular power (6), upperbody muscular strength (5), anaerobic endurance (4), maximal aerobic power (4), lower-body muscular power (3), prolonged high-intensity intermittent running ability/endurance (5), lower-body muscular strength (5), repeated high-intensity exercise performance (3), repeated-sprint ability (2), repeated-effort ability (1), maximal aerobic speed (1) and abdominal endurance (1). Stage 2 identified 20 studies describing measurement properties of 21 different tests. Only moderate evidence was found for the reliability of the 30–15 Intermittent Fitness. There was limited evidence found for the reliability and/or validity of 5 m, 10 m, 20 m speed tests, 505 test, modified 505 test, L run test, Sergeant Jump test and bench press repetitions-to-fatigue tests. There was no information from high-quality studies on the measurement properties of all the other tests identified in stage 1. Conclusion: A number of physiological characteristics are evaluated in rugby. Each physiological construct has multiple tests for measurement. However, there is paucity of information on measurement properties from high-quality studies for the tests. This raises questions about the usefulness and applicability of these tests in rugby and creates a need for high-quality future studies evaluating measurement properties of these physiological tests. Trial registrations: PROSPERO CRD 42015029747.
  • Thumbnail Image
    Item
    Open Access
    A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS)
    (BioMed Central, 2018-05-02) Dambi, Jermaine M; Corten, Lieselotte; Chiwaridzo, Matthew; Jack, Helen; Mlambo, Tecla; Jelsma, Jennifer
    Background Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings. Objectives To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS. Methods We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation. Results Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach’s alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity. Conclusion There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS. Trial registration PROSPERO-CRD42016052394.
  • Thumbnail Image
    Item
    Open Access
    Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods
    (BioMed Central, 2015-04-22) Lombard, Martani J; Steyn, Nelia P; Charlton, Karen E; Senekal, Marjanne
    Background: Several statistical tests are currently applied to evaluate validity of dietary intake assessment methods. However, they provide information on different facets of validity. There is also no consensus on types and combinations of tests that should be applied to reflect acceptable validity for intakes. We aimed to 1) conduct a review to identify the tests and interpretation criteria used where dietary assessment methods was validated against a reference method and 2) illustrate the value of and challenges that arise in interpretation of outcomes of multiple statistical tests in assessment of validity using a test data set. Methods: An in-depth literature review was undertaken to identify the range of statistical tests used in the validation of quantitative food frequency questionnaires (QFFQs). Four databases were accessed to search for statistical methods and interpretation criteria used in papers focusing on relative validity. The identified tests and interpretation criteria were applied to a data set obtained using a QFFQ and four repeated 24-hour recalls from 47 adults (18–65 years) residing in rural Eastern Cape, South Africa. Results: 102 studies were screened and 60 were included. Six statistical tests were identified; five with one set of interpretation criteria and one with two sets of criteria, resulting in seven possible validity interpretation outcomes. Twenty-one different combinations of these tests were identified, with the majority including three or less tests. Coefficient of correlation was the most commonly used (as a single test or in combination with one or more tests). Results of our application and interpretation of multiple statistical tests to assess validity of energy, macronutrients and selected micronutrients estimates illustrate that for most of the nutrients considered, some outcomes support validity, while others do not. Conclusions: One to three statistical tests may not be sufficient to provide comprehensive insights into various facets of validity. Results of our application and interpretation of multiple statistical tests support the value of such an approach in gaining comprehensive insights in different facets of validity. These insights should be considered in the formulation of conclusions regarding validity to answer a particular dietary intake related research question.
  • Thumbnail Image
    Item
    Open Access
    Construct validity testing of a low cost vitreoretinal surgical simulator
    (2020) van Der Westhuizen, Dean; Rice, James
    Objective: To test the construct validity of a low cost, low fidelity vitreoretinal surgical simulator Design: Construct validity study. Six microsurgical dexterity tasks, performed on a low cost vitreoretinal surgical simulator, were graded using a scoring rubric designed to assess microsurgical dexterity. Tasks one and two were dominant hand exercises, tasks three-five required bimanual dexterity and task six assessed visualization through a retinal viewing system The scores of a novice group (Ophthalmology residents who had never performed a pars planar vitrectomy) were compared to an expert group (Vitreoretinal surgeons who had performed in excess of 20 pars planar vitrectomies). Scores were graded via video recordings of the tasks, by blinded independent graders using a scoring rubric. Participants: The novice group of surgeons included 8 ophthalmology residents training at the Groote Schuur hospital department of Ophthalmology. The expert group of surgeons included 5 vitreoretinal surgeons working at the Groote Schuur hospital department of Ophthalmology, and 2 vitreoretinal surgeons working in the private sector in Cape Town, South Africa. Results: Expert surgeons performed significantly better( P=< 0.05) than the novice surgeons across all six microsurgical dexterity tasks. Greater differences were seen in bimanual tasks(tasks three-five) and in task six that was designed specifically to assess the surgeon's ability to ensure good visualisation through a retinal viewing system. Conclusions: The microsurgical dexterity tasks performed on This low cost, low-fidelity vitreoretinal surgical simulator can distinguish between novice and expert retinal surgeons demonstrating significant construct validity. Its use can be encouraged in the training of novice vitreoretinal surgeons.
  • Thumbnail Image
    Item
    Open Access
    Towards Validation of South African Communicative Development Inventories: An object naming/identification task for South African English and Afrikaans
    (2022) Husselmann, Nicole; Pascoe, Michelle; Southwood, Frenette
    Background: South Africa is a country rich in diversity, with language constituting a large proportion of this diversity as the country has eleven official languages with Afrikaans, isiXhosa and South African English (SAE) being the provincial languages of the Western Cape. Research on language acquisition in South Africa is limited, but vital for the early identification, assessment and management of children who are not developing language in a typical way. A recent project in South Africa has led to the development of Communicative Development Inventories (MB-CDIs) in several of the country's official languages. MB-CDIs are parent-report questionnaires about young children's language acquisition. It is challenging to validate these MB-CDIs in the local context as there are few other language assessments available for comparative purposes. Aims and Objectives: This project aimed to develop a protocol for language assessments that can be used as part of the validation process for the MB-CDIs in South African languages. The objectives were (1) to devise a protocol for an object naming and object identification task for use with six South African languages (Afrikaans, isiXhosa, SAE, Sesotho, Setswana, and Xitsonga); (2) to describe the expressive and receptive language of children acquiring SAE based on assessment with two different tools/approaches (the object naming/identification task and parent-report MB-CDI); and (3) to describe the expressive and receptive language of children acquiring Afrikaans based on assessment with two different tools/approaches (the object naming/identification task and parent-report MB-CDI). Methodology: This study used a mixed-methods, descriptive-linguistic approach. The first objective relied on literature only and no participants were needed. I devised a protocol for a novel object naming/identification task1 which could be used to validate the MB-CDIs in six languages (Afrikaans, isiXhosa, SAE, Sesotho, Setswana, and Xitsonga). For objectives 2 and 3, focusing solely on SAE and Afrikaans, I used the protocol to devise an object naming/identification task to be used with each language, respectively. Participants (toddlercaregiver dyads) were recruited and a pilot study undertaken in which the object naming/identification task was administered to each child participant. I collected parental report data by either administering the MB-CDI in SAE and Afrikaans manually to the adult participants (parents/guardians of the children), or by providing them with a link to the online version of the MB-CDI which they were able to complete in their own time. A total of 35 dyads were included in this study: 17 child and 17 adult participants for SAE and 18 child and 18 adult participants for Afrikaans. Results: SAE: The descriptive statistics suggested variability in the overall scores on both the object naming/identification task and the MB-CDI. Correlations between the 25 items in the object naming/identification task and the same 25 items in the MB-CDI indicated a significant correlation between the two assessments overall (r=0.928; p<0.05) and a significant correlation was indicated for toddlers only (r=0.935; p<0.05) and a significant correlation was indicated for toddlers only (r=0.901; p< 0.01). Correlations between the object naming/identification task and the entire MB-CDI indicated a significant correlation (r=0.901; p< 0.01) for overall vocabulary scores. Internal reliability scores for only the 25 items included in the object naming/identification task and the 25 items in the MB-CDI also indicated a high internal consistency for the language domains (α=0.911). For the gesture domain, a reasonable but lower internal consistency (α=0.673) was found. Internal reliability scores overall indicated a high internal consistency for the language domains (α=0.947). In contrast, the internal consistency indicated for the gesture domain was not satisfactory (α=0.293). Afrikaans: The descriptive statistics indicated variability among scores obtained on the MB-CDI and the object naming/identification task. Correlations between the 25 items included in the object naming/identification task and only the same 25 items included in the MB-CDI, indicated a strong correlation (r=0.906; p< 0.01). No correlation was found for infants only (r=0.692; p< 0.05) and a significant correlation was indicated for toddlers only (r=0.901; p< 0.01). Correlations between the object naming/identification task and the entire MB-CDI indicated a strong correlation for overall vocabulary scores (r=0.909; p< 0.01). Internal reliability scores on only the 25 items included in both assessments indicated a high internal consistency for the language domains (α=0.960). Internal reliability scores between the object naming/identification task and the entire MB-CDI indicated a high internal consistency for the language domains (α=0.950). Similarly, a strong internal consistency was found for the gesture domain (α=0.914). Conclusion: The findings indicate that when correlating the responses to the 25 items included in the object naming/identification task and the MB-CDI only, as well as from the entire vocabulary and gesture sections of the MB-CDI, there is high concurrent validity between the two assessments overall for both SAE and Afrikaans. Focusing on toddlers and infants more specifically, although high concurrent validity was found overall, the findings for both SAE and Afrikaans suggest that there is high concurrent validity for both assessments for toddlers, but no correlation between the assessments for infants. High internal consistency indicated reliability for both assessments for SAE and Afrikaans. The object naming/identification task, which was developed and piloted in this study, has the potential to be used as a measure to validate full MB-CDIs in SAE and Afrikaans. Furthermore, it has the potential to be used as a valid and reliable screening tool in its own right, although further refinement is needed for the infant component of the task. The protocol developed in the first objective of this study can now be applied to other local languages, ultimately contributing to the creation of a valid and reliable set of assessments of young children's early language development in South Africa.
  • Thumbnail Image
    Item
    Open Access
    Understanding the impact of tuberous sclerosis complex: development and validation of the TSC-PROM
    (BioMed Central, 2023-08-08) Müller, Annelieke R.; Luijten, Michiel A. J.; Haverman, Lotte; de Ranitz-Greven, Wendela L.; Janssens, Peter; Rietman, André B.; ten Hoopen, Leontine W.; de Graaff, Laura C. G.; de Wit, Marie-Claire; Jansen, Anna C.; Gipson, Tanjala; Capal, Jamie K.; de Vries, Petrus J.; van Eeghen, Agnies M.
    Background Tuberous sclerosis complex (TSC) is a rare and complex genetic disorder, associated with tumor growth in various organ systems, epilepsy, and a range of neuropsychiatric manifestations including intellectual disability. With improving patient-centered care and targeted therapies, patient-reported outcome measures (PROMs) are needed to measure the impact of TSC manifestations on daily functioning. The aim of this study was to develop a TSC-specific PROM for adults that captures the impact of TSC on physical functions, mental functions, activity and participation, and the social support individuals with TSC receive, called the TSC-PROM. Methods COSMIN methodology was used to develop a self-reported and proxy-reported version. Development and validation consisted of the following studies: PROM development, content validity, structural validity, internal consistency, and construct validity. The International Classification of Functioning and Disability was used as a framework. Content validity was examined by a multidisciplinary expert group and cognitive interview study. Structural and construct validity, and internal consistency were examined in a large cohort, using confirmatory factor analysis, hypotheses testing, and Cronbach’s alpha. Results The study resulted in an 82-item self version and 75-item proxy version of the TSC-PROM with four subscales (physical functions 18 and 19 items, mental functions 37 and 28 items, activities and participation 13 and 14 items, social support 13 items, for self version and proxy version respectively). Sufficient results were found for structural validity with sufficient unidimensionality for each subscale. With regard to construct validity, 82% of the hypotheses were met for the self version and 59% for the proxy version. The PROM showed good internal consistency (Cronbach’s alpha 0.78–0.97). Conclusions We developed a PROM for adults with TSC, named TSC-PROM, showing sufficient evidence for reliability and validity that can be used in clinical and research settings to systematically gain insight into their experiences. It is the first PROM in TSC that addresses the impact of specific TSC manifestations on functioning, providing a valuable, patient-centered addition to the current clinical outcomes.