Browsing by Subject "Reliability"

Now showing 1 - 5 of 5
  • Thumbnail Image
    Item
    Open Access
    A systematic review investigating measurement properties of physiological tests in rugby
    (BioMed Central, 2017-12-28) Chiwaridzo, Matthew; Oorschot, Sander; Dambi, Jermaine M; Ferguson, Gillian D; Bonney, Emmanuel; Mudawarima, Tapfuma; Tadyanemhandu, Cathrine; Smits-Engelsman, Bouwien C M
    Background: This systematic review was conducted with the first objective aimed at providing an overview of the physiological characteristics commonly evaluated in rugby and the corresponding tests used to measure each construct. Secondly, the measurement properties of all identified tests per physiological construct were evaluated with the ultimate purpose of identifying tests with strongest level of evidence per construct. Methods: The review was conducted in two stages. In all stages, electronic databases of EBSCOhost, Medline and Scopus were searched for full-text articles. Stage 1 included studies examining physiological characteristics in rugby. Stage 2 included studies evaluating measurement properties of all tests identified in Stage 1 either in rugby or related sports such as Australian Rules football and Soccer. Two independent reviewers screened relevant articles from titles and abstracts for both stages. Results: Seventy studies met the inclusion criteria for Stage 1. The studies described 63 tests assessing speed (8), agility/change of direction speed (7), upper-body muscular endurance (8), upper-body muscular power (6), upperbody muscular strength (5), anaerobic endurance (4), maximal aerobic power (4), lower-body muscular power (3), prolonged high-intensity intermittent running ability/endurance (5), lower-body muscular strength (5), repeated high-intensity exercise performance (3), repeated-sprint ability (2), repeated-effort ability (1), maximal aerobic speed (1) and abdominal endurance (1). Stage 2 identified 20 studies describing measurement properties of 21 different tests. Only moderate evidence was found for the reliability of the 30–15 Intermittent Fitness. There was limited evidence found for the reliability and/or validity of 5 m, 10 m, 20 m speed tests, 505 test, modified 505 test, L run test, Sergeant Jump test and bench press repetitions-to-fatigue tests. There was no information from high-quality studies on the measurement properties of all the other tests identified in stage 1. Conclusion: A number of physiological characteristics are evaluated in rugby. Each physiological construct has multiple tests for measurement. However, there is paucity of information on measurement properties from high-quality studies for the tests. This raises questions about the usefulness and applicability of these tests in rugby and creates a need for high-quality future studies evaluating measurement properties of these physiological tests. Trial registrations: PROSPERO CRD 42015029747.
  • Thumbnail Image
    Item
    Open Access
    A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS)
    (BioMed Central, 2018-05-02) Dambi, Jermaine M; Corten, Lieselotte; Chiwaridzo, Matthew; Jack, Helen; Mlambo, Tecla; Jelsma, Jennifer
    Background Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings. Objectives To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS. Methods We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation. Results Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach’s alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity. Conclusion There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS. Trial registration PROSPERO-CRD42016052394.
  • Thumbnail Image
    Item
    Open Access
    Inter-rater reliability and test-retest reliability of the Performance and Fitness (PERF-FIT) test battery for children: a test for motor skill related fitness
    (2021-03-11) Smits-Engelsman, Bouwien C M; Smit, Eline; Doe-Asinyo, Rosemary X; Lawerteh, Stella E; Aertssen, Wendy; Ferguson, Gillian; Jelsma, Dorothee L
    Background The Performance and Fitness (PERF-FIT) test battery for children is a recently developed, valid assessment tool for measuring motor skill-related physical fitness in 5 to 12-year-old children living in low-income settings. The aim of this study was to determine: (1) inter-rater reliability and (2) test-retest reliability of the PERF-FIT in children from 3 different countries (Ghana, South Africa and the Netherlands). Method For inter-rater reliability 29 children, (16 boys and 13 girls, 6–10 years) were scored by 2 raters simultaneously. For test–retest reliability 72 children, (33 boys and 39 girls, 5–12 years) performed the test twice, minimally 1 week and maximally 2 weeks apart. Relative and absolute reliability indices were calculated. ANOVA was used to examine differences between the three assessor teams in the three countries. Results The PERF-FIT demonstrated excellent inter-rater reliability (ICC, 0.99) and good test-retest reliability (ICC, ≥ 0.80) for 11 of the 12 tasks, with a poor ICC for the Jumping item, due to low spread in values. A significant difference between first and second test occasion was present on half of the items, but the differences were small (Cohen’s d 0.01–0.17), except for Stepping, Side jump and Bouncing and Catching (Cohen’s d 0.34, 0.41 and 0.33, respectively). Overall, measurement error, Limits of Agreement and Coefficient of Variation had acceptable levels to support clinical use. No systematic dissimilarities in error were found between first and second measurement between the three countries but for one item (Overhead throw). Conclusions The PERF-FIT can reliably measure motor skill related fitness in 5 to 12-year-old children in different settings and help clinicians monitor levels of fundamental motor skills (throwing, bouncing, catching, jumping, hopping and balance), power and agility.
  • Thumbnail Image
    Item
    Open Access
    Radiographic Union Score for Tibia (RUST) scoring system in adult diaphyseal femoral fractures treated with intramedullary nailing: an assessment of interobserver and intraobserver reliability
    (2022) Panchoo, Pravesh; Laubscher, Maritz
    Objectives The Radiographic Union Score for Tibia (RUST) scoring system has been validated in multiple studies assessing the healing of tibial fractures. Our objective was to assess the inter and intraobserver reliability for the RUST in diaphyseal femoral fractures treated with intramedullary (IM) nailing. Patients and Methods A total of 60 sets of anteroposterior (AP) and lateral radiographs of diaphyseal femoral fractures treated by reamed IM nailing were randomly selected from a prospectively collected database. The 60 sets of radiographs were then scored by three reviewers using the RUST system. Interobserver reliability was measured at initial scoring. The 60 sets of radiographs were scored again by the three reviewers to calculate the intraobserver reliability. Results The RUST scores ranged from 4 to 12 with a mean score of 11.3 ± 1.3. The interobserver intraclass correlation coefficient (ICC) was 0.87 (95% CI, 0.81-0.92) and the intraobserver ICC was 0.91 (95% CI, 0.88-0.94), which indicated excellent agreement. Conclusion This study demonstrated that the RUST system can be used reliably in the assessment of healing in diaphyseal femur fractures treated by reamed intramedullary nailing, with excellent interobserver and intraobserver reliability.
  • Thumbnail Image
    Item
    Open Access
    Towards Validation of South African Communicative Development Inventories: An object naming/identification task for South African English and Afrikaans
    (2022) Husselmann, Nicole; Pascoe, Michelle; Southwood, Frenette
    Background: South Africa is a country rich in diversity, with language constituting a large proportion of this diversity as the country has eleven official languages with Afrikaans, isiXhosa and South African English (SAE) being the provincial languages of the Western Cape. Research on language acquisition in South Africa is limited, but vital for the early identification, assessment and management of children who are not developing language in a typical way. A recent project in South Africa has led to the development of Communicative Development Inventories (MB-CDIs) in several of the country's official languages. MB-CDIs are parent-report questionnaires about young children's language acquisition. It is challenging to validate these MB-CDIs in the local context as there are few other language assessments available for comparative purposes. Aims and Objectives: This project aimed to develop a protocol for language assessments that can be used as part of the validation process for the MB-CDIs in South African languages. The objectives were (1) to devise a protocol for an object naming and object identification task for use with six South African languages (Afrikaans, isiXhosa, SAE, Sesotho, Setswana, and Xitsonga); (2) to describe the expressive and receptive language of children acquiring SAE based on assessment with two different tools/approaches (the object naming/identification task and parent-report MB-CDI); and (3) to describe the expressive and receptive language of children acquiring Afrikaans based on assessment with two different tools/approaches (the object naming/identification task and parent-report MB-CDI). Methodology: This study used a mixed-methods, descriptive-linguistic approach. The first objective relied on literature only and no participants were needed. I devised a protocol for a novel object naming/identification task1 which could be used to validate the MB-CDIs in six languages (Afrikaans, isiXhosa, SAE, Sesotho, Setswana, and Xitsonga). For objectives 2 and 3, focusing solely on SAE and Afrikaans, I used the protocol to devise an object naming/identification task to be used with each language, respectively. Participants (toddlercaregiver dyads) were recruited and a pilot study undertaken in which the object naming/identification task was administered to each child participant. I collected parental report data by either administering the MB-CDI in SAE and Afrikaans manually to the adult participants (parents/guardians of the children), or by providing them with a link to the online version of the MB-CDI which they were able to complete in their own time. A total of 35 dyads were included in this study: 17 child and 17 adult participants for SAE and 18 child and 18 adult participants for Afrikaans. Results: SAE: The descriptive statistics suggested variability in the overall scores on both the object naming/identification task and the MB-CDI. Correlations between the 25 items in the object naming/identification task and the same 25 items in the MB-CDI indicated a significant correlation between the two assessments overall (r=0.928; p<0.05) and a significant correlation was indicated for toddlers only (r=0.935; p<0.05) and a significant correlation was indicated for toddlers only (r=0.901; p< 0.01). Correlations between the object naming/identification task and the entire MB-CDI indicated a significant correlation (r=0.901; p< 0.01) for overall vocabulary scores. Internal reliability scores for only the 25 items included in the object naming/identification task and the 25 items in the MB-CDI also indicated a high internal consistency for the language domains (α=0.911). For the gesture domain, a reasonable but lower internal consistency (α=0.673) was found. Internal reliability scores overall indicated a high internal consistency for the language domains (α=0.947). In contrast, the internal consistency indicated for the gesture domain was not satisfactory (α=0.293). Afrikaans: The descriptive statistics indicated variability among scores obtained on the MB-CDI and the object naming/identification task. Correlations between the 25 items included in the object naming/identification task and only the same 25 items included in the MB-CDI, indicated a strong correlation (r=0.906; p< 0.01). No correlation was found for infants only (r=0.692; p< 0.05) and a significant correlation was indicated for toddlers only (r=0.901; p< 0.01). Correlations between the object naming/identification task and the entire MB-CDI indicated a strong correlation for overall vocabulary scores (r=0.909; p< 0.01). Internal reliability scores on only the 25 items included in both assessments indicated a high internal consistency for the language domains (α=0.960). Internal reliability scores between the object naming/identification task and the entire MB-CDI indicated a high internal consistency for the language domains (α=0.950). Similarly, a strong internal consistency was found for the gesture domain (α=0.914). Conclusion: The findings indicate that when correlating the responses to the 25 items included in the object naming/identification task and the MB-CDI only, as well as from the entire vocabulary and gesture sections of the MB-CDI, there is high concurrent validity between the two assessments overall for both SAE and Afrikaans. Focusing on toddlers and infants more specifically, although high concurrent validity was found overall, the findings for both SAE and Afrikaans suggest that there is high concurrent validity for both assessments for toddlers, but no correlation between the assessments for infants. High internal consistency indicated reliability for both assessments for SAE and Afrikaans. The object naming/identification task, which was developed and piloted in this study, has the potential to be used as a measure to validate full MB-CDIs in SAE and Afrikaans. Furthermore, it has the potential to be used as a valid and reliable screening tool in its own right, although further refinement is needed for the infant component of the task. The protocol developed in the first objective of this study can now be applied to other local languages, ultimately contributing to the creation of a valid and reliable set of assessments of young children's early language development in South Africa.