Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument

Simple item page
dc.contributor.authorBuchanan, Helen
dc.contributor.authorJelsma, Jennifer
dc.contributor.authorSiegfried, Nandi
dc.date.accessioned2021-10-08T06:20:32Z
dc.date.available2021-10-08T06:20:32Z
dc.date.issued2015
dc.description.abstractBackgroundValid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists.MethodsThe clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used.ResultsIn Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95% CI = 0.88–0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95% CI = 0.99–0.998; Time 2: ICC = 0.99, 95% CI = 0.97–0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = −4.078, p < 0.001) with a moderate effect size (r = 0.55).ConclusionThe modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium.Trial registrationPan African Controlled Trials Register PACTR201201000346141. Registered 31 January 2012.Clinical Trials NCT01512823. Registered 1 February 2012.South African National Clinical Trial Register DOH2710093067. Registered 27 October 2009.
dc.identifier.apacitationBuchanan, H., Jelsma, J., & Siegfried, N. (2015). Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument. <i>BMC Medical Education</i>, 15(1), 174 - 177. http://hdl.handle.net/11427/34301en_ZA
dc.identifier.chicagocitationBuchanan, Helen, Jennifer Jelsma, and Nandi Siegfried "Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument." <i>BMC Medical Education</i> 15, 1. (2015): 174 - 177. http://hdl.handle.net/11427/34301en_ZA
dc.identifier.citationBuchanan, H., Jelsma, J. & Siegfried, N. 2015. Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument. <i>BMC Medical Education.</i> 15(1):174 - 177. http://hdl.handle.net/11427/34301en_ZA
dc.identifier.issn1472-6920
dc.identifier.ris TY - Journal Article AU - Buchanan, Helen AU - Jelsma, Jennifer AU - Siegfried, Nandi AB - BackgroundValid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists.MethodsThe clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used.ResultsIn Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95% CI = 0.88–0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95% CI = 0.99–0.998; Time 2: ICC = 0.99, 95% CI = 0.97–0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = −4.078, p < 0.001) with a moderate effect size (r = 0.55).ConclusionThe modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium.Trial registrationPan African Controlled Trials Register PACTR201201000346141. Registered 31 January 2012.Clinical Trials NCT01512823. Registered 1 February 2012.South African National Clinical Trial Register DOH2710093067. Registered 27 October 2009. DA - 2015 DB - OpenUCT DP - University of Cape Town IS - 1 J1 - BMC Medical Education LK - https://open.uct.ac.za PY - 2015 SM - 1472-6920 T1 - Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument TI - Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument UR - http://hdl.handle.net/11427/34301 ER - en_ZA
dc.identifier.urihttp://hdl.handle.net/11427/34301
dc.identifier.vancouvercitationBuchanan H, Jelsma J, Siegfried N. Measuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument. BMC Medical Education. 2015;15(1):174 - 177. http://hdl.handle.net/11427/34301.en_ZA
dc.publisher.departmentDepartment of Health and Rehabilitation Sciences
dc.publisher.facultyFaculty of Health Sciences
dc.sourceBMC Medical Education
dc.source.journalissue1
dc.source.journalvolume15
dc.source.pagination174 - 177
dc.source.urihttps://dx.doi.org/10.1186/s12909-015-0475-2
dc.subject.otherAdult
dc.subject.otherClinical Competence
dc.subject.otherEducational Measurement
dc.subject.otherEvidence-Based Practice
dc.subject.otherFemale
dc.subject.otherHumans
dc.subject.otherMiddle Aged
dc.subject.otherOccupational Therapy
dc.subject.otherPsychometrics
dc.subject.otherSurveys and Questionnaires
dc.subject.otherYoung Adult
dc.titleMeasuring evidence-based practice knowledge and skills in occupational therapy—a brief instrument
dc.typeJournal Article
uct.type.publicationResearch
uct.type.resourceJournal Article
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
BuchananHelen_Measuring_evide_2015.pdf
Size:
1.07 MB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Journal Articles