Browsing by Subject "Evaluation"
Now showing 1 - 9 of 9
Results Per Page
Sort Options
- ItemOpen AccessDeveloping, implementing, and monitoring tailored strategies for integrated knowledge translation in five sub-Saharan African countries(BioMed Central, 2023-09-04) Sell, Kerstin; Jessani, Nasreen S.; Mesfin, Firaol; Rehfuess, Eva A.; Rohwer, Anke; Delobelle, Peter; Balugaba, Bonny E.; Schmidt, Bey-Marrié; Kedir, Kiya; Mpando, Talitha; Niyibizi, Jean B.; Osuret, Jimmy; Bayiga-Zziwa, Esther; Kredo, Tamara; Mbeye, Nyanyiwe M.; Pfadenhauer, Lisa M.Background Integrated knowledge translation (IKT) through strategic, continuous engagement with decision-makers represents an approach to bridge research, policy and practice. The Collaboration for Evidence-based Healthcare and Public Health in Africa (CEBHA +), comprising research institutions in Ethiopia, Malawi, Rwanda, South Africa, Uganda and Germany, developed and implemented tailored IKT strategies as part of its multifaceted research on prevention and care of non-communicable diseases and road traffic injuries. The objective of this article is to describe the CEBHA + IKT approach and report on the development, implementation and monitoring of site-specific IKT strategies. Methods We draw on findings derived from the mixed method IKT evaluation (conducted in 2020–2021), and undertook document analyses and a reflective survey among IKT implementers. Quantitative data were analysed descriptively and qualitative data were analysed using content analysis. The authors used the TIDieR checklist to report results in a structured manner. Results Preliminary IKT evaluation data (33 interviews with researchers and stakeholders from policy and practice, and 31 survey responses), 49 documents, and eight responses to the reflective survey informed this article. In each of the five African CEBHA + countries, a site-specific IKT strategy guided IKT implementation, tailored to the respective national context, engagement aims, research tasks, and individuals involved. IKT implementers undertook a variety of IKT activities at varying levels of engagement that targeted a broad range of decision-makers and other stakeholders, particularly during project planning, data interpretation, and output dissemination. Throughout the project, the IKT teams continued to tailor IKT strategies informally and modified the IKT approach by responding to ad hoc engagements and involving non-governmental organisations, universities, and communities. Challenges to using systematic, formalised IKT strategies arose in particular with respect to the demand on time and resources, leading to the modification of monitoring processes. Conclusion Tailoring of the CEBHA + IKT approach led to the inclusion of some atypical IKT partners and to greater responsiveness to unexpected opportunities for decision-maker engagement. Benefits of using systematic IKT strategies included clarity on engagement aims, balancing of existing and new strategic partnerships, and an enhanced understanding of research context, including site-specific structures for evidence-informed decision-making.
- ItemOpen AccessAn evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol(BioMed Central, 2016-03-09) Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, LieselotteBackground: Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. Methods/design: This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. Discussion: The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes.
- ItemOpen AccessGeneral practitioners and national health insurance - Results of a national survey(1999) BLECHER, M; JACOBS, T; McIntyre, DOBJECTIVE: To determine the attitudes of South African general practitioners (GPs) to national health insurance (NHI), social health insurance (SHI) and other related health system reforms. DESIGN: A national survey using postal questionnaires and telephonic follow-up of non-responders. SETTING: GPs throughout South Africa. PARTICIPANTS: Four hundred and forty-three GPs were randomly selected from a national sampling frame of 6,781 GPs. MAIN OUTCOME MEASURES: Acceptance of NHI and GP preferences with regard to financing, provision, benefits, coverage and the role of GPs. MAIN RESULTS: A response rate of 82.1% was achieved. Sixty-two per cent of GPs approved of the introduction of some form of social or NHI in South Africa, while 24.1% disapproved. Approval rose to 81.6% if GPs were to maintain their independent status, e.g. own premises and working hours, to 75% if additional private top-up insurance was allowed, and to 79.9% if payment was by fee-for-service. Seventy per cent of GPs in the study stated that they had the capacity to treat more patients. The most important reason given for approving of NHI was to make health care more equitable and accessible to the majority of South Africans. A high proportion of GPs approved of increasing the level of interaction between GPs and district health authorities. CONCLUSIONS: Most GPs approved of some form of social or NHI system, provided that the system did not significantly threaten their professional autonomy or economic and financial situation.
- ItemOpen AccessInspirE5: a participatory, internationally informed framework for health humanities curricula in health professions education(2022-06-24) Carr, Sandra E; Harris, Anna; Scott, Karen; Ani-Amponsah, Mary; Hooker, Claire; Phillips, Brid; Noya, Farah; Mavaddat, Nahal; Vuillermin, Daniel M; Reid, Steve; Brett-MacLean, PamelaBackground Reporting on the effect of health humanities teaching in health professions education courses to facilitate sharing and mutual exchange internationally, and the generation of a more interconnected body of evidence surrounding health humanities curricula is needed. This study asked, what could an internationally informed curriculum and evaluation framework for the implementation of health humanities for health professions education look like? Methods The participatory action research approach applied was based on three iterative phases 1. Perspective sharing and collaboration building. 2. Evidence gathering 3. Development of an internationally relevant curriculum and evaluation framework for health humanities. Over 2 years, a series of online meetings, virtual workshops and follow up communications resulted in the production of the curriculum framework. Results Following the perspective sharing and evidence gathering, the InspirE5 model of curriculum design and evaluation framework for health humanities in health professions education was developed. Five principal foci shaped the design of the framework. Environment: Learning and political environment surrounding the program. Expectations: Graduate capabilities that are clearly articulated for all, integrated into core curricula and relevant to graduate destinations and associated professional standards. Experience: Learning and teaching experience that supports learners’ achievement of the stated graduate capabilities. Evidence: Assessment of learning (formative and/or summative) with feedback for learners around the development of capabilities. Enhancement: Program evaluation of the students and teachers learning experiences and achievement. In all, 11 Graduate Capabilities for Health Humanities were suggested along with a summary of common core content and guiding principles for assessment of health humanities learning. Discussion Concern about objectifying, reductive biomedical approaches to health professions education has led to a growing expansion of health humanities teaching and learning around the world. The InspirE5 curriculum and evaluation framework provides a foundation for a standardised approach to describe or compare health humanities education in different contexts and across a range of health professions courses and may be adapted around the world to progress health humanities education.
- ItemOpen AccessSatisfaction and service quality in the quantity surveying profession(1997) Procter, Carol Jane; Rwelamila, P.D.This thesis investigates client satisfaction and service quality in the quantity surveyingprofession. Whilst many reasons abound for dissatisfaction with the construction industry,this thesis focuses on client satisfaction with the provision of quantity surveyors' services. To this end, a greater understanding of the psychological processes involved in making a satisfaction decision is required and is achieved by the presentation of the theory of consumer satisfaction. It was found that consumer satisfaction is the result of meeting or exceeding expectation with performance. Furthermore, performance is not measured in technical terms, but as a result of client perceptions. Perceptions are at the heart of this thesis. This study investigates the relationship between client perceptions and quantity surveyors' perceptions of the same.
- ItemOpen AccessStaff knowledge, attitudes and practices in public sector primary care of diabetes in Cape Town(1997)OBJECTIVE: To audit staff knowledge, attitudes and practices in the interest of improved public sector primary care for diabetics. DESIGN: External audit using face-to-face, private, questionnaire-based interviews. SETTING: Twelve public sector ambulatory health centres in Cape Town. SUBJECTS: Non-specialist, principal staff members (N = 35)-12 doctors, 10 primary health care nurses (PHCNs), 7 registered nurses (RNs) and 6 staff nurses (SNs). RESULTS: Staff members were long-standing employees (mean-doctors 6 years, PHCNs 8 years, RNs 5 years, SNs 12 years). Few had post-basic training (doctors 25%, PHCNs 20%, RNs 26%, SNs 83%). Knowledge of chronic diabetic complications was adequate, e.g. diabetic eye disease was mentioned by 100% of staff. There were gaps in knowledge of pathophysiology and of signs and symptoms of diabetic emergencies, e.g. < 33% knew control of hypertension to be important in the prevention of diabetic nephropathy. Knowledge of appropriate care of patients with hypoglycaemia (94% mentioned glucose administration) was better than that of hyperglycaemia (69% mentioned intravenous fluids). Problems were reported in inter-staff communication within (approximately 50%) and between (approximately 75%) disciplines by doctors, PHCNs and RNs. Staff/patient communication problems were reported by approximately 75% of staff. Solutions suggested by staff included meetings between staff members and with management, in-service training programmes and appointment systems for patients. Despite logistic, organisational and communication-related problems, most staff enjoy and believe in the value of their work. CONCLUSIONS: This study reveals deficiencies in in-service training with consequent gaps in knowledge and practice. Recommendations that would lead to improved quality of care and increased staff and patient satisfaction have been given.
- ItemOpen AccessTowards developing a consensus assessment framework for global emergency medicine fellowships(2019-11-11) Jahn, Haiko K; Kwan, James; O’Reilly, Gerard; Geduld, Heike; Douglass, Katherine; Tenner, Andrea; Wallis, Lee; Tupesis, Janis; Mowafi, Hani OAbstract Background The number of Global Emergency Medicine (GEM) Fellowship training programs are increasing worldwide. Despite the increasing number of GEM fellowships, there is not an agreed upon approach for assessment of GEM trainees. Main body In order to study the lack of standardized assessment in GEM fellowship training, a working group was established between the International EM Fellowship Consortium (IEMFC) and the International Federation for Emergency Medicine (IFEM). A needs assessment survey of IEMFC members and a review were undertaken to identify assessment tools currently in use by GEM fellowship programs; what relevant frameworks exist; and common elements used by programs with a wide diversity of emphases. A consensus framework was developed through iterative working group discussions. Thirty-two of 40 GEM fellowships responded (80% response). There is variability in the use and format of formal assessment between programs. Thirty programs reported training GEM fellows in the last 3 years (94%). Eighteen (56%) reported only informal assessments of trainees. Twenty-seven (84%) reported regular meetings for assessment of trainees. Eleven (34%) reported use of a structured assessment of any sort for GEM fellows and, of these, only 2 (18%) used validated instruments modified from general EM residency assessment tools. Only 3 (27%) programs reported incorporation of formal written feedback from partners in other countries. Using these results along with a review of the available assessment tools in GEM the working group developed a set of principles to guide GEM fellowship assessments along with a sample assessment for use by GEM fellowship programs seeking to create their own customized assessments. Conclusion There are currently no widely used assessment frameworks for GEM fellowship training. The working group made recommendations for developing standardized assessments aligned with competencies defined by the programs, that characterize goals and objectives of training, and document progress of trainees towards achieving those goals. Frameworks used should include perspectives of multiple stakeholders including partners in other countries where trainees conduct field work. Future work may evaluate the usability, validity and reliability of assessment frameworks in GEM fellowship training.
- ItemOpen AccessUsing theory of change to design and evaluate public health interventions: a systematic review(2015) Breuer, Erica; Lee, Lucy; De Silva, Mary; Lund, CrickBackground Despite the increasing popularity of the theory of change (ToC) approach, little is known about the extent to which ToC has been used in the design and evaluation of public health interventions. This review aims to determine how ToCs have been developed and used in the development and evaluation of public health interventions globally. Method s We searched for papers reporting the use of “theory of change” in the development or evaluation of public health interventions in databases of peer-reviewed journal articles such as Scopus, Pubmed, PsychInfo, grey literature databases, Google and websites of development funders. We included papers of any date, language or study design. Both abstracts and full text papers were double screened. Data were extracted and narratively and quantitatively summarised. Results A total of 62 papers were included in the review. Forty-nine (79 %) described the development of ToC, 18 (29 %) described the use of ToC in the development of the intervention and 49 (79 %) described the use of ToC in the evaluation of the intervention. Although a large number of papers were included in the review, their descriptions of the ToC development and use in intervention design and evaluation lacked detail. Conclusions The use of the ToC approach is widespread in the public health literature. Clear reporting of the ToC process and outputs is important to strengthen the body of literature on practical application of ToC in order to develop our understanding of the benefits and advantages of using ToC. We also propose a checklist for reporting on the use of ToC to ensure transparent reporting and recommend that our checklist is used and refined by authors reporting the ToC approach.
- ItemOpen AccessUsing theory of change to design and evaluate public health interventions: a systematic review(BioMed Central, 2016-05-06) Breuer, Erica; Lee, Lucy; De Silva, Mary; Lund, CrickBackground: Despite the increasing popularity of the theory of change (ToC) approach, little is known about the extent to which ToC has been used in the design and evaluation of public health interventions. This review aims to determine how ToCs have been developed and used in the development and evaluation of public health interventions globally. Methods: We searched for papers reporting the use of “theory of change” in the development or evaluation of public health interventions in databases of peer-reviewed journal articles such as Scopus, Pubmed, PsychInfo, grey literature databases, Google and websites of development funders. We included papers of any date, language or study design. Both abstracts and full text papers were double screened. Data were extracted and narratively and quantitatively summarised. Results: A total of 62 papers were included in the review. Forty-nine (79 %) described the development of ToC, 18 (29 %) described the use of ToC in the development of the intervention and 49 (79 %) described the use of ToC in the evaluation of the intervention. Although a large number of papers were included in the review, their descriptions of the ToC development and use in intervention design and evaluation lacked detail. Conclusions: The use of the ToC approach is widespread in the public health literature. Clear reporting of the ToC process and outputs is important to strengthen the body of literature on practical application of ToC in order to develop our understanding of the benefits and advantages of using ToC. We also propose a checklist for reporting on the use of ToC to ensure transparent reporting and recommend that our checklist is used and refined by authors reporting the ToC approach.