Treatment in Kenyan rural health facilities: projected drug costs using the WHO-UNICEF integrated management of childhood illness (IMCI) guidelines.

PubMed Central

Boulanger, L. L.; Lee, L. A.; Odhacha, A.

1999-01-01

Guidelines for the integrated management of childhood illness (IMCI) in peripheral health facilities have been developed by WHO and UNICEF to improve the recognition and treatment of common causes of childhood death. To evaluate the impact of the guidelines on treatment costs, we compared the cost of drugs actually prescribed to a sample of 747 sick children aged 2-59 months in rural health facilities in western Kenya with the cost of drugs had the children been managed using the IMCI guidelines. The average cost of drugs actually prescribed per child was US$ 0.44 (1996 US$). Antibiotics were the most costly component, with phenoxymethylpenicillin syrup accounting for 59% of the cost of all the drugs prescribed. Of the 295 prescriptions for phenoxymethylpenicillin syrup, 223 (76%) were for treatment of colds or cough. The cost of drugs that would have been prescribed had the same children been managed with the IMCI guidelines ranged from US$ 0.16 per patient (based on a formulary of larger-dose tablets and a home remedy for cough) to US$ 0.39 per patient (based on a formulary of syrups or paediatric-dose tablets and a commercial cough preparation). Treatment of coughs and colds with antibiotics is not recommended in the Kenyan or in the IMCI guidelines. Compliance with existing treatment guidelines for the management of acute respiratory infections would have halved the cost of the drugs prescribed. The estimated cost of the drugs needed to treat children using the IMCI guidelines was less than the cost of the drugs actually prescribed, but varied considerably depending on the dosage forms and whether a commercial cough preparation was used. PMID:10593034

Interactive Electronic Decision Trees for the Integrated Primary Care Management of Febrile Children in Low Resource Settings - Review of existing tools.

PubMed

Keitel, Kristina; D'Acremont, Valérie

2018-04-20

The lack of effective, integrated diagnostic tools pose a major challenge to the primary care management of febrile childhood illnesses. These limitations are especially evident in low-resource settings and are often inappropriately compensated by antimicrobial over-prescription. Interactive electronic decision trees (IEDTs) have the potential to close these gaps: guiding antibiotic use and better identifying serious disease. This narrative review summarizes existing IEDTs, to provide an overview of their degree of validation, as well as to identify gaps in current knowledge and prospects for future innovation. Structured literature review in PubMed and Embase complemented by google search and contact with developers. Six integrated IEDTs were identified: three (eIMCI, REC, and Bangladesh digital IMCI) based on Integrated Management of Childhood Illnesses (IMCI); four (SL eCCM, MEDSINC, e-iCCM, and D-Tree eCCM) on Integrated Community Case Management (iCCM); two (ALMANACH, MSFeCARE) with a modified IMCI content; and one (ePOCT) that integrates novel content with biomarker testing. The types of publications and evaluation studies varied greatly: the content and evidence-base was published for two (ALMANACH and ePOCT), ALMANACH and ePOCT were validated in efficacy studies. Other types of evaluations, such as compliance, acceptability were available for D-Tree eCCM, eIMCI, ALMANACH. Several evaluations are still ongoing. Future prospects include conducting effectiveness and impact studies using data gathered through larger studies to adapt the medical content to local epidemiology, improving the software and sensors, and Assessing factors that influence compliance and scale-up. IEDTs are valuable tools that have the potential to improve management of febrile children in primary care and increase the rational use of diagnostics and antimicrobials. Next steps in the evidence pathway should be larger effectiveness and impact studies (including cost analysis) and continuous integration of clinically useful diagnostic and treatment innovations. Copyright © 2018. Published by Elsevier Ltd.

Revisiting current “barefoot doctors” in border areas of China: system of services, financial issue and clinical practice prior to introducing integrated management of childhood illness (IMCI)

PubMed Central

2012-01-01

Background Under-5-years child mortality remains high in rural China. Integrated management of childhood illness (IMCI) was introduced to China in 1998, but only a few rural areas have been included. This study aimed at assessing the current situation of the health system of rural health care and evaluating the clinical competency of village doctors in management of childhood illnesses prior to implementing IMCI programme in remote border rural areas. Methods The study was carried out in the border areas of Puer prefecture of Yunnan province. There were 182 village doctors in the list of the health bureau in these border areas. Of these, 154 (84.6%) were recruited into the study. The local health system components were investigated using a qualitative approach and analyzed with triangulation of information from different sources. The clinical component was assessed objectively and quantitatively presented using descriptive statistics. Results The study found that the New Rural Cooperative Medical Scheme (NRCMS) coordinated the health insurance system and the provider service through 3 tiers: village doctor, township and county hospitals. The 30 RMB per person per year premium did not cover the referral cost, and thereby decreased the number of referrals. In contrast to available treatment facilities and drug supply, the level of basic medical education of village doctors and township doctors was low. Discontent among village doctors was common, especially concerning low rates of return from the service, exceptions being procedures such as injections, which in fact may create moral hazards to the patients. Direct observation on the assessment and management of paediatric patients by village doctors revealed inadequate history taking and physical examination, inability to detect potentially serious complications, overprescription of injection and antibiotics, and underprescription of oral rehydration salts and poor quality of counseling. Conclusion There is a need to improve health finance and clinical competency of the village doctors in the study area. PMID:22871045

Factors influencing the implementation of integrated management of childhood illness (IMCI) by healthcare workers at public health centers & dispensaries in Mwanza, Tanzania.

PubMed

Kiplagat, Augustine; Musto, Richard; Mwizamholya, Damas; Morona, Domenica

2014-03-25

Integrated Management of Childhood Illness (IMCI) was developed by the World Health Organization (WHO) and the United Nations International Children's Fund (UNICEF) and aims at reducing childhood morbidity and mortality in resource-limited settings including Tanzania. It was introduced in 1996 and has been scaled up in all districts in the country. The purpose of this study was to identify factors influencing the implementation of IMCI in the health facilities in Mwanza, Tanzania since reports indicates that the guidelines are not full adhered to by the healthcare workers. A cross-sectional study design was used and a sample size of 95 healthcare workers drawn from health centers and dispensaries within Mwanza city were interviewed using self-administered questionnaires. Structured interview was also used to get views from the city IMCI focal person and the 2 facilitators. Data were analyzed using SPSS and presented using figures and tables. Only 51% of healthcare workers interviewed had been trained. 69% of trained Healthcare workers expressed understanding of the IMCI approach. Most of the respondents (77%) had a positive attitude that IMCI approach was a better approach in managing common childhood illnesses especially with the reality of resource constraint in the health facilities. The main challenges identified in the implementation of IMCI are low initial training coverage among health care workers, lack of essential drugs and supplies, lack of onsite mentoring and lack of refresher courses and regular supportive supervision. Supporting the healthcare workers through training, onsite mentoring, supportive supervision and strengthening the healthcare system through increasing access to essential medicines, vaccines, strengthening supply chain management, increasing healthcare financing, improving leadership & management were the major interventions that could assist in IMCI implementation. The healthcare workers can implement better IMCI through the collaboration of supervisors, IMCI focal person, Council Health Management Teams (CHMT) and other stakeholders interested in child health. However, significant barriers impede a sustainable IMCI implementation. Recommendations have been made related to supportive supervision and HealthCare system strengthening among others.

[Integrated management of childhood illness (IMCI) in the practice of nurses graduated from USP].

PubMed

Higuchi, Cinthia Hiroko; Fujimori, Elizabeth; Cursino, Emília Gallindo; Chiesa, Anna Maria; Veríssimo, Maria de la O Ramallo; de Mello, Débora Falleiros

2011-06-01

This is a description of the Integrated Management of Childhood Illness (IMCI) strategy in the professional practice of nurses graduated from the School of Nursing of University of São Paulo (EE-USP). This is a case study of qualitative approach. The data were collected through focus groups and analyzed using thematic content analysis. IMCI strategy was considered an important tool in child health care, but only the assessment module was apart of professional practice. Difficulties in the use of the IMCI were: the strategy was not implanted at health services, it was unknown by co-workers and institutional obstacles. In spite of the limited and non-systematic use of IMCI, it has allowed nurses to provide integrated and comprehensive attention to the child, which justifies its teaching on undergraduate courses. Maintenance of the educational video, expansion of the practice, integration of courses and optimization of content and workload were suggested for improving the teaching of IMCI at the undergraduate level.

Implementation of the Integrated Management of Childhood Illnesses strategy: challenges and recommendations in Botswana.

PubMed

Mupara, Lucia U; Lubbe, Johanna C

2016-01-01

Under-five mortality has been a major public health challenge from time immemorial. In response to this challenge, the World Health Organization and the United Nations Children's Fund developed the Integrated Management of Childhood Illnesses (IMCI) strategy and presented it to the whole world as a key approach to reduce child morbidity and mortality. Botswana started to implement the IMCI strategy in 1998. Reductions in the under-five mortality rate (U5MR) have been documented, although the reduction is not on par with the expected Millennium Development Goal 4 predictions. A quantitative study was done to identify the problems IMCI implementers face when tending children under 5 years in the Gaborone Health District of Botswana. The study population was made up of all the IMCI-trained and registered nurses, and systematic sampling was used to randomly select study participants. Questionnaires were used to collect data. The study findings indicated challenges related to low training coverage, health systems, and the unique features of the IMCI strategy. The comprehensive implementation of the IMCI strategy has the potential to significantly influence the U5MR in Botswana.

A mixed methods protocol to evaluate the effect and cost-effectiveness of an Integrated electronic Diagnosis Approach (IeDA) for the management of childhood illnesses at primary health facilities in Burkina Faso.

PubMed

Blanchet, Karl; Lewis, James J; Pozo-Martin, Francisco; Satouro, Arsene; Somda, Serge; Ilboudo, Patrick; Sarrassat, Sophie; Cousens, Simon

2016-08-04

Burkina Faso introduced the Integrated Management of Childhood Illnesses (IMCI) strategy in 2003. However, an evaluation conducted in 2013 found that only 28 % of children were assessed for three danger signs as recommended by IMCI, and only 15 % of children were correctly classified. About 30 % of children were correctly prescribed with an antibiotic for suspected pneumonia or oral rehydration salts (ORS) for diarrhoea, and 40 % were correctly referred. Recent advances in information and communication technologies (ICT) and use of electronic clinical protocols hold the potential to transform healthcare delivery in low-income countries. However, no evidence is available on the effect of ICT on adherence to IMCI. This paper describes the research protocol of a mixed methods study that aims to measure the effect of the Integrated electronic Diagnosis Approach innovation (an electronic IMCI protocol provided to nurses) in two regions of Burkina Faso. The study combines a stepped-wedge trial, a realistic evaluation and an economic study in order to capture the effect of the innovation after its introduction on the level of adherence, cost and acceptability. The main challenge is to interconnect the three substudies. In integrating outcome, process and cost data, we focus on three key questions: (i) How does the effectiveness and the cost of the intervention vary by type of health worker and type of health centre? (ii) What is the impact of changes in the content, coverage and quality of the IeDA intervention on adherence and cost-effectiveness? (iii) What mechanisms of change (including costs) might explain the relationship between the IeDA intervention and adherence? Clinicaltrials.gov, NCT02341469 .

Implementation of the Integrated Management of Childhood Illnesses strategy: challenges and recommendations in Botswana

PubMed Central

Mupara, Lucia U.; Lubbe, Johanna C.

2016-01-01

Background Under-five mortality has been a major public health challenge from time immemorial. In response to this challenge, the World Health Organization and the United Nations Children's Fund developed the Integrated Management of Childhood Illnesses (IMCI) strategy and presented it to the whole world as a key approach to reduce child morbidity and mortality. Botswana started to implement the IMCI strategy in 1998. Reductions in the under-five mortality rate (U5MR) have been documented, although the reduction is not on par with the expected Millennium Development Goal 4 predictions. Design A quantitative study was done to identify the problems IMCI implementers face when tending children under 5 years in the Gaborone Health District of Botswana. The study population was made up of all the IMCI-trained and registered nurses, and systematic sampling was used to randomly select study participants. Questionnaires were used to collect data. Results The study findings indicated challenges related to low training coverage, health systems, and the unique features of the IMCI strategy. Conclusions The comprehensive implementation of the IMCI strategy has the potential to significantly influence the U5MR in Botswana. PMID:26899774

Impact of a Malaria-Control Project in Benin That Included the Integrated Management of Childhood Illness Strategy

PubMed Central

Onikpo, Faustin; Lama, Marcel; Osterholt, Dawn M.; Deming, Michael S.

2011-01-01

Objectives. To estimate the impact of the Integrated Management of Childhood Illness (IMCI) strategy on early-childhood mortality, we evaluated a malaria-control project in Benin that implemented IMCI and promoted insecticide-treated nets (ITNs). Methods. We conducted a before-and-after intervention study that included a nonrandomized comparison group. We used the preceding birth technique to measure early-childhood mortality (risk of dying before age 30 months), and we used health facility surveys and household surveys to measure process indicators. Results. Most process indicators improved in the area covered by the intervention. Notably, because ITNs were also promoted in the comparison area children's ITN use increased by about 20 percentage points in both areas. Regarding early-childhood mortality, the trend from baseline (1999–2001) to follow-up (2002–2004) for the intervention area (13.0% decrease; P < .001) was 14.1% (P < .001) lower than was the trend for the comparison area (1.3% increase; P = .46). Conclusions. Mortality decreased in the intervention area after IMCI and ITN promotion. ITN use increased similarly in both study areas, so the mortality impact of ITNs in the 2 areas might have canceled each other out. Thus, the mortality reduction could have been primarily attributable to IMCI's effect on health care quality and care-seeking. PMID:21566036

Determinants of Integrated Management of Childhood Illness (IMCI) non-severe pneumonia classification and care in Malawi health facilities: Analysis of a national facility census.

PubMed

Johansson, Emily White; Nsona, Humphreys; Carvajal-Aguirre, Liliana; Amouzou, Agbessi; Hildenwall, Helena

2017-12-01

Research shows inadequate Integrated Management of Childhood Illness (IMCI)-pneumonia care in various low-income settings but evidence is largely from small-scale studies with limited evidence of patient-, provider- and facility-levels determinants of IMCI non-severe pneumonia classification and its management. The Malawi Service Provision Assessment 2013-2014 included 3149 outpatients aged 2-59 months with completed observations, interviews and re-examinations. Mixed-effects logistic regression models quantified the influence of patient-, provider and facility-level determinants on having IMCI non-severe pneumonia and its management in observed consultations. Among 3149 eligible outpatients, 590 (18.7%) had IMCI non-severe pneumonia classification in re-examination. 228 (38.7%) classified cases received first-line antibiotics and 159 (26.9%) received no antibiotics. 18.6% with cough or difficult breathing had 60-second respiratory rates counted during consultations, and conducting this assessment was significantly associated with IMCI training ever received (odds ratio (OR) = 2.37, 95% confidence interval (CI): 1.29-4.31) and negative rapid diagnostic test results (OR = 3.21, 95% CI: 1.45-7.13). Older children had lower odds of assessments than infants (OR = 48-59 months: 0.35, 95% CI: 0.16-0.75). Children presenting with any of the following complaints also had reduced odds of assessment: fever, diarrhea, skin problem or any danger sign. First-line antibiotic treatment for classified cases was significantly associated with high temperatures (OR = 3.26, 95% CI: 1.24-8.55) while older children had reduced odds of first-line treatment compared to infants (OR = 48-59 months: 0.29, 95% CI: 0.10-0.83). RDT-confirmed malaria was a significant predictor of no antibiotic receipt for IMCI non-severe pneumonia (OR = 10.65, 95% CI: 2.39-47.36). IMCI non-severe pneumonia care was sub-optimal in Malawi health facilities in 2013-2014 with inadequate assessments and prescribing practices that must be addressed to reduce this leading cause of mortality. Child's symptoms and age, malaria diagnosis and provider training were primary influences on assessment and treatment practices. Current evidence could be used to better target IMCI training and support to improve pneumonia care for sick children in Malawi facilities.

Determinants of Integrated Management of Childhood Illness (IMCI) non–severe pneumonia classification and care in Malawi health facilities: Analysis of a national facility census

PubMed Central

Johansson, Emily White; Nsona, Humphreys; Carvajal–Aguirre, Liliana; Amouzou, Agbessi; Hildenwall, Helena

2017-01-01

Background Research shows inadequate Integrated Management of Childhood Illness (IMCI)–pneumonia care in various low–income settings but evidence is largely from small–scale studies with limited evidence of patient–, provider– and facility–levels determinants of IMCI non–severe pneumonia classification and its management. Methods The Malawi Service Provision Assessment 2013–2014 included 3149 outpatients aged 2–59 months with completed observations, interviews and re–examinations. Mixed–effects logistic regression models quantified the influence of patient–, provider and facility–level determinants on having IMCI non–severe pneumonia and its management in observed consultations. Findings Among 3149 eligible outpatients, 590 (18.7%) had IMCI non–severe pneumonia classification in re–examination. 228 (38.7%) classified cases received first–line antibiotics and 159 (26.9%) received no antibiotics. 18.6% with cough or difficult breathing had 60–second respiratory rates counted during consultations, and conducting this assessment was significantly associated with IMCI training ever received (odds ratio (OR) = 2.37, 95% confidence interval (CI): 1.29–4.31) and negative rapid diagnostic test results (OR = 3.21, 95% CI: 1.45–7.13). Older children had lower odds of assessments than infants (OR = 48–59 months: 0.35, 95% CI: 0.16–0.75). Children presenting with any of the following complaints also had reduced odds of assessment: fever, diarrhea, skin problem or any danger sign. First–line antibiotic treatment for classified cases was significantly associated with high temperatures (OR = 3.26, 95% CI: 1.24–8.55) while older children had reduced odds of first–line treatment compared to infants (OR = 48–59 months: 0.29, 95% CI: 0.10–0.83). RDT–confirmed malaria was a significant predictor of no antibiotic receipt for IMCI non–severe pneumonia (OR = 10.65, 95% CI: 2.39–47.36). Conclusions IMCI non–severe pneumonia care was sub–optimal in Malawi health facilities in 2013–2014 with inadequate assessments and prescribing practices that must be addressed to reduce this leading cause of mortality. Child’s symptoms and age, malaria diagnosis and provider training were primary influences on assessment and treatment practices. Current evidence could be used to better target IMCI training and support to improve pneumonia care for sick children in Malawi facilities. PMID:29163934

Experiences of primary health care nurses in implementing integrated management of childhood illnesses strategy at selected clinics of Limpopo Province.

PubMed

Vhuromu, E N; Davhana-Maselesele, M

2009-09-01

Treatment of the under five years is a national priority as an attempt in curbing deaths and deformities affecting children. Primary health care was implemented in the clinics in order to help in the treatment of illnesses affecting the community, including children. As a result of childhood illnesses; the World Health Organization (WHO) and United Nation Children's Fund (UNICEF) came up with Integrated Management of Childhood illnesses (IMCI) strategy to enhance treatment of such illnesses in developing countries. Primary health care nurses (PHCNS) in Limpopo Province were also trained to implement the strategy. This study is intended to explore and describe the experiences of PHCNS in implementing the IMCI strategy at selected clinics in Vhembe District in the Limpopo Province. A qualitative, explorative, descriptive and contextual design was used. In-depth interviews were conducted with PHCNS who are IMCI trained and have implemented the strategy for a period of not less than two years. Data analysis was done through using Tesch 's method of open coding for qualitative analysis. Findings revealed that PHCNS had difficulty in rendering IMCI services due to lack of resources and poor working conditions. Recommendations address the difficulties experienced by PHCNS when implementing the IMCI strategy.

Insight into implementation of facility-based integrated management of childhood illness strategy in a rural district of Sindh, Pakistan.

PubMed

Pradhan, Nousheen Akber; Rizvi, Narjis; Sami, Neelofar; Gul, Xaher

2013-07-05

Integrated management of childhood illnesses (IMCI) strategy has been proven to improve health outcomes in children under 5 years of age. Pakistan, despite being in the late implementation phase of the strategy, continues to report high under-five mortality due to pneumonia, diarrhea, measles, and malnutrition - the main targets of the strategy. The study determines the factors influencing IMCI implementation at public-sector primary health care (PHC) facilities in Matiari district, Sindh, Pakistan. An exploratory qualitative study with an embedded quantitative strand was conducted. The qualitative part included 16 in-depth interviews (IDIs) with stakeholders which included planners and policy makers at a provincial level (n=5), implementers and managers at a district level (n=3), and IMCI-trained physicians posted at PHC facilities (n=8). Quantitative part included PHC facility survey (n=16) utilizing WHO health facility assessment tool to assess availability of IMCI essential drugs, supplies, and equipments. Qualitative content analysis was used to interpret the textual information, whereas descriptive frequencies were calculated for health facility survey data. The major factors reported to enhance IMCI implementation were knowledge and perception about the strategy and need for separate clinic for children aged under 5 years as potential support factors. The latter can facilitate in strategy implementation through allocated workforce and required equipments and supplies. Constraint factors mainly included lack of clear understanding of the strategy, poor planning for IMCI implementation, ambiguity in defined roles and responsibilities among stakeholders, and insufficient essential supplies and drugs at PHC centers. The latter was further substantiated through health facilities' survey findings, which indicated that none of the facilities had 100% stock of essential supplies and drugs. Only one out of all 16 surveyed facilities had 75% of the total supplies, while 4 out of 16 facilities had 56% of the required IMCI drug stock. The mean availability of supplies ranged from 36.6 to 66%, while the mean availability of drugs ranged from 45.8 to 56.7%. Our findings indicate that the Matiari district has sound implementation potential; however, bottlenecks at health care facility and at health care management level have badly constrained the implementation process. An interdependency exists among the constraining factors, such as lack of sound planning resulting in unclear understanding of the strategy; leading to ambiguous roles and responsibilities among stakeholders which manifest as inadequate availability of supplies and drugs at PHC facilities. Addressing these barriers is likely to have a cumulative effect on facilitating IMCI implementation. On the basis of these findings, we recommend that the provincial Ministry of Health (MoH) and provincial Maternal Neonatal and Child Health (MNCH) program jointly assess the situation and streamline IMCI implementation in the district through sound planning, training, supervision, and logistic support.

Economic evaluation of a mentorship and enhanced supervision program to improve quality of integrated management of childhood illness care in rural Rwanda.

PubMed

Manzi, Anatole; Mugunga, Jean Claude; Iyer, Hari S; Magge, Hema; Nkikabahizi, Fulgence; Hirschhorn, Lisa R

2018-01-01

Integrated management of childhood illness (IMCI) can reduce under-5 morbidity and mortality in low-income settings. A program to strengthen IMCI practices through Mentorship and Enhanced Supervision at Health centers (MESH) was implemented in two rural districts in eastern Rwanda in 2010. We estimated cost per improvement in quality of care as measured by the difference in correct diagnosis and correct treatment at baseline and 12 months of MESH. Costs of developing and implementing MESH were estimated in 2011 United States Dollars (USD) from the provider perspective using both top-down and bottom-up approaches, from programmatic financial records and site-level data. Improvement in quality of care attributed to MESH was measured through case management observations (n = 292 cases at baseline, 413 cases at 12 months), with outcomes from the intervention already published. Sensitivity analyses were conducted to assess uncertainty under different assumptions of quality of care and patient volume. The total annual cost of MESH was US$ 27,955.74 and the average cost added by MESH per IMCI patient was US$1.06. Salary and benefits accounted for the majority of total annual costs (US$22,400 /year). Improvements in quality of care after 12 months of MESH implementation cost US$2.95 per additional child correctly diagnosed and $5.30 per additional child correctly treated. The incremental costs per additional child correctly diagnosed and child correctly treated suggest that MESH could be an affordable method for improving IMCI quality of care elsewhere in Rwanda and similar settings. Integrating MESH into existing supervision systems would further reduce costs, increasing potential for spread.

Why first-level health workers fail to follow guidelines for managing severe disease in children in the Coast Region, the United Republic of Tanzania

PubMed Central

Lyimo, Thomas; Skarbinski, Jacek; Metta, Emmy; Kahigwa, Elizeus; Flannery, Brendan; Dowell, Scott F; Abdulla, Salim; Kachur, S Patrick

2009-01-01

Abstract Objective To determine why health workers fail to follow integrated management of childhood illness (IMCI) guidelines for severely ill children at first-level outpatient health facilities in rural areas of the United Republic of Tanzania. Methods Retrospective and prospective case reviews of severely ill children aged < 5 years were conducted at health facilities in four districts. We ascertained treatment and examined the characteristics associated with referral, conducted follow-up interviews with parents of severely ill children, and gave health workers questionnaires and interviews. Findings In total, 502 cases were reviewed at 62 facilities. Treatment with antimalarials and antibiotics was consistent with the diagnosis given by health workers. However, of 240 children classified as having “very severe febrile disease”, none received all IMCI-recommended therapies, and only 25% of severely ill children were referred. Lethargy and anaemia diagnoses were independently associated with referral. Most (91%) health workers indicated that certain severe conditions can be managed without referral. Conclusion The health workers surveyed rarely adhered to IMCI treatment and referral guidelines for children with severe illness. They administered therapy based on narrow diagnoses rather than IMCI classifications, disagreed with referral guidelines and often considered referral unnecessary. To improve implementation of IMCI, attention should focus on the reasons for health worker non-adherence. PMID:19274361

Insight into implementation of facility-based integrated management of childhood illness strategy in a rural district of Sindh, Pakistan

PubMed Central

Akber Pradhan, Nousheen; Rizvi, Narjis; Sami, Neelofar; Gul, Xaher

2013-01-01

Background Integrated management of childhood illnesses (IMCI) strategy has been proven to improve health outcomes in children under 5 years of age. Pakistan, despite being in the late implementation phase of the strategy, continues to report high under-five mortality due to pneumonia, diarrhea, measles, and malnutrition – the main targets of the strategy. Objective The study determines the factors influencing IMCI implementation at public-sector primary health care (PHC) facilities in Matiari district, Sindh, Pakistan. Design An exploratory qualitative study with an embedded quantitative strand was conducted. The qualitative part included 16 in-depth interviews (IDIs) with stakeholders which included planners and policy makers at a provincial level (n=5), implementers and managers at a district level (n=3), and IMCI-trained physicians posted at PHC facilities (n=8). Quantitative part included PHC facility survey (n=16) utilizing WHO health facility assessment tool to assess availability of IMCI essential drugs, supplies, and equipments. Qualitative content analysis was used to interpret the textual information, whereas descriptive frequencies were calculated for health facility survey data. Results The major factors reported to enhance IMCI implementation were knowledge and perception about the strategy and need for separate clinic for children aged under 5 years as potential support factors. The latter can facilitate in strategy implementation through allocated workforce and required equipments and supplies. Constraint factors mainly included lack of clear understanding of the strategy, poor planning for IMCI implementation, ambiguity in defined roles and responsibilities among stakeholders, and insufficient essential supplies and drugs at PHC centers. The latter was further substantiated through health facilities’ survey findings, which indicated that none of the facilities had 100% stock of essential supplies and drugs. Only one out of all 16 surveyed facilities had 75% of the total supplies, while 4 out of 16 facilities had 56% of the required IMCI drug stock. The mean availability of supplies ranged from 36.6 to 66%, while the mean availability of drugs ranged from 45.8 to 56.7%. Conclusion Our findings indicate that the Matiari district has sound implementation potential; however, bottlenecks at health care facility and at health care management level have badly constrained the implementation process. An interdependency exists among the constraining factors, such as lack of sound planning resulting in unclear understanding of the strategy; leading to ambiguous roles and responsibilities among stakeholders which manifest as inadequate availability of supplies and drugs at PHC facilities. Addressing these barriers is likely to have a cumulative effect on facilitating IMCI implementation. On the basis of these findings, we recommend that the provincial Ministry of Health (MoH) and provincial Maternal Neonatal and Child Health (MNCH) program jointly assess the situation and streamline IMCI implementation in the district through sound planning, training, supervision, and logistic support. PMID:23830574

Evaluating health worker performance in Benin using the simulated client method with real children.

PubMed

Rowe, Alexander K; Onikpo, Faustin; Lama, Marcel; Deming, Michael S

2012-10-08

The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has not been realized for evaluating performance for pediatric illnesses because real children have not been utilized as SCs. Previous SC studies used scenarios of ill children that were not actually brought to health workers. During a trial that evaluated a quality improvement intervention in Benin (the Integrated Management of Childhood Illness [IMCI] strategy), we conducted an SC survey with adult caretakers as surveyors and real children to evaluate the feasibility of this approach and used the results to assess the validity of CO. We conducted an SC survey and a CO survey (one right after the other) of health workers in the same 55 health facilities. A detailed description of the SC survey process was produced. Results of the two surveys were compared for 27 performance indicators using logistic regression modeling. SC and CO surveyors observed 54 and 185 consultations, respectively. No serious problems occurred during the SC survey. Performance levels measured by CO were moderately higher than those measured by SCs (median CO - SC difference = 16.4 percentage-points). Survey differences were sometimes much greater for IMCI-trained health workers (median difference = 29.7 percentage-points) than for workers without IMCI training (median difference = 3.1 percentage-points). SC surveys can be done safely with real children if appropriate precautions are taken. CO can introduce moderately large positive biases, and these biases might be greater for health workers exposed to quality improvement interventions. http://clinicaltrials.gov Identifier NCT00510679.

Integrated management of childhood illness: a summary of first experiences.

PubMed Central

Lambrechts, T.; Bryce, J.; Orinda, V.

1999-01-01

The strategy of Integrated Management of Childhood Illness (IMCI) aims to reduce child mortality and morbidity in developing countries by combining improved management of common childhood illnesses with proper nutrition and immunization. The strategy includes interventions to improve the skills of health workers, the health system, and family and community practices. This article describes the experience of the first countries to adopt and implement the IMCI interventions, the clinical guidelines dealing with the major causes of morbidity and mortality in children, and the training package on these guidelines for health workers in first-level health facilities. The most relevant lessons learned and how these lessons have served as a basis for developing a broader IMCI strategy are described. PMID:10444882

Distribution and determinants of pneumonia diagnosis using Integrated Management of Childhood Illness guidelines: a nationally representative study in Malawi.

PubMed

Uwemedimo, Omolara T; Lewis, Todd P; Essien, Elsie A; Chan, Grace J; Nsona, Humphreys; Kruk, Margaret E; Leslie, Hannah H

2018-01-01

Pneumonia remains the leading cause of child mortality in sub-Saharan Africa. The Integrated Management of Childhood Illness (IMCI) strategy was developed to standardise care in low-income and middle-income countries for major childhood illnesses and can effectively improve healthcare worker performance. Suboptimal clinical evaluation can result in missed diagnoses and excess morbidity and mortality. We estimate the sensitivity of pneumonia diagnosis and investigate its determinants among children in Malawi. Data were obtained from the 2013-2014 Service Provision Assessment survey, a census of health facilities in Malawi that included direct observation of care and re-examination of children by trained observers. We calculated sensitivity of pneumonia diagnosis and used multilevel log-binomial regression to assess factors associated with diagnostic sensitivity. 3136 clinical visits for children 2-59 months old were observed at 742 health facilities. Healthcare workers completed an average of 30% (SD 13%) of IMCI guidelines in each encounter. 573 children met the IMCI criteria for pneumonia; 118 (21%) were correctly diagnosed. Advanced practice clinicians were more likely than other providers to diagnose pneumonia correctly (adjusted relative risk 2.00, 95% CI 1.21 to 3.29). Clinical quality was strongly associated with correct diagnosis: sensitivity was 23% in providers at the 75th percentile for guideline adherence compared with 14% for those at the 25th percentile. Contextual factors, facility structural readiness, and training or supervision were not associated with sensitivity. Care quality for Malawian children is poor, with low guideline adherence and missed diagnosis for four of five children with pneumonia. Better sensitivity is associated with provider type and higher adherence to IMCI. Existing interventions such as training and supportive supervision are associated with higher guideline adherence, but are insufficient to meaningfully improve sensitivity. Innovative and scalable quality improvement interventions are needed to strengthen health systems and reduce avoidable child mortality.

Comparison of severe acute respiratory illness (sari) and clinical pneumonia case definitions for the detection of influenza virus infections among hospitalized patients, western Kenya, 2009-2013.

PubMed

Makokha, Caroline; Mott, Joshua; Njuguna, Henry N; Khagayi, Sammy; Verani, Jennifer R; Nyawanda, Bryan; Otieno, Nancy; Katz, Mark A

2016-07-01

Although the severe acute respiratory illness (SARI) case definition is increasingly used for inpatient influenza surveillance, pneumonia is a more familiar term to clinicians and policymakers. We evaluated WHO case definitions for severe acute respiratory illness (SARI) and pneumonia (Integrated Management of Childhood Illnesses (IMCI) for children aged <5 years and Integrated Management of Adolescent and Adult Illnesses (IMAI) for patients aged ≥13 years) for detecting laboratory-confirmed influenza among hospitalized ARI patients. Sensitivities were 84% for SARI and 69% for IMCI pneumonia in children aged <5 years and 60% for SARI and 57% for IMAI pneumonia in patients aged ≥13 years. Clinical pneumonia case definitions may be a useful complement to SARI for inpatient influenza surveillance. © 2016 The Authors. Influenza and Other Respiratory Viruses Published by John Wiley & Sons Ltd.

Adherence to Integrated Management of Childhood Illnesses Guideline in Treating South Sudanese Children with Cough or Difficulty in Breathing

PubMed Central

Anyigu, Stanley; Ndungutse, David

2017-01-01

Background Pneumonia substantially kills children aged 2–59 months in South Sudan. However, information on health workers adherence to Integrated Management of Childhood Illnesses (IMCI) guideline in treating children with cough/difficulty in breathing remains scarce. This study assessed factors associated with adherence to IMCI guideline in Aweil East County, South Sudan. Methods This cross-sectional study involved 232 health workers from 36 health facilities. Data collected using structured questionnaire and checklist was double-entered in EpiData and analyzed with STATA at 5% significance level using logistic regression. Results Respondents mean age was 32.41 ± 7.0 years, 154 (66.4%) were males, 104 (44.8%) reached secondary education, and 190 (81.9%) had certificate. 23 (9.9%, 95% CI: 6.4–14.5) adhered to IMCI guideline. Holding diploma (adjusted odds ratio (AOR) = 6.97; 95% Confidence Interval (CI): 1.82–26.67; P = 0.005), shorter time to follow guideline steps (AOR = 12.0; 95% CI: 2.73–61.66; P < 0.001), and nondifficult use (AOR = 27.7; 95% CI: 5.40–142.25; P < 0.001) were associated with adherence. Conclusion Adherence was low. Academic qualifications, guideline complexity, and availability of IMCI drugs were associated factors. PMID:29075300

Quality of child healthcare at primary healthcare facilities: a national assessment of the Integrated Management of Childhood Illnesses in Afghanistan.

PubMed

Mansoor, Ghulam Farooq; Chikvaidze, Paata; Varkey, Sherin; Higgins-Steele, Ariel; Safi, Najibullah; Mubasher, Adela; Yusufi, Khaksar; Alawi, Sayed Alisha

2017-02-01

To assess quality of the national Integrated Management of Childhood Illness (IMCI) program services provided for sick children at primary health facilities in Afghanistan. Mixed methods including cross-sectional study. Thirteen (of thirty-four) provinces in Afghanistan. Observation of case management and re-examination of 177 sick children, exit interviews with caretakers and review of equipment/supplies at 44 health facilities. Introduction and scale up of Integrated Management of Childhood Illnesses at primary health care facilities. Care of sick children according to IMCI guidelines, health worker skills and essential health system elements. Thirty-two (71%) of the health workers were trained in IMCI and five (11%) received supervision in clinical case management during the past 6 months. On average, 5.4 out of 10 main assessment tasks were performed during cases observed, the index being higher in children seen by trained providers than untrained (6.3 vs 3.5, 95% CI 5.8-6.8 vs 2.9-4.1). In all, 74% of the 104 children who needed oral antibiotics received prescriptions, while 30% received complete and correct advice and 30% were overprescribed, and more so by untrained providers. Home care counseling was associated with provider training status (41.3% by trained and 24.5% by untrained). Essential oral and pre-referral injectable medicine and equipment/supplies were available in 66%, 23%, and 45% of health facilities, respectively. IMCI training improved assessment, rational use of antibiotics and counseling; further investment in IMCI in Afghanistan, continuing provider capacity building and supportive supervision for improved quality of care and counseling for sick children is needed, especially given high burden treatable childhood illness. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Acute Uncomplicated Febrile Illness in Children Aged 2-59 months in Zanzibar – Aetiologies, Antibiotic Treatment and Outcome

PubMed Central

Elfving, Kristina; Shakely, Deler; Andersson, Maria; Baltzell, Kimberly; Ali, Abdullah S.; Bachelard, Marc; Falk, Kerstin I.; Ljung, Annika; Msellem, Mwinyi I.; Omar, Rahila S.; Parola, Philippe; Xu, Weiping; Petzold, Max; Trollfors, Birger; Björkman, Anders; Lindh, Magnus; Mårtensson, Andreas

2016-01-01

Background Despite the fact that a large proportion of children with fever in Africa present at primary health care facilities, few studies have been designed to specifically study the causes of uncomplicated childhood febrile illness at this level of care, especially in areas like Zanzibar that has recently undergone a dramatic change from high to low malaria transmission. Methods We prospectively studied the aetiology of febrile illness in 677 children aged 2–59 months with acute uncomplicated fever managed by IMCI (Integrated Management of Childhood Illness) guidelines in Zanzibar, using point-of-care tests, urine culture, blood-PCR, chest X-ray (CXR) of IMCI-pneumonia classified patients, and multiple quantitative (q)PCR investigations of nasopharyngeal (NPH) (all patients) and rectal (GE) swabs (diarrhoea patients). For comparison, we also performed NPH and GE qPCR analyses in 167 healthy community controls. Final fever diagnoses were retrospectively established based on all clinical and laboratory data. Clinical outcome was assessed during a 14-day follow-up. The utility of IMCI for identifying infections presumed to require antibiotics was evaluated. Findings NPH-qPCR and GE-qPCR detected ≥1 pathogen in 657/672 (98%) and 153/164 (93%) of patients and 158/166 (95%) and 144/165 (87%) of controls, respectively. Overall, 57% (387/677) had IMCI-pneumonia, but only 12% (42/342) had CXR-confirmed pneumonia. Two patients were positive for Plasmodium falciparum. Respiratory syncytial virus (24.5%), influenza A/B (22.3%), rhinovirus (10.5%) and group-A streptococci (6.4%), CXR-confirmed pneumonia (6.2%), Shigella (4.3%) were the most common viral and bacterial fever diagnoses, respectively. Blood-PCR conducted in a sub-group of patients (n = 83) without defined fever diagnosis was negative for rickettsiae, chikungunya, dengue, Rift Valley fever and West Nile viruses. Antibiotics were prescribed to 500 (74%) patients, but only 152 (22%) had an infection retrospectively considered to require antibiotics. Clinical outcome was generally good. However, two children died. Only 68 (11%) patients remained febrile on day 3 and three of them had verified fever on day 14. An additional 29 (4.5%) children had fever relapse on day 14. Regression analysis determined C-reactive Protein (CRP) as the only independent variable significantly associated with CXR-confirmed pneumonia. Conclusions This is the first study on uncomplicated febrile illness in African children that both applied a comprehensive laboratory panel and a healthy control group. A majority of patients had viral respiratory tract infection. Pathogens were frequently detected by qPCR also in asymptomatic children, demonstrating the importance of incorporating controls in fever aetiology studies. The precision of IMCI for identifying infections requiring antibiotics was low. PMID:26821179

Risk of developmental delay of children aged between two and 24 months and its association with the quality of family stimulus

PubMed Central

Guimarães, Alessandro Fernandes; de Carvalho, Davi Vilela; Machado, Nathália Ádila A.; Baptista, Regiane Aparecida N.; Lemos, Stela Maris A.

2013-01-01

OBJECTIVE: To analyze the association between neurodevelopment and the family environment resources of children from the coverage area of a Basic Health Unit (BHU) of Belo Horizonte, Brazil, using a tool based on the Integrated Management of Childhood Illness (IMCI) strategy. METHODS: Cross-sectional study with a non-probabilistic sample involving 298 children aged between 2-24 months old, who attended a BHU in 2010. The assessment of child development and family resources made at the BHU lasted, in average, 45 minutes and included two tests - an adaptation of the Handbook for Monitoring Child Development in the Context of IMCI and an adapted version of the Family Environment Resource (FER) inventary. The nonparametric tests of Kruskal-Wallis and Mann-Whitney were used for the statistical analysis. RESULTS: The sample included 291 assessments, with 18.2% of children between 18 and 24 months old, 53.6% male gender, and 91.4% who did not attend day care centers. According to IMCI, 31.7% of the children were in the risk group for developmental delay. The total average score in FER was 38.0 points. Although it has been found an association between the IMCI outcome and the total FER score, all groups had low scores in the family environment assessment. CONCLUSIONS: The data indicate the need for childhood development screening in the primary health care and for early intervention programs aimed at this age group. PMID:24473949

[IMCI and the maternal practice of African descendants' living on the Colombian Caribbean coast regarding the common cold and diarrhea].

PubMed

Díaz-Cárdenas, Shyrley; Arrieta-Vergara, Katherine; Ramos-Martínez, Ketty

2013-01-01

Evaluating maternal practice regarding diarrhoea and the common cold. This was a cross-sectional descriptive study which was conducted on the island of Barú, near Cartagena, Colombia. It involved 127 mothers of African descent and their 138 children aged less than 5 years of age; convenience sampling was used. The Integrated Management of Childhood Illness (IMCI) instrument was used for the survey during a one-day healthcare session. The prevalence of diarrhoea and the common cold during the 7 days immediately before the survey were estimated, as were maternal practice regarding these and the occurrence of other risks and protective factors; a history of breastfeeding, complementary feeding and vaccination was compiled. Descriptive statistics were used and the χ² test was used for ascertaining the significance of the relationships between variables. Diarrhoea prevalence was 71.7 % (64-79 95 % CI), this being lower for girls aged 2 months to 5 years-old (p = 0,02) and common cold prevalence was 99.2 % (97-100 95 % CI), this being higher in girls aged older than 2 months (p=0.004). 86.9 % (81-92 95 % CI) of the mothers did not know how to identify warning signs for these diseases, 84.9 % (78-90 95 % CI) of the practices were inadequate and 73.3% of the mothers took their children to a doctor as their first line medical practice (p=0.05). Efforts must be increased regarding the implementation of the IMCI strategy in vulnerable communities, through effective channels of communication and innovative ways to reduce child morbidity and mortality indices, thereby promoting the island's social development.

Use of Antibiotics within the IMCI Guidelines in Outpatient Settings in Papua New Guinean Children: An Observational and Effectiveness Study

PubMed Central

Senn, Nicolas; Rarau, Patricia; Salib, Mary; Manong, Doris; Siba, Peter; Rogerson, Stephen

2014-01-01

Introduction There is a need to investigate the effectiveness and appropriateness of antibiotics prescription within the Integrated Management of Childhood Illness (IMCI) strategy in the context of routine outpatient clinics. Methods Making use of a passive case detection system established for a malaria prevention trial in outpatient clinics in Papua New Guinea, the appropriateness and effectiveness of the use of antibiotics within the IMCI was assessed in 1605 young children. Main outcomes were prescription of antibiotics and re-attendances within 14 days for mild pneumonia, mild diarrhoea and uncomplicated malaria whether they were managed with or without antibiotics (proxy of effectiveness). Appropriateness was assessed for both mild and severe cases, while effectiveness was assessed only for mild diseases. Results A total of 6975 illness episodes out of 8944 fulfilled inclusion criteria (no previous attendance <14 days+full medical records). Clinical incidence rates (episodes/child/year; 95% CI) were 0.85 (0.81–0.90) for pneumonia, 0.62 (0.58–0.66) for malaria and 0.72 (0.65–0.93) for diarrhoea. Fifty three percent of 6975 sick children were treated with antibiotics, 11% were not treated with antibiotics when they should have been and in 29% antibiotics were prescribed when they should not have been. Re-attendance rates within 14 days following clinical diagnosis of mild pneumonia were 9% (126/1401) when managed with antibiotics compared to 8% (56/701) when managed without (adjusted Hazard Ratio (aHR) = 1.00 (0.57–1.76), p = 0.98). Rates for mild diarrhoea were 8% (73/874) and 9% (79/866) respectively (aHR = 0.8 (0.42–1.57), p = 0.53). Conclusion Non-adherence to IMCI recommendations for prescription of antibiotics is common in routine settings in Papua New Guinea. Although recommended, the use of antibiotics in young children with mild pneumonia as defined by IMCI criteria did not impact on their outcome. Better tools and new strategies for the identification of bacterial infections that require antibiotics are urgently needed. PMID:24626194

Management of Childhood Illness at Health Facilities in Benin: Problems and Their Causes

PubMed Central

Rowe, Alexander K.; Onikpo, Faustin; Lama, Marcel; Cokou, Francois; Deming, Michael S.

2001-01-01

Objectives. To prepare for the implementation of Integrated Management of Childhood Illness (IMCI) in Benin, we studied the management of ill children younger than 5 years at outpatient health facilities. Methods. We observed a representative sample of consultations; after each consultation, we interviewed caregivers and reexamined children. Health workers' performance was evaluated against IMCI guidelines. To identify determinants of performance, statistical modeling was performed and 6 focus groups with health workers were conducted to solicit their opinions. Results. Altogether, 584 children were enrolled and 101 health workers were observed; 130 health workers participated in focus group discussions. Many serious deficiencies were found: incomplete assessment of children's signs and symptoms, incorrect diagnosis and treatment of potentially life-threatening illnesses, inappropriate prescription of dangerous sedatives, missed opportunities to vaccinate, and failure to refer severely ill children for hospitalization. Quantitative and qualitative analyses showed various health facility–, health worker–, caregiver-, and child-related factors as possible determinants of health worker performance. Conclusions. Action is urgently needed. Our results suggest that to improve health care delivery, interventions should target both the health system and the community level. PMID:11574325

Pneumonia’s second wind? A case study of the global health network for childhood pneumonia

PubMed Central

Berlan, David

2016-01-01

Advocacy, policy, research and intervention efforts against childhood pneumonia have lagged behind other health issues, including malaria, measles and tuberculosis. Accelerating progress on the issue began in 2008, following decades of efforts by individuals and organizations to address the leading cause of childhood mortality and establish a global health network. This article traces the history of this network’s formation and evolution to identify lessons for other global health issues. Through document review and interviews with current, former and potential network members, this case study identifies five distinct eras of activity against childhood pneumonia: a period of isolation (post WWII to 1984), the duration of WHO’s Acute Respiratory Infections (ARI) Programme (1984–1995), Integrated Management of Childhood illness’s (IMCI) early years (1995–2003), a brief period of network re-emergence (2003–2008) and recent accelerating progress (2008 on). Analysis of these eras reveals the critical importance of building a shared identity in order to form an effective network and take advantage of emerging opportunities. During the ARI era, an initial network formed around a relatively narrow shared identity focused on community-level care. The shift to IMCI led to the partial dissolution of this network, stalled progress on addressing pneumonia in communities and missed opportunities. Frustrated with lack of progress on the issue, actors began forming a network and shared identity that included a broad spectrum of those whose interests overlap with pneumonia. As the network coalesced and expanded, its members coordinated and collaborated on conducting and sharing research on severity and tractability, crafting comprehensive strategies and conducting advocacy. These network activities exerted indirect influence leading to increased attention, funding, policies and some implementation. PMID:26438780

Pneumonia's second wind? A case study of the global health network for childhood pneumonia.

PubMed

Berlan, David

2016-04-01

Advocacy, policy, research and intervention efforts against childhood pneumonia have lagged behind other health issues, including malaria, measles and tuberculosis. Accelerating progress on the issue began in 2008, following decades of efforts by individuals and organizations to address the leading cause of childhood mortality and establish a global health network. This article traces the history of this network's formation and evolution to identify lessons for other global health issues. Through document review and interviews with current, former and potential network members, this case study identifies five distinct eras of activity against childhood pneumonia: a period of isolation (post WWII to 1984), the duration of WHO's Acute Respiratory Infections (ARI) Programme (1984-1995), Integrated Management of Childhood illness's (IMCI) early years (1995-2003), a brief period of network re-emergence (2003-2008) and recent accelerating progress (2008 on). Analysis of these eras reveals the critical importance of building a shared identity in order to form an effective network and take advantage of emerging opportunities. During the ARI era, an initial network formed around a relatively narrow shared identity focused on community-level care. The shift to IMCI led to the partial dissolution of this network, stalled progress on addressing pneumonia in communities and missed opportunities. Frustrated with lack of progress on the issue, actors began forming a network and shared identity that included a broad spectrum of those whose interests overlap with pneumonia. As the network coalesced and expanded, its members coordinated and collaborated on conducting and sharing research on severity and tractability, crafting comprehensive strategies and conducting advocacy. These network activities exerted indirect influence leading to increased attention, funding, policies and some implementation. Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine © The Author 2015; all rights reserved.

Diagnosis of paediatric HIV infection in a primary health care setting with a clinical algorithm.

PubMed Central

Horwood, C.; Liebeschuetz, S.; Blaauw, D.; Cassol, S.; Qazi, S.

2003-01-01

OBJECTIVE: To determine the validity of an algorithm used by primary care health workers to identify children with symptomatic human immunodeficiency virus (HIV) infection. This HIV algorithm is being implemented in South Africa as part of the Integrated Management of Childhood Illness (IMCI), a strategy that aims to improve childhood morbidity and mortality by improving care at the primary care level. As AIDS is a leading cause of death in children in southern Africa, diagnosis and management of symptomatic HIV infection was added to the existing IMCI algorithm. METHODS: In total, 690 children who attended the outpatients department in a district hospital in South Africa were assessed with the HIV algorithm and by a paediatrician. All children were then tested for HIV viral load. The validity of the algorithm in detecting symptomatic HIV was compared with clinical diagnosis by a paediatrician and the result of an HIV test. Detailed clinical data were used to improve the algorithm. FINDINGS: Overall, 198 (28.7%) enrolled children were infected with HIV. The paediatrician correctly identified 142 (71.7%) children infected with HIV, whereas the IMCI/HIV algorithm identified 111 (56.1%). Odds ratios were calculated to identify predictors of HIV infection and used to develop an improved HIV algorithm that is 67.2% sensitive and 81.5% specific in clinically detecting HIV infection. CONCLUSIONS: Children with symptomatic HIV infection can be identified effectively by primary level health workers through the use of an algorithm. The improved HIV algorithm developed in this study could be used by countries with high prevalences of HIV to enable IMCI practitioners to identify and care for HIV-infected children. PMID:14997238

External validation of the DHAKA score and comparison with the current IMCI algorithm for the assessment of dehydration in children with diarrhoea: a prospective cohort study.

PubMed

Levine, Adam C; Glavis-Bloom, Justin; Modi, Payal; Nasrin, Sabiha; Atika, Bita; Rege, Soham; Robertson, Sarah; Schmid, Christopher H; Alam, Nur H

2016-10-01

Dehydration due to diarrhoea is a leading cause of child death worldwide, yet no clinical tools for assessing dehydration have been validated in resource-limited settings. The Dehydration: Assessing Kids Accurately (DHAKA) score was derived for assessing dehydration in children with diarrhoea in a low-income country setting. In this study, we aimed to externally validate the DHAKA score in a new population of children and compare its accuracy and reliability to the current Integrated Management of Childhood Illness (IMCI) algorithm. DHAKA was a prospective cohort study done in children younger than 60 months presenting to the International Centre for Diarrhoeal Disease Research, Bangladesh, with acute diarrhoea (defined by WHO as three or more loose stools per day for less than 14 days). Local nurses assessed children and classified their dehydration status using both the DHAKA score and the IMCI algorithm. Serial weights were obtained and dehydration status was established by percentage weight change with rehydration. We did regression analyses to validate the DHAKA score and compared the accuracy and reliability of the DHAKA score and IMCI algorithm with receiver operator characteristic (ROC) curves and the weighted κ statistic. This study was registered with ClinicalTrials.gov, number NCT02007733. Between March 22, 2015, and May 15, 2015, 496 patients were included in our primary analyses. On the basis of our criterion standard, 242 (49%) of 496 children had no dehydration, 184 (37%) of 496 had some dehydration, and 70 (14%) of 496 had severe dehydration. In multivariable regression analyses, each 1-point increase in the DHAKA score predicted an increase of 0·6% in the percentage dehydration of the child and increased the odds of both some and severe dehydration by a factor of 1·4. Both the accuracy and reliability of the DHAKA score were significantly greater than those of the IMCI algorithm. The DHAKA score is the first clinical tool for assessing dehydration in children with acute diarrhoea to be externally validated in a low-income country. Further validation studies in a diverse range of settings and paediatric populations are warranted. National Institutes of Health Fogarty International Center. Copyright © 2016 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY license. Published by Elsevier Ltd.. All rights reserved.

External validation of the DHAKA score and comparison with the current IMCI algorithm for the assessment of dehydration in children with diarrhoea: a prospective cohort study

PubMed Central

Levine, Adam C; Glavis-Bloom, Justin; Modi, Payal; Nasrin, Sabiha; Atika, Bita; Rege, Soham; Robertson, Sarah; Schmid, Christopher H; Alam, Nur H

2016-01-01

Summary Background Dehydration due to diarrhoea is a leading cause of child death worldwide, yet no clinical tools for assessing dehydration have been validated in resource-limited settings. The Dehydration: Assessing Kids Accurately (DHAKA) score was derived for assessing dehydration in children with diarrhoea in a low-income country setting. In this study, we aimed to externally validate the DHAKA score in a new population of children and compare its accuracy and reliability to the current Integrated Management of Childhood Illness (IMCI) algorithm. Methods DHAKA was a prospective cohort study done in children younger than 60 months presenting to the International Centre for Diarrhoeal Disease Research, Bangladesh, with acute diarrhoea (defined by WHO as three or more loose stools per day for less than 14 days). Local nurses assessed children and classified their dehydration status using both the DHAKA score and the IMCI algorithm. Serial weights were obtained and dehydration status was established by percentage weight change with rehydration. We did regression analyses to validate the DHAKA score and compared the accuracy and reliability of the DHAKA score and IMCI algorithm with receiver operator characteristic (ROC) curves and the weighted κ statistic. This study was registered with ClinicalTrials.gov, number NCT02007733. Findings Between March 22, 2015, and May 15, 2015, 496 patients were included in our primary analyses. On the basis of our criterion standard, 242 (49%) of 496 children had no dehydration, 184 (37%) of 496 had some dehydration, and 70 (14%) of 496 had severe dehydration. In multivariable regression analyses, each 1-point increase in the DHAKA score predicted an increase of 0·6% in the percentage dehydration of the child and increased the odds of both some and severe dehydration by a factor of 1·4. Both the accuracy and reliability of the DHAKA score were significantly greater than those of the IMCI algorithm. Interpretation The DHAKA score is the first clinical tool for assessing dehydration in children with acute diarrhoea to be externally validated in a low-income country. Further validation studies in a diverse range of settings and paediatric populations are warranted. Funding National Institutes of Health Fogarty International Center. PMID:27567350

Constraints, synergies and avenues for scaling up breastfeeding, antibiotics for pneumonia and IMCI interventions in the Cusco region, Peru

PubMed Central

Gericke, Christian A

2012-01-01

Objective: The purpose of this qualitative case study was to assess the feasibility of scaling up exclusive breastfeeding for 6 months, antibiotics for pneumonia and integrated management of childhood illness (IMCI) child interventions in three districts of the Cusco region, Peru. Methods: During field visits, constraints, synergies and solutions to the implementation of the selected interventions were collected through observational recording and interviews of mothers, health workers, and health managers/decision makers. Results are presented for each intervention according to the health system level where they occurred: mother/community, health worker, health centre, and political/managerial levels. Findings: This case study demonstrates that it is feasible to scale up exclusive breastfeeding, antibiotics for pneumonia and IMCI interventions in poverty-stricken rural areas of a low-income country. Factors that helped and hindered the implementation were identified for each intervention. Conclusions: The need for a coherent multi-sector approach that includes regulation, implementation and monitoring of health policies and education of all involved stakeholders was apparent. This study also demonstrates that global health interventions need to undergo local adaptation. Identifying local constraints and facilitating factors in a systematic way as proposed in this study is a useful step to increase their effectiveness and reach at the local level and to identify areas for improvement in the original intervention policies. PMID:24358831

The Usefulness of Rapid Diagnostic Tests in the New Context of Low Malaria Transmission in Zanzibar

PubMed Central

Shakely, Delér; Msellem, Mwinyi I.; Morris, Ulrika; Omar, Rahila; Weiping, Xu; Petzold, Max; Greenhouse, Bryan; Baltzell, Kimberly A.; Ali, Abdullah S.; Björkman, Anders; Mårtensson, Andreas

2013-01-01

Background We assessed if histidine-rich-protein-2 (HRP2) based rapid diagnostic test (RDT) remains an efficient tool for Plasmodium falciparum case detection among fever patients in Zanzibar and if primary health care workers continue to adhere to RDT results in the new epidemiological context of low malaria transmission. Further, we evaluated the performance of RDT within the newly adopted integrated management of childhood illness (IMCI) algorithm in Zanzibar. Methods and Findings We enrolled 3890 patients aged ≥2 months with uncomplicated febrile illness in this health facility based observational study conducted in 12 primary health care facilities in Zanzibar, between May-July 2010. One patient had an inconclusive RDT result. Overall 121/3889 (3.1%) patients were RDT positive. The highest RDT positivity rate, 32/528 (6.1%), was found in children aged 5–14 years. RDT sensitivity and specificity against PCR was 76.5% (95% CI 69.0–83.9%) and 99.9% (95% CI 99.7–100%), and against blood smear microscopy 78.6% (95% CI 70.8–85.1%) and 99.7% (95% CI 99.6–99.9%), respectively. All RDT positive, but only 3/3768 RDT negative patients received anti-malarial treatment. Adherence to RDT results was thus 3887/3889 (99.9%). RDT performed well in the IMCI algorithm with equally high adherence among children <5 years as compared with other age groups. Conclusions The sensitivity of HRP-2 based RDT in the hands of health care workers compared with both PCR and microscopy for P. falciparum case detection was relatively low, whereas adherence to test results with anti-malarial treatment was excellent. Moreover, the results provide evidence that RDT can be reliably integrated in IMCI as a tool for improved childhood fever management. However, the relatively low RDT sensitivity highlights the need for improved quality control of RDT use in primary health care facilities, but also for more sensitive point-of-care malaria diagnostic tools in the new epidemiological context of low malaria transmission in Zanzibar. Trial registration ClinicalTrials.gov NCT01002066 PMID:24023791

Malaria diagnosis and treatment under the strategy of the integrated management of childhood illness (IMCI): relevance of laboratory support from the rapid immunochromatographic tests of ICT Malaria P.f/P.v and OptiMal.

PubMed

Tarimo, D S; Minjas, J N; Bygbjerg, I C

2001-07-01

The algorithm developed for the integrated management of childhood illness (IMCI) provides guidelines for the treatment of paediatric malaria. In areas where malaria is endemic, for example, the IMCI strategy may indicate that children who present with fever, a recent history of fever and/or pallor should receive antimalarial chemotherapy. In many holo-endemic areas, it is unclear whether laboratory tests to confirm that such signs are the result of malaria would be very relevant or useful. Children from a holo-endemic region of Tanzania were therefore checked for malarial parasites by microscopy and by using two rapid immunochromatographic tests (RIT) for the diagnosis of malaria (ICT Malaria P.f/P.v and OptiMal. At the time they were tested, each of these children had been targeted for antimalarial treatment (following the IMCI strategy) because of fever and/or pallor. Only 70% of the 395 children classified to receive antimalarial drugs by the IMCI algorithm had malarial parasitaemias (68.4% had Plasmodium falciparum trophozoites, 1.3% only P. falciparum gametocytes, 0.3% P. ovale and 0.3% P. malariae). As indicators of P. falciparum trophozoites in the peripheral blood, fever had a sensitivity of 93.0% and a specificity of 15.5% whereas pallor had a sensitivity of 72.2% and a specificity of 50.8%. The RIT both had very high corresponding sensitivities (of 100.0% for the ICT and 94.0% for OptiMal) but the specificity of the ICT (74.0%) was significantly lower than that for OptiMal (100.0%). Fever and pallor were significantly associated with the P. falciparum asexual parasitaemias that equalled or exceeded the threshold intensity (2000/microl) that has the optimum sensitivity and specificity for the definition of a malarial episode. Diagnostic likelihood ratios (DLR) showed that a positive result in the OptiMal test (DLR = infinity) was a better indication of malaria than a positive result in the ICT (DLR = 3.85). In fact, OptiMal had diagnostic reliability (0.93) which approached that of an ideal test and, since it only detects live parasites, OptiMal is superior to the ICT in monitoring therapeutic responses. Although the RIT may seem attractive for use in primary health facilities because relatively inexperienced staff can perform them, the high cost of these tests is prohibitive. In holo-endemic areas, use of RIT or microscopical examination of bloodsmears may only be relevant when malaria needs to be excluded as a cause of illness (e.g. prior to treatment with toxic or expensive drugs, or during malaria epidemics). Wherever the effective drugs for the first-line treatment of malaria are cheap (e.g. chloroquine and Fansidar), treatment based on clinical diagnosis alone should prove cost-saving in health facilities without microscopy.

A survey on Integrated Management of Neonatal and Childhood Illness implementation by nurses in four districts of West Arsi zone of Ethiopia.

PubMed

Seid, Sheka Shemsi; Sendo, Endalew Gemechu

2018-01-01

In Ethiopia, one in 17 children dies before 1 year of age and one in 11 children dies before 5 years. Research that examines the factors influencing the implementation of the Integrated Management of Neonatal and Childhood Illnesses (IMNCI) strategy in Ethiopia is limited. This study aimed to identify the factors compelling the execution of IMNCI by nurses in four districts of West Arsi zone of Ethiopia. A mixed-method cross-sectional study was conducted from February to March 2016 in West Arsi zone of Oromia regional state, Ethiopia. A total of 185 Integrated Management of Childhood Illness (IMCI)-trained registered nurses working at Under-Five Clinic were purposively chosen for the study among 291 registered nurses based at health centers and hospitals in the Arsi zone. The study was complemented by a qualitative method. More than half (57.8%) of the nurses interviewed had been trained (51.35% of them attended in-service training). The most common issues encountered in the implementation of IMCI were: lack of trained staff (56.2%), lack of essential drugs and supplies (37.3%), and irregular supportive supervision (89.2%). The qualitative data supplemented the factors that influence IMNCI implementation, including drug unavailability, lack of human resources, and lack of effective supportive supervision and follow-up visits. Therefore, interventions aiming at training nurses, with emphasis on performing supportive consistent supervision and supporting the system of health care by enhancing admittance to indispensable drugs and supplies, are recommended to help IMCI implementation.

Is there any association between parental education and child mortality? A study in a rural area of Bangladesh.

PubMed

Akter, T; Hoque, D M E; Chowdhury, E K; Rahman, M; Russell, M; Arifeen, S E

2015-12-01

To assess the association between parental education and under-five mortality, using the Integrated Management of Childhood Illness (IMCI) data from rural Bangladesh. It also investigated whether the association of parental education with under-five mortality had changed over time. This study was nested in the IMCI cluster randomized controlled trial. Participants considered for the analysis were all children aged under five years from the baseline (1995-2000) and the final (2002-2007) IMCI household survey. The analysis sample included 39,875 and 38,544 live births from the baseline and the final survey respectively. The outcome variable was under-five mortality and the exposure variables were mother's and father's education. Data were analysed with logistic regression. In 2002-2007, the odds of the under-five mortality were 38% lower for the children with mother having secondary education, compared to the children with uneducated mother. For similar educational differences for fathers, at the same time period, the odds of the under-five mortality were 16% lower. The association of mother's education with under-five mortality was significantly stronger in 2002-2007 compared to 1995-2000. Mother's education appears to have a strong and significant association with under-five mortality, compared to father's education. The association of mother's education with under-five mortality appears to have increased over time. Our findings indicate that investing on girls' education is a good strategy to combat infant mortality in developing countries. Copyright © 2015 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Effective e-learning for health professional and medical students: the experience with SIAS-Intelligent Tutoring System.

PubMed

Muñoz, Diana C; Ortiz, Alexandra; González, Carolina; López, Diego M; Blobel, Bernd

2010-01-01

Current e-learning systems are still inadequate to support the level of interaction, personalization and engagement demanded by clinicians, care givers, and the patient themselves. For effective e-learning to be delivered in the health context, collaboration between pedagogy and technology is required. Furthermore, e-learning systems should be flexible enough to be adapted to the students' needs, evaluated regularly, easy to use and maintain and provide students' feedback, guidelines and supporting material in different formats. This paper presents the implementation of an Intelligent Tutoring System (SIAS-ITS), and its evaluation compared to a traditional virtual learning platform (Moodle). The evaluation was carried out as a case study, in which the participants were separated in two groups, each group attending a virtual course on the WHO Integrated Management of Childhood Illness (IMCI) strategy supported by one of the two e-learning platforms. The evaluation demonstrated that the participants' knowledge level, pedagogical strategies used, learning efficiency and systems' usability were improved using the Intelligent Tutoring System.

Health education for microcredit clients in Peru: a randomized controlled trial

PubMed Central

2011-01-01

Background Poverty, lack of female empowerment, and lack of education are major risk factors for childhood illness worldwide. Microcredit programs, by offering small loans to poor individuals, attempt to address the first two of these risk factors, poverty and gender disparity. They provide clients, usually women, with a means to invest in their businesses and support their families. This study investigates the health effects of also addressing the remaining risk factor, lack of knowledge about important health issues, through randomization of members of a microcredit organization to receive a health education module based on the World Health Organization's Integrated Management of Childhood Illness (IMCI) community intervention. Methods Baseline data were collected in February 2007 from clients of a microcredit organization in Pucallpa, Peru (n = 1,855) and their children (n = 598). Loan groups, consisting of 15 to 20 clients, were then randomly assigned to receive a health education intervention involving eight monthly 30-minute sessions given by the organization's loan officers at monthly loan group meetings. In February 2008, follow-up data were collected, and included assessments of sociodemographic information, knowledge of child health issues, and child health status (including child height, weight, and blood hemoglobin levels). To explore the effects of treatment (i.e., participation in the health education sessions) on the key outcome variables, multivariate regressions were implemented using ordinary least squares. Results Individuals in the IMCI treatment arm demonstrated more knowledge about a variety of issues related to child health, but there were no changes in anthropometric measures or reported child health status. Conclusions Microcredit clients randomized to an IMCI educational intervention showed greater knowledge about child health, but no differences in child health outcomes compared to controls. These results imply that the intervention did not have sufficient intensity to change behavior, or that microcredit organizations may not be an appropriate setting for the administration of child health educational interventions of this type. Trial Registration This study is registered with ClinicalTrials.gov, NCT01047033. PMID:21261988

Health education for microcredit clients in Peru: a randomized controlled trial.

PubMed

Hamad, Rita; Fernald, Lia Ch; Karlan, Dean S

2011-01-24

Poverty, lack of female empowerment, and lack of education are major risk factors for childhood illness worldwide. Microcredit programs, by offering small loans to poor individuals, attempt to address the first two of these risk factors, poverty and gender disparity. They provide clients, usually women, with a means to invest in their businesses and support their families. This study investigates the health effects of also addressing the remaining risk factor, lack of knowledge about important health issues, through randomization of members of a microcredit organization to receive a health education module based on the World Health Organization's Integrated Management of Childhood Illness (IMCI) community intervention. Baseline data were collected in February 2007 from clients of a microcredit organization in Pucallpa, Peru (n = 1,855) and their children (n = 598). Loan groups, consisting of 15 to 20 clients, were then randomly assigned to receive a health education intervention involving eight monthly 30-minute sessions given by the organization's loan officers at monthly loan group meetings. In February 2008, follow-up data were collected, and included assessments of sociodemographic information, knowledge of child health issues, and child health status (including child height, weight, and blood hemoglobin levels). To explore the effects of treatment (i.e., participation in the health education sessions) on the key outcome variables, multivariate regressions were implemented using ordinary least squares. Individuals in the IMCI treatment arm demonstrated more knowledge about a variety of issues related to child health, but there were no changes in anthropometric measures or reported child health status. Microcredit clients randomized to an IMCI educational intervention showed greater knowledge about child health, but no differences in child health outcomes compared to controls. These results imply that the intervention did not have sufficient intensity to change behavior, or that microcredit organizations may not be an appropriate setting for the administration of child health educational interventions of this type. This study is registered with ClinicalTrials.gov, NCT01047033.

Development and technical basis of simplified guidelines for emergency triage assessment and treatment in developing countries. WHO Integrated Management of Childhood Illness (IMCI) Referral Care Project.

PubMed

Gove, S; Tamburlini, G; Molyneux, E; Whitesell, P; Campbell, H

1999-12-01

Simplified guidelines for the emergency care of children have been developed to improve the triage and rapid initiation of appropriate emergency treatments for children presenting to hospitals in developing countries. The guidelines are part of the effort to improve referral level paediatric care within the World Health Organisation/Unicef strategy integrated management of childhood illness (IMCI), based on evidence of significant deficiencies in triage and emergency care. Existing emergency guidelines have been modified according to resource limitations and significant differences in the epidemiology of severe paediatric illness and preventable death in developing countries with raised infant and child mortality rates. In these settings, it is important to address the emergency management of diarrhoea with severe dehydration, severe malaria, severe malnutrition, and severe bacterial pneumonia, and to focus attention on sick infants younger than 2 months of age. The triage assessment relies on a few clinical signs, which can be readily taught so that it can be used by health workers with limited clinical background. The assessment has been designed so that it can be carried out quickly if negative, making it functional for triaging children in queues.

South Vietnamese Rural Mothers' Knowledge, Attitude, and Practice in Child Health Care

PubMed Central

Thac, Dinh; Pedersen, Freddy Karup; Thuong, Tang Chi; Lien, Le Bich; Ngoc Anh, Nguyen Thi; Phuc, Nguyen Ngoc

2016-01-01

A study of 600 rural under-five mothers' knowledge, attitude, and practice (KAP) in child care was performed in 4 southern provinces of Vietnam. The mothers were randomly selected and interviewed about sociodemographic factors, health seeking behaviour, and practice of home care of children and neonates. 93.2% of the mothers were literate and well-educated, which has been shown to be important for child health care. 98.5% were married suggesting a stable family, which is also of importance for child health. Only 17.3% had more than 2 children in their family. The mother was the main caretaker in 77.7% of the families. Only 1% would use quacks as their first health contact, but 25.2% would use a private clinic, which therefore eases the burden on the government system. Nearly 69% had given birth in a hospital, 27% in a commune health station, and only 2.7% at home without qualified assistance. 89% were giving exclusive breast feeding at 6 months, much more frequent than in the cities. The majority of the mothers could follow IMCI guideline for home care, although 25.2% did not deal correctly with cough and 38.7% did not deal correctly with diarrhoea. Standard information about Integrated Management of Childhood Illnesses (IMCI) based home care is still needed. PMID:26881233

A mobile phone based tool to identify symptoms of common childhood diseases in Ghana: development and evaluation of the integrated clinical algorithm in a cross-sectional study.

PubMed

Franke, Konstantin H; Krumkamp, Ralf; Mohammed, Aliyu; Sarpong, Nimako; Owusu-Dabo, Ellis; Brinkel, Johanna; Fobil, Julius N; Marinovic, Axel Bonacic; Asihene, Philip; Boots, Mark; May, Jürgen; Kreuels, Benno

2018-03-27

The aim of this study was the development and evaluation of an algorithm-based diagnosis-tool, applicable on mobile phones, to support guardians in providing appropriate care to sick children. The algorithm was developed on the basis of the Integrated Management of Childhood Illness (IMCI) guidelines and evaluated at a hospital in Ghana. Two hundred and thirty-seven guardians applied the tool to assess their child's symptoms. Data recorded by the tool and health records completed by a physician were compared in terms of symptom detection, disease assessment and treatment recommendation. To compare both assessments, Kappa statistics and predictive values were calculated. The tool detected the symptoms of cough, fever, diarrhoea and vomiting with good agreement to the physicians' findings (kappa = 0.64; 0.59; 0.57 and 0.42 respectively). The disease assessment barely coincided with the physicians' findings. The tool's treatment recommendation correlated with the physicians' assessments in 93 out of 237 cases (39.2% agreement, kappa = 0.11), but underestimated a child's condition in only seven cases (3.0%). The algorithm-based tool achieved reliable symptom detection and treatment recommendations were administered conformably to the physicians' assessment. Testing in domestic environment is envisaged.

Clinical overlap between malaria and pneumonia: can malaria rapid diagnostic test play a role?

PubMed

Ukwaja, Kingsley Nnanna; Aina, Olufemi B; Talabi, Ademola A

2011-03-21

Malaria and pneumonia account for 40% of mortality among children under five years of age in sub-Saharan Africa. Due to lack of diagnostic facilities, their management is based on the integrated management of childhood illnesses (IMCI) strategy. Symptoms of malaria and pneumonia overlap in African children, necessitating dual IMCI classifications at health centres and treatment with both antibiotics and antimalarials. This study determined the prevalence of malaria-pneumonia symptom overlap and confirmed the diagnosis of malaria in these cases using a rapid diagnostic test. Consecutive consultations of 1,216 children (two months to five years old) were documented over a three-month period in a comprehensive health centre. Malaria rapid diagnostic tests were conducted only for children who had symptom overlap. Of the 1,216 children enrolled, 1,090 (90%) reported cough or fever. Among the children fulfilling the malaria case definition, 284 (30%) also met the pneumonia case definition. Twenty-three percent (284) of all children enrolled met the criteria for both malaria and pneumonia. However, only 130 (46%) of them had a positive result for malaria using a malaria rapid diagnostic test. During a malaria-pneumonia overlap, female children (chi-square 5.9, P = 0.01) and children ≥ one year (chi-square 4.8, P = 0.003) were more likely to seek care within two days of fever. Dual treatment with antimalarials and antibiotics in children with malaria-pneumonia overlap may result in unnecessary over-prescription of antimalarial medications. Use of rapid diagnostic tests in their management can potentially avoid over-prescribing of malaria medications.

The need for theory evaluation in global citizenship programmes: The case of the GCSA programme.

PubMed

Goodier, Sarah; Field, Carren; Goodman, Suki

2018-02-01

Many education programmes lack a documented programme theory. This is a problem for programme planners and evaluators as the ability to measure programme success is grounded in the plausibility of the programme's underlying causal logic. Where the programme theory has not been documented, conducting a theory evaluation offers a foundational evaluation step as it gives an indication of whether the theory behind a programme is sound. This paper presents a case of a theory evaluation of a Global Citizenship programme at a top-ranking university in South Africa, subsequently called the GCSA Programme. This evaluation highlights the need for documented programme theory in global citizenship-type programmes for future programme development. An articulated programme theory produced for the GCSA Programme, analysed against the available social science literature, indicated it is comparable to other such programmes in terms of its overarching framework. What the research found is that most other global citizenship programmes do not have an articulated programme theory. These programmes also do not explicitly link their specific activities to their intended outcomes, making demonstrating impact impossible. In conclusion, we argue that taking a theory-based approach can strengthen and enable outcome evaluations in global citizenship programmes. Copyright © 2017. Published by Elsevier Ltd.

The ALMANACH Project: Preliminary results and potentiality from Afghanistan.

PubMed

Bernasconi, A; Crabbé, F; Rossi, R; Qani, I; Vanobberghen, A; Raab, M; Du Mortier, S

2018-06-01

ALMANACH (ALgorithms for the MANagement of Acute CHildhood illnesses) is an electronic version of IMCI (Integrated Management of Childhood Illness) running on tablets. ALMANACH enhances its concept, it integrates well into health staff's daily consultation work and facilitates diagnosis and treatment. ALMANACH informs when to refer a child or to perform a rapid diagnostic test (RDT), recommends the right treatment dosage and synchronizes collected data real time with a Health Management Information System (DHIS2) for epidemiological evaluation and decision making. Since May 2016, ALMANACH is under investigational deployment in three primary health care facilities in Afghanistan with the goal to improve the quality of care provided to children between 2 months and 5 years old. IMCI's algorithms were updated in considering latest scientific publications, national guidelines, innovations in RDTs, the target population's epidemiological profile and the local resources available. Before the implementation of the project, a direct observation of 599 consultations was carried out to assess the daily performance at three selected health facilities in Kabul. The baseline survey showed that nutritional screening, vitamin A supplementation and deworming were not systematically performed: few patients were diagnosed for malnutrition (1.8%), received vitamin A (2.7%) or deworming (7.5%). Physical examination was appropriate only for 23.8% of the diagnoses of respiratory or gastrointestinal diseases, ear infection and sore throat. Respiratory rate was checked only in 33.5% of the children with fever and cough, dehydration status was assessed in only 16.5% of the diarrhoea cases. Forty-seven percent of patients received incorrect treatment. Sixty-four percent of the children, before the introduction of ALMANACH, received at least one antibiotic, although for 87.1% antibiotic therapy was unnecessary. The review of 8'047 paediatric consultations between May 2016 and September 2017 showed that with ALMANACH, malnutrition detection, deworming and Vitamin A supplementation increased respectively to 4.4%, 50.2% and 27.5%. Antibiotic prescription decreased to 21.83% and all children were examined and treated in compliance with the protocols. A survey will be conducted one year after the implementation to validate these initial promising results. If the efficacy of the approach is confirmed, ALMANACH could establish as a powerful innovation for primary health care. Copyright © 2017 Elsevier B.V. All rights reserved.

'Better medicines for children' within the Integrated Management of Childhood Illness framework: a qualitative inquiry in Uganda.

PubMed

Nsabagasani, Xavier; Ogwal-Okeng, Japer; Hansen, Ebba Holme; Mbonye, Anthony; Muyinda, Herbert; Ssengooba, Freddie

2016-01-01

The Integrated Management of Childhood Illnesses is the main approach for treating children in more than 100 low income countries worldwide. In 2007, the World Health Assembly urged countries to integrate 'better medicines for children' into their essential medicines lists and treatment guidelines. WHO regularly provides generic algorithms for IMCI and publishes the Model Essential Medicines List with child-friendly medicines based on new evidence for member countries to adopt. However, the status of 'better medicines for children' within the Integrated Management of Childhood Illnesses approach in Uganda has not been studied. Qualitative interviews were conducted with: two officials from the ministry of health; two district health officials and, 22 health workers from public health facilities. Interview transcripts were manually analyzed for manifest and latent content. Child-appropriate dosage formulations were not included in the package for the Integrated Management of Childhood Illnesses and ministry officials attributed this to resource constraints and lack of initial guidance from the World Health Organization. Underfunding reportedly undercut efforts to: orient health workers; do support supervision and update treatment guidelines to reflect 'better medicines for children'. Health workers reported difficulties in administering tablets and capsules to under-five children and that's why they preferred liquid oral dosage formulations, suppositories and injections. The IMCI strategy in Uganda was not revised to reflect child-appropriate dosage formulations - a missed opportunity for improving the quality of management of childhood illnesses. Funding was an obstacle to the integration of child-appropriate dosage formulations. Ministry of health should prioritize funding for the Integrated Management of Childhood Illnesses and revising the Essential Medicines and Health Supplies List of Uganda, the Uganda Clinical Guidelines and, the Treatment Charts for the Integrated Management of Childhood Illnesses to reflect child-appropriate dosage formulations.

Equity and child-survival strategies.

PubMed

Mulholland, Ek; Smith, L; Carneiro, I; Becher, H; Lehmann, D

2008-05-01

Recent advances in child survival have often been at the expense of increasing inequity. Successive interventions are applied to the same population sectors, while the same children in other sectors consistently miss out, leading to a trend towards increasing inequity in child survival. This is particularly important in the case of pneumonia, the leading cause of child death, which is closely linked to poverty and malnutrition, and for which effective community-based case management is more difficult to achieve than for other causes of child death. The key strategies for the prevention of childhood pneumonia are case management, mainly through Integrated Management of Childhood Illness (IMCI), and immunization, particularly the newer vaccines against Haemophilus influenzae type b (Hib) and pneumococcus. There is a tendency to introduce both interventions into communities that already have access to basic health care and preventive services, thereby increasing the relative disadvantage experienced by those children without such access. Both strategies can be implemented in such a way as to decrease rather than increase inequity. It is important to monitor equity when introducing child-survival interventions. Economic poverty, as measured by analyses based on wealth quintiles, is an important determinant of inequity in health outcomes but in some settings other factors may be of greater importance. Geography and ethnicity can both lead to failed access to health care, and therefore inequity in child survival. Poorly functioning health facilities are also of major importance. Countries need to be aware of the main determinants of inequity in their communities so that measures can be taken to ensure that IMCI, new vaccine implementation and other child-survival strategies are introduced in an equitable manner.

Hypothetical performance of syndrome-based management of acute paediatric admissions of children aged more than 60 days in a Kenyan district hospital.

PubMed Central

English, Mike; Berkley, James; Mwangi, Isiah; Mohammed, Shebbe; Ahmed, Maimuna; Osier, Faith; Muturi, Neema; Ogutu, Bernhards; Marsh, Kevin; Newton, Charles R. J. C.

2003-01-01

OBJECTIVE: To investigate whether the outpatient, syndrome-based approach of the Integrated Management of Childhood Illness (IMCI) protocol could be extended to the inpatient arena to give clear and simple minimum standards of care for poorly resourced facilities. METHODS: A prospective, one-year admission cohort retrospectively compared hypothetical performance of syndrome-based management with paediatrician-defined final diagnosis. Admission syndrome definitions were based on local adaptations to the IMCI protocol that encompassed 20 clinical features, measurement of oxygen saturation, and malaria microscopy. FINDINGS: After 315 children with clinically obvious diagnoses (e.g. sickle cell disease and burns) were excluded, 3705 admission episodes were studied. Of these, 2334 (63%) met criteria for at least one severe syndrome (mortality 8% vs <1% for "non-severe" cases), and half of these had features of two or more severe syndromes. No cases of measles were seen. Syndrome-based treatment would have been appropriate (sensitivity >95%) for severe pneumonia, severe malaria, and diarrhoea with severe dehydration, and probably for severe malnutrition (sensitivity 71%). Syndrome-directed treatment suggested the use of broad-spectrum antibiotics in 75/133 (56% sensitivity) children with bacteraemic and 63/71 (89% sensitivity) children with meningitis. CONCLUSIONS: Twenty clinical features, oxygen saturation measurements, and results of malaria blood slides could be used for inpatient, syndrome-based management of acute paediatric admissions. The addition of microscopy of the cerebrospinal fluid and haemoglobin measurements would improve syndrome-directed treatment considerably. This approach might rationalize admission policy and standardize inpatient paediatric care in resource-poor countries, although the clinical detection of bacteraemia remains a problem. PMID:12764512

Rethinking programme evaluation in health professions education: beyond 'did it work?'.

PubMed

Haji, Faizal; Morin, Marie-Paule; Parker, Kathryn

2013-04-01

For nearly 40 years, outcome-based models have dominated programme evaluation in health professions education. However, there is increasing recognition that these models cannot address the complexities of the health professions context and studies employing alternative evaluation approaches that are appearing in the literature. A similar paradigm shift occurred over 50 years ago in the broader discipline of programme evaluation. Understanding the development of contemporary paradigms within this field provides important insights to support the evolution of programme evaluation in the health professions. In this discussion paper, we review the historical roots of programme evaluation as a discipline, demonstrating parallels with the dominant approach to evaluation in the health professions. In tracing the evolution of contemporary paradigms within this field, we demonstrate how their aim is not only to judge a programme's merit or worth, but also to generate information for curriculum designers seeking to adapt programmes to evolving contexts, and researchers seeking to generate knowledge to inform the work of others. From this evolution, we distil seven essential elements of educational programmes that should be evaluated to achieve the stated goals. Our formulation is not a prescriptive method for conducting programme evaluation; rather, we use these elements as a guide for the development of a holistic 'programme of evaluation' that involves multiple stakeholders, uses a combination of available models and methods, and occurs throughout the life of a programme. Thus, these elements provide a roadmap for the programme evaluation process, which allows evaluators to move beyond asking whether a programme worked, to establishing how it worked, why it worked and what else happened. By engaging in this process, evaluators will generate a sound understanding of the relationships among programmes, the contexts in which they operate, and the outcomes that result from them. © Blackwell Publishing Ltd 2013.

How can systems engineering inform the methods of programme evaluation in health professions education?

PubMed

Rojas, David; Grierson, Lawrence; Mylopoulos, Maria; Trbovich, Patricia; Bagli, Darius; Brydges, Ryan

2018-04-01

We evaluate programmes in health professions education (HPE) to determine their effectiveness and value. Programme evaluation has evolved from use of reductionist frameworks to those addressing the complex interactions between programme factors. Researchers in HPE have recently suggested a 'holistic programme evaluation' aiming to better describe and understand the implications of 'emergent processes and outcomes'. We propose a programme evaluation framework informed by principles and tools from systems engineering. Systems engineers conceptualise complexity and emergent elements in unique ways that may complement and extend contemporary programme evaluations in HPE. We demonstrate how the abstract decomposition space (ADS), an engineering knowledge elicitation tool, provides the foundation for a systems engineering informed programme evaluation designed to capture both planned and emergent programme elements. We translate the ADS tool to use education-oriented language, and describe how evaluators can use it to create a programme-specific ADS through iterative refinement. We provide a conceptualisation of emergent elements and an equation that evaluators can use to identify the emergent elements in their programme. Using our framework, evaluators can analyse programmes not as isolated units with planned processes and planned outcomes, but as unfolding, complex interactive systems that will exhibit emergent processes and emergent outcomes. Subsequent analysis of these emergent elements will inform the evaluator as they seek to optimise and improve the programme. Our proposed systems engineering informed programme evaluation framework provides principles and tools for analysing the implications of planned and emergent elements, as well as their potential interactions. We acknowledge that our framework is preliminary and will require application and constant refinement. We suggest that our framework will also advance our understanding of the construct of 'emergence' in HPE research. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

Reflect before you act: providing structure to the evaluation of rehabilitation programmes.

PubMed

Velema, Johan P; Cornielje, Huib

2003-11-18

This paper is concerned with understanding and evaluating potentially diverse rehabilitation programmes. It helps evaluators and programme managers to focus attention on specific aspects of the rehabilitation process and select evaluation questions relevant to each. Distinction is made between the rehabilitation programme itself, the programme environment and the relationships between the two. For each of these areas, evaluation questions have been formulated. For services offered to individual clients, questions address whether the status of clients has improved, what interventions are offered and who benefit from them, the relationships between the service providers and the clients, and who may be involved in the rehabilitation process besides the client. To assess the programme environment, questions address the epidemiology of disability, the resources available to persons with disabilities, the inclusiveness of education and employment and a number of eco-social variables. Relationships between the programme and its environment concern the support of the community for the programme, the way the programme seeks to influence the community, the referral of clients to other services available in the community and the extent to which the programme is a learning organization. Lists of evaluation questions are presented from which the evaluator can select those most relevant to the programme to be evaluated. This provides a framework for the evaluation and for the information to be gathered. Rather than providing a blue print, this framework permits flexibility to adapt to the specific situation of the programme to be evaluated. This paper presents a useful guideline that stimulates the thinking of those preparing for the evaluation of rehabilitation programmes.

The Evaluation of Foreign-Language-Teacher Education Programmes

ERIC Educational Resources Information Center

Peacock, Matthew

2009-01-01

This article presents a new procedure for the evaluation of EFL teacher-training programmes based on principles of programme evaluation and foreign-language-teacher (FLT) education. The procedure focuses on programme strengths and weaknesses and how far the programme meets the needs of students. I tested the procedure through an evaluation of a…

A framework for evaluating community-based physical activity promotion programmes in Latin America.

PubMed

Schmid, Thomas L; Librett, John; Neiman, Andrea; Pratt, Michael; Salmon, Art

2006-01-01

A growing interest in promoting physical activity through multi-sectoral community-based programmes has highlighted the need for effective programme evaluation. Meeting in Rio de Janeiro, an international workgroup of behavioural, medical, public health and other scientists and practitioners endorsed the principle of careful evaluation of all programmes and in a consensus process developed the Rio de Janeiro Recommendations for Evaluation of Physical Activity Interventions". Among these recommendations and principles were that when possible, evaluation should 'built into' the programme from the beginning. The workgroup also called for adequate funding for evaluation, setting a goal of about 10% of programme resources for evaluation. The group also determined that evaluations should be developed in conjunction with and the results shared with all appropriate stakeholders in the programme; evaluations should be guided by ethical standards such as those proposed by the American Evaluation Association and should assess programme processes as well as outcomes; evaluation outcomes should be used to revise and refine ongoing programmes and guide decisions about programme continuation or expansion. It was also recognised that additional training in programme evaluation is needed and the Centers for Disease Control and Prevention's Physical Activity Evaluation Handbook could be easily adapted for use in culturally diverse communities, especially in Latin America. This paper describes a 6-step evaluation process and provides the full set of recommendations from the Rio de Janeiro Workgroup. The handbook has been translated and additional case studies from Colombia and Brazil have been added. Spanish and Portuguese language editions of the Evaluation Handbook are available from the Centers for Disease Control and Prevention, Physical Activity and Health Branch.

A one-year practice-based learning programme for new general practice nurses in Scotland: evaluation of the pilot.

PubMed

Wakeling, Judy; Ferguson, Julie; Kennedy, Susan

2016-01-01

This paper summarises the evaluation of a pilot programme introduced by NHS Education for Scotland to provide education and skills training for nurses new to general practice. The programme was developed through extensive consultation with existing general practice nurses and was educationally accredited by the Royal College of General Practitioners and the Royal College of Nursing in 2013. Twelve nurses embarked upon the programme 2012-2013 and nine completed it. The programme was extensively evaluated through questionnaires (with supervisors, practice staff and participants), analysis of programme documentation and interviews with participants. Based on the evaluation feedback, alterations have been made to subsequent deliveries of the programme. These include removing some topic areas and lengthening the programme by three months. The programme continues to be successfully delivered and evaluation is ongoing to ensure it continues to meet nurses' needs.

Leadership as a Health Research Policy Intervention: An Evaluation of the NIHR Leadership Programme (Phase 2).

PubMed

Marjanovic, Sonja; Cochrane, Gavin; Manville, Catriona; Harte, Emma; Chataway, Joanna; Jones, Molly Morgan

2016-01-29

In early 2012, the National Institute for Health Research (NIHR) leadership programme was re-commissioned for a further three years following an evaluation by RAND Europe. During this new phase of the programme, we conducted a real-time evaluation, the aim of which was to allow for reflection on and adjustment of the programme on an on-going basis as events unfold. This approach also allowed for participants on the programme to contribute to and positively engage in the evaluation. The study aimed to understand the outputs and impacts from the programme, and to test the underlying assumptions behind the NIHR Leadership Programme as a science policy intervention. Evidence on outputs and impacts of the programme were collected around the motivations and expectations of participants, programme design and individual-, institutional- and system-level impacts.

Programme Evaluation: Maintaining Quality in Higher Education

ERIC Educational Resources Information Center

Loots, A.

2008-01-01

The evaluation of educational or social programmes is paramount for establishing success or impact in higher education. Evaluation questions about programme goals (e.g. better performance of first-year students) or about the quality of programme strategies (design and implementation) and effectiveness of delivery (coordinator inputs and…

Evaluation of European Domestic Violence Perpetrator Programmes: Toward a Model for Designing and Reporting Evaluations Related to Perpetrator Treatment Interventions.

PubMed

Lilley-Walker, Sarah-Jane; Hester, Marianne; Turner, William

2018-03-01

This article is based on a review of 60 evaluations (published and unpublished) relating to European domestic violence perpetrator programmes, involving 7,212 programme participants across 12 countries. The purpose of the review, part of the "IMPACT: Evaluation of European Perpetrator Programmes" project funded by the European Commission (Daphne III Programme), was to provide detailed knowledge about the range of European evaluation studies with particular emphasis on the design, methods, input, output, and outcome measures used in order to identify the possibilities and challenges of a multicountry, Europe-wide evaluation methodology that could be used to assess perpetrator programmes in the future. We provide a model to standardise the reporting of evaluation studies and to ensure attention is paid to what information is being collected at different time points so as to understand what and how the behaviour and attitudes of perpetrators might change throughout the course of the programme.

Evaluating the Level of Degree Programmes in Higher Education: Conceptual Design

ERIC Educational Resources Information Center

Rexwinkel, Trudy; Haenen, Jacques; Pilot, Albert

2013-01-01

Evaluating the level of degree programmes became crucial with the Bologna Agreement in 1999 when European ministers agreed to implement common bachelor's and master's degree programmes and a common system of quality assurance. The European Quality Assurance system demands evaluation of the degree programme level based on valid and reliable…

mPneumonia: Development of an Innovative mHealth Application for Diagnosing and Treating Childhood Pneumonia and Other Childhood Illnesses in Low-Resource Settings

PubMed Central

Ginsburg, Amy Sarah; Delarosa, Jaclyn; Brunette, Waylon; Levari, Shahar; Sundt, Mitch; Larson, Clarice; Tawiah Agyemang, Charlotte; Newton, Sam; Borriello, Gaetano; Anderson, Richard

2015-01-01

Pneumonia is the leading infectious cause of death in children worldwide. Each year, pneumonia kills an estimated 935,000 children under five years of age, with most of these deaths occurring in developing countries. The current approach for pneumonia diagnosis in low-resource settings—using the World Health Organization Integrated Management of Childhood Illness (IMCI) paper-based protocols and relying on a health care provider’s ability to manually count respiratory rate—has proven inadequate. Furthermore, hypoxemia—a diagnostic indicator of the presence and severity of pneumonia often associated with an increased risk of death—is not assessed because pulse oximetry is frequently not available in low-resource settings. In an effort to address childhood pneumonia mortality and improve frontline health care providers’ ability to diagnose, classify, and manage pneumonia and other childhood illnesses, PATH collaborated with the University of Washington to develop “mPneumonia,” an innovative mobile health application using an Android tablet. mPneumonia integrates a digital version of the IMCI algorithm with a software-based breath counter and a pediatric pulse oximeter. We conducted a design-stage usability field test of mPneumonia in Ghana, with the goal of creating a user-friendly diagnostic and management tool for childhood pneumonia and other childhood illnesses that would improve diagnostic accuracy and facilitate adherence by health care providers to established guidelines in low-resource settings. The results of the field test provided valuable information for understanding the usability and acceptability of mPneumonia among health care providers, and identifying approaches to iterate and improve. This critical feedback helped ascertain the common failure modes related to the user interface design, navigation, and accessibility of mPneumonia and the modifications required to improve user experience and create a tool aimed at decreasing mortality from pneumonia and other childhood illnesses in low-resource settings. PMID:26474321

mPneumonia, an Innovation for Diagnosing and Treating Childhood Pneumonia in Low-Resource Settings: A Feasibility, Usability and Acceptability Study in Ghana

PubMed Central

Ginsburg, Amy Sarah; Tawiah Agyemang, Charlotte; Ambler, Gwen; Delarosa, Jaclyn; Brunette, Waylon; Levari, Shahar; Larson, Clarice; Sundt, Mitch; Newton, Sam; Borriello, Gaetano; Anderson, Richard

2016-01-01

Pneumonia is the leading cause of infectious disease mortality in children. Currently, health care providers (HCPs) are trained to use World Health Organization Integrated Management of Childhood Illness (IMCI) paper-based protocols and manually assess respiratory rate to diagnose pneumonia in low-resource settings (LRS). However, this approach of relying on clinical signs alone has proven problematic. Hypoxemia, a diagnostic indicator of pneumonia severity associated with an increased risk of death, is not assessed because pulse oximetry is often not available in LRS. To improve HCPs’ ability to diagnose, classify, and manage pneumonia and other childhood illnesses, “mPneumonia” was developed. mPneumonia is a mobile health application that integrates a digital version of the IMCI algorithm with a software-based breath counter and a pulse oximeter. A design-stage qualitative pilot study was conducted to assess feasibility, usability, and acceptability of mPneumonia in six health centers and five community-based health planning and services centers in Ghana. Nine health administrators, 30 HCPs, and 30 caregivers were interviewed. Transcribed interview audio recordings were coded and analyzed for common themes. Health administrators reported mPneumonia would be feasible to implement with approval and buy-in from national and regional decision makers. HCPs felt using the mPneumonia application would be feasible to integrate into their work with the potential to improve accurate patient care. They reported it was “easy to use” and provided confidence in diagnosis and treatment recommendations. HCPs and caregivers viewed the pulse oximeter and breath counter favorably. Challenges included electricity requirements for charging and the time needed to complete the application. Some caregivers saw mPneumonia as a sign of modernity, increasing their trust in the care received. Other caregivers were hesitant or confused about the new technology. Overall, this technology was valued by users and is a promising innovation for improving quality of care in frontline health facilities. PMID:27788179

Evaluating a Research Training Programme for People with Intellectual Disabilities Participating in Inclusive Research: The Views of Participants.

PubMed

Fullana, Judit; Pallisera, Maria; Català, Elena; Puyalto, Carolina

2017-07-01

This article presents the results of evaluating a research training programme aimed at developing the skills of people with intellectual disabilities to actively participate in inclusive research. The present authors opted for a responsive approach to evaluation, using a combination of interviews, questionnaires and focus groups to gather information on the views of students, trainers and members of the research team regarding how the programme progressed, the learning achieved and participants' satisfaction with the programme. The evaluation showed that most of the participants were satisfied with the programme and provided guidelines for planning contents and materials, demonstrating the usefulness of these types of programme in constructing the research group and empowering people with intellectual disabilities to participate in research. The evaluation revealed that the programme had been a positive social experience that fostered interest in lifelong learning for people with intellectual disabilities. © 2016 John Wiley & Sons Ltd.

Research Capacity Strengthening in Low and Middle Income Countries - An Evaluation of the WHO/TDR Career Development Fellowship Programme.

PubMed

Käser, Michael; Maure, Christine; Halpaap, Beatrice M M; Vahedi, Mahnaz; Yamaka, Sara; Launois, Pascal; Casamitjana, Núria

2016-05-01

Between August 2012 and April 2013 the Career Development Fellowship programme of the Special Programme for Research and Training in Tropical Diseases (World Health Organization) underwent an external evaluation to assess its past performance and determine recommendations for future programme development and continuous performance improvement. The programme provides a year-long training experience for qualified researchers from low and middle income countries at pharmaceutical companies or product development partnerships. Independent evaluators from the Swiss Tropical and Public Health Institute and the Barcelona Institute for Global Health used a results-based methodology to review the programme. Data were gathered through document review, surveys, and interviews with a range of programme participants. The final evaluation report found the Career Development Fellowship to be relevant to organizers' and programme objectives, efficient in its operations, and effective in its training scheme, which was found to address needs and gaps for both fellows and their home institutions. Evaluators found that the programme has the potential for impact and sustainability beyond the programme period, especially with the successful reintegration of fellows into their home institutions, through which newly-developed skills can be shared at the institutional level. Recommendations included the development of a scheme to support the re-integration of fellows into their home institutions post-fellowship and to seek partnerships to facilitate the scaling-up of the programme. The impact of the Professional Membership Scheme, an online professional development tool launched through the programme, beyond the scope of the Career Development Fellowship programme itself to other applications, has been identified as a positive unintended outcome. The results of this evaluation may be of interest for other efforts in the field of research capacity strengthening in LMICs or, generally, to other professional development schemes of a similar structure.

Health promotion and sustainability programmes in Australia: barriers and enablers to evaluation.

PubMed

Patrick, Rebecca; Kingsley, Jonathan

2017-08-01

In an era characterised by the adverse impacts of climate change and environmental degradation, health promotion programmes are beginning to actively link human health with environmental sustainability imperatives. This paper draws on a study of health promotion and sustainability programmes in Australia, providing insights to evaluation approaches being used and barriers and enablers to these evaluations. The study was based on a multi-strategy research involving both quantitative and qualitative methods. Health promotion practitioners explained through surveys and semi-structured interviews that they focused on five overarching health and sustainability programme types (healthy and sustainable food, active transport, energy efficiency, contact with nature, and capacity building). Various evaluation methods and indicators (health, social, environmental, economic and demographic) were identified as being valuable for monitoring and evaluating health and sustainability programmes. Findings identified several evaluation enablers such as successful community engagement, knowledge of health and sustainability issues and programme champions, whereas barriers included resource constraints and competing interests. This paper highlights the need for ecological models and evaluation tools to support the design and monitoring of health promotion and sustainability programmes.

Cross-Evaluation of Degree Programmes in Higher Education

ERIC Educational Resources Information Center

Kettunen, Juha

2010-01-01

Purpose: This study seeks to develop and describe the benchmarking approach of enhancement-led evaluation in higher education and to present a cross-evaluation process for degree programmes. Design/methodology/approach: The benchmarking approach produces useful information for the development of degree programmes based on self-evaluation,…

A systematic review of technology-based interventions for unintentional injury prevention education and behaviour change.

PubMed

Omaki, Elise; Rizzutti, Nicholas; Shields, Wendy; Zhu, Jeffrey; McDonald, Eileen; Stevens, Martha W; Gielen, Andrea

2017-04-01

The aims of this literature review are to (1) summarise how computer and mobile technology-based health behaviour change applications have been evaluated in unintentional injury prevention, (2) describe how these successes can be applied to injury-prevention programmes in the future and (3) identify research gaps. Studies included in this systematic review were education and behaviour change intervention trials and programme evaluations in which the intervention was delivered by either a computer or mobile technology and addressed an unintentional injury prevention topic. Articles were limited to those published in English and after 1990. Among the 44 technology-based injury-prevention studies included in this review, 16 studies evaluated locally hosted software programmes, 4 studies offered kiosk-based programmes, 11 evaluated remotely hosted internet programmes, 2 studies used mobile technology or portable devices and 11 studies evaluated virtual-reality interventions. Locally hosted software programmes and remotely hosted internet programmes consistently increased knowledge and behaviours. Kiosk programmes showed evidence of modest knowledge and behaviour gains. Both programmes using mobile technology improved behaviours. Virtual-reality programmes consistently improved behaviours, but there were little gains in knowledge. No studies evaluated text-messaging programmes dedicated to injury prevention. There is much potential for computer-based programmes to be used for injury-prevention behaviour change. The reviewed studies provide evidence that computer-based communication is effective in conveying information and influencing how participants think about an injury topic and adopt safety behaviours. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Institutionalizing and sustaining social change in health systems: the case of Uganda.

PubMed

Hage, Jerald; Valadez, Joseph J

2017-11-01

The key to high impact health services is institutionalizing and sustaining programme evaluation. Uganda represents a success story in the use of a specific programme evaluation method: Lot Quality Assurance Sampling (LQAS). Institutionalization is defined by two C's: competent programme evaluators and control mechanisms that effectively use evaluation data to improve health services. Sustainability means continued training and funding for the evaluation approach. Social science literature that researches institutionalization has emphasized 'stability', whereas in global health, the issue is determining how to improve the impact of services by 'changing' programmes. In Uganda, we measured the extent of the institutionalization and sustainability of evaluating programmes that produce change in nine districts sampled to represent three largely rural regions and varying levels of effective health programmes. We used the proportion of mothers with children aged 0-11 months who delivered in a health facility as the principal indicator to measure programme effectiveness. Interviews and focus groups were conducted among directors, evaluation supervisors, data collectors in the district health offices, and informant interviews conducted individually at the central government level. Seven of the nine districts demonstrated a high level of institutionalization of evaluation. The two others had only conducted one round of programme evaluation. When we control for the availability of health facilities, we find that the degree of institutionalization is moderately related to the prevalence of the delivery of a baby in a health facility. Evaluation was institutionalized at the central government level. Sustainability existed at both levels. Several measures indicate that lessons from the nine district case studies may be relevant to the 74 districts that had at least two rounds of programme evaluation. We note that there is an association between the evaluation data being used to change health services, and the four separate indicators being used to measure women's health and child survival services. We conclude that the two C's (competent evaluators and control mechanisms) have been critical for sustaining programme evaluation in Uganda. © The Author 2017. Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine.

Institutionalizing and sustaining social change in health systems: the case of Uganda

PubMed Central

Hage, Jerald; Valadez, Joseph J

2017-01-01

Abstract The key to high impact health services is institutionalizing and sustaining programme evaluation. Uganda represents a success story in the use of a specific programme evaluation method: Lot Quality Assurance Sampling (LQAS). Institutionalization is defined by two C’s: competent programme evaluators and control mechanisms that effectively use evaluation data to improve health services. Sustainability means continued training and funding for the evaluation approach. Social science literature that researches institutionalization has emphasized ‘stability’, whereas in global health, the issue is determining how to improve the impact of services by ‘changing’ programmes. In Uganda, we measured the extent of the institutionalization and sustainability of evaluating programmes that produce change in nine districts sampled to represent three largely rural regions and varying levels of effective health programmes. We used the proportion of mothers with children aged 0–11 months who delivered in a health facility as the principal indicator to measure programme effectiveness. Interviews and focus groups were conducted among directors, evaluation supervisors, data collectors in the district health offices, and informant interviews conducted individually at the central government level. Seven of the nine districts demonstrated a high level of institutionalization of evaluation. The two others had only conducted one round of programme evaluation. When we control for the availability of health facilities, we find that the degree of institutionalization is moderately related to the prevalence of the delivery of a baby in a health facility. Evaluation was institutionalized at the central government level. Sustainability existed at both levels. Several measures indicate that lessons from the nine district case studies may be relevant to the 74 districts that had at least two rounds of programme evaluation. We note that there is an association between the evaluation data being used to change health services, and the four separate indicators being used to measure women's health and child survival services. We conclude that the two C’s (competent evaluators and control mechanisms) have been critical for sustaining programme evaluation in Uganda. PMID:28981663

Extracurricular leadership development programme to prepare future Saudi physicians as leaders.

PubMed

Ayuob, Nasra Naeim; Al Sayes, Faten Mohamed; El Deek, Basem Salama

2016-06-01

To describe and evaluate an innovative approach for developing leadership skills in a cohort of medical students through an extracurricular programme. The study was conducted at King Abdulaziz University, Jeddah, Saudi Arabia, from April to June of the academic year 2014-15, and comprised medical students from all batches. Mixed-method design was used to evaluate the leadership development programme. Pre- and post-tests were conducted to assess students' learning and their satisfaction was evaluated at the end of the programme. Focus groups were conducted to assess the programme's impact on participants' behaviour. Data analysis was done using SPSS 16. Of the 55 participants, 45(82%) responded to the evaluation survey. Of them, 29(65%) reported intended changes in their leadership practices immediately after the programme, with 8(28%) of them reporting more than one change. The mean students' satisfaction with the overall performance of the speakers and programme organisation was high at 4.12±0.91 and 4.54±0.89, respectively. Early experience of the leadership development programme produced positive results. An intense programme analysis is required to fully understand this significant organisational need.

Global Fund grant programmes: an analysis of evaluation scores.

PubMed

Radelet, Steven; Siddiqi, Bilal

2007-05-26

The Global Fund to Fight AIDS, Tuberculosis and Malaria evaluates programme performance after 2 years to help decide whether to continue funding. We aimed to identify the correlation between programme evaluation scores and characteristics of the programme, the health sector, and the recipient country. We obtained data on the first 140 Global Fund grants evaluated in 2006, and analysed 134 of these. We used an ordered probit multivariate analysis to link evaluation scores to different characteristics, allowing us to record the association between changes in those characteristics and the probability of a programme receiving a particular evaluation score. Programmes that had government agencies as principal recipients, had a large amount of funding, were focused on malaria, had weak initial proposals, or were evaluated by the accounting firm KPMG, scored lowest. Countries with a high number of doctors per head, high measles immunisation rates, few health-sector donors, and high disease-prevalence rates had higher evaluation scores. Poor countries, those with small government budget deficits, and those that have or have had socialist governments also received higher scores. Our results show associations, not causality, and they focus on evaluation scores rather than actual performance of the programmes. Yet they provide some early indications of characteristics that can help the Global Fund identify and monitor programmes that might be at risk. The results should not be used to influence the distribution of funding, but rather to allocate resources for oversight and risk management.

Systematic Review: the use of vouchers for reproductive health services in developing countries: systematic review.

PubMed

Bellows, Nicole M; Bellows, Ben W; Warren, Charlotte

2011-01-01

To identify where vouchers have been used for reproductive health (RH) services, to what extent RH voucher programmes have been evaluated, and whether the programmes have been effective. A systematic search of the peer review and grey literature was conducted to identify RH voucher programmes and evaluation findings. Experts were consulted to verify RH voucher programme information and identify further programmes and studies not found in the literature search. Studies were examined for outcomes regarding targeting, costs, knowledge, utilization, quality, and population health impact. Included studies used cross-sectional, before-and-after and quasi-experimental designs. Thirteen RH voucher programmes fitting established criteria were identified. RH voucher programmes were located in Bangladesh, Cambodia, China, Kenya (2), Korea, India, Indonesia, Nicaragua (3), Taiwan, and Uganda. Among RH voucher programmes, 7 were quantitatively evaluated in 15 studies. All evaluations reported some positive findings, indicating that RH voucher programmes increased utilization of RH services, improved quality of care, and improved population health outcomes. The potential for RH voucher programmes appears positive; however, more research is needed to examine programme effectiveness using strong study designs. In particular, it is important to see stronger evidence on cost-effectiveness and population health impacts, where the findings can best direct governments and external funders. © 2010 Blackwell Publishing Ltd.

Informationist programme in support of biomedical research: a programme description and preliminary findings of an evaluation

PubMed Central

Whitmore, Susan C.; Grefsheim, Suzanne F.; Rankin, Jocelyn A.

2008-01-01

Background The informationist programme at the Library of the National Institutes of Health (NIH) in Bethesda, MD, USA has grown to 14 informationists working with 40 clinical and basic science research teams. Purpose This case report, intended to contribute to the literature on informationist programmes, describes the NIH informationist programme including implementation experiences, the informationists' training programme, their job responsibilities and programme outcomes. Brief description The NIH informationist programme was designed to enhance the library's service capacity. Over time, the steps for introducing the service to new groups were formalized to ensure support by leadership, the team being served and the library. Job responsibilities also evolved from traditional library roles to a wide range of knowledge management activities. The commitment by the informationist, the team and the library to continuous learning is critical to the programme's success. Results/outcomes NIH scientists reported that informationists saved them time and contributed to teamwork with expert searching and point-of-need instruction. Process evaluation helped refine the programme. Evaluation method High-level, preliminary outcomes were identified from a survey of scientists receiving informationist services, along with key informant interviews. Process evaluation examined service implementation, informationists' training, and service components. Anecdotal evidence has also indicated a favorable response to the programme. PMID:18494648

Training Programme for Secondary School Principals: Evaluating its Effectiveness and Impact

ERIC Educational Resources Information Center

Hutton, Disraeli M.

2013-01-01

The article presents the evaluation of the training programme for secondary school principals conducted in the period between 2006 and 2009. A mixed method approach was used to conduct the summative evaluation with 28 graduate participants. For the impact evaluation, 15 of the graduates were interviewed three years after the programme was…

Economic evaluation of occupational health and safety programmes in health care.

PubMed

Guzman, J; Tompa, E; Koehoorn, M; de Boer, H; Macdonald, S; Alamgir, H

2015-10-01

Evidence-based resource allocation in the public health care sector requires reliable economic evaluations that are different from those needed in the commercial sector. To describe a framework for conducting economic evaluations of occupational health and safety (OHS) programmes in health care developed with sector stakeholders. To define key resources and outcomes to be considered in economic evaluations of OHS programmes and to integrate these into a comprehensive framework. Participatory action research supported by mixed qualitative and quantitative methods, including a multi-stakeholder working group, 25 key informant interviews, a 41-member Delphi panel and structured nominal group discussions. We found three resources had top priority: OHS staff time, training the workers and programme planning, promotion and evaluation. Similarly, five outcomes had top priority: number of injuries, safety climate, job satisfaction, quality of care and work days lost. The resulting framework was built around seven principles of good practice that stakeholders can use to assist them in conducting economic evaluations of OHS programmes. Use of a framework resulting from this participatory action research approach may increase the quality of economic evaluations of OHS programmes and facilitate programme comparisons for evidence-based resource allocation decisions. The principles may be applicable to other service sectors funded from general taxes and more broadly to economic evaluations of OHS programmes in general. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Patient education in Parkinson's disease: Formative evaluation of a standardized programme in seven European countries.

PubMed

Macht, Michael; Gerlich, Christian; Ellgring, Heiner; Schradi, Martina; Rusiñol, Angels Bayés; Crespo, Maricruz; Prats, Ana; Viemerö, Vappu; Lankinen, Anu; Bitti, Pio Enrico Ricci; Candini, Lorena; Spliethoff-Kamminga, Noëlle; de Vreugd, Janny; Simons, Gwenda; Pasqualini, Marcia Smith; Thompson, Simon B N; Taba, Pille; Krikmann, Ulle; Kanarik, Eve

2007-02-01

To evaluate a newly developed education programme for Parkinson's disease (PD) patients. The programme consisted of eight sessions and aimed at improving knowledge and skills related to self-monitoring, health promotion, stress management, depression, anxiety, social competence, and social support, all with special reference to PD. The programme was formatively evaluated in seven European countries (Spain, Finland, Italy, The Netherlands, United Kingdom, Estonia, Germany) with 151 patients diagnosed with idiopathic PD. The evaluation included patients' ratings of the comprehensibility and feasibility of the programme as well as mood ratings before and after each session. Patients also completed questionnaires at the beginning and end of the programme to explore possible changes in disease-related psychosocial problems, quality of life, and depression. The programme was feasible to run, and patients were able to understand its elements. Patients reported mood elevations following individual sessions and reduced disease-related psychosocial problems after completing the programme. There were no substantial differences in results between cultures. Patient education appears to have potential as a useful and feasible intervention, complementing medical treatment in PD. The present programme will soon be available in seven European languages and can be tested in different health care systems.

Key principles to improve programmes and interventions in complementary feeding.

PubMed

Lutter, Chessa K; Iannotti, Lora; Creed-Kanashiro, Hilary; Guyon, Agnes; Daelmans, Bernadette; Robert, Rebecca; Haider, Rukhsana

2013-09-01

Although there are some examples of successful complementary feeding programmes to promote healthy growth and prevent stunting at the community level, to date there are few, if any, examples of successful programmes at scale. A lack of systematic process and impact evaluations on pilot projects to generate lessons learned has precluded scaling up of effective programmes. Programmes to effect positive change in nutrition rarely follow systematic planning, implementation, and evaluation (PIE) processes to enhance effectiveness over the long term. As a result a set of programme-oriented key principles to promote healthy growth remains elusive. The purpose of this paper is to fill this gap by proposing a set of principles to improve programmes and interventions to promote healthy growth and development. Identifying such principles for programme success has three requirements: rethinking traditional paradigms used to promote improved infant and young child feeding; ensuring better linkages to delivery platforms; and, improving programming. Following the PIE model for programmes and learning from experiences from four relatively large-scale programmes described in this paper, 10 key principles are identified in the areas of programme planning, programme implementation, programme evaluation, and dissemination, replication, and scaling up. Nonetheless, numerous operational research questions remain, some of which are highlighted in this paper. © 2013 John Wiley & Sons Ltd.

The value of theory in programmes to implement clinical guidelines: Insights from a retrospective mixed-methods evaluation of a programme to increase adherence to national guidelines for chronic disease in primary care

PubMed Central

Sheringham, Jessica; Solmi, Francesca; Ariti, Cono; Baim-Lance, Abigail; Morris, Steve; Fulop, Naomi J.

2017-01-01

Background Programmes have had limited success in improving guideline adherence for chronic disease. Use of theory is recommended but is often absent in programmes conducted in ‘real-world’ rather than research settings. Materials and methods This mixed-methods study tested a retrospective theory-based approach to evaluate a ‘real-world’ programme in primary care to improve adherence to national guidelines for chronic obstructive pulmonary disease (COPD). Qualitative data, comprising analysis of documents generated throughout the programme (n>300), in-depth interviews with planners (clinicians, managers and improvement experts involved in devising, planning, and implementing the programme, n = 14) and providers (practice clinicians, n = 14) were used to construct programme theories, experiences of implementation and contextual factors influencing care. Quantitative analyses comprised controlled before-and-after analyses to test ‘early’ and evolved’ programme theories with comparators grounded in each theory. ‘Early’ theory predicted the programme would reduce emergency hospital admissions (EHA). It was tested using national analysis of standardized borough-level EHA rates between programme and comparator boroughs. ‘Evolved’ theory predicted practices with higher programme participation would increase guideline adherence and reduce EHA and costs. It was tested using a difference-in-differences analysis with linked primary and secondary care data to compare changes in diagnosis, management, EHA and costs, over time and by programme participation. Results Contrary to programme planners’ predictions in ‘early’ and ‘evolved’ programme theories, admissions did not change following the programme. However, consistent with ‘evolved’ theory, higher guideline adoption occurred in practices with greater programme participation. Conclusions Retrospectively constructing theories based on the ideas of programme planners can enable evaluators to address some limitations encountered when evaluating programmes without a theoretical base. Prospectively articulating theory aided by existing models and mid-range implementation theories may strengthen guideline adoption efforts by prompting planners to scrutinise implementation methods. Benefits of deriving programme theory, with or without the aid of mid-range implementation theories, however, may be limited when the evidence underpinning guidelines is flawed. PMID:28328942

Parents' Training: Effects of the Self-Help Skills Programme with Down's Syndrome Babies

ERIC Educational Resources Information Center

Sanz, Maria Teresa; Menendez, Javier

2010-01-01

This article reviews studies evaluating the effectiveness of two types of early intervention programmes for babies with Down's syndrome (DS). Evaluation of self-help early intervention programmes was done with two types of training with the parents: in the first the parents learned the training programme from observing the clinician, and in the…

Evaluating the Effectiveness of a Large-Scale Professional Development Programme

ERIC Educational Resources Information Center

Main, Katherine; Pendergast, Donna

2017-01-01

An evaluation of the effectiveness of a large-scale professional development (PD) programme delivered to 258 schools in Queensland, Australia is presented. Formal evaluations were conducted at two stages during the programme using a tool developed from Desimone's five core features of effective PD. Descriptive statistics of 38 questions and…

Kansas nurse leader residency programme: advancing leader knowledge and skills.

PubMed

Shen, Qiuhua; Peltzer, Jill; Teel, Cynthia; Pierce, Janet

2018-03-01

To evaluate the effectiveness of the Kansas Nurse Leader Residency (KNLR) programme in improving nurses' leadership knowledge and skills and its acceptability, feasibility and fidelity. The Future of Nursing Report (Institute of Medicine, 2011) calls for nurses to lead change and advance health. The 6-month KNLR programme was developed by the Kansas Action Coalition to support nurses' leadership development. Nurses (n = 36) from four nursing specialties (acute care, long-term care, public health and school health) participated in the programme. The adapted Leader Knowledge and Skill Inventory was used to assess leadership knowledge and skills. Programme acceptability, feasibility and implementation fidelity also were evaluated. The programme completion rate was 67.7% (n = 24). Programme completers had significantly improved self-assessed and mentor-assessed leadership knowledge and skills (p < .05). These post-programme gains were maintained 3 months after programme completion. The KNLR programme effectively improved leadership knowledge and skills and was positively evaluated by participants. The implementation of the KNLR programme using a hybrid format of in-person sessions and online modules was feasible across four specialty areas in both rural and urban regions. The next steps include the development of an advanced programme. Residency programmes for new nurse leaders are critical for successful transition into management positions. © 2017 John Wiley & Sons Ltd.

Evaluation of an adaptive ice skating programme for children with disabilities.

PubMed

Fragala-Pinkham, Maria A; Dumas, Helene M; Boyce, Megan; Peters, Christine Y; Haley, Stephen M

2009-08-01

To describe an adaptive ice skating programme designed by paediatric therapists. Twenty-two children, ages 5-12 years, with developmental disabilities participated in this once per week skating programme lasting 6 weeks. Ice skating instructors led the group lessons, while university student coaches provided individualized assistance to the children. The programme was evaluated using a summative evaluation design. Outcomes included participant attendance, incidence of injuries, skating skills and parent and student coach survey data. On average, participants attended 83% of the sessions and one minor injury was reported. Participants' parents were very satisfied with the programme and reported improvements in their child's skating skills, leg strength, endurance, balance, self-esteem/confidence and ability to participate in a group. Student coaches also reported high levels of satisfaction with this programme and reported similar improvements in the children they coached. The programme appeared promising, but may require minor modifications.

Technology-Enhanced Physics Programme for Community-Based Science Learning: Innovative Design and Programme Evaluation in a Theme Park

ERIC Educational Resources Information Center

Tho, Siew Wei; Chan, Ka Wing; Yeung, Yau Yuen

2015-01-01

In this study, a new physics education programme is specifically developed for a famous theme park in Hong Kong to provide community-based science learning to her visitors, involving her three newly constructed rides. We make innovative use of digital technologies in this programme and incorporate a rigorous evaluation of the learning…

What EFL Student Teachers Think about Their Professional Preparation: Evaluation of an English Language Teacher Education Programme in Spain

ERIC Educational Resources Information Center

Martinez Agudo, Juan de Dios

2017-01-01

Given the importance of programme evaluation in the EFL teacher education, this research paper of exploratory-interpretive nature mainly focuses on both strengths and weaknesses identified through the analysis and/or critical evaluation of an EFL teacher education programme carried out in Spain. Both quantitative and qualitative research…

Informationist programme in support of biomedical research: a programme description and preliminary findings of an evaluation.

PubMed

Whitmore, Susan C; Grefsheim, Suzanne F; Rankin, Jocelyn A

2008-06-01

The informationist programme at the Library of the National Institutes of Health (NIH) in Bethesda, MD, USA has grown to 14 informationists working with 40 clinical and basic science research teams. This case report, intended to contribute to the literature on informationist programmes, describes the NIH informationist programme, including implementation experiences, the informationists' training programme, their job responsibilities and programme outcomes. The NIH informationist programme was designed to enhance the library's service capacity. Over time, the steps for introducing the service to new groups were formalized to ensure support by leadership, the team being served and the library. Job responsibilities also evolved from traditional library roles to a wide range of knowledge management activities. The commitment by the informationist, the team and the library to continuous learning is critical to the programme's success. RESULTS / OUTCOMES: NIH scientists reported that informationists saved them time and contributed to teamwork with expert searching and point-of-need instruction. Process evaluation helped refine the programme. High-level, preliminary outcomes were identified from a survey of scientists receiving informationist services, along with key informant interviews. Process evaluation examined service implementation, informationists' training and service components. Anecdotal evidence has also indicated a favourable response to the programme.

Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol.

PubMed

McHugh, S; Tracey, M L; Riordan, F; O'Neill, K; Mays, N; Kearney, P M

2016-07-28

Over the last three decades in response to the growing burden of diabetes, countries worldwide have developed national and regional multifaceted programmes to improve the monitoring and management of diabetes and to enhance the coordination of care within and across settings. In Ireland in 2010, against a backdrop of limited dedicated strategic planning and engrained variation in the type and level of diabetes care, a national programme was established to standardise and improve care for people with diabetes in Ireland, known as the National Diabetes Programme (NDP). The NDP comprises a range of organisational and service delivery changes to support evidence-based practices and policies. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended. This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. In stage 1, to identify the official programme theories, documentary analysis and qualitative interviews were conducted with national stakeholders involved in the design, development and management of the programme. In stage 2, as part of a multiple case study design with one case per administrative region in the health system, qualitative interviews are being conducted with frontline staff and service users to explore their responses to, and reasoning about, the programme's resources (mechanisms). Finally, administrative data will be used to examine intermediate implementation outcomes such as service uptake, acceptability, and fidelity to models of care. This evaluation is using the principles of realist evaluation to examine the implementation of a national programme to standardise and improve services for people with diabetes in Ireland. The concurrence of implementation and evaluation has enabled us to produce formative feedback for the NDP while also supporting the refinement and revision of initial theories about how the programme is being implemented in the dynamic and unstable context of the Irish healthcare system.

Multiple and mixed methods in formative evaluation: Is more better? Reflections from a South African study.

PubMed

Odendaal, Willem; Atkins, Salla; Lewin, Simon

2016-12-15

Formative programme evaluations assess intervention implementation processes, and are seen widely as a way of unlocking the 'black box' of any programme in order to explore and understand why a programme functions as it does. However, few critical assessments of the methods used in such evaluations are available, and there are especially few that reflect on how well the evaluation achieved its objectives. This paper describes a formative evaluation of a community-based lay health worker programme for TB and HIV/AIDS clients across three low-income communities in South Africa. It assesses each of the methods used in relation to the evaluation objectives, and offers suggestions on ways of optimising the use of multiple, mixed-methods within formative evaluations of complex health system interventions. The evaluation's qualitative methods comprised interviews, focus groups, observations and diary keeping. Quantitative methods included a time-and-motion study of the lay health workers' scope of practice and a client survey. The authors conceptualised and conducted the evaluation, and through iterative discussions, assessed the methods used and their results. Overall, the evaluation highlighted programme issues and insights beyond the reach of traditional single methods evaluations. The strengths of the multiple, mixed-methods in this evaluation included a detailed description and nuanced understanding of the programme and its implementation, and triangulation of the perspectives and experiences of clients, lay health workers, and programme managers. However, the use of multiple methods needs to be carefully planned and implemented as this approach can overstretch the logistic and analytic resources of an evaluation. For complex interventions, formative evaluation designs including multiple qualitative and quantitative methods hold distinct advantages over single method evaluations. However, their value is not in the number of methods used, but in how each method matches the evaluation questions and the scientific integrity with which the methods are selected and implemented.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

Preventing type 2 diabetes: systematic review of studies of cost-effectiveness of lifestyle programmes and metformin, with and without screening, for pre-diabetes

PubMed Central

Roberts, Samantha; Barry, Eleanor; Craig, Dawn; Airoldi, Mara; Bevan, Gwyn; Greenhalgh, Trisha

2017-01-01

Objective Explore the cost-effectiveness of lifestyle interventions and metformin in reducing subsequent incidence of type 2 diabetes, both alone and in combination with a screening programme to identify high-risk individuals. Design Systematic review of economic evaluations. Data sources and eligibility criteria Database searches (Embase, Medline, PreMedline, NHS EED) and citation tracking identified economic evaluations of lifestyle interventions or metformin alone or in combination with screening programmes in people at high risk of developing diabetes. The International Society for Pharmaco-economics and Outcomes Research’s Questionnaire to Assess Relevance and Credibility of Modelling Studies for Informing Healthcare Decision Making was used to assess study quality. Results 27 studies were included; all had evaluated lifestyle interventions and 12 also evaluated metformin. Primary studies exhibited considerable heterogeneity in definitions of pre-diabetes and intensity and duration of lifestyle programmes. Lifestyle programmes and metformin appeared to be cost effective in preventing diabetes in high-risk individuals (median incremental cost-effectiveness ratios of £7490/quality-adjusted life-year (QALY) and £8428/QALY, respectively) but economic estimates varied widely between studies. Intervention-only programmes were in general more cost effective than programmes that also included a screening component. The longer the period evaluated, the more cost-effective interventions appeared. In the few studies that evaluated other economic considerations, budget impact of prevention programmes was moderate (0.13%–0.2% of total healthcare budget), financial payoffs were delayed (by 9–14 years) and impact on incident cases of diabetes was limited (0.1%–1.6% reduction). There was insufficient evidence to answer the question of (1) whether lifestyle programmes are more cost effective than metformin or (2) whether low-intensity lifestyle interventions are more cost effective than the more intensive lifestyle programmes that were tested in trials. Conclusions The economics of preventing diabetes are complex. There is some evidence that diabetes prevention programmes are cost effective, but the evidence base to date provides few clear answers regarding design of prevention programmes because of differences in denominator populations, definitions, interventions and modelling assumptions. PMID:29146638

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Use of WONCA global standards to evaluate family medicine postgraduate education for curriculum development and review in Nepal and Myanmar.

PubMed

Gibson, Christine; Ladak, Farah; Shrestha, Ashis; Yadav, Bharat; Thu, Kyaw; Aye, Tin

2016-09-01

Family medicine is an integral part of primary care within health systems. Globally, training programmes exhibit a great degree of variability in content and skill acquisition. While this may in part reflect the needs of a given setting, there exists standard criteria that all family medicine programmes should consider core activities. WONCA has provided an open-access list of standards that their expert community considers essential for family medicine (GP) post-graduate training. Evaluation of developing or existing training programmes using these standards can provide insight into the degree of variability, gaps within programmes and equally as important, gaps within recommendations. In collaboration with the host institution, two family medicine programmes in Nepal and Myanmar were evaluated based on WONCA global standards. The results of the evaluation demonstrated that such a process can allow for critical review of curriculum in various stages of development and evaluation. The implications of reviewing training programmes according to WONCA standards can lead to enhanced training world-wide and standardisation of training for post-graduate family medicine.

Programme Recruitment and Evaluation: The Effect of an Employability Enhancement Programme on the General Self-Efficacy Levels of Unemployed Graduates

ERIC Educational Resources Information Center

Hazenberg, R.; Seddon, F.; Denny, S.

2015-01-01

This paper reports research that engaged in the evaluation of an intervention programme designed to enhance the employability of a group of unemployed graduates. The evaluation adopted a quasi-experimental intervention research method employing a general self-efficacy scale, which had been validated in prior research. Results revealed that…

Criteria for evaluating programme theory diagrams in quality improvement initiatives: a structured method for appraisal.

PubMed

Issen, Laurel; Woodcock, Thomas; McNicholas, Christopher; Lennox, Laura; Reed, Julie E

2018-04-09

Despite criticisms that many quality improvement (QI) initiatives fail due to incomplete programme theory, there is no defined way to evaluate how programme theory has been articulated. The objective of this research was to develop, and assess the usability and reliability of scoring criteria to evaluate programme theory diagrams. Criteria development was informed by published literature and QI experts. Inter-rater reliability was tested between two evaluators. About 63 programme theory diagrams (42 driver diagrams and 21 action-effect diagrams) were reviewed to establish whether the criteria could support comparative analysis of different approaches to constructing diagrams. Components of the scoring criteria include: assessment of overall aim, logical overview, clarity of components, cause-effect relationships, evidence and measurement. Independent reviewers had 78% inter-rater reliability. Scoring enabled direct comparison of different approaches to developing programme theory; action-effect diagrams were found to have had a statistically significant but moderate improvement in programme theory quality over driver diagrams; no significant differences were observed based on the setting in which driver diagrams were developed. The scoring criteria summarise the necessary components of programme theory that are thought to contribute to successful QI projects. The viability of the scoring criteria for practical application was demonstrated. Future uses include assessment of individual programme theory diagrams and comparison of different approaches (e.g. methodological, teaching or other QI support) to produce programme theory. The criteria can be used as a tool to guide the production of better programme theory diagrams, and also highlights where additional support for QI teams could be needed.

Application of a responsive evaluation approach in medical education.

PubMed

Curran, Vernon; Christopher, Jeanette; Lemire, Francine; Collins, Alice; Barrett, Brendan

2003-03-01

This paper reports on the usefulness of a responsive evaluation model in evaluating the clinical skills assessment and training (CSAT) programme at the Faculty of Medicine, Memorial University of Newfoundland, Canada. The purpose of this paper is to introduce the responsive evaluation approach, ascertain its utility, feasibility, propriety and accuracy in a medical education context, and discuss its applicability as a model for medical education programme evaluation. Robert Stake's original 12-step responsive evaluation model was modified and reduced to five steps, including: (1) stakeholder audience identification, consultation and issues exploration; (2) stakeholder concerns and issues analysis; (3) identification of evaluative standards and criteria; (4) design and implementation of evaluation methodology; and (5) data analysis and reporting. This modified responsive evaluation process was applied to the CSAT programme and a meta-evaluation was conducted to evaluate the effectiveness of the approach. The responsive evaluation approach was useful in identifying the concerns and issues of programme stakeholders, solidifying the standards and criteria for measuring the success of the CSAT programme, and gathering rich and descriptive evaluative information about educational processes. The evaluation was perceived to be human resource dependent in nature, yet was deemed to have been practical, efficient and effective in uncovering meaningful and useful information for stakeholder decision-making. Responsive evaluation is derived from the naturalistic paradigm and concentrates on examining the educational process rather than predefined outcomes of the process. Responsive evaluation results are perceived as having more relevance to stakeholder concerns and issues, and therefore more likely to be acted upon. Conducting an evaluation that is responsive to the needs of these groups will ensure that evaluative information is meaningful and more likely to be used for programme enhancement and improvement.

Evaluating disease management programme effectiveness: an introduction to the regression discontinuity design.

PubMed

Linden, Ariel; Adams, John L; Roberts, Nancy

2006-04-01

Although disease management (DM) has been in existence for over a decade, there is still much uncertainty as to its effectiveness in improving health status and reducing medical cost. The main reason is that most programme evaluations typically follow weak observational study designs that are subject to bias, most notably selection bias and regression to the mean. The regression discontinuity (RD) design may be the best alternative to randomized studies for evaluating DM programme effectiveness. The most crucial element of the RD design is its use of a 'cut-off' score on a pre-test measure to determine assignment to intervention or control. A valuable feature of this technique is that the pre-test measure does not have to be the same as the outcome measure, thus maximizing the programme's ability to use research-based practice guidelines, survey instruments and other tools to identify those individuals in greatest need of the programme intervention. Similarly, the cut-off score can be based on clinical understanding of the disease process, empirically derived, or resource-based. In the RD design, programme effectiveness is determined by a change in the pre-post relationship at the cut-off point. While the RD design is uniquely suitable for DM programme evaluation, its success will depend, in large part, on fundamental changes being made in the way DM programmes identify and assign individuals to the programme intervention.

Technology-Enhanced Physics Programme for Community-Based Science Learning: Innovative Design and Programme Evaluation in a Theme Park

NASA Astrophysics Data System (ADS)

Tho, Siew Wei; Chan, Ka Wing; Yeung, Yau Yuen

2015-10-01

In this study, a new physics education programme is specifically developed for a famous theme park in Hong Kong to provide community-based science learning to her visitors, involving her three newly constructed rides. We make innovative use of digital technologies in this programme and incorporate a rigorous evaluation of the learning effectiveness of the programme. A total of around 200 students from nine local secondary schools participated in both the physics programme and its subsequent evaluation which consists of a combination of research and assessment tools, including pre- and post-multiple-choice tests, a questionnaire survey and an interview as specifically developed for this programme, or adopted from some well-accepted research instruments. Based on the evaluation of students' academic performance, there are two educationally significant findings on enhancing the students' physics learning: (a) traditionally large gender differences in physics performance and interest of learning are mostly eliminated; and (b) a less-exciting ride called the aviator (instead of the most exciting roller-coaster ride) can induce the largest learning effect (or gain in academic performance) amongst teenagers. Besides, findings from the questionnaire survey and interviews of participants are reported to reveal their views, perceptions, positive and negative comments or feedback on this programme which could provide valuable insights for future development of other similar community-based programmes.

Process evaluation of a walking programme delivered through the workplace in the South Pacific island Vanuatu.

PubMed

Siefken, Katja; Schofield, Grant; Schulenkorf, Nico

2015-06-01

The South Pacific region is experiencing significant rates of chronic diseases. Well-evaluated health promotion programmes are needed as a central piece of a strategic solution. Just as important as the evaluation itself is how that evaluation outcome can be communicated for future programme use by local programme planners. The objective of this study is to evaluate a physical activity (PA) programme that was designed for Pacific women in urban Vanuatu, and subsequently to develop new techniques to display data that support the understanding and communication of programme success and challenges. Data collection methods included quantitative Likert scale questions and qualitative open-ended questions. A new analysis technique visualises open-ended process evaluation data. We present themes using word sizes proportional to the frequency of the themes identified through thematic analysis. The Likert scale technique revealed little meaningful information; almost all participants rated most elements of the programme highly. This may be related to Pacific people being frequently inclined to assent with external ideas. Open-ended questions provided more significant insights. For example, we found a stronger change in eating habits (68.9%) than in exercise behaviour (28.2%). We present an evaluation of the first pedometer-based PA intervention in the Pacific and respond to the paucity of process evaluations that have been carried out in the context of low- and middle-income countries. Moreover, the new thematic data visualisation (TDV) approach may aid in understanding complex and cluttered data in a constructive and coordinated way; we present a new approach in health promotion research. © The Author(s) 2014.

An evaluation of the HM prison service "thinking skills programme" using psychometric assessments.

PubMed

Gobbett, Matthew J; Sellen, Joselyn L

2014-04-01

The most widely implemented offending behaviour programme in the United Kingdom was Enhanced Thinking Skills (ETS), a cognitive-behavioural group intervention that aimed to develop participant's general cognitive skills. A new offending behaviour programme has been developed to replace ETS: the Thinking Skills Programme (TSP). This study reports an evaluation of the effectiveness of TSP using psychometric assessments. Phasing of the two programmes created an opportunity to compare the two programmes consecutively. Forty participants, 20 from each programme, completed a range of psychometric measures to examine cognition, attitudes, and thinking styles. Analysis of pre- and post-programme psychometric results indicated that participants of TSP demonstrated improvements on 14 of the 15 scales, 9 of which were statistically significant. Effect sizes between pre-post results were generally greater for TSP than ETS, demonstrating that TSP had a more positive impact on the thinking styles and attitudes of participants than the ETS programme.

Process evaluation improves delivery of a nutrition-sensitive agriculture programme in Burkina Faso.

PubMed

Nielsen, Jennifer N; Olney, Deanna K; Ouedraogo, Marcellin; Pedehombga, Abdoulaye; Rouamba, Hippolyte; Yago-Wienne, Fanny

2017-12-26

Evidence is emerging from rigorous evaluations about the effectiveness of nutrition-sensitive agriculture programmes in improving nutritional outcomes. Additional evidence can elucidate how different programme components and pathways contribute and can be optimized for impact. The International Food Policy Research Institute, with Helen Keller International, designed a comprehensive framework to evaluate the delivery, utilization, and impact of Helen Keller International's enhanced homestead food production programme in Burkina Faso. After 18 months of implementation, a process evaluation was conducted to examine programme impact pathways, using key informant and semistructured interviews with implementing agents and beneficiaries, and with residents of control communities. Data were analyzed by International Food Policy Research Institute and reviewed with project managers and partners through multiple workshops to identify opportunities to strengthen implementation. Findings illuminated gaps between intended and actual delivery schemes, including input constraints, knowledge gaps among community agents in agriculture and young child nutrition practices, and lower than expected activity by community volunteers. In response, staff developed measures to overcome water constraints and expand vegetable and poultry production, retrained volunteers in certain techniques of food production and counselling for nutrition behaviour change, added small incentives to motivate volunteers, and shaped both immediate and long-term changes to the programme model. Working closely with International Food Policy Research Institute on the evaluation activities also expanded the repertoire of research methods and skills of Helen Keller International staff. Process evaluation can strengthen programme delivery, utilization, and design. Collaboration between researchers and implementers can improve programme effectiveness, project staff capacity, and advance delivery science. © 2017 John Wiley & Sons Ltd.

Feasibility of the Participatory Experience Survey and the Setting Affordances Survey for use in evaluation of programmes serving youth with intellectual and developmental disabilities.

PubMed

Liljenquist, K; Coster, W; Kramer, J; Rossetti, Z

2017-07-01

Participation by youth with disabilities in recreational activities has been shown to promote the development of important skills needed for transition to adulthood. The Participatory Experience Survey (PES) and the Setting Affordances Survey (SAS) were developed for use by recreational programmes serving youth with significant intellectual and developmental disabilities (SIDD) to assess participant experiences and ensure that participants are afforded optimal opportunities to develop these skills. This paper presents a feasibility evaluation to determine the appropriateness of the PES and the SAS for use in a programme evaluation context. The PES and the SAS were used to evaluate a programme serving youth with SIDD in the greater northwest region of the United States. Three recreational activities were evaluated: an art project, trip to a zoo and a track practice. Programme volunteers used the SAS to assess opportunities and affordances offered within each activity. The PES was then given to 10 young people in each activity to capture their experiences. It was hypothesized that each setting would afford different experiences and developmental opportunities because of the differing nature of the activities. The PES and SAS were found to be feasible for conducting a programme evaluation. All three settings offered varying types of experiences and affordances. Notably, as measured by the SAS, opportunity for skill development was greater in more structured activities; the zoo had the fewest opportunities for skill development and the art project had the most skill development opportunities. Youth answered 'no' most often to 'asking for help' and 'helping a kid', suggesting changes to offer more opportunities to develop these skills would be beneficial in all three activities. These new instruments offer programmes a means to more fully include young people with disabilities during programme evaluations, leading to better-structured, more supportive programmes. © 2016 John Wiley & Sons Ltd.

Developing a Mind-Body Exercise Programme for Stressed Children

ERIC Educational Resources Information Center

Wang, Claudia; Seo, Dong-Chul; Geib, Roy W

2017-01-01

Objective: To describe the process of developing a Health Qigong programme for stressed children using a formative evaluation approach. Methods: A multi-step formative evaluation method was utilised. These steps included (1) identifying programme content and drafting the curriculum, (2) synthesising effective and age-appropriate pedagogies, (3)…

Evaluating a Special Education Training Programme in Nicaragua

ERIC Educational Resources Information Center

Delkamiller, Julie; Swain, Kristine D.; Ritzman, Mitzi J.; Leader-Janssen, Elizabeth M.

2016-01-01

This study examined a two-year special education and inclusive practices in-service training programme with a university in Nicaragua. Participants included 14 teachers from nine schools in Nicaragua. Participants' knowledge of special education concepts were evaluated as part of assessing the training modules. In addition, programme evaluation…

Using Programmable Calculators to Evaluate Complicated Formulas.

ERIC Educational Resources Information Center

Snover, Stephen L.; Spikell, Mark A.

The application of the programmable calculator to evaluating complicated formulas is illustrated by considering the formula for finding the area of any triangle when only the lengths of the three sides are known. Other advantages of the programmable calculator are discussed such as freeing the student to explore more challenging problems and…

Improving Children's Problem Eating and Mealtime Behaviours: An Evaluative Study of a Single Session Parent Education Programme

ERIC Educational Resources Information Center

Fraser, Kim; Wallis, Marianne; St. John, Winsome

2004-01-01

Objective: To evaluate the effectiveness of a "single session" group, early intervention, multidisciplinary, education programme (entitled the "Fun not Fuss with Food" group programme) designed to improve children's problem eating and mealtime behaviours. Design: A quasi-experimental time-series design incorporating data…

Does the EUA Institutional Evaluation Programme Contribute to Quality Improvement?

ERIC Educational Resources Information Center

Tavares, Diana Amado; Rosa, Maria Joao; Amaral, Alberto

2010-01-01

Purpose: This paper aims to reflect on the relevance of the Institutional Evaluation Programme (IEP) of the European University Association (EUA) to universities' quality improvement. It aims to analyse IEP follow-up reports to determine whether the programme contributes to the development of a quality improvement culture.…

Talk for Literacy: Evaluation Report and Executive Summary

ERIC Educational Resources Information Center

Styles, Ben; Bradshaw, Sally

2015-01-01

This NFER report has been produced for the Education Endowment Foundation and its evaluation of a speaking and listening intervention combining two programmes: the Vocabulary Enrichment Intervention Programme (VEIP) and the narrative Intervention Programme (NIP). The intervention was used with pupils who needed extra support to improve their…

The National Institute for Health Research Leadership Programme

PubMed Central

Jones, Molly Morgan; Wamae, Watu; Fry, Caroline Viola; Kennie, Tom; Chataway, Joanna

2012-01-01

Abstract RAND Europe evaluated the National Institute for Health Research (NIHR) Leadership Programme in an effort to help the English Department of Health consider the extent to which the programme has helped to foster NIHR's aims, extract lessons for the future, and develop plans for the next phase of the leadership programme. Successful delivery of high-quality health research requires not only an effective research base, but also a system of leadership supporting it. However, research leaders are not often given the opportunity, nor do they have the time, to attend formal leadership or management training programmes. This is unfortunate because research has shown that leadership training can have a hugely beneficial effect on an organisation. Therefore, the evaluation has a particular interest in understanding the role of the programme as a science policy intervention and will use its expertise in science policy analysis to consider this element alongside other, more traditional, measures of evaluation. PMID:28083231

Evaluation of RugbySmart: a rugby union community injury prevention programme.

PubMed

Gianotti, Simon M; Quarrie, Ken L; Hume, Patria A

2009-05-01

RugbySmart, a rugby union injury prevention programme, was launched in New Zealand in 2001. It was compulsory for all coaches and referees to complete RugbySmart requirements annually in order to continue coaching or refereeing. After 5 years of implementation the programme partners, Accident Compensation Corporation and New Zealand Rugby Union, evaluated RugbySmart to determine its effectiveness in reducing injuries. The purpose was to evaluate the effect of RugbySmart on reducing injury rates per 100,000 players and resulting injury prevention behaviours. The RugbySmart programme was associated with a decrease in injury claims per 100,000 players in most areas the programme targeted; the programme had negligible impact on non-targeted injury sites. The decrease in injury claims numbers was supported by results from the player behaviour surveys pre- and post-RugbySmart. There was an increase in safe behaviour in the contact situations of tackle, scrum and ruck technique.

Undergraduate medical education programme renewal: a longitudinal context, input, process and product evaluation study.

PubMed

Mirzazadeh, Azim; Gandomkar, Roghayeh; Hejri, Sara Mortaz; Hassanzadeh, Gholamreza; Koochak, Hamid Emadi; Golestani, Abolfazl; Jafarian, Ali; Jalili, Mohammad; Nayeri, Fatemeh; Saleh, Narges; Shahi, Farhad; Razavi, Seyed Hasan Emami

2016-02-01

The purpose of this study was to utilize the Context, Input, Process and Product (CIPP) evaluation model as a comprehensive framework to guide initiating, planning, implementing and evaluating a revised undergraduate medical education programme. The eight-year longitudinal evaluation study consisted of four phases compatible with the four components of the CIPP model. In the first phase, we explored the strengths and weaknesses of the traditional programme as well as contextual needs, assets, and resources. For the second phase, we proposed a model for the programme considering contextual features. During the process phase, we provided formative information for revisions and adjustments. Finally, in the fourth phase, we evaluated the outcomes of the new undergraduate medical education programme in the basic sciences phase. Information was collected from different sources such as medical students, faculty members, administrators, and graduates, using various qualitative and quantitative methods including focus groups, questionnaires, and performance measures. The CIPP model has the potential to guide policy makers to systematically collect evaluation data and to manage stakeholders' reactions at each stage of the reform in order to make informed decisions. However, the model may result in evaluation burden and fail to address some unplanned evaluation questions.

Evaluating stakeholder participation in water management: intermediary outcomes as potential indicators for future resource management outcomes

NASA Astrophysics Data System (ADS)

Carr, Gemma; Bloeschl, Guenter; Loucks, Daniel Pete

2013-04-01

Evaluation of participation programmes, projects and activities is essential to identify whether stakeholder involvement has been successful in achieving its aims. Aims may include an improvement in water resource management such as enhanced ecological functioning, an improvement in human wellbeing and economic conditions, or overcoming a conflict between interest groups. Evaluating against "interest-based" resource management criteria requires that a desirable outcome can be identified, agreed upon and be measured at the time of evaluation. In many water management situations where collaborative approaches are applied, multiple interests and objectives are present, or stakeholders have not yet identified their own positions and priorities. Even if a resource management objective has been identified and strategy agreed upon, resource management changes tend to emerge over longer timescales and evaluation frequently takes place before they can be recognised. Evaluating against resource management criteria may lead evaluators to conclude that a programme has failed because it has not achieved a resource management objective at the time of evaluation. This presents a critical challenge to researchers assessing the effectiveness of stakeholder participation programmes. One strategy to overcome this is to conduct "goal-free" evaluation to identify what the programme is actually achieving. An evaluation framework that includes intermediary outcomes that are both tangible achievements such as innovation, creation of new organisations, and shared information and knowledge, as well as intangible achievements such as trust and network development can be applied to more broadly assess a programme's success. Analysis of case-studies in the published literature for which a resource management outcome has been achieved shows that intermediary outcomes frequently precede resource management outcomes. They seem to emerge over shorter timescales than resource management outcomes. Furthermore, failure to achieve intermediary outcomes correlates to failure to achieve resource management outcomes. Evaluating intermediary outcomes leads to both a broader assessment of a programme's achievements at the time of evaluation, and can indicate whether a programme will go on to achieve resource management objectives in the future.

Poverty alleviation programmes in India: a social audit.

PubMed

K Yesudian, C A

2007-10-01

The review highlights the poverty alleviation programmes of the government in the post-economic reform era to evaluate the contribution of these programmes towards reducing poverty in the country. The poverty alleviation programmes are classified into (i) self-employment programmes; (ii) wage employment programmes; (iii) food security programmes; (iv) social security programmes; and (v) urban poverty alleviation programmes. The parameter used for evaluation included utilization of allocated funds, change in poverty level, employment generation and number or proportion of beneficiaries. The paper attempts to go beyond the economic benefit of the programmes and analyzes the social impact of these programmes on the communities where the poor live, and concludes that too much of government involvement is actually an impediment. On the other hand, involvement of the community, especially the poor has led to better achievement of the goals of the programmes. Such endeavours not only reduced poverty but also empowered the poor to find their own solutions to their economic problems. There is a need for decentralization of the programmes by strengthening the panchayat raj institutions as poverty is not merely economic deprivation but also social marginalization that affects the poor most.

What Counts is not Falling … but Landing1

PubMed Central

BROUSSELLE, ASTRID

2012-01-01

Implementation evaluations, also called process evaluations, involve studying the development of programmes, and identifying and understanding their strengths and weaknesses. Undertaking an implementation evaluation offers insights into evaluation objectives, but does not help the researcher develop a research strategy. During the implementation analysis of the UNAIDS drug access initiative in Chile, the strategic analysis model developed by Crozier and Friedberg was used. However, a major incompatibility was noted between the procedure put forward by Crozier and Friedberg and the specific characteristics of the programme being evaluated. In this article, an adapted strategic analysis model for programme evaluation is proposed. PMID:23526306

Estimating costs of quality improvement for outpatient healthcare organisations: a practical methodology.

PubMed

Brown, Sydney E S; Chin, Marshall H; Huang, Elbert S

2007-08-01

Outpatient healthcare organisations worldwide participate in quality improvement (QI) programmes. Despite the importance of understanding the financial impact of such programmes, there are no established standard methods for empirically assessing QI programme costs and their consequences for small outpatient healthcare organisations. The costs and cost consequences were evaluated for a diabetes QI programme implemented throughout the USA in federally qualified community health centres. For five case study centres, survey instruments and methods for data analysis were developed. Two types of cost/revenue were evaluated. Direct costs/revenues, such as personnel time, items purchased and grants received, were evaluated using self-administered surveys. Cost/revenue consequences, which were cost/revenue changes that may have occurred due to changes in patient utilisation or physician behaviour, were evaluated using electronic billing data. Other methods for evaluating cost/revenue consequences if electronic billing data are not available are also discussed. This paper describes a practical taxonomy and method for assessing the costs and revenues of QI programmes for outpatient organisations. Results of such analyses will be useful for healthcare organisations implementing QI programmes and also for policy makers designing incentives for QI participation.

The Value of Fidelity of Implementation Criteria to Evaluate School-Based Science Curriculum Innovations

NASA Astrophysics Data System (ADS)

Lee, Yew-Jin; Chue, Shien

2013-10-01

School-based curriculum innovations, including those in science education, are usually not adequately evaluated, if at all. Furthermore, current procedures and instruments for programme evaluations are often unable to support evidence-based decision-making. We suggest that adopting fidelity of implementation (FOI) criteria from healthcare research can both characterize and narrow the separation between programme intent and actual implementation, which is a mandatory stage of evaluation before determining overall programme value. We demonstrate how such a process could be applied by science educators using data from a secondary school in Singapore that had devised a new curriculum to promote interest, investigative processes, and knowledge in science. Results showed that there were ambivalent student responses to this programme, while there were high levels of science process skill instruction and close alignment with the intended lesson design. The implementation of this programme appeared to have a satisfactory overall level of FOI, but we also detected tensions between programme intent and everyday classroom teaching. If we want to advance science education, then our argument is that applying FOI criteria is necessary when evaluating all curricular innovations, not just those that originate from schools.

Adaptation, Evaluation and Inclusion

ERIC Educational Resources Information Center

Basson, R.

2011-01-01

In this article I reflect on a recent development currently shaping programme evaluation as field, which makes the case for evaluators facilitating evaluation training evaluees to self-evaluate and improve the programmes they teach. Fetterman argues persuasively that the practice was incipient in the field and required formalization and acceptance…

What Counts is not Falling … but Landing: Strategic Analysis: An Adapted Model for Implementation Evaluation.

PubMed

Brousselle, Astrid

2004-04-01

Implementation evaluations, also called process evaluations, involve studying the development of programmes, and identifying and understanding their strengths and weaknesses. Undertaking an implementation evaluation offers insights into evaluation objectives, but does not help the researcher develop a research strategy. During the implementation analysis of the UNAIDS drug access initiative in Chile, the strategic analysis model developed by Crozier and Friedberg was used. However, a major incompatibility was noted between the procedure put forward by Crozier and Friedberg and the specific characteristics of the programme being evaluated. In this article, an adapted strategic analysis model for programme evaluation is proposed.

International Evaluation Studies of Second Step, a Primary Prevention Programme: A Review

ERIC Educational Resources Information Center

Schick, Andreas; Cierpka, Manfred

2013-01-01

Second Step is a social-emotional, skill-based, violence-prevention programme, which has been adapted for several European countries. The various versions of the programme (for kindergarten/preschool, elementary school, middle school) have been evaluated in a series of research studies. The outcomes and study designs of these studies are reported…

Peer Sexual Health Education: Interventions for Effective Programme Evaluation

ERIC Educational Resources Information Center

Sriranganathan, Gobika; Jaworsky, Denise; Larkin, June; Flicker, Sarah; Campbell, Lisa; Flynn, Susan; Janssen, Jesse; Erlich, Leah

2012-01-01

Peer education is used as a health promotion strategy in a number of areas, including sexual health. Although peer education programmes have been around for some time, published systematic evaluations of youth sexual health peer education programmes are rare. This article discusses the advantages and disadvantages of youth sexual health peer…

Involving Stakeholders in Programme Theory Specification: Discussion of a Systematic, Consensus-Based Approach

ERIC Educational Resources Information Center

van Urk, Felix; Grant, Sean; Bonell, Chris

2016-01-01

The use of explicit programme theory to guide evaluation is widely recommended. However, practitioners and other partnering stakeholders often initiate programmes based on implicit theories, leaving researchers to explicate them before commencing evaluation. The current study aimed to apply a systematic method to undertake this process. We…

Brief Report: An Evaluation of an Australian Autism-Specific, Early Intervention Programme

ERIC Educational Resources Information Center

Paynter, Jessica M.; Riley, Emma P.; Beamish, Wendi; Scott, James G.; Heussler, Helen S.

2015-01-01

There is a relative paucity of evidence examining the effectiveness of early intervention for young children with Autism Spectrum Disorder, in particular those delivered through educationally-based programmes. This study aimed to evaluate the real world effectiveness of a community-based autism-specific early learning and intervention programme in…

Designing and Evaluating a Professional Development Programme for Basic Technology Integration in English as a Foreign Language (EFL) Classrooms

ERIC Educational Resources Information Center

Ansyari, Muhammad Fauzan

2015-01-01

This study aims to develop and evaluate a professional development programme for technology integration in an Indonesian university's English language teaching setting. The study explored the characteristics of this programme to English lecturers' technological pedagogical content knowledge (TPCK) development. This design-based research employed…

Evaluation of Eco Schools Scotland. SCRE Research Report No. 124

ERIC Educational Resources Information Center

Pirrie, Anne; Elliot, Dely; McConnell, Fraser; Wilkinson, J. Eric

2006-01-01

In October 2005, Keep Scotland Beautiful commissioned the SCRE Centre at the University of Glasgow to undertake an evaluation of the Eco Schools Programme in Scotland. Eco Schools is a programme for environmental management, certification and sustainable development education. It is an international programme that was developed in 1994 in response…

Assessing the role of prevention partnerships in STD prevention: a review of comprehensive STD prevention systems progress reports.

PubMed

Hogben, Matthew; Hood, Julia; Collins, Dayne; McFarlane, Mary

2013-11-01

Systematic analysis of STD programme data contributes to a national portrait of sexually transmitted disease (STD) prevention activities, including research and evaluation specifically designed to optimise programme efficiency and impact. We analysed the narrative of the 2009 annual progress reports of the US Comprehensive STD Prevention Systems cooperative agreement for 58 STD programmes, concentrating on programme characteristics and partnerships. Programmes described 516 unique partnerships with a median of seven organisations cited per STD programme. Non-profit organisations (including service providers) were most frequently cited. Higher gonorrhoea morbidity was associated with reporting more partnerships; budget problems were associated with reporting fewer. Challenges to engaging in partnerships included budget constraints, staff turnover and low interest. Data provide a source of information for judging progress in programme collaboration and for informing a sustained programme-focused research and evaluation agenda.

Veggie Rx: an outcome evaluation of a healthy food incentive programme.

PubMed

Cavanagh, Michelle; Jurkowski, Janine; Bozlak, Christine; Hastings, Julia; Klein, Amy

2017-10-01

One challenge to healthy nutrition, especially among low-income individuals, is access to and consumption of fresh fruits and vegetables. To address this problem, Veggie Rx, a healthy food incentive programme, was established within a community clinic to increase access to fresh produce for low-income patients diagnosed with obesity, hypertension and/or type 2 diabetes. The current research aimed to evaluate Veggie Rx programme effectiveness. A retrospective pre/post design using medical records and programme data was used to evaluate the programme. The study was approved by the University of Albany Institutional Review Board and the Patient Interest Committee of a community clinic. The study was conducted in a low-income, urban neighbourhood in upstate New York. Medical record data and Veggie Rx programme data were analysed for fifty-four eligible participants. An equal-sized control group of patients who were not programme participants were matched on age, ethnicity and co-morbidity status. A statistically significant difference in mean BMI change (P=0·02) between the intervention and the control group was calculated. The intervention group had a mean decrease in BMI of 0·74 kg/m2. Greater improvement in BMI was found among Veggie Rx programme participants. This information will guide programme changes and inform the field on the effectiveness of healthy food incentive programmes for improving health outcomes for low-income populations.

Veggie Rx: an outcome evaluation of a healthy food incentive programme

PubMed Central

Cavanagh, Michelle; Jurkowski, Janine; Bozlak, Christine; Hastings, Julia; Klein, Amy

2017-01-01

Objective One challenge to healthy nutrition, especially among low-income individuals, is access to and consumption of fresh fruits and vegetables. To address this problem, Veggie Rx, a healthy food incentive programme, was established within a community clinic to increase access to fresh produce for low-income patients diagnosed with obesity, hypertension and/or type 2 diabetes. The current research aimed to evaluate Veggie Rx programme effectiveness. Design A retrospective pre/post design using medical records and programme data was used to evaluate the programme. The study was approved by the University of Albany Institutional Review Board and the Patient Interest Committee of a community clinic. Setting The study was conducted in a low-income, urban neighbourhood in upstate New York. Subjects Medical record data and Veggie Rx programme data were analysed for fifty-four eligible participants. An equal-sized control group of patients who were not programme participants were matched on age, ethnicity and co-morbidity status. Results: A statistically significant difference in mean BMI change (P = 0.02) between the intervention and the control group was calculated. The intervention group had a mean decrease in BMI of 0.74 kg/m2. Conclusions Greater improvement in BMI was found among Veggie Rx programme participants. This information will guide programme changes and inform the field on the effectiveness of healthy food incentive programmes for improving health outcomes for low-income populations. PMID:27539192

Unintended outcomes evaluation approach: A plausible way to evaluate unintended outcomes of social development programmes.

PubMed

Jabeen, Sumera

2018-06-01

Social development programmes are deliberate attempts to bring about change and unintended outcomes can be considered as inherent to any such intervention. There is now a solid consensus among the international evaluation community regarding the need to consider unintended outcomes as a key aspect in any evaluative study. However, this concern often equates to nothing more than false piety. Exiting evaluation theory suffers from overlap of terminology, inadequate categorisation of unintended outcomes and lack of guidance on how to study them. To advance the knowledge of evaluation theory, methods and practice, the author has developed an evaluation approach to study unintended effects using a theory building, testing and refinement process. A comprehensive classification of unintended outcomes on the basis of knowability, value, distribution and temporality helped specify various type of unintended outcomes for programme evaluation. Corresponding to this classification, a three-step evaluation process was proposed including a) outlining programme intentions b) forecasting likely unintended effects c) mapping the anticipated and understanding unanticipated unintended outcomes. This unintended outcomes evaluation approach (UOEA) was then trialled by undertaking a multi-site and multi-method case study of a poverty alleviation programme in Pakistan and refinements were made to the approach.The case study revealed that this programme was producing a number of unintended effects, mostly negative, affecting those already disadvantaged such as the poorest, women and children. The trialling process demonstrated the effectiveness of the UOEA and suggests that this can serve as a useful guide for future evaluation practice. It also provides the discipline of evaluation with an empirically-based reference point for further theoretical developments in the study of unintended outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Large-scale road safety programmes in low- and middle-income countries: an opportunity to generate evidence.

PubMed

Hyder, Adnan A; Allen, Katharine A; Peters, David H; Chandran, Aruna; Bishai, David

2013-01-01

The growing burden of road traffic injuries, which kill over 1.2 million people yearly, falls mostly on low- and middle-income countries (LMICs). Despite this, evidence generation on the effectiveness of road safety interventions in LMIC settings remains scarce. This paper explores a scientific approach for evaluating road safety programmes in LMICs and introduces such a road safety multi-country initiative, the Road Safety in 10 Countries Project (RS-10). By building on existing evaluation frameworks, we develop a scientific approach for evaluating large-scale road safety programmes in LMIC settings. This also draws on '13 lessons' of large-scale programme evaluation: defining the evaluation scope; selecting study sites; maintaining objectivity; developing an impact model; utilising multiple data sources; using multiple analytic techniques; maximising external validity; ensuring an appropriate time frame; the importance of flexibility and a stepwise approach; continuous monitoring; providing feedback to implementers, policy-makers; promoting the uptake of evaluation results; and understanding evaluation costs. The use of relatively new approaches for evaluation of real-world programmes allows for the production of relevant knowledge. The RS-10 project affords an important opportunity to scientifically test these approaches for a real-world, large-scale road safety evaluation and generate new knowledge for the field of road safety.

Professional Development Programmes for Teachers in the Northern Territory of Australia: Enablers and Inhibiters for Success in Two Aspirant Leadership Programmes

ERIC Educational Resources Information Center

Speering, Glen

2016-01-01

Professional development programmes for teachers have become an increasing focus in the quest to improve teacher quality. In regional and remote areas of Australia the delivery of professional development programmes can become problematic. This study compares and contrasts the two separate professional development programmes evaluated (Programme A…

Evaluation of a group based cognitive behavioural therapy programme for menstrual pain management in young women with intellectual disabilities: protocol for a mixed methods controlled clinical trial

PubMed Central

2014-01-01

Background Menstrual pain which is severe enough to impact on daily activities is very common amongst menstruating females. Research suggests that menstrual pain which impacts on daily functioning may be even more prevalent amongst those with intellectual disabilities. Despite this, little research attention has focused on pain management programmes for those with intellectual disabilities. The aims of this pilot study were to develop and evaluate a theory-based cognitive behavioural therapy (CBT) programme for menstrual pain management in young women with intellectual disabilities. Methods/Design The study utilised a mixed methods controlled clinical trial to evaluate elements from a CBT programme called Feeling Better (McGuire & McManus, 2010). The Feeling Better programme is a modular, manualised intervention designed for people with an intellectual disability and their carers. The programme was delivered to 36 young women aged 12 – 30 years who have a Mild - Moderate Intellectual Disability, split between two conditions. The treatment group received the Feeling Better intervention and the control group received treatment as usual. To evaluate the effectiveness of the programme, measures were taken of key pain variables including impact, knowledge, self-efficacy and coping. Process evaluation was conducted to examine which elements of the programme were most successful in promoting change. Discussion Participants in the intervention group were expected to report the use of a greater number of coping strategies and have greater knowledge of pain management strategies following participation in the intervention and at three month follow-up, when compared to control group participants. A significant advantage of the study was the use of mixed methods and inclusion of process evaluation to determine which elements of a cognitive behavioural therapy programme work best for individuals with intellectual disabilities. Trial registration Current Controlled Trials ISRCTN75567759 PMID:25201648

A process evaluation of the 'Aware' and 'Supportive Communities' gambling harm-minimisation programmes in New Zealand.

PubMed

Kolandai-Matchett, Komathi; Bellringer, Maria; Landon, Jason; Abbott, Max

2018-04-01

The Gambling Act 2003 mandated a public health strategy for preventing and minimising gambling harm in New Zealand. Aware Communities and Supportive Communities are two public health programmes subsequently implemented nationwide. These programmes differed from common health promotion initiatives such as media or education campaigns as they were community-action based (requiring community involvement in programme planning and delivery). We carried out a process evaluation to determine their implementation effectiveness and inform improvement and future programme planning. Our qualitative dominant mixed methods design comprised analysis of over a hundred implementer progress reports (submitted July 2010 - June 2013), a staff survey and a staff focus group interview. The programmes demonstrated capacity to not only achieve expected outcomes (e.g. enhanced community awareness about harmful gambling), but also to enhance social sustainability at the community level (e.g. established trustful relationships) and achieve some programme sustainability (e.g. community ownership over ongoing programme delivery). The evaluation noted the potential for a sustainable gambling harm-minimisation model. Community-action based harm-minimisation programmes offer programme sustainability potential which in turn offers funding cost-effectiveness when there are continual public health outcomes beyond initial funding. Although resource intensive, the community-action based approach enables culturally appropriate public health programmes suitable for societies where specific ethnic groups have higher gambling risk. Recognition of such harm-minimisation programmes' contribution to social sustainability is important considering the potential for broader public health outcomes (e.g. better life quality, lesser social problems) within socially sustainable societies.

Anaemia control: lessons from the flour fortification programme.

PubMed

Sadighi, J; Mohammad, K; Sheikholeslam, R; Amirkhani, M A; Torabi, P; Salehi, F; Abdolahi, Z

2009-12-01

Anaemia is an important public health problem in Iran; therefore, a programme of flour fortification with iron was launched in two pilot provinces. The present study was conducted in January 2009 to evaluate the effectiveness and process of this programme. A 'before-and-after study' was conducted to evaluate the effectiveness of the flour fortification programme, and the process of the programme was evaluated using a cross-sectional study. To evaluate the effectiveness of the programme, blood haemoglobin and ferritin levels were measured in sample populations from Bushehr and Golestan provinces. The target population was women aged 15-49 years. Iron content was measured in samples of flour and bread to evaluate the flour fortification process in these two national pilot provinces. The total study population was 600 women from Bushehr province and 652 women from Golestan province. Similar trends were found in the indicators of anaemia/iron deficiency among the women studied in both provinces. The flour fortification programme only appears to have had a beneficial effect on ferritin levels (iron deficiency) in the two provinces. The prevalence of iron-deficiency anaemia before and after the intervention did not differ significantly in either province. Interestingly, the prevalence of anaemia (low haemoglobin) was significantly higher after the intervention in women from both provinces. The coverage of fortified flour and bread was 90% and 98.7% in Bushehr province, and 94.1% and 95% in Golestan province, respectively. In areas where anaemia is not mainly due to iron deficiency, an iron fortification programme might decrease the prevalence of iron deficiency without affecting the prevalence of anaemia.

A practical framework for evaluating a culturally tailored adolescent substance abuse treatment programme in Molokai, Hawaii.

PubMed

Withy, Kelley M; Lee, Wayde; Renger, Ralph F

2007-11-01

Successful substance abuse treatment requires many changes in behavior, attitude and skills. Culturally tailored approaches to substance abuse treatment have shown initial success, but are not yet accepted as best practice models. In order to document programme effectiveness of a new culturally tailored substance abuse treatment programme on the rural island of Molokai, Hawaii, the authors worked to develop a multi-level evaluation plan to measure behavior changes occurring after participation in activities targeting identified causes of substance abuse in the population of interest. The authors compiled interview results to develop a map of identified causes of substance abuse in the community studied. Strategic planning then identified the specific activities aimed at impacting identified root causes. A literature review was performed to document the effectiveness of such activities. An evaluation plan was developed to measure programme impact on antecedent conditions contributing to substance use in this community. Prioritized causes of substance abuse in the target group included low self esteem, lack of self identity and life plan, and limited communication and conflict resolution skills. Activities targeting these conditions included cultural activities, group counseling, and individual counseling. Literature to support the benefit of addressing these factors was uncovered, and evaluation methodology was developed to measure changes in behaviors, attitudes, and practices, as a measure of programme success. While programme evaluation data is still being collected, the authors have demonstrated a sound foundation for programme activities, and designed methodology for collecting meaningful data to measure programme effectiveness at changing important root causes of substance abuse in a rural Native Hawaiian community.

Evaluation of a tele-education programme in Brazil.

PubMed

Joshi, Ashish; Novaes, Magdala A; Iyengar, Sriram; Machiavelli, Josiane L; Zhang, Jiajie; Vogler, Robert; Hsu, Chiehwen E

2011-01-01

We evaluated a tele-education programme for primary care staff in Pernambuco State, Brazil. During 2008 and 2009, tele-education sessions occurred four times each week for one hour per day. The topics included public health, child and adolescent health, mental health and nursing. After each session, participants completed an evaluation questionnaire. A total of 73 municipalities and 141 health centres participated in the programme. There were 254 tele-education sessions scheduled during the 20-month study period; of these, 224 sessions were successfully performed and 30 were cancelled. We collected 3504 responses from the satisfaction survey. There was high acceptance of the programme: 97% rated it as excellent or good.

An extensive literature review of the evaluation of HIV prevention programmes.

PubMed

Coleman, L M; Ford, N J

1996-09-01

This paper draws out and distils three key themes that have emerged from a substantial bibliographical review of a range of HIV intervention programmes, implemented throughout the world between years 1987 and 1995. Specifically, the paper assesses (1) to what extent intervention programmes have been tailored to meet the requirements and needs of specific target groups; (2) to what extent intervention programmes are supported by social and psychological theory of attitudinal and behavioural change, and also to what extent the results and findings from the interventions have amended existing theory; and, finally, (3) the range of methodologies employed in evaluating intervention programmes and also to what extent behavioural measures have been used in examining a programme's effectiveness. In light of these themes, the paper presents and discusses the principal factors thought to contribute towards the effectiveness of HIV intervention programmes.

Involving the Hard to Reach: Developing and Evaluating a Sexual Health Programme for Early School Leavers in Hong Kong

ERIC Educational Resources Information Center

Wong, William C. W.; Holroyd, Eleanor A.; Lee, Albert; Wong, Jonathan C. P.; Leung, Phil W. S.

2011-01-01

Early school leavers cannot access school-based sex education programmes, increasing their vulnerability to sexual health issues. This study evaluated a culturally-sensitive and target-orientated sex education programme involving this group. Early school leavers were recruited from two branches of the Chinese Young Men's Christian Association in…

Evaluating the Impact of an Environmental Education Programme: An Empirical Study in Mexico

ERIC Educational Resources Information Center

Ruiz-Mallen, Isabel; Barraza, Laura; Bodenhorn, Barbara; Reyes-Garcia, Victoria

2009-01-01

This study draws on information from 11 in-depth interviews, two focus groups and 72 written questionnaires to evaluate an extra-curricular environmental education programme on forestry designed for preparatory school students from a small rural community in Mexico. Specifically, the study assessed the impact of the programme on the ecological…

Innovative Access Programme for Young Mothers Wishing to Train in Childbirth Education: From Concept to Evaluation

ERIC Educational Resources Information Center

Nolan, Mary L.

2008-01-01

This paper describes the conception, planning, implementation and evaluation of an access programme arising out of an innovative collaboration between two charities, Straight Talking and the National Childbirth Trust. The access programme was designed at the request of a group of young mothers who had finished compulsory education and subsequently…

An Evaluation of the "FRIENDS for Life" Programme among Children Presenting with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Burke, Mary-Kate; Prendeville, Paula; Veale, Angela

2017-01-01

"FRIENDS for Life" is a cognitive behavioural therapy (CBT) programme which aims to reduce anxiety and promote resilience among children. This study evaluated the "FRIENDS for Life" (FRIENDS) programme used as an intervention for seven children between the ages of 10 and 11 presenting with high functioning autism spectrum…

Independent Thinkers and Learners: A Critical Evaluation of the "Growing Together Schools Programme"

ERIC Educational Resources Information Center

Sharpe, Darren

2014-01-01

This article reports on primary data following an evaluative research project examining an innovative outdoor learning programme in the South East of England with pupils from year six in a primary school. The programme focused on enhancing the skills, experiences and personal attributes of children and young people to cope better with the…

Evaluation of an Adoption Strategy for a Healthy Diet Programme for Lower Vocational Schools

ERIC Educational Resources Information Center

Bessems, Kathelijne M. H. H.; van Assema, Patricia; Paulussen, Theo W. G. M.; de Vries, Nanne K.

2011-01-01

This paper describes the evaluation of an adoption strategy for the school-based healthy diet programme Krachtvoer. Health promotion (HP) professionals from five Regional Public Health Services (RPHSs) in The Netherlands were asked to recruit a total of 25 schools to adopt the Krachtvoer programme in accordance with this strategy. Afterwards, they…

A Process Evaluation of Student Participation in a Whole School Food Programme

ERIC Educational Resources Information Center

Orme, Judy; Jones, Matthew; Salmon, Debra; Weitkamp, Emma; Kimberlee, Richard

2013-01-01

Purpose: Health promotion programmes are widely held to be more effective when the subjects of them actively participate in the process of change. The purpose of this paper is to report on an evaluation of the Food for Life Partnership programme, a multi-level initiative in England promoting healthier nutrition and food sustainability awareness…

A Practice-Based Evaluation of Barnardo's Forward Steps Early Intervention Programme for Children Diagnosed with Autism

ERIC Educational Resources Information Center

Braiden, Hannah Jane; McDaniel, Benny; McCrudden, Eunan; Janes, Michele; Crozier, Barbara

2012-01-01

This study used a pre-experimental and post-experimental design to evaluate a TEACCH-based Early Intervention Programme. Thirty-one parents of 18 preschool children recently diagnosed with an Autistic Spectrum Disorder attended the eight-week programme delivered by trained facilitators. Parents completed pre-intervention and post-intervention…

Turkish Parents' Views on Quality Standards for Children's Television Programmes

ERIC Educational Resources Information Center

Önder, Alev; Dagal, Asude Balaban

2007-01-01

The main purpose of this study was to evaluate the opinions of parents of pre-school children about children's programmes on TV. The study had two phases: In the first step "The Evaluation Scale for Children's Programmes" was translated into Turkish, the reliability and validity of the scale was tested through analyzing of the data…

Monitoring and evaluation of strategic change programme implementation-Lessons from a case analysis.

PubMed

Neumann, Jan; Robson, Andrew; Sloan, Diane

2018-02-01

This study considered the monitoring and evaluation of a large-scale and domestic and global strategic change programme implementation. It considers the necessary prerequisites to overcome challenges and barriers that prevent systematic and effective monitoring and evaluation to take place alongside its operationalisation. The work involves a case study based on a major industrial company from the energy sector. The change programme makes particular reference to changes in business models, business processes, organisation structures as well as Enterprise Resource Planning infrastructure. The case study focussed on the summative evaluation of the programme post-implementation. This assessment involved 25 semi-structured interviews with employees across a range of managerial strata capturing more than 65 roles within the change programme at both local and global levels. Data relating to their perception of evaluation effectiveness and shortcomings were analysed by means of template analysis. The study identifies responsibilities for executing an evaluation alongside various methods and tools that are appropriate, thereby focussing on the "Who" (roles, responsibility for particular activities) and "How" (methods and tools) rather than "What" to monitor and evaluate. The findings are presented generically so they offer new insights and transferability for practitioners involved in managing strategic change and its associated evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

New pathways in the evaluation of programmes for men who perpetrate violence against their female partners.

PubMed

Wojnicka, Katarzyna; Scambor, Christian; Kraus, Heinrich

2016-08-01

Today, evaluation research in the field of intervention programmes for men who perpetrate violence against their female partners still makes a fragmentary impression. Across Europe various evaluation studies have been performed. However, the methodologies applied are too heterogeneous to allow the combination of the results in a meta-analytical way. In this paper we propose a future pathway for organising outcome evaluation studies of domestic violence perpetrator programmes in community settings, so that today's problems in this field can be overcome. In a pragmatic framework that acknowledges the limited pre-conditions for evaluation studies in the area of domestic violence perpetrator programmes as it is today, feasible approaches for outcome evaluation are outlined, with recent developments in the field taken as starting points. The framework for organising future evaluation studies of work with perpetrators of domestic violence is presented together with a strategy to promote this framework. International networks of practitioners and researchers play a central role in this strategy through upskilling the area of practical work, preparing the ground for evaluation research and improving cooperation between practitioners and researchers. This paper is based on the results of the European funded project IMPACT (under the Daphne-III-funding programme of the European Commission). Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating a Professional Development Programme for Implementation of a Multidisciplinary Science Subject

ERIC Educational Resources Information Center

Visser, Talitha C.; Coenders, Fer G. M.; Terlouw, Cees; Pieters, Jules

2013-01-01

This study aims to evaluate a professional development programme that prepares and assists teachers with the implementation of a multidisciplinary science module, basing the evaluation on "participants' reactions," the first level of Guskey's five-level model for evaluation (2002). Positive evaluations at the higher levels in Guskey's…

Process factors explaining the ineffectiveness of a multidisciplinary fall prevention programme: A process evaluation

PubMed Central

Bleijlevens, Michel HC; Hendriks, Marike RC; van Haastregt, Jolanda CM; van Rossum, Erik; Kempen, Gertrudis IJM; Diederiks, Joseph PM; Crebolder, Harry FJM; van Eijk, Jacques ThM

2008-01-01

Background Falls are a major health threat to older community-living people, and initiatives to prevent falls should be a public health priority. We evaluated a Dutch version of a successful British fall prevention programme. Results of this Dutch study showed no effects on falls or daily functioning. In parallel to the effect evaluation, we carried out a detailed process evaluation to assess the feasibility of our multidisciplinary fall prevention programme. The present study reports on the results of this process evaluation. Methods Our fall prevention programme comprised a medical and occupational-therapy assessment, resulting in recommendations and/or referrals to other services if indicated. We used self-administered questionnaires, structured telephone interviews, structured recording forms, structured face-to-face interviews and a plenary group discussion to collect data from participants allocated to the intervention group (n = 166) and from all practitioners who performed the assessments (n = 8). The following outcomes were assessed: the extent to which the multidisciplinary fall prevention programme was performed according to protocol, the nature of the recommendations and referrals provided to the participants, participants' self-reported compliance and participants' and practitioners' opinions about the programme. Results Both participants and practitioners judged the programme to be feasible. The programme was largely performed according to protocol. The number of referrals and recommendations ensuing from the medical assessment was relatively small. Participants' self-reported compliance as regards contacting their GP to be informed of the recommendations and/or referrals was low to moderate. However, self-reported compliance with such referrals and recommendations was reasonable to good. A large majority of participants reported they had benefited from the programme. Conclusion The results of the present study show that the programme was feasible for both practitioners and participants. Main factors that seem to be responsible for the lack of effectiveness are the relatively low number of referrals and recommendations ensuing from the medical assessments and participants' low compliance as regards contacting their GP about the results of the medical assessment. We do not recommend implementing the programme in its present form in regular care. Trial registration ISRCTN64716113 PMID:18816381

Evaluating the impact of a partnership for creating change in substance misuse practice in St. Petersburg, Russia.

PubMed

Green, Anita J; Holloway, David G

2005-11-01

This paper reports on an evaluation of an innovative education and training programme for nurses and narcologists in St. Petersburg, Russia. The aims of the evaluation were: first, to evaluate the effect of the education and training programme on the clinical practice of doctors and nurses who have had direct contact with the programme and, second, to evaluate the influence of the education and training programme on city-wide drug and alcohol policy and practice. Brief contextual information regarding the programme is provided prior to an account of the qualitative methodology. Particular attention was paid to the work of Patton [Utilisation-focused evaluation, second ed., Sage, London, 1986; Qualitative research and evaluation methods, third ed., Sage, London, 2002] for the theoretical framework and to Hantais and Mangen [Cross-national research methods in the social sciences, Pinter, London, 1996] regarding the methodological issues that surround international and cross-cultural research projects. Data collection was carried out in St. Petersburg and in the United Kingdom, which involved key participants in the programme. The data analysis followed Miles and Huberman [Qualitative data analysis. An expanded sourcebook, second ed. Sage, Thousand Oaks, 1994] which yielded six major themes: rehabilitation, the role and continuing professional development of the trained nurse; the status of the nurse training-college and the staff, small scale projects and their significance; sharing experiences/networking/face-to-face meetings; and, lack of resistance. The findings are discussed and recommendations for further involvement are identified.

Improving end of life care in care homes; an evaluation of the six steps to success programme.

PubMed

O'Brien, Mary; Kirton, Jennifer; Knighting, Katherine; Roe, Brenda; Jack, Barbara

2016-06-03

There are approximately 426,000 people residing within care homes in the UK. Residents often have complex trajectories of dying, which make it difficult for staff to manage their end-of-life care. There is growing recognition for the need to support care homes staff in the care of these residents with increased educational initiatives. One educational initiative is The Six Steps to Success programme. In order to evaluate the implementation of Six Steps with the first cohort of care homes to complete the end-of-life programme in the North West of England., a pragmatic evaluation methodology was implemented in 2012-2013 using multiple methods of qualitative data collection; online questionnaire with facilitators (n = 16), interviews with facilitators (n = 9) and case studies of care homes that had completed the programme (n = 6). The evaluation explored the implementation approach and experiences of the programme facilitators and obtain a detailed account of the impact of Six Steps on individual care homes. Based upon the National Health Service (NHS) End of Life Care (EoLC) Programme, The Route to Success in EoLC - Achieving Quality in Care Homes. The programme was flexibly designed so that it could be individually tailored to the geographical location and the individual cohort requirements. Facilitators provided comprehensive and flexible support to care homes. Challenges to programme success were noted as; lack of time allocated to champions to devote to additional programme work, inappropriate staff selected as 'Champions' and staff sickness/high staff turnover presented challenges to embedding programme values. Benefits to completing the programme were noted as; improvement in Advance Care Planning, improved staff communication/confidence when dealing with multi-disciplinary teams, improved end-of-life processes/documentation and increased staff confidence through acquisition of new knowledge and new processes. The findings suggested an overall positive impact from the programme. This flexibly designed programme continues to be dynamic, iteratively amended and improved which may affect the direct transferability of the results to future cohorts.

Historical and Contemporary Evaluations of Early Childhood Programmes

ERIC Educational Resources Information Center

Saracho, Olivia N.

2015-01-01

Researchers continue to be interested in the evaluation of early childhood education programmes, their interventions, and the implementation of different types of evaluation. Their interest continues to increase and attract other researchers. In understanding the nature and appropriate use of evaluation in early childhood education and the basis…

Quality evaluation in the management of child sponsorship programmes.

PubMed

McDonnell, W A; McDonnell, T P

1994-08-01

Programme evaluation tactics for child sponsorship programmes have historically concentrated on quantitative analysis of service units, amount of money invested, number of countries served, the number of projects, and number of children in each project. While these are valuable measures of programme variables, they do not assess the impact of programmes on the lives of the children sponsored. Outcome measures designed to assess programme impact add greatly to the information available to child welfare professionals. This study collected data about the impact of the programme on the lives of the children. The Child Welfare League's Child Well-Being Scales (CWBS) were used to assess programme impact. Twelve scales were chosen as directly related in type to the programmes administered by Children International, a traditional and well established child sponsorship organization located in Kansas City, Missouri. A thirteenth scale was suggested by field workers in India as particularly relevant to Third World populations. The scales were translated into languages appropriate to each population in the programme countries. Social workers in each country were trained to administer and score them. This analysis used the emerging data technology becoming available to programmes in Third World countries. The system enables administrators in the Third World to evaluate, enhance and summarize their programmes in a way understandable across borders. Epi Info (Dean et al., 1990) was customized to provide the framework for the analysis. The population for this study was selected by a 5% random sampling of children currently enrolled as sponsored children (180,000+ worldwide). These were compared with a waiting-list control group selected randomly from lists of children who have applied for sponsorship but have not yet been receiving services (n = 50 from each project).(ABSTRACT TRUNCATED AT 250 WORDS)

Programme evaluation training for health professionals in francophone Africa: process, competence acquisition and use

PubMed Central

Ridde, Valéry; Fournier, Pierre; Banza, Baya; Tourigny, Caroline; Ouédraogo, Dieudonné

2009-01-01

Background While evaluation is, in theory, a component of training programmes in health planning, training needs in this area remain significant. Improving health systems necessarily calls for having more professionals who are skilled in evaluation. Thus, the Université de Ouagadougou (Burkina Faso) and the Université de Montréal (Canada) have partnered to establish, in Burkina Faso, a master's-degree programme in population and health with a course in programme evaluation. This article describes the four-week (150-hour) course taken by two cohorts (2005–2006/2006–2007) of health professionals from 11 francophone African countries. We discuss how the course came to be, its content, its teaching processes and the master's programme results for students. Methods The conceptual framework was adapted from Kirkpatrick's (1996) four-level evaluation model: reaction, learning, behaviour, results. Reaction was evaluated based on a standardized questionnaire for all the master's courses and lessons. Learning and behaviour competences were assessed by means of a questionnaire (pretest/post-test, one year after) adapted from the work of Stevahn L, King JA, Ghere G, Minnema J: Establishing Essential Competencies for Program Evaluators. Am J Eval 2005, 26(1):43–59. Master's programme effects were tested by comparing the difference in mean scores between times (before, after, one year after) using pretest/post-test designs. Paired sample tests were used to compare mean scores. Results The teaching is skills-based, interactive and participative. Students of the first cohort gave the evaluation course the highest score (4.4/5) for overall satisfaction among the 16 courses (3.4–4.4) in the master's programme. What they most appreciated was that the forms of evaluation were well adapted to the content and format of the learning activities. By the end of the master's programme, both cohorts of students considered that they had greatly improved their mastery of the 60 competences (p < 0.001). This level was maintained one year after completing the master's degree, except for reflective practice (p < 0.05). Those who had carried out an evaluation in the intervening 12 months reported a negative gap between their declared mastery and their actual application. However, this is only statistically significant for reflective practice (p < 0.05). Conclusion This study shows the importance of integrating summative evaluation into the learning process. Skills-based teaching is much appreciated and well-adapted. Creating a master's programme in population and health in Africa and providing training in evaluation to high-level health professionals from many countries augurs well for scaling up the practice of evaluation in African health systems. PMID:19146690

Continuity, Support, Togetherness and Trust: Findings from an Evaluation of a University-Administered Early Professional Development Programme for Teachers in England

ERIC Educational Resources Information Center

McIntyre, Joanna; Hobson, Andrew J.; Mitchell, Nick

2009-01-01

This article discusses the evaluation of a unique university-based early professional development (EPD) programme in England that enabled newly and recently qualified teachers to have continued contact with their initial teacher preparation provider. The programme was designed to enhance the induction, EPD and retention of beginning teachers of…

Parents Plus Programme 1: Evaluation of Its Effectiveness for Pre-School Children with Developmental Disabilities and Behavioural Problems

ERIC Educational Resources Information Center

Quinn, Mark; Carr, Alan; Carroll, Louise; O'Sullivan, David

2007-01-01

Background: This study aimed to evaluate the effectiveness of the Parents Plus programme with families of pre-school children with developmental disabilities and significant behavioural problems in the Irish health service. The Parents Plus programme is a group-based parent training package involving video modelling, which was designed to be…

Evaluation of Bioinformatic Programmes for the Analysis of Variants within Splice Site Consensus Regions

PubMed Central

Tang, Rongying; Prosser, Debra O.; Love, Donald R.

2016-01-01

The increasing diagnostic use of gene sequencing has led to an expanding dataset of novel variants that lie within consensus splice junctions. The challenge for diagnostic laboratories is the evaluation of these variants in order to determine if they affect splicing or are merely benign. A common evaluation strategy is to use in silico analysis, and it is here that a number of programmes are available online; however, currently, there are no consensus guidelines on the selection of programmes or protocols to interpret the prediction results. Using a collection of 222 pathogenic mutations and 50 benign polymorphisms, we evaluated the sensitivity and specificity of four in silico programmes in predicting the effect of each variant on splicing. The programmes comprised Human Splice Finder (HSF), Max Entropy Scan (MES), NNSplice, and ASSP. The MES and ASSP programmes gave the highest performance based on Receiver Operator Curve analysis, with an optimal cut-off of score reduction of 10%. The study also showed that the sensitivity of prediction is affected by the level of conservation of individual positions, with in silico predictions for variants at positions −4 and +7 within consensus splice sites being largely uninformative. PMID:27313609

Clinical case management for patients with schizophrenia with high care needs.

PubMed

Mas-Expósito, Laia; Amador-Campos, Juan Antonio; Gómez-Benito, Juana; Mauri-Mas, Lluís; Lalucat-Jo, Lluís

2015-02-01

The aim of this study is to establish the effectiveness of a clinical case management (CM) programme compared to a standard treatment programme (STP) in patients with schizophrenia. Patients for the CM programme were consecutively selected among patients in the STP with schizophrenia who had poor functioning. Seventy-five patients were admitted to the CM programme and were matched to 75 patients in the STP. Patients were evaluated at baseline and at 1 year follow-up. At baseline, patients in the CM programme showed lower levels of clinical and psychosocial functioning and more care needs than patients in the STP. Both treatment programmes were effective in maintaining contact with services but the CM programme did not show advantages over the STP on outcomes. Differences between groups at baseline may be masking the effects of CM at one year follow-up. A longer follow-up may be required to evaluate the real CM practices effects.

FIFA 11+: an effective programme to prevent football injuries in various player groups worldwide—a narrative review

PubMed Central

Bizzini, Mario; Dvorak, Jiri

2015-01-01

In 2009, FIFA promoted and disseminated the FIFA 11+ injury prevention programme worldwide. Developed and studied by the FIFA Medical Assessment and Research Centre (F-MARC), the programme was based on a randomised controlled study and one countrywide campaign in amateur football that significantly reduced injuries and healthcare costs. Since the FIFA 11+ launch, key publications have confirmed the preventive effects of the programme and have evaluated its performance effects in female as well as male amateur football players. Furthermore, implementation strategies of this prevention programme have also been studied. The goal of this narrative review was to summarise the available scientific evidence about the FIFA 11+ programme. While FIFA continues to disseminate and implement FIFA 11+ among its Member Associations, adaptations of the injury prevention programme for children and referees have been developed and are currently being evaluated. PMID:25878073

Individual-level outcomes from a national clinical leadership development programme.

PubMed

Patton, Declan; Fealy, Gerard; McNamara, Martin; Casey, Mary; Connor, Tom O; Doyle, Louise; Quinlan, Christina

2013-08-01

A national clinical leadership development programme was instituted for Irish nurses and midwives in 2010. Incorporating a development framework and leadership pathway and a range of bespoke interventions for leadership development, including workshops, action-learning sets, mentoring and coaching, the programme was introduced at seven pilot sites in the second half of 2011. The programme pilot was evaluated with reference to structure, process and outcomes elements, including individual-level programme outcomes. Evaluation data were generated through focus groups and group interviews, individual interviews and written submissions. The data provided evidence of nurses' and midwives' clinical leadership development through self and observer-reported behaviours and dispositions including accounts of how the programme participants developed and displayed particular clinical leadership competencies. A key strength of the new programme was that it involved interventions that focussed on specific leadership competencies to be developed within the practice context.

Information, education and communication on family planning and maternal and child health care: an evaluation of a special action programme in northern Karnataka.

PubMed

Rajaretnam, T; Deshpande, R V

1991-01-01

This paper presents the results of an evaluation undertaken by the Population Research Centre of the India Population Project-III in two districts of Karnataka state in late 1990. "The evaluation study revealed that mass media type...programmes such as...films...were carried out satisfactorily. But inter-[personal] communication type...programmes such as group meetings...were rarely conducted and people's participation was not sufficiently ensured." Recommendations for improvements are included. excerpt

[Health coaching as a part of integration into the job market--evaluation of a qualification concept].

PubMed

Heinmüller, M; Liel, K; Angerer, P; Gündel, H; Geldermann, B; Gottwald, M; Kimil, A; Limm, H

2014-03-01

The aim of this study is to develop, implement and evaluate an education programme enabling the pedagogic staff of employment promotion agencies to integrate health promotion approaches und activities in vocational training programmes. The evaluation of the education programme is based on Kirkpatrick's 4 levels training evaluation model. Besides the participants' verbal end of session feedback, a standardised questionnaire was used at the end of the education programme and after 3 months practical experience. Process evaluation included the implementation level of the methods learned. From a total of 71 participants, 56 completed the first and 31 the second questionnaire (return rate 79% and 44%, respectively). The participants' mean age was 42 years, 80% were female. Only 22% of them integrated health topics systematically into their daily work. A 3-day basic training followed by case conferences during practical work was developed to transfer knowledge and practical competence in person-to-person talks and group activities (so called FIT-counselling and FIT-group). For 96% of participants, their expectations regarding the education programme were met completely or predominantly. 91% indicated a rise in motivation to work as health coach. When rating the training material, 96% judged it helpful for implementation/transfer. Many participants marked the education programme as being too short and wished more time for the topic of "mental health" and exchange of experiences. The follow-up after 3 months on-the-job training revealed that 84 and 97%, respectively, found FIT-counselling and FIT-groups helpful for their daily work. In all employment promotion agencies FIT-counselling and FIT-groups were implemented. Our results affirm the need for and prove the acceptance of education programmes enabling the pedagogic staff of job-training programmes to deliver health coaching. Periodic case conferences take into account the participants' request for more exchange of experiences, facilitate implementation and contribute to quality and sustainability. Further development of the education programme is ongoing. © Georg Thieme Verlag KG Stuttgart · New York.

An evaluation of a leadership development coaching and mentoring programme.

PubMed

Le Comte, Lyndsay; McClelland, Beverley

2017-07-03

Purpose The purpose of this paper was to determine the value and impact of the Leadership Development - Coaching and Mentoring Programme at Counties Manukau Health and understand how the skills gained are applied. Design/methodology/approach Mixed-methods approach including surveys of programme participants and senior staff and semi-structured interviews with programme participants. Findings The survey response rate was 24.4 per cent for programme participants and 30 per cent for senior staff. Eight programme participants participated in semi-structured interviews. Of the 70 programme participants, 69 utilised their learning from the programme; 45 of 70 changed their approach to managing staff; and 40 of 68 programme participants reported that meeting with peers for triad group coaching was the most challenging aspect of the programme. Key themes identified through interviews included: working with others; not owning others' problems; professional support and development; coaching and mentoring; future participants. Practical implications The majority of participants changed their leadership behaviours as a result of the programme, which has resulted in improved communication, a more supportive culture and distributed leadership. These changes contribute to better patient care. Originality value There is a paucity of evidence in the literature about the impact of coaching and mentoring programme on leadership development and how the skills gained in such programmes are applied in practice in a healthcare context. This evaluation helps to address that gap.

Religious adaptation of a parenting programme: process evaluation of the Family Links Islamic Values course for Muslim fathers.

PubMed

Scourfield, J; Nasiruddin, Q

2015-09-01

Amid concern about the reach and inclusivity of parenting interventions, attempts have been made to culturally adapt programmes for specific ethnic or linguistic groups. This paper describes a novel approach of the religious adaptation of a parenting programme, namely the Family Links Islamic Values course. A small-scale qualitative process evaluation was conducted on one Family Links Islamic Values course for Muslim fathers in the South of England in order to describe the intervention as implemented and its theory of change, as well as the acceptability of the programme to the participants. The data consisted of 13 semi-structured interviews (10 with parents and three with staff), 25 h of observation and reading of programme manuals. A logic model is presented to describe the theoretical basis of the intervention. The programme was highly acceptable to fathers who valued the integration of religious teachings and were generally very positive about their experience of attending the course. Post-course interviews with both fathers and mothers mentioned some positive changes in fathers as a result of their attendance. It is important to be responsive to the needs of some British Muslims for religiously credible interventions. This small-scale process evaluation needs to be followed by a robust evaluation of programme outcomes for parents and children. © 2015 The Authors. Child: Care, Health and Development published by John Wiley & Sons Ltd.

The Impact of Pediatric Palliative Care Education on Medical Students' Knowledge and Attitudes

PubMed Central

Przysło, Łukasz; Kędzierska, Bogna; Stolarska, Małgorzata; Młynarski, Wojciech

2013-01-01

Purpose. Most undergraduate palliative care curricula omit pediatric palliative care (PPC) issues. Aim of the study was to evaluate the pilot education programme. Methods. All 391 students of Faculty of Medicine (FM) and 59 students of Division of Nursing (DN) were included in anonymous questionnaire study. Respondents were tested on their knowledge and attitude towards PPC issues before and at the end of the programme and were expected to evaluate the programme at the end. Results. For final analysis, authors qualified 375 double forms filled in correctly (320 FM and 55 DN). Before the programme, students' knowledge assessed on 0–100-point scale was low (FM: median: 43.35 points; 25%–75%: (40p–53.3p); DN: 26.7p; 13.3p–46.7p), and, in addition, there were differences (P < 0.001) between both faculties. Upon completion of the programme, significant increase of the level of knowledge in both faculties was noted (FM: 80p; 73.3–100; DN: 80p; 66.7p–80p). Participation in the programme changed declared attitudes towards some aspects of withholding of special procedures, euthanasia, and abortion. Both groups of students positively evaluated the programme. Conclusions. This study identifies medical students' limited knowledge of PPC. Educational intervention changes students' attitudes to the specific end-of-life issues. There is a need for palliative care curricula evaluation. PMID:24501581

Religious adaptation of a parenting programme: process evaluation of the Family Links Islamic Values course for Muslim fathers

PubMed Central

Nasiruddin, Q.

2015-01-01

Abstract Background Amid concern about the reach and inclusivity of parenting interventions, attempts have been made to culturally adapt programmes for specific ethnic or linguistic groups. This paper describes a novel approach of the religious adaptation of a parenting programme, namely the Family Links Islamic Values course. Methods A small‐scale qualitative process evaluation was conducted on one Family Links Islamic Values course for Muslim fathers in the South of England in order to describe the intervention as implemented and its theory of change, as well as the acceptability of the programme to the participants. The data consisted of 13 semi‐structured interviews (10 with parents and three with staff), 25 h of observation and reading of programme manuals. Results A logic model is presented to describe the theoretical basis of the intervention. The programme was highly acceptable to fathers who valued the integration of religious teachings and were generally very positive about their experience of attending the course. Post‐course interviews with both fathers and mothers mentioned some positive changes in fathers as a result of their attendance. Conclusions It is important to be responsive to the needs of some British Muslims for religiously credible interventions. This small‐scale process evaluation needs to be followed by a robust evaluation of programme outcomes for parents and children. PMID:25649634

Pilot evaluation of an adolescent risk and injury prevention programme incorporating curriculum and school connectedness components.

PubMed

Chapman, R L; Buckley, L; Sheehan, M; Shochet, I M

2013-08-01

School connectedness is an important protective factor for adolescent risk-taking behaviour. This study examined a pilot version of the Skills for Preventing Injury in Youth (SPIY) programme, combining teacher professional development (PD) for increasing school connectedness (connectedness component) with a risk and injury prevention curriculum for early adolescents (curriculum component). A process evaluation was conducted on the connectedness component, involving assessments of programme reach, participant receptiveness and initial use, and a preliminary impact evaluation was conducted on the combined connectedness and curriculum programme. The connectedness component was well received by teacher participants, who saw benefits for both themselves and their students. Classroom observation also showed that teachers who received PD made use of the programme strategies. Grade 8 students who participated in the SPIY programme were less likely to report violent behaviour at 6-month follow-up than were control students, and trends also suggested reduced transport injuries. The results of this research support the use of the combined SPIY connectedness and curriculum components in a large-scale effectiveness trial to assess the impact of the programme on students' connectedness, risk-taking and associated injuries.

`Discover, Understand, Implement, and Transfer': Effectiveness of an intervention programme to motivate students for science

NASA Astrophysics Data System (ADS)

Schütte, Kerstin; Köller, Olaf

2015-09-01

Considerable research has focused on how best to satisfy modern societies' needs for skilled labour in the field of science. The present study evaluated an intervention programme designed to increase secondary school students' motivation to pursue a science career. Students from 3 schools of the highest educational track participated for up to 2 years in the intervention programme, which was implemented as an elective in the school curriculum. Our longitudinal study design for evaluating the effectiveness of the intervention programme included all students at the grade levels involved in the programme with students who did not participate serving as a control group. Mixed-model analyses of variance showed none of the intended effects of the intervention programme on science motivation; latent growth models corroborated these results. When the programme began, students who enrolled in the science elective (n = 92) were already substantially more motivated than their classmates (n = 228). Offering such an intervention programme as an elective did not further increase the participating students' science motivation. It seems worthwhile to carry out intervention programmes with talented students who show (comparatively) little interest in science at the outset rather than with highly motivated students who self-select into the programme.

Establishment and implementation of a psychiatry enrichment programme for medical students.

PubMed

Lyons, Zaza

2017-02-01

There has been a growing interest in psychiatry enrichment programmes such as summer schools and institutes for medical students in the last 10 years. Evaluation of enrichment programmes shows that they can be an effective method of increasing students' interest in psychiatry as a career. However, despite initial enthusiasm and motivation within an academic department, establishing a programme can be a daunting task. The aim of this paper is to provide a background of how to establish and implement a psychiatry summer school or institute. The steps that can be taken to establish and implement a psychiatry enrichment programme such as a summer school or institute are described and discussed. This includes how to structure a programme, content to include, costs and budget, programme promotion, selection of students and programme evaluation. Establishing an enrichment programme can provide academic departments of psychiatry with the opportunity to demonstrate excellence and innovation in teaching and positively promote psychiatry to students and other non-medical academics involved in medical education. For students interested in psychiatry, enrichment programmes have the potential to extend interest and knowledge beyond the curriculum and encourage serious consideration of psychiatry as a career.

Trialling a shaken baby syndrome prevention programme in the Auckland District Health Board.

PubMed

Kelly, Patrick; Wilson, Kati; Mowjood, Aqeela; Friedman, Joshua; Reed, Peter

2016-02-19

To describe and evaluate a shaken baby prevention programme trialled in the Auckland District Health Board from January 2010, to December 2011. Development and implementation of the programme, telephone survey of a sample of caregivers and written survey of a sample of providers. At least 2,592 caregivers received the trial programme. 150 (6%) were surveyed by telephone a median of 6 weeks later. 128 (85%) remembered at least one key message, unprompted; most commonly "It's OK to walk away" (94/150, 63%). When asked, 92% had made a plan for what to do when frustrated and 63% had shared the information with others. Only 98/150 (65%) watched the programme DVD. Many said they already knew about the risks of shaking a baby, but still found the programme highly relevant. Thirty-one nurses were surveyed. There was a high degree of agreement that the programme was relevant. Barriers to programme delivery included time, workload and the documentation required. A shaken baby prevention programme adapted to New Zealand can be introduced in a District Health Board and is acceptable to caregivers and health professionals. Further research is needed to evaluate the content, mode of delivery and effectiveness of this programme.

[Neurophysiological Foundations and Practical Realizations of the Brain-Machine Interfaces the Technology in Neurological Rehabilitation].

PubMed

Kaplan, A Ya

2016-01-01

Technology brain-computer interface (BCI) based on the registration and interpretation of EEG has recently become one of the most popular developments in neuroscience and psychophysiology. This is due not only to the intended future use of these technologies in many areas of practical human activity, but also to the fact that IMC--is a completely new paradigm in psychophysiology, allowing test hypotheses about the possibilities of the human brain to the development of skills of interaction with the outside world without the mediation of the motor system, i.e. only with the help of voluntary modulation of EEG generators. This paper examines the theoretical and experimental basis, the current state and prospects of development of training, communicational and assisting complexes based on BCI to control them without muscular effort on the basis of mental commands detected in the EEG of patients with severely impaired speech and motor system.

A national public health programme on gambling policy development in New Zealand: insights from a process evaluation.

PubMed

Kolandai-Matchett, Komathi; Landon, Jason; Bellringer, Maria; Abbott, Max

2018-03-06

In New Zealand, a public health programme on gambling policy development is part of a national gambling harm reduction and prevention strategy mandated by the Gambling Act 2003. Funded by the Ministry of Health, the programme directs workplace/organisational gambling policies, non-gambling fundraising policies, and local council policies on electronic gaming machines (EGMs). We carried out a process evaluation of this programme to identify practical information (e.g. advocacy approaches; challenges and ameliorating strategies) that can be used by programme planners and implementers to reinforce programme effectiveness and serve to guide similar policy-focused public health initiatives elsewhere. Evaluation criteria, based on the programme's official service specifications, guided our evaluation questions, analysis and reporting. To identify informative aspects of programme delivery, we thematically analysed over 100 six-monthly implementer progress reports (representing 3 years of programme delivery) and transcript of a focus group with public health staff. Identified output-related themes included purposeful awareness raising to build understanding about gambling harms and the need for harm-reduction policies and stakeholder relationship development. Outcome-related themes included enhanced community awareness about gambling harms, community involvement in policy development, some workplace/organisational policy development, and some influences on council EGM policies. Non-gambling fundraising policy development was not common. The programme offers an unprecedented gambling harm reduction approach. Although complex (due to its three distinct policy focus areas targeting different sectors) and challenging (due to the extensive time and resources needed to develop relationships and overcome counteractive views), the programme resulted in some policy development. Encouraging workplace/organisational policy development requires increased awareness of costs to employers and society and appreciation of policy value. Although encouraging non-gambling fundraising policies will likely remain challenging, public debate on ethical aspects could stimulate policy consideration. Influencing council EGM policy decisions will remain important for minimising EGM accessibility among vulnerable communities. Public involvement in EGM policy decisions has strong implications for policy effectiveness. Given the expanding range of gambling activities (including online gambling) presently accessible to communities worldwide, both organisational and public policies (as advocated through the programme) are needed to minimise gambling harms.

What Role for Developmental Theories in Mathematics Study Programmes in French-Speaking Belgium? An Analysis of the Geometry Curriculum's Aspects, Framed by Van Hiele's Model

ERIC Educational Resources Information Center

Duroisin, Natacha; Demeuse, Marc

2015-01-01

One possible way of evaluating set curricula is to examine the consistency of study programmes with students' psycho-cognitive development. Three theories were used to evaluate matching between developmental theories and content proposed in the mathematics programmes (geometry section) for primary and the beginning of secondary education. These…

A Teacher Competence Development Programme for Supporting Students' Reflection Skills

ERIC Educational Resources Information Center

Dekker-Groen, Agaath M.; van der Schaaf, Marieke F.; Stokking, Karel M.

2013-01-01

This study aimed to evaluate a training programme for Dutch teachers in six institutes for nursing education to support students' reflection skills. The research question was: what are the feasibility, quality and effects of the programme? The training programme focused on four competences of teachers regarding instructing, guiding, giving…

The Effectiveness of Finishing School Programmes from the Perspectives of Graduates and Employers

ERIC Educational Resources Information Center

Ali, Jamal; Eam, Lim Hock; Ismail, Russayani; Rahim, Fauziah Abdul; Isa, Filzah Md; Ismail, Ismi Arif

2014-01-01

Purpose: This study examined the effectiveness of Finishing School programmes in enhancing the employability of graduates from institutions of higher learning. The perceptions of the graduates and employers towards the effectiveness of the programmes were analyzed. The effectiveness of Finishing School programmes evaluated through a graduate…

Using Bullying Incident Density to Evaluate the Olweus Bullying Prevention Programme

ERIC Educational Resources Information Center

Black, Sally A.; Jackson, Ericka

2007-01-01

Bullying negatively impacts the mental and physical health of student victims, bullies and bystanders. The Olweus Bullying Prevention Programme is an internationally recognized school based programme demonstrated effective in research. The purpose of this study was to determine if the Bullying Prevention Programme was effective for urban youth…

Programme coordinators' perceptions of strengths, weaknesses, opportunities and threats associated with school nutrition programmes.

PubMed

Valaitis, Renata F; Hanning, Rhona M; Herrmann, Isabela S

2014-06-01

As part of a larger evaluation of school nutrition programmes (SNP), the present study examined programme coordinators' perceptions of strengths, weaknesses, opportunities and threats (SWOT) regarding their SNP and public health professionals' support. Qualitative interviews were conducted with twenty-two of eighty-one programme coordinators who had completed a programme evaluation survey. Interviews followed a SWOT framework to evaluate programmes and assessed coordinators' perceptions regarding current and future partnerships with public health professionals. The study was conducted in a large, urban region within Ontario. The twenty-two coordinators who participated represented a cross-section of elementary, secondary, Public and Catholic schools. SNP varied enormously in foods/services offered, how they offered them and perceived needs. Major strengths included universality, the ability to reach needy students and the provision of social opportunities. Major weaknesses included challenges in forming funding partnerships, lack of volunteers, scheduling and timing issues, and coordinator workload. Common threats to effective SNP delivery included lack of sustainable funding, complexity in tracking programme use and food distribution, unreliable help from school staff, and conflicts with school administration. Opportunities for increased public health professionals' assistance included menu planning, nutrition education, expansion of programme food offerings, and help identifying community partners and sustainable funding. The present research identified opportunities for improving SNP and strategies for building on strengths. Since programmes were so diverse, tailored strategies are needed. Public health professionals can play a major role through supporting menu planning, food safety training, access to healthy foods, curriculum planning and by building community partnerships.

Capacity building of midwifery faculty to implement a 3-years midwifery diploma curriculum in Bangladesh: A process evaluation of a mentorship programme.

PubMed

Erlandsson, Kerstin; Doraiswamy, Sathyanarayanan; Wallin, Lars; Bogren, Malin

2018-03-01

When a midwifery diploma-level programme was introduced in 2010 in Bangladesh, only a few nursing faculty staff members had received midwifery diploma-level. The consequences were an inconsistency in interpretation and implementation of the midwifery curriculum in the midwifery programme. To ensure that midwifery faculty staff members were adequately prepared to deliver the national midwifery curriculum, a mentorship programme was developed. The aim of this study was to examine feasibility and adherence to a mentorship programme among 19 midwifery faculty staff members who were lecturing the three years midwifery diploma-level programme at ten institutes/colleges in Bangladesh. The mentorship programme was evaluated using a process evaluation framework: (implementation, context, mechanisms of impact and outcomes). An online and face-to-face blended mentorship programme delivered by Swedish midwifery faculty staff members was found to be feasible, and it motivated the faculty staff members in Bangladesh both to deliver the national midwifery diploma curriculum as well as to carry out supportive supervision for midwifery students in clinical placement. First, the Swedish midwifery faculty staff members visited Bangladesh and provided a two-days on-site visit prior to the initiation of the online part of the mentorship programme. The second on-site visit was five-days long and took place at the end of the programme, that being six to eight months from the first visit. Building on the faculty staff members' response to feasibility and adherence to the mentorship programme, the findings indicate opportunities for future scale-up to all institutes/collages providing midwifery education in Bangladesh. It has been proposed that a blended online and face-to-face mentorship programme may be a means to improving national midwifery programmes in countries where midwifery has only recently been introduced. Copyright © 2018. Published by Elsevier Ltd.

[Medical rehabilitation group-programmes concerning health promotion, patient education and psychoeducation - a 2010 national survey].

PubMed

Reusch, A; Schug, M; Küffner, R; Vogel, H; Faller, H

2013-08-01

High quality demands are being placed on concepts of educational group programmes in medical rehabilitation as well as the related trainer qualifications. A nationwide survey of German medical rehabilitation clinics in 2005 had revealed a need for improving educational practice according to these quality criteria. An updated investigation was performed in 2010 aiming at describing group programmes used in medical rehabilitation. 1 473 inpatient and outpatient medical rehabilitation clinics were invited to participate. 908 clinics reported on their training programmes. Data from clinics caring for patients with somatic disorders could be compared to the 2005 survey. Data from clinics for both psychosomatic and substance abuse disorders was collected for the first time in 2010. Overall, psychologists and physicians were reported to be the most frequent conductors of educative programmes. In somatic clinics, psychologists, dieticians and occupational therapists or physiotherapists were the most common conductors. Two-thirds of the institutions reported no training prerequisites for staff members to perform patient education. 80% of the education programmes were categorized post hoc into 3 classes: "generic health education", "disorder-specific patient education", and "psychoeducational group programmes". Almost two-thirds of all programmes were carried out with 8-15 participants, and many used several interactive didactic methods. Programmes conducted in small groups (<8 participants) used significantly more interactive methods than those conducted in larger groups did (>15 participants). Only half of the programmes were manualized. Significantly more interactive methods were used in completely manualized programmes. Only about half of the programmes were evaluated, and only very few evaluation studies were published. The institutions wished additional support by workshops especially concerning qualification of their staff and concerning educational concepts. A need for further improvement and support exists relative to the training of educators and the development of manuals as well as evaluation and publication of the programmes. © Georg Thieme Verlag KG Stuttgart · New York.

Conceptualizing Programme Evaluation

ERIC Educational Resources Information Center

Hassan, Salochana

2013-01-01

The main thrust of this paper deals with the conceptualization of theory-driven evaluation pertaining to a tutor training programme. Conceptualization of evaluation, in this case, is an integration between a conceptualization model as well as a theoretical framework in the form of activity theory. Existing examples of frameworks of programme…

Evaluation of a nationally funded state-based programme to reduce fatal occupational injuries

PubMed Central

Menendez, Cammie Chaumont; Castillo, Dawn; Rosenman, Kenneth; Harrison, Robert; Hendricks, Scott

2015-01-01

Background The Fatality Assessment and Control Evaluation (FACE) programme was established by the National Institute for Occupational Safety and Health to help prevent occupational traumatic fatalities by funding states to conduct targeted fatality investigations within cause-specific focus areas and associated prevention efforts. Purpose To investigate the impact of the state-based FACE programme on two previous focus areas. Methods A longitudinal time-series analysis spanning 22 years compared state fatality rates for occupational falls and electrocutions before and after FACE programme funding with states not receiving FACE programme funding. Lag periods were utilised to allow time for the programme to have an effect, and rates were adjusted for a variety of covariates. Separate analyses were conducted for each injury outcome. Results A reduction in fall fatality rates that was of borderline significance (1-year lag adjRR=0.92 (0.84 to 1.00)) and a non-significant reduction in electrocution fatality rates (3-year lag adjRR=0.92 (0.82 to 1.03)) were observed in states with FACE programme funding, Best-fit models presented two separate lag periods. Conclusions While it is challenging to quantitatively evaluate effectiveness of programmes such as FACE, the data suggest the FACE programme may be effective in preventing occupational injury deaths within its outcome focus areas throughout the state. It is important to look for ways to measure intermediate effects more precisely, as well as ways to maintain effects over time. PMID:22864251

Developing information literacy: a key to evidence-based nursing.

PubMed

Shorten, A; Wallace, M C; Crookes, P A

2001-06-01

This report describes the evaluation of a curriculum-integrated programme designed to help students develop an awareness of the nursing literature, the skills to locate and retrieve it, and skills required in its evaluation; in other words'information literacy'. Positive changes in student performance on objective measures of information-literacy skills were revealed as well as a significant increase in the levels of confidence of the student in performing those skills. Students who had undertaken the information-literacy programme ('programme' students) performed better on a range of objective measures of information literacy, as well as reporting higher levels of confidence in these skills, than students who had not participated in the programme ('non-programme' students). Evaluation of this programme provides evidence of the potential usefulness of a curriculum-integrated approach for the development of information-literacy skills within nursing education. With these underlying skills, students will be better equipped to consolidate and extend their key information-literacy skills to include research appreciation and application. These are vital for effective lifelong learning and a prerequisite to evidence-based practice.

Evaluation of a pilot oral health promotion programme 'Keep Smiling': perspectives from GDPs, health champions and school staff.

PubMed

Yusuf, H; Wright, K; Robertson, C

2015-04-24

To evaluate a pilot oral health promotion programme (fluoride varnish and tooth brushing), targeting 3-7-year-olds in primary schools in a deprived area of London. A pilot programme was conducted among five primary schools targeting 3-7-year-old children in a deprived area of London. The programme consisted of a fluoride varnish application and tooth brushing sessions. Outcome (participation rates) and process evaluations were carried out using semi-structured interviews with school staff, health champions and dentists. Overall, 79.2% of the targeted children participated in tooth brushing and 68.6% of children received fluoride varnish. The programme received positive feedback from school staff, dental teams and health champions. It raised awareness of dental health among all stakeholders and provided children with a unique experience, creating a positive image of dental teams. Community engagement and collaboration between health, education and the voluntary sector is feasible and integral in developing oral health promotion programmes aimed at children attending primary schools in a deprived area of London.

Evaluating an in-home multicomponent cognitive behavioural programme to manage concerns about falls and associated activity avoidance in frail community-dwelling older people: Design of a randomised control trial [NCT01358032

PubMed Central

2011-01-01

Background Concerns about falls are frequently reported by older people. These concerns can have serious consequences such as an increased risk of falls and the subsequent avoidance of activities. Previous studies have shown the effectiveness of a multicomponent group programme to reduce concerns about falls. However, owing to health problems older people may not be able to attend a group programme. Therefore, we adapted the group approach to an individual in-home programme. Methods/Design A two-group randomised controlled trial has been developed to evaluate the in-home multicomponent cognitive behavioural programme to manage concerns about falls and associated activity avoidance in frail older people living in the community. Persons were eligible for study if they were 70 years of age or over, perceived their general health as fair or poor, had at least some concerns about falls and associated avoidance of activity. After screening for eligibility in a random sample of older people, eligible persons received a baseline assessment and were subsequently allocated to the intervention or control group. Persons assigned to the intervention group were invited to participate in the programme, while those assigned to the control group received care as usual. The programme consists of seven sessions, comprising three home visits and four telephone contacts. The sessions are aimed at instilling adaptive and realistic views about falls, as well as increasing activity and safe behaviour. An effect evaluation, a process evaluation and an economic evaluation are conducted. Follow-up measurements for the effect evaluation are carried out 5 and 12 months after the baseline measurement. The primary outcomes of the effect evaluation are concerns about falls and avoidance of activity as a result of these concerns. Other outcomes are disability and falls. The process evaluation measures: the population characteristics reached; protocol adherence by facilitators; protocol adherence by participants (engagement in exposure and homework); opinions about the programme of participants and facilitators; perceived benefits and achievements; and experienced barriers. The economic evaluation examines the impact on health-care utilisation, as well as related costs. Discussion A total number of 389 participants is included in the study. Final results are expected in 2012. Trial registration NCT01358032 PMID:21933436

Improving community development by linking agriculture, nutrition and education: design of a randomised trial of "home-grown" school feeding in Mali.

PubMed

Masset, Edoardo; Gelli, Aulo

2013-02-21

Providing food through schools has well documented effects in terms of the education, health and nutrition of school children. However, there is limited evidence in terms of the benefits of providing a reliable market for small-holder farmers through "home-grown" school feeding approaches. This study aims to evaluate the impact of school feeding programmes sourced from small-holder farmers on small-holder food security, as well as on school children's education, health and nutrition in Mali. In addition, this study will examine the links between social accountability and programme performance. This is a field experiment planned around the scale-up of the national school feeding programme, involving 116 primary schools in 58 communities in food insecure areas of Mali. The randomly assigned interventions are: 1) a school feeding programme group, including schools and villages where the standard government programme is implemented; 2) a "home-grown" school feeding and social accountability group, including schools and villages where the programme is implemented in addition to training of community based organisations and local government; and 3) the control group, including schools and household from villages where the intervention will be delayed by at least two years, preferably without informing schools and households. Primary outcomes include small-holder farmer income, school participation and learning, and community involvement in the programme. Other outcomes include nutritional status and diet-diversity. The evaluation will follow a mixed method approach, including household, school and village level surveys as well as focus group discussions with small-holder farmers, school children, parents and community members. The impact evaluation will be incorporated within the national monitoring and evaluation (M&E) system strengthening activities that are currently underway in Mali. Baselines surveys are planned for 2012. A monthly process monitoring visits, spot checks and quarterly reporting will be undertaken as part of the regular programme monitoring activities. Evaluation surveys are planned for 2014. National governments in sub-Saharan Africa have demonstrated strong leadership in the response to the recent food and financial crises by scaling-up school feeding programmes. "Home-grown" school feeding programmes have the potential to link the increased demand for school feeding goods and services to community-based stakeholders, including small-holder farmers and women's groups. Alongside assessing the more traditional benefits to school children, this evaluation will be the first to examine the impact of linking school food service provision to small-holder farmer income, as well as the link between community level engagement and programme performance. ISRCTN76705891.

Evaluation and impact of cardiotocography training programmes: a systematic review.

PubMed

Pehrson, C; Sorensen, J L; Amer-Wåhlin, I

2011-07-01

The interpretation and management of cardiotocography (CTG) tracings are often criticised in obstetric malpractice cases. As a consequence, regular CTG training has been recommended, even though little is known about the effect of CTG training. To perform a systematic review of the existing literature on studies on CTG training in order to assess educational strategies, evaluation of training programmes, and impact of training programmes. The Medline database was searched to identify studies describing and/or evaluating CTG training programmes. The literature search resulted in 409 citations. Twenty studies describing and evaluating CTG training programmes were included. There was no restriction on study design. Data regarding study design, study quality, educational strategies used for training in CTG interpretation and decision making, target groups, number of participants, methods used for evaluation, quality of evaluation, level of evaluation and results of training was extracted from 20 articles, and analysed using Kirkpatrick's four-level model for the evaluation of education. Training was associated with improvements on all Kirkpatrick levels, resulting in increased CTG knowledge and interpretive skills, higher interobserver agreement, better management of intrapartum CTG, and improved quality of care. Computer-based training (CBT) might be less time-consuming than classroom teaching. Clinical skills seem to decrease faster than theoretical knowledge. Training can improve CTG competence and clinical practise. Further research on CBT, test-enhanced learning and long-term retention, evaluation of training and impact on clinical outcomes is recommended. © 2011 The Authors BJOG An International Journal of Obstetrics and Gynaecology © 2011 RCOG.

Uncovering Contradictions in Evaluation: The Case of the Music Education Programme at the University of Granada

ERIC Educational Resources Information Center

Arostegui, Jose Luis

2004-01-01

This paper reports the evaluation carried out on the Music Teacher Education programme at the University of Granada. The first section deals with the European, national and university framework in which that evaluation was done. The four-stage methodology for collecting data, raising interpretations, external evaluation, and final report…

Alleviating psychological distress of suicide survivors: evaluation of a volunteer care programme.

PubMed

Lu, Y-J; Chang, H-J; Tung, Y-Y; Hsu, M-C; Lin, M-F

2011-06-01

The crisis level in the worldwide suicide rate has revealed a severe suicide problem in Taiwan that is now well above the world average of 16 per 100,000 individuals. Many countries have relied on suicide care volunteers training programmes to conduct suicide prevention programmes. However, there is a dearth of research evaluating the effect of volunteers on psychological distress and the impact of volunteer experience level. An evaluation of the impact of experienced and novice volunteers in alleviating psychological distress of suicide survivors was conducted. A supervised programme trained 15 volunteers at Years 1 and 2. Year 1 volunteers completed 400 h of service with continuing education. Programme evaluation occurred after Year 2 volunteers had completed training. Eighty-two suicide survivors were recruited. With 60 suicide survivors completing 3 month of volunteer care, a significant group difference with time interaction in suicide survivors who exhibited moderate to severe distress between the veteran care and novice care groups was found. Compared with novice volunteers, veteran volunteers with at least 1 year of experience are more effective with suicide survivors reporting higher psychological distress. © 2011 Blackwell Publishing.

Case study of evaluations that go beyond clinical outcomes to assess quality improvement diabetes programmes using the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE).

PubMed

Paquette-Warren, Jann; Harris, Stewart B; Naqshbandi Hayward, Mariam; Tompkins, Jordan W

2016-10-01

Investments in efforts to reduce the burden of diabetes on patients and health care are critical; however, more evaluation is needed to provide evidence that informs and supports future policies and programmes. The newly developed Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE) incorporates the theoretical concepts needed to facilitate the capture of critical information to guide investments, policy and programmatic decision making. The aim of the study is to assess the applicability and value of DEFINE in comprehensive real-world evaluation. Using a critical and positivist approach, this intrinsic and collective case study retrospectively examines two naturalistic evaluations to demonstrate how DEFINE could be used when conducting real-world comprehensive evaluations in health care settings. The variability between the cases and the evaluation designs are described and aligned to the DEFINE goals, steps and sub-steps. The majority of the theoretical steps of DEFINE were exemplified in both cases, although limited for knowledge translation efforts. Application of DEFINE to evaluate diverse programmes that target various chronic diseases is needed to further test the inclusivity and built-in flexibility of DEFINE and its role in encouraging more comprehensive knowledge translation. This case study shows how DEFINE could be used to structure or guide comprehensive evaluations of programmes and initiatives implemented in health care settings and support scale-up of successful innovations. Future use of the framework will continue to strengthen its value in guiding programme evaluation and informing health policy to reduce the burden of diabetes and other chronic diseases. © 2016 The Authors. Journal of Evaluation in Clinical Practice published by John Wiley & Sons, Ltd.

Setting the Context for Using Complexity Theory in Evaluation: Boundaries, Governance and Utilisation

ERIC Educational Resources Information Center

Walton, Mat

2016-01-01

Recent literature has usefully explored the application of complexity theory to evaluation. However, there is little discussion of the contextual conditions in applying complexity theory. Drawing upon a single complexity-consistent public health programme evaluation and subsequent policy decisions, this paper considers how programme framing and…

The EUA Institutional Evaluation Programme: An Account of Institutional Best Practices

ERIC Educational Resources Information Center

Rosa, Maria Joao; Cardoso, Sonia; Dias, Diana; Amaral, Alberto

2011-01-01

When evaluating the EUA Institutional Evaluation Programme (IEP), Nilsson "et al." emphasised the interest in creating a data bank on good practices derived from its reports that would contribute to disseminating examples of effective quality management practices and to supporting mutual learning among universities. In IEP, evaluated…

Appreciation and implementation of the Krachtvoer healthy diet promotion programme for 12- to 14- year-old students of prevocational schools

PubMed Central

2011-01-01

Background Krachtvoer is a school-based healthy diet programme, developed in 2001 and revised in 2007 to meet the needs of particular segments of the target population as well as a wider target group. The main aims of the present process evaluation of the revised programme were to examine student and teacher appreciation of the programme, completeness of and adherence to its implementation, and relations between appreciation and completeness of implementation. Methods Data were collected among 22 teachers and 1117 students of 13 schools, using student evaluation forms, teacher logbooks, telephone interviews, and classroom observations. Results Results indicate favourable levels of teacher and student appreciation for the programme in general and the revised elements. Girls, first-year students and students with more favourable dietary intakes particularly appreciated individual programme elements. Levels of completeness of implementation were high, but several teachers did not adhere to the intended implementation period. Some moderately strong relations were found between teacher appreciation and completeness of implementation scores. Conclusion We conclude that the revisions have resulted in a programme that was appreciated well, also by the extended target group, and was implemented with a high degree of completeness. Teacher appreciation proved potentially important for completeness of implementation. We identified several aspects requiring improvement, indicating the importance of continued programme updates and repeated evaluation. PMID:22151954

"We Didn't Even Realize that Kids like Us Could Go on the Radio"--An Evaluation of a Victorian Schools Youth Development Programme

ERIC Educational Resources Information Center

Broadbent, Robyn S.; Papadopoulos, Theo

2010-01-01

This paper reports on a comprehensive evaluation of the Advance programme by Victoria University in 2007/08. Advance is a flexible school-based programme for young people to volunteer or implement a project of benefit to their communities in the state of Victoria, in Australia. It is a partnership between the Office for Youth, Victorian government…

Communities of teaching practice in the workplace: Evaluation of a faculty development programme.

PubMed

Schreurs, Marie-Louise; Huveneers, Wilma; Dolmans, Diana

2016-08-01

The focus of faculty development (FD) has recently shifted from individual and formal learning to formal and informal learning by a team of teachers in the workplace where the teaching is actually effected. This study aimed to evaluate the impact of a faculty development programme on teachers' educational workplace environment. We invited 23 teachers, who had successfully completed a University Teaching Qualification (UTQ) programme, to evaluate the faculty development programme and participate in focus group discussions. This UTQ programme spanned one year and covered 185 hours of formal and informal learning and training activities and formal coaching. After having obtained their UTQ, teachers reported that coaching enhances reflection and feedback, to participate more frequently in educational networks, which enhances consultation among teachers, increased awareness of organizational educational policies and more confidence in fulfilling educational tasks and activities. The evaluation of the UTQ programme demonstrated to enhance the development of a community of teachers at the workplace who share a passion for education and provide each other with support and feedback, which triggered a change in culture enhancing improvement of education. However, this did not hold for all teachers. Inhibiting factors hold sway, such as a prevailing commitment to research over education in some departments and a lack of interest in education by some department chairs.

An evaluation of Well Ways, a family education programme for carers of people with a mental illness.

PubMed

Stephens, Jessica R; Farhall, John; Farnan, Sue; Ratcliff, Kirk M

2011-01-01

Family education programmes aim to improve the well-being of carers of people with a mental illness. We evaluated the effectiveness of one such programme, Well Ways, in reducing negative care-giving consequences. We employed a pre-post design to evaluate the effectiveness of Well Ways in a naturalistic setting using a sample of carers of people with a mental illness. The Involvement Evaluation Questionnaire, a measure of care-giving consequences including worrying, tension, urging and supervision, and incorporating the General Health Questionnaire-12 (GHQ-12), was completed by 459 carers before and after participation in Well Ways. Participants' worrying, tension, urging and distress (GHQ-12) were significantly lower following completion of the programme. These improvements were maintained at 3 and 6 month follow up. Carers of people with a psychotic disorder experienced significantly greater reductions in worrying than did other carers. Females reported significantly greater reductions in tension than did males. Findings indicated support for the effectiveness of the Well Ways programme in reducing negative care-giving consequences for families of people with a mental illness. Given the evidence of poor psychological health and negatively appraised family relationships observed at baseline, these findings highlight the need for programmes such as Well Ways.

A model to evaluate quality and effectiveness of disease management.

PubMed

Lemmens, K M M; Nieboer, A P; van Schayck, C P; Asin, J D; Huijsman, R

2008-12-01

Disease management has emerged as a new strategy to enhance quality of care for patients suffering from chronic conditions, and to control healthcare costs. So far, however, the effects of this strategy remain unclear. Although current models define the concept of disease management, they do not provide a systematic development or an explanatory theory of how disease management affects the outcomes of care. The objective of this paper is to present a framework for valid evaluation of disease-management initiatives. The evaluation model is built on two pillars of disease management: patient-related and professional-directed interventions. The effectiveness of these interventions is thought to be affected by the organisational design of the healthcare system. Disease management requires a multifaceted approach; hence disease-management programme evaluations should focus on the effects of multiple interventions, namely patient-related, professional-directed and organisational interventions. The framework has been built upon the conceptualisation of these disease-management interventions. Analysis of the underlying mechanisms of these interventions revealed that learning and behavioural theories support the core assumptions of disease management. The evaluation model can be used to identify the components of disease-management programmes and the mechanisms behind them, making valid comparison feasible. In addition, this model links the programme interventions to indicators that can be used to evaluate the disease-management programme. Consistent use of this framework will enable comparisons among disease-management programmes and outcomes in evaluation research.

A nurse-led intensive care after-care programme - development, experiences and preliminary evaluation.

PubMed

Samuelson, Karin A M; Corrigan, Ingrid

2009-01-01

The benefits of critical care follow-up services include increased understanding of the long-term consequences of intensive care and entail helping patients and their next of kin to come to terms with their problems and distress following critical illness and intensive care treatment. To establish an intensive care after-care programme and to conduct a preliminary evaluation of the follow-up service from the patients' and relatives' perspectives in a general intensive care unit (ICU) in Sweden. A descriptive and evaluative design was used, and data from the first year of the after-care programme were collected. The final programme was nurse led and included five main points; a patient diary with colour photographs, ward visits, a patient information pamphlet, a follow-up consultation 2-3 months after intensive care discharge and feedback to the ICU staff. An evaluation questionnaire was handed out to patients and next of kin attending the follow-up clinic, e.g. asking the respondents to rate their satisfaction of the consultation on a visual analogue scale (VAS). The first year of after-care statistics showed that 170 survivors with a stay of 48 h or more were discharged from the ICU, resulting in 190 ward visits and 79 follow-up consultations. The preliminary evaluation revealed that the 2-month follow-up consultation achieved a median VAS rating of 9.8 (ranging from 1 to 10, poor to excellent) from both patients and next of kin. The development and preliminary evaluation of this nurse-led intensive care programme resulted in a feasible programme, requiring modest resources, with a high level of patient and relative satisfaction. This paper attempts to share with professional colleagues important steps during the developmental process of establishing an intensive care follow-up service and presents the content and preliminary evaluation of a nurse-led intensive care after-care programme focusing on the patients' and relatives' perspectives.

Developing Multi-Agency Teams: Implications of a National Programme Evaluation

ERIC Educational Resources Information Center

Simkins, Tim; Garrick, Ros

2012-01-01

This paper explores the factors which influence the effectiveness of formal development programmes targeted at multi-agency teams in children's services. It draws on two studies of the National College for School Leadership's Multi-Agency Teams Development programme, reporting key characteristics of the programme, short-term outcomes in terms of…

How to calculate the annual costs of NGO-implemented programmes to support orphans and vulnerable children: a six-step approach

PubMed Central

2011-01-01

Background Information on the costs of implementing programmes designed to provide support of orphans and vulnerable children (OVC) in sub-Saharan Africa and elsewhere is increasingly being requested by donors for programme evaluation purposes. To date, little information exists to document the costs and structure of costs of OVC programmes as actually implemented "on the ground" by local non-governmental organizations (NGOs). This analysis provides a practical, six-step approach that NGOs can incorporate into routine operations to evaluate their costs of implementing their OVC programmes annually. This approach is applied to the Community-Based Care for Orphans and Vulnerable Children (CBCO) Program implemented by BIDII (a Kenyan NGO) in Eastern Province of Kenya. Methods and results The costing methodology involves the following six steps: accessing and organizing the NGO's annual financial report into logical sub-categories; reorganizing the sub-categories into input cost categories to create a financial cost profile; estimating the annual equivalent payment for programme equipment; documenting donations to the NGO for programme implementation; including a portion of NGO organizational costs not attributed to specific programmes; and including the results of Steps 3-5 into an expanded cost profile. Detailed results are provided for the CBCO programme. Conclusions This paper shows through a concrete example how NGOs implementing OVC programmes (and other public health programmes) can organize themselves for data collection and documentation prospectively during the implementation of their OVC programmes so that costing analyses become routine practice to inform programme implementation rather than a painful and flawed retrospective activity. Such information is required if the costs and outcomes achieved by OVC programmes will ever be clearly documented and compared across OVC programmes and other types of programmes (prevention, treatment, etc.). PMID:22182588

How to calculate the annual costs of NGO-implemented programmes to support orphans and vulnerable children: a six-step approach.

PubMed

Larson, Bruce A; Wambua, Nancy

2011-12-19

Information on the costs of implementing programmes designed to provide support of orphans and vulnerable children (OVC) in sub-Saharan Africa and elsewhere is increasingly being requested by donors for programme evaluation purposes. To date, little information exists to document the costs and structure of costs of OVC programmes as actually implemented "on the ground" by local non-governmental organizations (NGOs). This analysis provides a practical, six-step approach that NGOs can incorporate into routine operations to evaluate their costs of implementing their OVC programmes annually. This approach is applied to the Community-Based Care for Orphans and Vulnerable Children (CBCO) Program implemented by BIDII (a Kenyan NGO) in Eastern Province of Kenya. The costing methodology involves the following six steps: accessing and organizing the NGO's annual financial report into logical sub-categories; reorganizing the sub-categories into input cost categories to create a financial cost profile; estimating the annual equivalent payment for programme equipment; documenting donations to the NGO for programme implementation; including a portion of NGO organizational costs not attributed to specific programmes; and including the results of Steps 3-5 into an expanded cost profile. Detailed results are provided for the CBCO programme. This paper shows through a concrete example how NGOs implementing OVC programmes (and other public health programmes) can organize themselves for data collection and documentation prospectively during the implementation of their OVC programmes so that costing analyses become routine practice to inform programme implementation rather than a painful and flawed retrospective activity. Such information is required if the costs and outcomes achieved by OVC programmes will ever be clearly documented and compared across OVC programmes and other types of programmes (prevention, treatment, etc.).

Case study of evaluations that go beyond clinical outcomes to assess quality improvement diabetes programmes using the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE)

PubMed Central

Harris, Stewart B.; Naqshbandi Hayward, Mariam; Tompkins, Jordan W.

2016-01-01

Abstract Rationale, aims and objectives Investments in efforts to reduce the burden of diabetes on patients and health care are critical; however, more evaluation is needed to provide evidence that informs and supports future policies and programmes. The newly developed Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE) incorporates the theoretical concepts needed to facilitate the capture of critical information to guide investments, policy and programmatic decision making. The aim of the study is to assess the applicability and value of DEFINE in comprehensive real‐world evaluation. Method Using a critical and positivist approach, this intrinsic and collective case study retrospectively examines two naturalistic evaluations to demonstrate how DEFINE could be used when conducting real‐world comprehensive evaluations in health care settings. Results The variability between the cases and the evaluation designs are described and aligned to the DEFINE goals, steps and sub‐steps. The majority of the theoretical steps of DEFINE were exemplified in both cases, although limited for knowledge translation efforts. Application of DEFINE to evaluate diverse programmes that target various chronic diseases is needed to further test the inclusivity and built‐in flexibility of DEFINE and its role in encouraging more comprehensive knowledge translation. Conclusions This case study shows how DEFINE could be used to structure or guide comprehensive evaluations of programmes and initiatives implemented in health care settings and support scale‐up of successful innovations. Future use of the framework will continue to strengthen its value in guiding programme evaluation and informing health policy to reduce the burden of diabetes and other chronic diseases. PMID:26804339

Is the delivery of a quality improvement education programme in obstetrics and gynaecology for final year medical students feasible and still effective in a shortened time frame?

PubMed

Kool, Bridget; Wise, Michelle R; Peiris-John, Roshini; Sadler, Lynn; Mahony, Faith; Wells, Susan

2017-05-26

Teaching clinical audit skills to nascent health professionals is one strategy to improve frontline care. The undergraduate medical curriculum at the University of Auckland provides improvement science theory and skills in Year 5 teaching, and the opportunity to put this into practice during an Obstetrics and Gynaecology (O&G) clinical attachment in Year 6. In 2015, a revised medical school curriculum at the university resulted in a planned reduction of the O&G attachment from five weeks to four, necessitating revision of the Year 6 Quality Improvement (QI) project. The aim of this study was to evaluate if the revised programme provided an important experiential learning opportunity for medical students without imposing an unsustainable burden on clinical services. Based on a CIPP (Context/Input/Process/Product) evaluation model, the study was conducted in several stages to get a sense of the context as the new programme was being planned (Context evaluation), the feasibility of an alternative approach to meet the educational need (Input evaluation), the implementation of the revised programme (Process evaluation) and finally, the programme outcomes (Product evaluation). We used multiple data sources (supervisors, students, academic administrators, and hospital staff) and data collection methods (questionnaires, focus groups, individual interviews, consultative workshops, student reports and oral presentations). The context evaluation revealed the Year 6 QI programme to be valuable and contributed to O&G service improvements, however, the following concerns were identified: time to complete the project, timely topic selection and access to data, recognition of student achievement, and staff workload. The evaluation of the revised QI project indicated improvement in student perceptions of their QI knowledge and skills, and most areas previously identified as challenging, despite the concurrent reduction in the duration of the O&G attachment. Applying the CIPP model for evaluation to our revised QI programme enabled streamlining of procedures to achieve greater efficiency without compromising the quality of the learning experience, or increasing pressure on staff. A four week clinical rotation is adequate for medical educators to consider opportunities for including QI projects as part of student experiential learning.

Private animal health and welfare standards in quality assurance programmes: a review and proposed framework for critical evaluation.

PubMed

More, S J; Hanlon, A; Marchewka, J; Boyle, L

2017-06-24

In recent years, 'private standards' in animal health and welfare have become increasingly common, and are often incorporated into quality assurance (QA) programmes. Here, we present an overview of the use of private animal health and welfare standards in QA programmes, and propose a generic framework to facilitate critical programme review. Private standards are being developed in direct response to consumer demand for QA, and offer an opportunity for product differentiation and a means to drive consumer choice. Nonetheless, a range of concerns have been raised, relating to the credibility of these standards, their potential as a discriminatory barrier to trade, the multiplicity of private standards that have been developed, the lack of consumer input and compliance costs. There is a need for greater scrutiny of private standards and of associated QA programmes. We propose a framework to clarify the primary programme goal(s) and measureable outputs relevant to animal health and welfare, the primary programme beneficiaries and to determine whether the programme is effective, efficient and transparent. This paper provides a theoretical overview, noting that this framework could be used as a tool directly for programme evaluation, or as a tool to assist with programme development and review. British Veterinary Association.

Towards Developing an Initial Programme Theory: Programme Designers and Managers Assumptions on the Antiretroviral Treatment Adherence Club Programme in Primary Health Care Facilities in the Metropolitan Area of Western Cape Province, South Africa.

PubMed

Mukumbang, Ferdinand C; van Belle, Sara; Marchal, Bruno; van Wyk, Brian

2016-01-01

The antiretroviral adherence club intervention was rolled out in primary health care facilities in the Western Cape province of South Africa to relieve clinic congestion, and improve retention in care, and treatment adherence in the face of growing patient loads. We adopted the realist evaluation approach to evaluate what aspects of antiretroviral club intervention works, for what sections of the patient population, and under which community and health systems contexts, to inform guidelines for scaling up of the intervention. In this article, we report on a step towards the development of a programme theory-the assumptions of programme designers and health service managers with regard to how and why the adherence club intervention is expected to achieve its goals and perceptions on how it has done so (or not). We adopted an exploratory qualitative research design. We conducted a document review of 12 documents on the design and implementation of the adherence club intervention, and key informant interviews with 12 purposively selected programme designers and managers. Thematic content analysis was used to identify themes attributed to the programme actors, context, mechanisms, and outcomes. Using the context-mechanism-outcome configurational tool, we provided an explanatory focus of how the adherence club intervention is roll-out and works guided by the realist perspective. We classified the assumptions of the adherence club designers and managers into the rollout, implementation, and utilisation of the adherence club programme, constructed around the providers, management/operational staff, and patients, respectively. Two rival theories were identified at the patient-perspective level. We used these perspectives to develop an initial programme theory of the adherence club intervention, which will be tested in a later phase. The perspectives of the programme designers and managers provided an important step towards developing an initial programme theory, which will guide our realist evaluation of the adherence club programme in South Africa.

Interprofessional Education and Practice Guide No. 7: Development, implementation, and evaluation of a large-scale required interprofessional education foundational programme.

PubMed

Shrader, Sarah; Hodgkins, Renee; Laverentz, Delois; Zaudke, Jana; Waxman, Michael; Johnston, Kristy; Jernigan, Stephen

2016-09-01

Health profession educators and administrators are interested in how to develop an effective and sustainable interprofessional education (IPE) programme. We describe the approach used at the University of Kansas Medical Centre, Kansas City, United States. This approach is a foundational programme with multiple large-scale, half-day events each year. The programme is threaded with common curricular components that build in complexity over time and assures that each learner is exposed to IPE. In this guide, lessons learned and general principles related to the development of IPE programming are discussed. Important areas that educators should consider include curriculum development, engaging leadership, overcoming scheduling barriers, providing faculty development, piloting the programming, planning for logistical coordination, intentionally pairing IP facilitators, anticipating IP conflict, setting clear expectations for learners, publicising the programme, debriefing with faculty, planning for programme evaluation, and developing a scholarship and dissemination plan.

The Community Connection Model: implementation of best evidence into practice for self-management of chronic diseases.

PubMed

Liddy, C; Johnston, S; Irving, H; Nash, K

2013-06-01

With chronic diseases becoming an increasing burden for healthcare systems worldwide, self-management support has gained traction in many health regions and organizations. However, the real-world application of the findings from clinical trials into actual community programming is not self-evident. The aim of this study was to present a model of programme implementation, namely the Community Connection Model. The process of implementing a chronic disease self-management programme has been documented in detail from its initial inception through to a sustainable programme. This account includes a description of the strategic activities undertaken (e.g. alignment with local policy and the formation of community partnerships) and the specific steps taken on the path to programme implementation (e.g. a scoping literature review, an environmental scan and a pilot programme with an evaluation component). Reflection on this case example suggests that a cognizance of the interactions between policy, partnership, planning and programme could act as a useful tool to guide programme implementation, evaluation and sustainability. Multiple types of self-management support have been implemented (as part of the Living Health Champlain programme), and are being evaluated and adapted in response to new evidence, shifting priorities and direction from more partners. The widespread access means that self-management support programmes are becoming part of the culture of care in the study region. Establishing a connection around an important health problem, ensuring active partnerships, adequate planning and early implementation of a programme grounded on the principles of applying best-available evidence can lead to successful solutions. The Community Connection Model is proposed as a way of conceptualizing these processes. Copyright © 2013 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Impact of pandemic flu training on ability of medical personnel to recognize an index case of avian influenza.

PubMed

Adini, Bruria; Goldberg, Avishay; Cohen, Robert; Bar-Dayan, Yaron

2012-04-01

This study investigated the relationship between training programmes for pandemic flu and level of knowledge of health-care professionals with performance in an avian flu exercise. Training programmes of all general hospitals in Israel for managing a pandemic influenza were evaluated. Spearman's ρ correlation was used to analyse the relationship between training scores and level of knowledge of medical personnel with performance in an avian flu exercise. Hospital preparedness levels were evaluated at two time points and Wilcoxon signed-rank test was used to determine if overall preparedness scores improved over time. Evaluation of training programmes for pandemic influenza showed high to very high scores in most hospitals (mean 85, SD 22). Significant correlations between training and performance in the exercise were noted for: implementation of training programmes 0.91, P = 0.000; designating personnel for training 0.87, P = 0.000; content of training 0.61, P = 0.001; and training materials 0.36, P = 0.05. Overall reliability of the evaluation scores was 0.82 and reliability for two of the sub-scales was: implementation of the programme 0.78; and designating personnel for training 0.37. No significant correlation was found between level of knowledge and performance in the exercise. Training programmes for hospital personnel for pandemic flu have a significant role in improving performance in case of pandemic flu. The key component of the training programme appears to be the implementation of the programme. Use of knowledge tests should be further investigated, as they do not appear to correlate with the level of emergency preparedness for pandemic influenza.

Evaluation of an occupational health intervention programme on whole‐body vibration in forklift truck drivers: a controlled trial

PubMed Central

Hulshof, C T J; Verbeek, J H A M; Braam, I T J; Bovenzi, M; van Dijk, F J H

2006-01-01

Objectives To evaluate process and outcome of a multifaceted occupational health intervention programme on whole‐body vibration (WBV) in forklift truck drivers. Methods An experimental pretest/post‐test control group study design. The authors trained occupational health services (OHS) in the experimental group in the use of the programme. OHS in the control group were asked to deliver care as usual. In total, 15 OHS, 32 OHS professionals, 26 companies, and 260 forklift drivers were involved. Post‐test measurements were carried out one year after the start of the programme. Results Baseline data before the start of the programme showed no difference between experimental and control group. Results of the outcome evaluation indicate a slight, although not statistically significant, reduction of WBV exposure in the experimental group (p = 0.06). Process evaluation revealed a positive influence on company policy toward WBV, attitude and intended behaviour of forklift drivers, and a trend towards an increase in knowledge of OHS professionals and company managers. The number of observed control measures with a major impact (levelling of surface and reduction of speed) was rather low. In those cases where control measures had been taken, there was a significant reduction in WBV exposure. This limited effect of the programme might be caused by the short period of follow up and the dropout of participants. The feasibility and the usefulness of the programme within the OHS setting were rated good by the participants. Conclusions This programme to decrease WBV exposure was partially effective. Significant effects on intermediate objectives were observed. More research on the effectiveness of intervention in the field of WBV is needed. PMID:16551762

Evaluating Parenting Classes Held at a Secondary School

ERIC Educational Resources Information Center

Orchard, Linda

2007-01-01

The purpose of this research was to evaluate a parent intervention programme, open to parents of children in Year 7, aimed at assisting parents to help their children achieve their full potential. The benefit for parents themselves was also examined. Unlike many existing evaluations of parent intervention programmes, it drew upon statistically…

Evaluating the Implementation of an Emotional Wellbeing Programme for Primary School Children Using Participatory Approaches

ERIC Educational Resources Information Center

Clarke, Aleisha M.; Sixsmith, Jane; Barry, Margaret M.

2015-01-01

Objective: This paper reports on the use of child participatory approaches to evaluate the implementation and impact of the "Zippy's Friends" emotional wellbeing programme on children in disadvantaged primary schools in Ireland. Design: As part of the overall evaluation study, which comprised a clustered randomised controlled trial,…

Evaluation of quality improvement programmes

PubMed Central

Ovretveit, J; Gustafson, D

2002-01-01



 In response to increasing concerns about quality, many countries are carrying out large scale programmes which include national quality strategies, hospital programmes, and quality accreditation, assessment and review processes. Increasing amounts of resources are being devoted to these interventions, but do they ensure or improve quality of care? There is little research evidence as to their effectiveness or the conditions for maximum effectiveness. Reasons for the lack of evaluation research include the methodological challenges of measuring outcomes and attributing causality to these complex, changing, long term social interventions to organisations or health systems, which themselves are complex and changing. However, methods are available which can be used to evaluate these programmes and which can provide decision makers with research based guidance on how to plan and implement them. This paper describes the research challenges, the methods which can be used, and gives examples and guidance for future research. It emphasises the important contribution which such research can make to improving the effectiveness of these programmes and to developing the science of quality improvement. PMID:12486994

Employment and educational outcomes in early intervention programmes for early psychosis: a systematic review.

PubMed

Bond, G R; Drake, R E; Luciano, A

2015-10-01

Young adults with early psychosis want to pursue normal roles - education and employment. This paper summarises the empirical literature on the effectiveness of early intervention programmes for employment and education outcomes. We conducted a systematic review of employment/education outcomes for early intervention programmes, distinguishing three programme types: (1) those providing supported employment, (2) those providing unspecified vocational services and (3) those without vocational services. We summarised findings for 28 studies. Eleven studies evaluated early intervention programmes providing supported employment. In eight studies that reported employment outcomes separately from education outcomes, the employment rate during follow-up for supported employment patients was 49%, compared with 29% for patients receiving usual services. The two groups did not differ on enrolment in education. In four controlled studies, meta-analysis showed that the employment rate for supported employment participants was significantly higher than for control participants, odds ratio = 3.66 [1.93-6.93], p < 0.0001. Five studies (four descriptive and one quasi-experimental) of early intervention programmes evaluating unspecified vocational services were inconclusive. Twelve studies of early intervention programmes without vocational services were methodologically heterogeneous, using diverse methods for evaluating vocational/educational outcomes and precluding a satisfactory meta-analytic synthesis. Among studies with comparison groups, 7 of 11 (64%) reported significant vocational/education outcomes favouring early intervention over usual services. In early intervention programmes, supported employment moderately increases employment rates but not rates of enrolment in education. These improvements are in addition to the modest effects early programmes alone have on vocational/educational outcomes compared with usual services.

Mental health promotion in the Internet age: a consultation with Australian young people to inform the design of an online mindfulness training programme.

PubMed

Monshat, Kaveh; Vella-Brodrick, Dianne; Burns, Jane; Herrman, Helen

2012-06-01

Mindfulness training (MT) has been shown to lead to significant improvements in psychological distress and emotion regulation skills. The Internet has many advantages as a medium for building emotional skills in young people. The aim of this study was to involve young people in designing an online MT programme. A draft programme was initially designed based on a review of the literature and an established face-to-face programme for medical students. Twenty young people were then recruited through online advertising and 13 (age 16-26) interviewed. They were asked to comment on how useful, easy to use and enjoyable they found the proposed programme and how the draft version and its planned evaluation strategy could be improved. Interviewee responses were independently processed by two of the authors within a qualitative thematic analysis paradigm. The results showed that young people were eager to engage with the design of this health promotion programme and provided valuable input. All interviewees believed that young people would find the programme desirable. They provided a variety of suggestions about how training structure and content could be improved, how best it could be evaluated and how young people could be encouraged to engage with and complete the programme. It thus appears that online MT is a feasible mental health promotion strategy for young people and that it can be evaluated in a controlled trial. The result of this consultation process was the Mindful Awareness Training and Education (MATE) programme, which has been detailed.

Evaluating the Success of a Science Academic Development Programme at a Research-Intensive University

ERIC Educational Resources Information Center

Engelbrecht, Johann; Harding, Ansie; Potgieter, Marietjie

2014-01-01

Academic development (AD) programmes for students not complying with the entrance requirements of mainstream programmes in science have been running at a number of universities in South Africa. In this study we contribute to the debate on criteria for the success of AD programmes, specifically in the context of research-intensive universities in…

Improving Physics Teaching through Action Research: The Impact of a Nationwide Professional Development Programme

ERIC Educational Resources Information Center

Grace, Marcus; Rietdijk, Willeke; Garrett, Caro; Griffiths, Janice

2015-01-01

This article presents an independent evaluation of the Action Research for Physics (ARP) programme, a nationwide professional development programme which trains teachers to use action research to increase student interest in physics and encourage them to take post-compulsory physics. The impact of the programme was explored from the perspective of…

Improving Numeracy and Literacy: Evaluation Report and Executive Summary

ERIC Educational Resources Information Center

Worth, Jack; Sizmur, Juliet; Ager, Rob; Styles, Ben

2015-01-01

The project, "Oxford Improving Numeracy and Literacy Programme," was delivered by Oxford University Department of Education. This evaluation tested two different initiatives with Year 2 children: "Mathematics and Reasoning" and "Literacy and Morphemes." The "Mathematics and Reasoning" programme aimed to…

Evaluating the delivery, impact, costs and benefits of an active lives programme for older people living in the community.

PubMed

Gandy, Rob; Bell, Amelia; McClelland, Bob; Roe, Brenda

2017-03-01

Aim Age UK Lancashire received Big Lottery funding to deliver an active lives programme from January 2012 to December 2014 to the population of West Lancashire aged over 50 years. The overall aims of the associated evaluation were to measure older people's experiences of participating in the programme, identify the impacts on their health and well-being and their suggestions for services development, and establish the costs and benefits of the programme. The World Health Organisation recommends older people should be able to achieve physical, social and mental well-being throughout their lives, and that international, national and local policies should be developed to support older adults, promote their independence and well-being, and encourage physical exercise. Consequently, the West Lancashire programme was to establish preventative community support for older people to assist in improving their well-being and physical and mental health, particularly those isolated due to age-related illness or disability. It was to provide interventions not available from local social care providers. A mixed methods approach was adopted, with the qualitative evaluation utilising focus groups to establish people's experiences, identify impacts on their health and well-being, and suggestions for services development. This paper describes the quantitative evaluation, which involved three surveys and a costs analysis. The surveys were scheduled to give timely feedback to management about programme delivery and content, and overall benefits of participation. Findings The active lives programme and groups offered a wide range of flexible and local activities that provided benefits for older people in terms of health and well-being, social well-being and quality of life, and reducing social isolation. There was interconnectivity between these benefits. The programme was delivered in an affordable and flexible manner. Such programmes should be made more widely available.

Improving capacity in ethnicity and health research: report of a tailored programme for NHS Public Health practitioners.

PubMed

Salway, Sarah; Piercy, Hilary; Chowbey, Punita; Brewins, Louise; Dhoot, Permjeet

2013-10-01

To determine whether an intervention designed to enhance research capacity among commissioners in the area of ethnicity and health was feasible and impactful, and to identify programme elements that might usefully be replicated elsewhere. How healthcare commissioners should be equipped to understand and address multiethnic needs has received little attention to-date. Being able to mobilise and apply evidence is a central element of the commissioning process that requires development. Researching ethnicity and health is widely recognised as challenging and several prior interventions have aimed to enhance competence in this area. These have, however, predominantly taken place in North America and have not been evaluated in detail. An innovative research capacity development programme was delivered to public health staff within a large healthcare commissioning organisation in England. Evaluation methodology drew on 'pluralistic' evaluation principles and included formative and summative elements. Participant evaluation forms gave immediate feedback during the programme. Participants also provided feedback at two weeks and 12 months after the programme ended. In addition, one participant and one facilitator provided reflective accounts of the programme's strengths and weaknesses, and programme impact was traced through ongoing partnership work. The programme was well received and had a tangible impact on knowledge, confidence and practice for most participants. Factors important to success included: embedding learning within the participants' work context; ensuring a balance between theory and practical tips to enhance confidence; and having sustained interaction between trainers and participants. Despite positive signs, the challenging nature of the topic was highlighted, as were wider structural and cultural factors that impede progress in this area. Although it is unrealistic to expect such programmes to have a major impact on commissioning practices, they may well make an important contribution to raising the confidence and competence of staff to undertake work in this area.

Formal mentoring programmes for medical students and doctors--a review of the Medline literature.

PubMed

Buddeberg-Fischer, Barbara; Herta, Katja-Daniela

2006-05-01

Mentoring programmes have been implemented as a specific career-advancement tool in the training and further education of various groups in the medical profession. The main focus of our investigation was to examine what types of structured mentoring programmes exist for doctors as well as for medical students, what short- and long-term goals these projects pursue, and whether statements can be made on the effectiveness and efficiency of these programmes. A literature-search strategy was applied to Medline for 1966-2002 using the keyword combinations: (a) mentor* [AND] program* [AND] medical students, and (b) mentor* [AND] program* [AND] physicians. Although a total of 162 publications were identified, only 16 papers (nine for medical students and seven for doctors) met the selected methodological criteria. The majority of the programmes lack a concrete structure as well as a short- and long-term evaluation. Main goals are to increase professional competence in research and in further specialization and to build up a professional network for the mentees; no statements are to be found on the advantages for the mentors. Programme evaluation is for the most part presented descriptively in terms of great interest and high level of satisfaction. No publication contains statements on the effectiveness or the efficiency of the programme. Although the results of mentoring are promising, more formal programmes with clear setup goals and a short- and long-term evaluation of the individual successes of the participants as well as the cost-benefit analysis are needed.

[Groups of statutory bodies and evaluation of health recovery programmes for mothers and their child(ren) - An application of a time-based break-even analysis].

PubMed

Schönig, W

2002-01-01

Public and private expenditure in health recovery programmes for mothers and their children is stagnating. A focal point to turn around this trend is to convince the responsible statury bodies by proving both effectiveness and efficiency of these programmes. The paper suggests the application of the break-even analysis on a time-based principle. A primary calculation with the data of a major German evaluation shows significant savings if the success of the health recovery programmes holds for at least 1.19 years. Available data does not cover such a long period.

Shared decision-making for psychiatric medication: A mixed-methods evaluation of a UK training programme for service users and clinicians.

PubMed

Ramon, Shulamit; Morant, Nicola; Stead, Ute; Perry, Ben

2017-12-01

Shared decision making (SDM) is recognised as a promising strategy to enhance good collaboration between clinicians and service users, yet it is not practised regularly in mental health. Develop and evaluate a novel training programme to enhance SDM in psychiatric medication management for service users, psychiatrists and care co-ordinators. The training programme design was informed by existing literature and local stakeholders consultations. Parallel group-based training programmes on SDM process were delivered to community mental health service users and providers. Evaluation consisted of quantitative measures at baseline and 12-month follow-up, post-programme participant feedback and qualitative interviews. Training was provided to 47 service users, 35 care-coordinators and 12 psychiatrists. Participant feedback was generally positive. Statistically significant changes in service users' decisional conflict and perceptions of practitioners' interactional style in promoting SDM occurred at the follow-up. Qualitative data suggested positive impacts on service users' and care co-ordinators confidence to explore medication experience, and group-based training was valued. The programme was generally acceptable to service users and practitioners. This indicates the value of conducting a larger study and exploring application for non-medical decisions.

Service impact of a national clinical leadership development programme: findings from a qualitative study.

PubMed

Fealy, Gerard M; McNamara, Martin S; Casey, Mary; O'Connor, Tom; Patton, Declan; Doyle, Louise; Quinlan, Christina

2015-04-01

The study reported here was part of a larger study, which evaluated a national clinical leadership development programme with reference to resources, participant experiences, participant outcomes and service impact. The aim of the present study was to evaluate the programme's service impact. Clinical leadership development develops competencies that are expressed in context. The outcomes of clinical leadership development occur at individual, departmental and organisational levels. The methods used to evaluate the service impact were focus groups, group interviews and individual interviews. Seventy participants provided data in 18 separate qualitative data collection events. The data contained numerous accounts of service development activities, initiated by programme participants, which improved service and/or improved the culture of the work setting. Clinical leadership development programmes that incorporate a deliberate service impact element can result in identifiable positive service outcomes. The nuanced relationship between leader development and service development warrants further investigation. This study demonstrates that clinical leadership development can impact on service in distinct and identifiable ways. Clinical leadership development programmes should focus on the setting in which the leadership competencies will be demonstrated. © 2013 John Wiley & Sons Ltd.

A national survey of medical education fellowships.

PubMed

Thompson, Britta M; Searle, Nancy S; Gruppen, Larry D; Hatem, Charles J; Nelson, Elizabeth A

2011-04-04

The purpose of our study was to determine the prevalence, focus, time commitment, graduation requirements and programme evaluation methods of medical education fellowships throughout the United States. Medical education fellowships are defined as a single cohort of medical teaching faculty who participate in an extended faculty development programme. A 26-item online questionnaire was distributed to all US medical schools (n=127) in 2005 and 2006. The questionnaire asked each school if it had a medical education fellowship and the characteristics of the fellowship programme. Almost half (n=55) of the participating schools (n=120, response rate 94.5 %) reported having fellowships. Duration (10-584 hours) and length (<1 month-48 months) varied; most focused on teaching skills, scholarly dissemination and curriculum design, and required the completion of a scholarly project. A majority collected participant satisfaction; few used other programme evaluation strategies. The number of medical education fellowships increased rapidly during the 1990s and 2000s. Across the US, programmes are similar in participant characteristics and curricular focus but unique in completion requirements. Fellowships collect limited programme evaluation data, indicating a need for better outcome data. These results provide benchmark data for those implementing or revising existing medical education fellowships.

A national survey of medical education fellowships

PubMed Central

Thompson, Britta M.; Searle, Nancy S.; Gruppen, Larry D.; Hatem, Charles J.; Nelson, Elizabeth A.

2011-01-01

Purpose The purpose of our study was to determine the prevalence, focus, time commitment, graduation requirements and programme evaluation methods of medical education fellowships throughout the United States. Medical education fellowships are defined as a single cohort of medical teaching faculty who participate in an extended faculty development programme. Methods A 26-item online questionnaire was distributed to all US medical schools (n=127) in 2005 and 2006. The questionnaire asked each school if it had a medical education fellowship and the characteristics of the fellowship programme. Results Almost half (n=55) of the participating schools (n=120, response rate 94.5 %) reported having fellowships. Duration (10–584 hours) and length (<1 month–48 months) varied; most focused on teaching skills, scholarly dissemination and curriculum design, and required the completion of a scholarly project. A majority collected participant satisfaction; few used other programme evaluation strategies. Conclusions The number of medical education fellowships increased rapidly during the 1990s and 2000s. Across the US, programmes are similar in participant characteristics and curricular focus but unique in completion requirements. Fellowships collect limited programme evaluation data, indicating a need for better outcome data. These results provide benchmark data for those implementing or revising existing medical education fellowships. PMID:21475643

Healthcare Programmes for Truck Drivers in Sub-Saharan Africa: A Systematic Review and Meta-Analysis

PubMed Central

Lalla-Edward, Samanta Tresha; Fobosi, Siyabulela Christopher; Hankins, Catherine; Case, Kelsey; Venter, W. D. Francois; Gomez, Gabriela

2016-01-01

Background Truck drivers have unique health needs, and by virtue of their continuous travel, experience difficulty in accessing healthcare. Currently, planning for effective care is hindered by lack of knowledge about their health needs and about the impact of on-going programmes on this population’s health outcomes. We reviewed healthcare programmes implemented for sub-Saharan African truck drivers, assessed the evaluation methods, and examined impact on health outcomes. Methods We searched scientific and institutional databases, and online search engines to include all publications describing a healthcare programme in sub-Saharan Africa where the main clients were truck drivers. We consulted experts and organisations working with mobile populations to identify unpublished reports. Forest plots of impact and outcome indicators with unadjusted risk ratios and 95% confidence intervals were created to map the impact of these programmes. We performed a subgroup analysis by type of indicator using a random-effects model to assess between-study heterogeneity. We conducted a sensitivity analysis to examine both the summary effect estimate chosen (risk difference vs. risk ratio) and model to summarise results (fixed vs. random effects). Results Thirty-seven publications describing 22 healthcare programmes across 30 countries were included from 5,599 unique records. All programmes had an HIV-prevention focus with only three expanding their services to cover conditions other primary healthcare services. Twelve programmes were evaluated and most evaluations assessed changes in input, output, and outcome indicators. Absence of comparison groups, preventing attribution of the effect observed to the programme and lack of biologically confirmed outcomes were the main limitations. Four programmes estimated a quantitative change in HIV prevalence or reported STI incidence, with mixed results, and one provided anecdotal evidence of changes in AIDS-related mortality and social norms. Most programmes showed positive changes in risk behaviours, knowledge, and attitudes. Our conclusions were robust in sensitivity analyses. Conclusion Diverse healthcare programmes tailored to the needs of truck drivers implemented in 30 sub-Saharan African countries have shown potential benefits. However, information gaps about availability of services and their effects impede further planning and implementation of effective healthcare programmes for truck drivers. PMID:27333301

Improving community development by linking agriculture, nutrition and education: design of a randomised trial of “home-grown” school feeding in Mali

PubMed Central

2013-01-01

Background Providing food through schools has well documented effects in terms of the education, health and nutrition of school children. However, there is limited evidence in terms of the benefits of providing a reliable market for small-holder farmers through “home-grown” school feeding approaches. This study aims to evaluate the impact of school feeding programmes sourced from small-holder farmers on small-holder food security, as well as on school children’s education, health and nutrition in Mali. In addition, this study will examine the links between social accountability and programme performance. Design This is a field experiment planned around the scale-up of the national school feeding programme, involving 116 primary schools in 58 communities in food insecure areas of Mali. The randomly assigned interventions are: 1) a school feeding programme group, including schools and villages where the standard government programme is implemented; 2) a “home-grown” school feeding and social accountability group, including schools and villages where the programme is implemented in addition to training of community based organisations and local government; and 3) the control group, including schools and household from villages where the intervention will be delayed by at least two years, preferably without informing schools and households. Primary outcomes include small-holder farmer income, school participation and learning, and community involvement in the programme. Other outcomes include nutritional status and diet-diversity. The evaluation will follow a mixed method approach, including household, school and village level surveys as well as focus group discussions with small-holder farmers, school children, parents and community members. The impact evaluation will be incorporated within the national monitoring and evaluation (M&E) system strengthening activities that are currently underway in Mali. Baselines surveys are planned for 2012. A monthly process monitoring visits, spot checks and quarterly reporting will be undertaken as part of the regular programme monitoring activities. Evaluation surveys are planned for 2014. Discussion National governments in sub-Saharan Africa have demonstrated strong leadership in the response to the recent food and financial crises by scaling-up school feeding programmes. “Home-grown” school feeding programmes have the potential to link the increased demand for school feeding goods and services to community-based stakeholders, including small-holder farmers and women’s groups. Alongside assessing the more traditional benefits to school children, this evaluation will be the first to examine the impact of linking school food service provision to small-holder farmer income, as well as the link between community level engagement and programme performance. Trial registration ISRCTN76705891 PMID:23433395

Design of the iPlay study: systematic development of a physical activity injury prevention programme for primary school children.

PubMed

Collard, Dorine C M; Chinapaw, Mai J M; van Mechelen, Willem; Verhagen, Evert A L M

2009-01-01

Health benefits of physical activity in children are well known. However, a drawback is the risk of physical activity-related injuries. Children are at particular risk for these injuries, because of a high level of exposure. Because of the high prevalence of physical activity injuries and the negative short- and long-term consequences, prevention of these injuries in children is important. This article describes how we systematically developed a school-based physical activity injury prevention programme using the intervention mapping (IM) protocol. IM describes a process for developing theory- and evidence-based health promotion programmes. The development can be described in six steps: (i) perform a needs assessment; (ii) identify programme and performance objectives; (iii) select methods and strategies; (iv) develop programme; (v) adopt and implement; and (vi) evaluate. First, the results of the needs assessment showed the injury problem in children and the different risk factors for physical activity injuries. Based on the results of the needs assessment the main focus of the injury prevention programme was described. Second, the overall programme objective of the injury prevention programme was defined as reducing the incidence of lower extremity physical activity injuries. Third, theoretical methods and practical strategies were selected to accomplish a decrease in injury incidence. The theoretical methods used were active learning, providing cues and scenario-based risk information, and active processing of information. The practical strategy of the injury prevention programme was an 8-month course about injury prevention to be used in physical education classes in primary schools. Fourth, programme materials that were used in the injury prevention programme were developed, including newsletters for children and parents, posters, exercises to improve motor fitness, and an information website. Fifth, an implementation plan was designed in order to ensure that the prevention programme would be implemented, adopted and sustained over time. Finally, an evaluation plan was designed. The injury prevention programme is being evaluated in a cluster randomized controlled trial with more than 2200 children from 40 primary schools throughout the Netherlands. The IM process is a useful process for developing an injury prevention programme. Based on the steps of the IM we developed an 8-month injury prevention programme to be used in physical education classes of primary schools.

New perspectives on counselling in audiological habilitation/rehabilitation.

PubMed

Borg, Erik; Borg, Birgitta

2015-01-01

To develop and apply a pedagogical method focusing on Empowerment, Empathy, Competence, and Counselling: the EC programme, and to present an initial evaluation. The EC programme was gradually developed within a study circle framework and in dialogue with study circle leaders and participants (clients) with hearing impairment (HI). An evaluation was carried out with the study circle leaders. Seventeen upper secondary school students with HI took part in the development of the programme. Eighteen study circle leaders responded to a questionnaire. The EC programme developed consisted of films, CD, and DVD productions to increase insight into one's own hearing ability, to demonstrate for others what HI means, strategies to evaluate situations, and help to act constructively in social situations. The study circle leaders found most of the course material appropriate and easy to use, as a whole or in parts. The leaders' evaluations indicated that the clients had increased their knowledge about how the HI affected themselves and others. The clients had improved their self-confidence and their empathic view of others. The EC programme can be used in its entirety or in part. Participation may lead to increased empowerment, empathy, competence and counselling ability.

"Stay away from them until you're old enough to make a decision": tobacco company testimony about youth smoking initiation.

PubMed

Wakefield, Melanie; McLeod, Kim; Perry, Cheryl L

2006-12-01

To determine common themes used by US tobacco industry witnesses pertaining to youth smoking initiation during litigation in the United States. Qualitative thematic analysis of transcripts from 29 tobacco litigation cases dating from 1992 to 2002. Youth smoking is portrayed by the tobacco industry as a source of great concern to them. Youth smoking prevention programmes developed by US tobacco companies are supposedly intended to delay decision-making about smoking until age 18, when individuals are then seen to be of an age where they are able to "choose to smoke". Tobacco industry media campaigns, youth access, community and school-based programmes are predicated on peer influence, parental factors, and commercial access being the primary influences on youth smoking uptake, rather than tobacco marketing, inaccurate risk appraisal, price and other factors known to influence youth smoking. Despite substantial financial investment in tobacco industry programmes, their witnesses were able to describe only weak evaluation methods, being preoccupied with measures of message comprehension, programme reach and uptake, and the associated costs of their efforts, rather than any evaluation designed to assess effects on youth smoking behaviour. Stated concerns about youth smoking and youth smoking prevention programmes are put forward in litigation as evidence that the tobacco industry is "serious" about tackling youth smoking, and serve as a primary strategy to improve the tobacco industry's public image. The tobacco industry's evaluation of the effectiveness of their youth smoking prevention programmes is demonstrably insufficient under current public health evaluation standards. Public health and welfare agencies should avoid engagement with tobacco industry-sponsored programmes.

The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.

PubMed

Kelder, Steve; Hoelscher, Deanna M; Barroso, Cristina S; Walker, Joey L; Cribb, Peter; Hu, Shaohua

2005-04-01

Although many school-based diet and physical activity interventions have been designed and evaluated, relatively few have been tested for the after-school setting. After-school day-care programmes at either elementary schools or private locations provide a ready-made opportunity for health programmes that may be difficult to incorporate into an already-full school day. The purpose of this paper is to report on a pilot study of an after-school adaptation of the CATCH (Coordinated Approach To Child Health) elementary school programme called the CATCH Kids Club (CKC). The CKC was pilot-tested and formatively evaluated in 16 Texas after-school programmes: eight in El Paso and eight in Austin (four intervention and four reference sites each). Evaluation consisted of direct observation of moderate to vigorous physical activity during play time, self-reported food intake and physical activity, and focus group interviews with after-school programme staff. Students responded well to the physical activity and snack components and were less interested in the five-module education component. Routine staff training was a key variable in achieving proper implementation; the ideal would be a full day with repeated follow-up model teaching visits. Staff turnover was a logistic issue, as was programme leader readiness and interest in conducting the programme. Strong and significant effects were observed for the physical activity but not for the education component. The results of the physical education component suggest it is feasible, effective and ready for larger-scale evaluation or dissemination.

Student-Teachers' Evaluation on the Use of Different Modes of Problem-Based Learning in Teacher Education

ERIC Educational Resources Information Center

Kwan, Tammy Y. L.

2008-01-01

Problem-based learning (PBL) has been widely adopted in many university programmes. Evaluations of PBL in medicine, dentistry, nursing and social work reveal positive outcomes from both tutors and learners. However, few evaluations have been published about using PBL in teacher education programmes. This paper reports how the 13 student-teachers…

Developing the Model for Optimal Learning and Transfer (MOLT) Following an Evaluation of Outdoor Groupwork Skills Programmes

ERIC Educational Resources Information Center

Cooley, Sam Joseph; Cumming, Jennifer; Holland, Mark J. G.; Burns, Victoria E.

2015-01-01

Purpose: This paper aims to evaluate the perceived efficacy of outdoor groupwork skills programmes for the undergraduate and postgraduate students, and the factors that influence its success. It also illustrates the use of Kirkpatrick's (1994) 4-level model of training evaluation as a framework for qualitative investigation of learning and…

Evaluating the Level of Degree Programmes in Higher Education: The Case of Nursing

ERIC Educational Resources Information Center

Rexwinkel, Trudy; Haenen, Jacques; Pilot, Albert

2013-01-01

The European Quality Assurance system demands that the degree programme level is represented in terms of quantitative outcomes to be valid and reliable. To meet this need the Educational Level Evaluator (ELE) was devised. This conceptually designed procedure with instrumentation aiming to evaluate the level of a degree validly and reliably still…

Evaluating a Research Training Programme for People with Intellectual Disabilities Participating in Inclusive Research: The Views of Participants

ERIC Educational Resources Information Center

Fullana, Judit; Pallisera, Maria; Català, Elena; Puyalto, Carolina

2017-01-01

Background: This article presents the results of evaluating a research training programme aimed at developing the skills of people with intellectual disabilities to actively participate in inclusive research. Methods: The present authors opted for a responsive approach to evaluation, using a combination of interviews, questionnaires and focus…

Community Arts for Health: An Evaluation of a District Programme

ERIC Educational Resources Information Center

South, Jane

2006-01-01

Purpose: The purpose of this paper is to present an evaluation of a community arts for health programme in the UK involving the delivery of three separate projects targeted at disadvantaged areas. Design/methodology/approach: Evaluation plans were drawn up for each project, which linked long-term goals, objectives, indicators of success and data…

Software Engineering Laboratory (SEL) programmer workbench phase 1 evaluation

NASA Technical Reports Server (NTRS)

1981-01-01

Phase 1 of the SEL programmer workbench consists of the design of the following three components: communications link, command language processor, and collection of software aids. A brief description, and evaluation, and recommendations are presented for each of these three components.

National and regional asthma programmes in Europe.

PubMed

Selroos, Olof; Kupczyk, Maciej; Kuna, Piotr; Łacwik, Piotr; Bousquet, Jean; Brennan, David; Palkonen, Susanna; Contreras, Javier; FitzGerald, Mark; Hedlin, Gunilla; Johnston, Sebastian L; Louis, Renaud; Metcalf, Leanne; Walker, Samantha; Moreno-Galdó, Antonio; Papadopoulos, Nikolaos G; Rosado-Pinto, José; Powell, Pippa; Haahtela, Tari

2015-09-01

This review presents seven national asthma programmes to support the European Asthma Research and Innovation Partnership in developing strategies to reduce asthma mortality and morbidity across Europe. From published data it appears that in order to influence asthma care, national/regional asthma programmes are more effective than conventional treatment guidelines. An asthma programme should start with the universal commitments of stakeholders at all levels and the programme has to be endorsed by political and governmental bodies. When the national problems have been identified, the goals of the programme have to be clearly defined with measures to evaluate progress. An action plan has to be developed, including defined re-allocation of patients and existing resources, if necessary, between primary care and specialised healthcare units or hospital centres. Patients should be involved in guided self-management education and structured follow-up in relation to disease severity. The three evaluated programmes show that, thanks to rigorous efforts, it is possible to improve patients' quality of life and reduce hospitalisation, asthma mortality, sick leave and disability pensions. The direct and indirect costs, both for the individual patient and for society, can be significantly reduced. The results can form the basis for development of further programme activities in Europe. Copyright ©ERS 2015.

[Sexual and reproductive health in Roma women: the family planning programme of Polígono Sur in Seville (Spain)].

PubMed

Escobar-Ballesta, Marta; García-Ramírez, Manuel; Albar-Marín, M ª Jesús; Paloma, Virginia

2018-04-05

To describe the challenges, resources and strategies of the staff of the family planning programme of the Polígono Sur Healthcare Centre in Seville (Spain) in their care of Roma women. This is a descriptive study in which in-depth interviews and discussion groups were held with all programme professionals, including a documentary review of the programme. The information was analyzed based on the Roma Health Integration Policy Index, a tool that evaluates the entitlement, accessibility, sensitivity and capacity for change of health programmes for the Roma population. The professionals encountered multiple challenges to implement the family planning programme with Roma women due to the characteristics of the users and the low sensitivity of the programme towards them. The absence of specific actions for Roma women within the family planning programme, agreed to by the healthcare district, obliges professionals to develop adaptations and strategies to ensure quality sexual and reproductive health services for their users. It is necessary to adapt sexual and reproductive health programmes targeted at Roma women by (a) detecting, evaluating, systematizing and disseminating good practices, (b) developing actions that address the multiple vulnerabilities of Roma women, (c) acknowledging professionals who advocate for the health of these women within their organizations, and (d) promoting reproductive justice as the goal of these programmes. Copyright © 2018 SESPAS. All rights reserved.

Evaluation of the NMC community specialist practitioner award.

PubMed

Chambers, Claire; Goodman-Brown, Jane; Horn, Sue; Ryder, Elaine

2007-10-01

This paper discusses the evaluation of the NMC community specialist practitioner (CSP) programme over a period of four years. The purpose of the evaluation was to assess if the programme produced practitioners who were fit for purpose and fit for practice as well as assessing whether they were supported in their new roles. The evaluation took place eight months after qualification at a workshop where the practitioners discussed their experiences in focus groups. The evaluation is presented using Kirkpatrick's model and the results indicate the importance of collaboration between HEI's and their sponsors in meeting students' needs. Issues about support and work life balance are also highlighted as areas that were addressed as a result of the evaluation. Continued development of the programme through collaboration is desirable to produce effective practitioners who are able to function in the changing primary care arena.

Steps towards equal gender representation: TANDEMplusIDEA - an international mentoring and personal development scheme for female scientists

NASA Astrophysics Data System (ADS)

Schaefli, Bettina; Breuer, Elke

2010-05-01

TANDEMplusIDEA was a European mentoring programme conducted by the technical universities RWTH Aachen, Imperial College London, ETH Zurich and TU Delft between 2007 and 2010 to achieve more gender equality in science. Given the continuing underrepresentation of women in science and technology and the well-known structural and systematic disadvantages in male-dominated scientific cultures, the main goal of this programme was to promote excellent female scientists through a high-level professional and personal development programme. Based on the mentoring concept of the RWTH Aachen, TANDEMplusIDEA was the first mentoring programme for female scientists realized in international cooperation. As a pilot scheme funded by the 6th Framework Programme of the European Commission, the scientific evaluation was an essential part of the programme, in particular in view of the development of a best practice model for international mentoring. The participants of this programme were female scientists at an early stage of their academic career (postdoc or assistant professor) covering a wide range of science disciplines, including geosciences. This transdisciplinarity as well as the international dimension of the programme have been identified by the participants as one of the keys of success of the programme. In particular, the peer-mentoring across discipline boarders proved to have been an invaluable component of the development programme. This presentation will highlight some of the main findings of the scientific evaluation of the programme and focus on some additional personal insights from the participants.

Evaluating the implementation of a school-based emotional well-being programme: a cluster randomized controlled trial of Zippy's Friends for children in disadvantaged primary schools.

PubMed

Clarke, Aleisha M; Bunting, Brendan; Barry, Margaret M

2014-10-01

Schools are recognized as one of the most important settings for promoting social and emotional well-being among children and adolescents. This clustered randomized controlled trial evaluated Zippy's Friends, an international school-based emotional well-being programme, with 766 children from designated disadvantaged schools. The purpose of this study was to evaluate the immediate and long term impact of the programme and to determine the impact of implementation fidelity on programme outcomes. Teachers reported emotional literacy outcomes using the Emotional Literacy Checklist, and emotional and behavioural outcomes using the Strengths and Difficulties Questionnaire. Controlling for the hierarchical structure of the data, path analysis using structural equation modelling revealed that the programme had a significant positive impact on the children's emotional literacy scores including significant improvements in the subscale scores of self-awareness (P < 0.001), self-regulation (P < 0.01), motivation (P < 0.001) and social skills (P < 0.001) at post-intervention. These results were maintained at 12-month follow-up (P < 0.01). The programme, however, did not have a significant impact on children's emotional and behavioural problems. Analysis of programme fidelity indicated that high fidelity was directly related to improved emotional literacy scores at post-intervention. © The Author 2014. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

The Development and Evaluation of a Life Skills Programme for Young Adult Offenders.

PubMed

Jordaan, Jacques; Beukes, Roelf; Esterhuyse, Karel

2017-10-01

The purpose of this research project was to develop, implement, and evaluate a Life Skills programme for young adult male long-term offenders with the aim of improving their life skills that, in turn, could enable them to adjust more effectively in the correctional environment. Experimental research was used to investigate the effectiveness of the programme. In this study, 96 literate young adult male offenders between the ages of 21 and 25 years, with long sentences, were selected randomly. The participants were assigned randomly into an experimental and a control group. The Solomon four-group design was utilized to control for the effect of pretest sensitization. The measurements of the effectiveness of the programme were conducted before the programme commenced, directly (short term) after, 3 months (medium term) after, and 6 months (long term) after. The findings indicated that the programme had limited success in equipping the offenders with the necessary skills crucial to their survival in a correctional centre. The programme did, however, have significant effects, especially on problem solving and anger management in the short and medium term. These improvements were not long lived.

An evaluation of the problem-solving ability of diplomates from a comprehensive nursing programme.

PubMed

Makhathini, J T; Uys, L R

1996-10-01

The aim of this South African study was to obtain a measurement of the problem-solving ability of diplomates from a basic nursing programme with this skill included in its programme objectives. The problem-solving skills of diplomates from this programme were compared with those of first years to determine if there is an improvement in the problem-solving skills. A comparison was also made with a different basic programmes not claiming to teach problem-solving. The research design selected for this study was the ex post facto design. Data were collected using the Triple Jump Method which is an interview technique. The findings suggested that the level of the problem-solving skills of the comprehensive nursing programme diplomate is not satisfactory. There was, however, some improvement in the problem-solving ability from the first to the fourth year. The level of performance of the fourth years was slightly higher than that of the third years of the three-year nursing programme, who were used as the control group. Recommendations on selection teaching and evaluation of students, as well as further research, were made.

Realism and resources: Towards more explanatory economic evaluation

PubMed Central

Anderson, Rob; Hardwick, Rebecca

2016-01-01

To be successfully and sustainably adopted, policy-makers, service managers and practitioners want public programmes to be affordable and cost-effective, as well as effective. While the realist evaluation question is often summarised as what works for whom, under what circumstances, we believe the approach can be as salient to answering questions about resource use, costs and cost-effectiveness – the traditional domain of economic evaluation methods. This paper first describes the key similarities and differences between economic evaluation and realist evaluation. It summarises what health economists see as the challenges of evaluating complex interventions, and their suggested solutions. We then use examples of programme theory from a recent realist review of shared care for chronic conditions to illustrate two ways in which realist evaluations might better capture the resource requirements and resource consequences of programmes, and thereby produce explanations of how they are linked to outcomes (i.e. explanations of cost-effectiveness). PMID:27478402

The efficacy of a movement control exercise programme to reduce injuries in youth rugby: a cluster randomised controlled trial

PubMed Central

Hislop, M D; Stokes, K A; Williams, S; McKay, C D; England, M; Kemp, S P T

2016-01-01

Background Injuries to youth rugby players have become an increasingly prominent health concern, highlighting the importance of developing and implementing appropriate preventive strategies. A growing body of evidence from other youth sports has demonstrated the efficacy of targeted exercise regimens to reduce injury risk. However, studies have yet to investigate the effect of such interventions in youth contact sport populations like rugby union. Objective To determine the efficacy of an evidence-based movement control exercise programme compared with a sham exercise programme to reduce injury risk in youth rugby players. Exercise programme compliance between trial arms and the effect of coach attitudes on compliance will also be evaluated. Setting School rugby coaches in England will be the target of the researcher intervention, with the effects of the injury prevention programmes being measured in male youth players aged 14–18 years in school rugby programmes over the 2015–2016 school winter term. Methods A cluster-randomised controlled trial with schools randomly allocated to either a movement control exercise programme or a sham exercise programme, both of which are coach-delivered. Injury measures will derive from field-based injury surveillance, with match and training exposure and compliance recorded. A questionnaire will be used to evaluate coach attitudes, knowledge, beliefs and behaviours both prior to and on the conclusion of the study period. Outcome measures Summary injury measures (incidence, severity and burden) will be compared between trial arms, as will the influence of coach attitudes on compliance and injury burden. Additionally, changes in these outcomes through using the exercise programmes will be evaluated. Trial registration number ISRTCNN13422001. PMID:27900148

Industrial Restructuring Training Programme. Evaluation Report.

ERIC Educational Resources Information Center

European Social Fund, Dublin (Ireland).

Ireland's Industrial Restructuring Training Programme (IRTP) was evaluated to determine its effectiveness as a vehicle for improving the managerial and supervisory skill levels of employees in existing enterprises. Data were collected from the following sources: review of all program-monitoring documents submitted since the IRTP's inception;…

Evaluation of the COMETT Programme.

ERIC Educational Resources Information Center

Thompson, Quentin; Ambler, Mark

1990-01-01

The evaluation report of the European Community Action Programme for Education and Training for Technology (COMETT) examines COMETT program content, COMETT projects, and initial program impact. It was concluded that COMETT has alerted the educational sector and industry to benefits of cooperative training but that transnational cooperative…

Bridging the qualitative-quantitative divide: Experiences from conducting a mixed methods evaluation in the RUCAS programme.

PubMed

Makrakis, Vassilios; Kostoulas-Makrakis, Nelly

2016-02-01

Quantitative and qualitative approaches to planning and evaluation in education for sustainable development have often been treated by practitioners from a single research paradigm. This paper discusses the utility of mixed method evaluation designs which integrate qualitative and quantitative data through a sequential transformative process. Sequential mixed method data collection strategies involve collecting data in an iterative process whereby data collected in one phase contribute to data collected in the next. This is done through examples from a programme addressing the 'Reorientation of University Curricula to Address Sustainability (RUCAS): A European Commission Tempus-funded Programme'. It is argued that the two approaches are complementary and that there are significant gains from combining both. Using methods from both research paradigms does not, however, mean that the inherent differences among epistemologies and methodologies should be neglected. Based on this experience, it is recommended that using a sequential transformative mixed method evaluation can produce more robust results than could be accomplished using a single approach in programme planning and evaluation focussed on education for sustainable development. Copyright © 2015 Elsevier Ltd. All rights reserved.

[GeKo KidS--Health Literacy in School Children].

PubMed

Splieth, C H; Franze, M; Plachta-Danielzik, S; Thyrian, J R; Schmidt, C O; John, U; Kohlmann, T; Müller, M J; Hoffmann, W

2015-09-01

The main goal of this study was the evaluation of an intervention programme for the promotion of health literacy in school-aged children (grade 5-6). The project and the programme were highly accepted, the extension of the annual dental health examination was suitable to collect data within evaluation projects in schools. In spite of positive outcomes, a longer supervision phase would be necessary in order to optimise and to implement other programme components fully. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluation of the medical student research programme in Norwegian medical schools. A survey of students and supervisors

PubMed Central

Hunskaar, Steinar; Breivik, Jarle; Siebke, Maje; Tømmerås, Karin; Figenschau, Kristian; Hansen, John-Bjarne

2009-01-01

Background The Medical Student Research Programme is a national education and grant scheme for medical students who wish to carry out research in parallel with their studies. The purpose of the programme is to increase recruitment of people with a standard medical degree to medical research. The Research Programme was established in 2002 and underwent a thorough evaluation during the spring of 2007. The evaluation should investigate if the programme had fulfilled its objectives of increased recruitment to medical research, in addition to the students' and supervisors' satisfaction of the programme, and unwanted differences between the universities. Methods Data was collected from students, supervisors and administrative staff via web-based questionnaires. Information about admission, implementation, results achieved and satisfaction was analysed and compared between the four Norwegian medical schools. In addition, the position of the scheme in relation to the national Quality Reform of Higher Education was analysed. Results At the end of 2006, the Medical Student Research Programme had recruited 265 medical students to research. These consisted of 214 active students, 35 who had completed their studies and only 17 who had dropped out. Both students and supervisors were generally very satisfied with the scheme, including the curriculum, the results achieved and the administrative service. The majority of students wanted to continue their research towards a PhD and, of those who had completed the Medical Student Research Programme, practically all had published one or several scientific papers. The survey showed only small differences between the four medical schools, despite their choice of somewhat different solutions in terms of administration and organisation. The Medical Student Research Programme satisfies the majority of the demands of the Quality Reform, however as an integrated research programme aimed at a PhD it presupposes access to PhD courses before the completion of medical studies, as well as the ability to include undergraduate scientific work in a PhD thesis. Conclusion The Medical Student Research Programme has led to an increase in the recruitment of graduated physicians to medical research in Norway. It will only be possible to evaluate whether this in turn will result in a larger number of PhDs in 3–5 years; this will also depend on the access to grants and fellowships. PMID:19602226

Teenagers with diabetes: self-management education and training on a big schooner.

PubMed

Viklund, Gunnel E; Rudberg, Susanne; Wikblad, K F

2007-12-01

The aims of this study are to evaluate whether diabetic teenagers participating in a group educational programme, 'the schooner programme', differ from non-participants in attitudes towards diabetes and self-care, and to evaluate the impact on the attitudes, HbA1c and treatment of the programme. Ninety teenagers aged 14-18 years attended the programme. Attitudes towards diabetes and self-care were measured with a validated questionnaire. Medical data were collected from the medical records. The participants reported more positive attitudes towards diabetes and self-care and more frequent contacts with others with diabetes monitored blood glucose more often and felt less disturbed by diabetes than non-participants. The programme had positive impact on attitudes towards diabetes. There was no change in HbA1c, but the use of insulin pumps was more frequent among participants after the programme. To get teenagers attracted to group education, the diabetes care team needs to influence them towards more positive attitudes.

An evaluation of the Parents Plus-Parenting When Separated programme.

PubMed

Keating, Adele; Sharry, John; Murphy, Michelle; Rooney, Brendan; Carr, Alan

2016-04-01

This study evaluated the Parents Plus-Parenting when Separated Programme, an intervention specifically designed to address the needs of separated parents in an Irish context. In a randomized control trial, 82 separated parents with young children were assigned to the Parents Plus-Parenting when Separated Programme treatment group and 79 to a waiting-list control group. They were assessed on measures of client goals, parenting satisfaction, child and parental adjustment and interparental conflict at baseline (Time 1) and 6 weeks later (Time 2), after the treatment group completed the Parents Plus-Parenting when Separated Programme. From Time 1 to 2, significant goal attainment, increases in parenting satisfaction and decreases in child behaviour problems, parental adjustment problems and interparental conflict occurred in the Parents Plus-Parenting when Separated Programme group, but not in the control group. These results supported the effectiveness of Parents Plus-Parenting when Separated Programme, which should be made more widely available to separated parents. © The Author(s) 2015.

Participant-Directed Evaluation: Using Teachers' Own Inquiries to Evaluate Professional Development in Technology Integration

ERIC Educational Resources Information Center

Ham, Vince

2010-01-01

Considering the high levels of time and money invested in teacher professional development programmes in information technologies over recent decades, questions arise as to how effective these programmes have been and by whose lights we are to judge. Based on a critical review of the evaluations of several of our own action-research-based…

Moving beyond a "Bums-on-Seats" Analysis of Progress towards Widening Participation: Reflections on the Context, Design and Evaluation of an Australian Government-Funded Mentoring Programme

ERIC Educational Resources Information Center

Lynch, Julianne; Walker-Gibbs, Bernadette; Herbert, Sandra

2015-01-01

In 2010, the Australian government established the Higher Education Participation and Partnerships Programme--a funding agenda to promote programmes that respond to the under-representation in higher education of people from low socioeconomic status (SES) backgrounds. Many government-funded programmes and projects have since emerged that respond…

National tuberculosis programme review: experience over the period 1990-95.

PubMed Central

Pio, A.; Luelmo, F.; Kumaresan, J.; Spinaci, S.

1997-01-01

Since 1990 the WHO Global Tuberculosis Programme (GTB) has promoted the revision of national tuberculosis programmes to strengthen the focus on directly observed treatment, short-course (DOTS) and close monitoring of treatment outcomes. GTB has encouraged in-depth evaluation of activities through a comprehensive programme review. Over the period 1990-95, WHO supported 12 such programme reviews. The criteria for selection were as follows: large population (Bangladesh, Brazil, China, Ethiopia, India, Indonesia, Mexico, and Thailand); good prospects of developing a model programme for a region (Nepal, Zimbabwe); or at advanced stage of implementation of a model programme for a region (Guinea, Peru). The estimated combined incidence of smear-positive pulmonary tuberculosis was 82 per 100,000 population, about 43% of the global incidence. The prevalence of infection with human immunodeficiency virus (HIV) was variable, being very high in Ethiopia and Zimbabwe, but negligible in Bangladesh, China, Nepal and Peru. The programme reviews were conducted by teams of 15-35 experts representing a wide range of national and external institutions. After a 2-3-month preparatory period, the conduct of the review usually lasted 2-3 weeks, including a first phase of meetings with authorities and review of documents, a second phase for field visits, and a third phase of discussion of findings and recommendations. The main lessons learned from the programme reviews were as follows: programme review is a useful tool to secure government commitment, reorient the tuberculosis control policies and replan the activities on solid grounds; the involvement of public health and academic institutions, cooperating agencies, and nongovernmental organizations secured a broad support to the new policies; programme success is linked to a centralized direction which supports a decentralized implementation through the primary health care services; monitoring and evaluation of case management functions well if it is based on the right classification of cases and quarterly reports on cohorts of patients; a comprehensive programme review should include teaching about tuberculosis in medical, nursing, and laboratory workers' schools; good quality diagnosis and treatment are the essential requirements for expanding a programme beyond the pilot testing; and control targets cannot be achieved if private and social security patients are left outside the programme scope. The methodology of comprehensive programme review should be recommended to all countries which require programme reorientation; it is also appropriate for carrying out evaluations at 4-5-year intervals in countries that are implementing the correct tuberculosis control policies. PMID:9509630

National tuberculosis programme review: experience over the period 1990-95.

PubMed

Pio, A; Luelmo, F; Kumaresan, J; Spinaci, S

1997-01-01

Since 1990 the WHO Global Tuberculosis Programme (GTB) has promoted the revision of national tuberculosis programmes to strengthen the focus on directly observed treatment, short-course (DOTS) and close monitoring of treatment outcomes. GTB has encouraged in-depth evaluation of activities through a comprehensive programme review. Over the period 1990-95, WHO supported 12 such programme reviews. The criteria for selection were as follows: large population (Bangladesh, Brazil, China, Ethiopia, India, Indonesia, Mexico, and Thailand); good prospects of developing a model programme for a region (Nepal, Zimbabwe); or at advanced stage of implementation of a model programme for a region (Guinea, Peru). The estimated combined incidence of smear-positive pulmonary tuberculosis was 82 per 100,000 population, about 43% of the global incidence. The prevalence of infection with human immunodeficiency virus (HIV) was variable, being very high in Ethiopia and Zimbabwe, but negligible in Bangladesh, China, Nepal and Peru. The programme reviews were conducted by teams of 15-35 experts representing a wide range of national and external institutions. After a 2-3-month preparatory period, the conduct of the review usually lasted 2-3 weeks, including a first phase of meetings with authorities and review of documents, a second phase for field visits, and a third phase of discussion of findings and recommendations. The main lessons learned from the programme reviews were as follows: programme review is a useful tool to secure government commitment, reorient the tuberculosis control policies and replan the activities on solid grounds; the involvement of public health and academic institutions, cooperating agencies, and nongovernmental organizations secured a broad support to the new policies; programme success is linked to a centralized direction which supports a decentralized implementation through the primary health care services; monitoring and evaluation of case management functions well if it is based on the right classification of cases and quarterly reports on cohorts of patients; a comprehensive programme review should include teaching about tuberculosis in medical, nursing, and laboratory workers' schools; good quality diagnosis and treatment are the essential requirements for expanding a programme beyond the pilot testing; and control targets cannot be achieved if private and social security patients are left outside the programme scope. The methodology of comprehensive programme review should be recommended to all countries which require programme reorientation; it is also appropriate for carrying out evaluations at 4-5-year intervals in countries that are implementing the correct tuberculosis control policies.

Progress in centralised ethics review processes: Implications for multi-site health evaluations.

PubMed

Prosser, Brenton; Davey, Rachel; Gibson, Diane

2015-04-01

Increasingly, public sector programmes respond to complex social problems that intersect specific fields and individual disciplines. Such responses result in multi-site initiatives that can span nations, jurisdictions, sectors and organisations. The rigorous evaluation of public sector programmes is now a baseline expectation. For evaluations of large and complex multi-site programme initiatives, the processes of ethics review can present a significant challenge. However in recent years, there have been new developments in centralised ethics review processes in many nations. This paper provides the case study of an evaluation of a national, inter-jurisdictional, cross-sector, aged care health initiative and its encounters with Australian centralised ethics review processes. Specifically, the paper considers progress against the key themes of a previous five-year, five nation study (Fitzgerald and Phillips, 2006), which found that centralised ethics review processes would save time, money and effort, as well as contribute to more equitable workloads for researchers and evaluators. The paper concludes with insights for those charged with refining centralised ethics review processes, as well as recommendations for future evaluators of complex multi-site programme initiatives. Copyright © 2015 Elsevier Ltd. All rights reserved.

Towards Developing an Initial Programme Theory: Programme Designers and Managers Assumptions on the Antiretroviral Treatment Adherence Club Programme in Primary Health Care Facilities in the Metropolitan Area of Western Cape Province, South Africa

PubMed Central

Mukumbang, Ferdinand C.; van Belle, Sara; Marchal, Bruno; van Wyk, Brian

2016-01-01

Background The antiretroviral adherence club intervention was rolled out in primary health care facilities in the Western Cape province of South Africa to relieve clinic congestion, and improve retention in care, and treatment adherence in the face of growing patient loads. We adopted the realist evaluation approach to evaluate what aspects of antiretroviral club intervention works, for what sections of the patient population, and under which community and health systems contexts, to inform guidelines for scaling up of the intervention. In this article, we report on a step towards the development of a programme theory—the assumptions of programme designers and health service managers with regard to how and why the adherence club intervention is expected to achieve its goals and perceptions on how it has done so (or not). Methods We adopted an exploratory qualitative research design. We conducted a document review of 12 documents on the design and implementation of the adherence club intervention, and key informant interviews with 12 purposively selected programme designers and managers. Thematic content analysis was used to identify themes attributed to the programme actors, context, mechanisms, and outcomes. Using the context-mechanism-outcome configurational tool, we provided an explanatory focus of how the adherence club intervention is roll-out and works guided by the realist perspective. Results We classified the assumptions of the adherence club designers and managers into the rollout, implementation, and utilisation of the adherence club programme, constructed around the providers, management/operational staff, and patients, respectively. Two rival theories were identified at the patient-perspective level. We used these perspectives to develop an initial programme theory of the adherence club intervention, which will be tested in a later phase. Conclusion The perspectives of the programme designers and managers provided an important step towards developing an initial programme theory, which will guide our realist evaluation of the adherence club programme in South Africa. PMID:27560352

Field programmable gate arrays: Evaluation report for space-flight application

NASA Technical Reports Server (NTRS)

Sandoe, Mike; Davarpanah, Mike; Soliman, Kamal; Suszko, Steven; Mackey, Susan

1992-01-01

Field Programmable Gate Arrays commonly called FPGA's are the newer generation of field programmable devices and offer more flexibility in the logic modules they incorporate and in how they are interconnected. The flexibility, the number of logic building blocks available, and the high gate densities achievable are why users find FPGA's attractive. These attributes are important in reducing product development costs and shortening the development cycle. The aerospace community is interested in incorporating this new generation of field programmable technology in space applications. To this end, a consortium was formed to evaluate the quality, reliability, and radiation performance of FPGA's. This report presents the test results on FPGA parts provided by ACTEL Corporation.

An evaluation of the critical care assistant role within an acute NHS Trust Critical Care Unit.

PubMed

McGloin, Sarah; Knowles, Judie

2005-01-01

This study provides an evaluation of a training programme designed for developing six critical care assistants to work alongside registered nurses to care for patients within the critical care environment. The programme was run as a pilot funded from the Department of Health's 'critical care bid'. At 18 months long, the programme incorporated a foundation programme, and National Vocational Qualification (NVQ) level 3 in care and adapted Operating Department Practitioner (ODP) NVQ units. Six critical care assistants successfully completed the programme; however, they all then left the unit to undertake further study for pre-registration nursing qualifications. Upon evaluation, a number of key issues were identified. Clear definition of the critical care assistants's role is essential as are dedicated practice development staff, who focus purely on developing the critical care assistant role. More importantly, however, with such key changes in the staffing structure within critical care units, appropriate change management techniques should be employed, ensuring that all staff contributing to the training and development are fully involved from the start.

The effectiveness of home hand exercise programmes in rheumatoid arthritis: a systematic review.

PubMed

Hammond, Alison; Prior, Yeliz

2016-09-01

Rheumatoid arthritis (RA) commonly reduces hand function. We systematically reviewed trials to investigate effects of home hand exercise programmes on hand symptoms and function in RA. We searched: Medline (1946-), AMED, CINAHL, Physiotherapy Evidence Database, OT Seeker, the Cochrane Library, ISI Web of Science from inception to January 2016. Nineteen trials were evaluated. Only three were randomized controlled trials with a low risk of bias (n = 665). Significant short-term improvements occurred in hand function, pain and grip strength, with long-term improvements in hand and upper limb function and pinch strength. Heterogeneity of outcome measures meant meta-analysis was not possible. Evaluation of low and moderate risk of bias trials indicated high-intensity home hand exercise programmes led to better short-term outcomes than low-intensity programmes. Such programmes are cost-effective. Further research is required to evaluate methods of helping people with RA maintain long-term home hand exercise. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Maintaining evaluation designs in long term community based health promotion programmes: Heartbeat Wales case study.

PubMed Central

Nutbeam, D; Smith, C; Murphy, S; Catford, J

1993-01-01

STUDY OBJECTIVE--To examine the difficulties of developing and maintaining outcome evaluation designs in long term, community based health promotion programmes. DESIGN--Semistructured interviews of health promotion managers. SETTING--Wales and two reference health regions in England. PARTICIPANTS--Nine health promotion managers in Wales and 18 in England. MEASUREMENTS AND MAIN RESULTS--Information on selected heart health promotion activity undertaken or coordinated by health authorities from 1985-90 was collected. The Heartbeat Wales coronary heart disease prevention programme was set up in 1985, and a research and evaluation strategy was established to complement the intervention. A substantial increase in the budget occurred over the period. In the reference health regions in England this initiative was noted and rapidly taken up, thus compromising their use as control areas. CONCLUSION--Information on large scale, community based health promotion programmes can disseminate quickly and interfere with classic intervention/evaluation control designs through contamination. Alternative experimental designs for assessing the effectiveness of long term intervention programmes need to be considered. These should not rely solely on the use of reference populations, but should balance the measurement of outcome with an assessment of the process of change in communities. The development and use of intervention exposure measures together with well structured and comprehensive process evaluation in both the intervention and reference areas is recommended. PMID:8326270

Measuring informed choice in population-based reproductive genetic screening: a systematic review

PubMed Central

Ames, Alice Grace; Metcalfe, Sylvia Ann; Archibald, Alison Dalton; Duncan, Rony Emily; Emery, Jon

2015-01-01

Genetic screening and health-care guidelines recommend that programmes should facilitate informed choice. It is therefore important that accurate measures of informed choice are available to evaluate such programmes. This review synthesises and appraises measures used to evaluate informed choice in population-based genetic screening programmes for reproductive risk. Databases were searched for studies offering genetic screening for the purpose of establishing reproductive risk to an adult population sample, in which aspects of informed choice were measured. Studies were included if, at a minimum, measures of uptake of screening and knowledge were used. Searches identified 1462 citations and 76 studies were reviewed in full text; 34 studies met the inclusion criteria. Over 20 different measures of informed choice were used. Many measures lacked adequate validity and reliability data. This systematic review will inform future evaluation of informed choice in population genetic screening programmes. PMID:24848746

The impact of leadership development on GP mental health commissioning.

PubMed

Dickerson, Emma; Fenge, Lee-Ann; Rosenorn-Lanng, Emily

2017-07-03

Purpose This paper aims to explore the learning needs of general practitioners (GPs) involved in commissioning mental health provision in England, and offer an evaluation of a leadership and commissioning skills development programme for Mental Health Commissioners. Design/methodology/approach Retrospective mixed method, including online mixed method survey, rating participants' knowledge, skills, abilities, semi-structured telephone interviews and third-party questionnaires were used. Results were analysed for significant differences using the Wilcoxon Signed Ranks test. Open-ended responses and interview transcripts were analysed thematically. Findings Indicative results showed that participants perceived significant impacts in ability across eight key question groups evaluated. Differences were found between the perceived and observed impact in relation to technical areas covered within the programme which were perceived as the highest scoring impacts by participants. Research limitations/implications The indicative results show a positive impact on practice has been both perceived and observed. Findings illustrate the value of this development programme on both the personal development of GP Mental Health Commissioners and commissioning practice. Although the findings of this evaluation increase understanding in relation to an important and topical area, larger scale, prospective evaluations are required. Impact evaluations could be embedded within future programmes to encourage higher participant and third-party engagement. Future evaluations would benefit from collection and analysis of attendance data. Further research could involve patient, service user and carer perspectives on mental health commissioning. Originality value Results of this evaluation could inform the development of future learning programmes for mental health commissioners as part of a national approach to improve mental health provision.

Are cardiovascular disease risk assessment and management programmes cost effective? A systematic review of the evidence.

PubMed

Lee, John Tayu; Lawson, Kenny D; Wan, Yizhou; Majeed, Azeem; Morris, Stephen; Soljak, Michael; Millett, Christopher

2017-06-01

The World Health Organization recommends that countries implement population-wide cardiovascular disease (CVD) risk assessment and management programmes. The aim of this study was to conduct a systematic review to evaluate whether this recommendation is supported by cost-effectiveness evidence. Published economic evaluations were identified via electronic medical and social science databases (including Medline, Web of Science, and the NHS Economic Evaluation Database) from inception to March 2016. Study quality was evaluated using a modified version of the Consolidated Health Economic Evaluation Reporting Standards. Fourteen economic evaluations were included: five studies based on randomised controlled trials, seven studies based on observational studies and two studies using hypothetical modelling synthesizing secondary data. Trial based studies measured CVD risk factor changes over 1 to 3years, with modelled projections of longer term events. Programmes were either not, or only, cost-effective under non-verified assumptions such as sustained risk factor changes. Most observational and hypothetical studies suggested programmes were likely to be cost-effective; however, study deigns are subject to bias and subsequent empirical evidence has contradicted key assumptions. No studies assessed impacts on inequalities. In conclusion, recommendations for population-wide risk assessment and management programmes lack a robust, real world, evidence basis. Given implementation is resource intensive there is a need for robust economic evaluation, ideally conducted alongside trials, to assess cost effectiveness. Further, the efficiency and equity impact of different delivery models should be investigated, and also the combination of targeted screening with whole population interventions recognising that there multiple approaches to prevention. Copyright © 2017. Published by Elsevier Inc.

Business Informatics: An Engineering Perspective on Information Systems

ERIC Educational Resources Information Center

Helfert, Markus

2008-01-01

Over the last three decades many universities have offered various programmes related to Information Systems. However, the rapid changes in recent years demand constant evaluation and modification of education programmes. Recent challenges include, for instance, the move towards programmes that are more applied and professionally-orientated. The…

Equivalency Programmes (EPs) for Promoting Lifelong Learning

ERIC Educational Resources Information Center

Haddad, Caroline, Ed.

2006-01-01

Equivalency programmes (EPs) refers to alternative education programmes that are equivalent to the formal education system in terms of curriculum and certification, policy support mechanisms, mode of delivery, staff training, and other support activities such as monitoring, evaluation and assessment. The development of EPs is potentially an…

Assessing "Me Generation's" Entrepreneurship Degree Programmes in Malaysia

ERIC Educational Resources Information Center

Zainuddin, Muhammad Nizam; Rejab, Mohd Rozaini Mohd

2010-01-01

Purpose: The purpose of this paper is to assess the effectiveness of undergraduates' specialised entrepreneurship programmes in Malaysian universities that have been made available to "ME generation" students. By analysing the antecedents and predicting self-employment intention, the paper evaluates the impact of such programmes upon the…

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Developing a music programme for preschool children with cochlear implants.

PubMed

Koşaner, Julie; Kilinc, Aynur; Deniz, Murat

2012-11-01

Although music perception is especially challenging for cochlear implant (CI) users, young CI users' musical perception abilities are improved by participation in structured musical activities. To design, implement, evaluate, and publish a music training programme with a monitoring tool for preschool CI users, for use in family-centred habilitation programmes. We devised a programme of musical activities, Musical EARS®, and a curriculum-related hierarchical Evaluation Form to represent performance. The programme included sections on singing; recognizing songs, tunes, and timbre; and responding appropriately to music and rhythm. It was implemented over 18 months at Ilkses Rehabilitation Centre, with 25 paediatric MED-EL CI users split into three groups of varying age, duration of CI use, and ability. Mean total scores increased significantly for all groups. Scores increased unevenly across subscales. Participation in and enjoyment of musical activities increased for both children and parents. Significant correlations were found between scores and length of CI use. The training programme effectively enriches child CI users' musical experience. To varying degrees, children learned to perform the Musical EARS® activities. The study allowed us to validate the lesson content and the hierarchical nature of the Evaluation Form. We conclude that prelingually deafened CI users should be systematically involved in musical activities to help them acquire skills acquired more easily by hearing peers.

The development and evaluation of a succession planning programme in nursing, in Australia.

PubMed

Brunero, Scott; Kerr, Suzie; Jastrzab, Grazyna

2009-07-01

This study reports on a locally organized model of succession planning in a 550-bed general hospital. Within healthcare, succession planning has traditionally been considered for people at the executive director level and little research has been published with nurses working at the clinical level. A succession planning model was developed from the literature and through a process of consultation with senior staff. The model was then evaluated from a customer satisfaction, programme progress, effective placement and organizational results perspectives. Nurses who were successful in obtaining a new role were surveyed after 6 weeks in the position. Descriptive statistics, including numbers of placements and types of positions filled, were recorded. A checklist for conducting a programme evaluation of succession planning was also used. Twenty-five nurses participated, with 31 positions succeeded to. Nurses reported positively that the programme was beneficial, increased their sense of career planning and gave them a greater understanding of their career pathway. The succession planning programme provided an opportunity for the organization to identify new leaders. The study outcomes have identified potential improvements to the way succession planning is conducted at the hospital. Nurse Managers are in key positions to develop effective succession planning models. This study offers a process for managers to develop effective succession planning programmes within their organization.

Quality of care in reproductive health programmes: monitoring and evaluation of quality improvement.

PubMed

Kwast, B E

1998-12-01

As 200 million women become pregnant every year, at least 30 million will develop life-threatening complications requiring emergency treatment at any level of society where they live. But it is a basic human right that pregnancy be made safe for all women as complications are mostly unpredictable. This requires reproductive health programmes which are responsive to women's and their families' needs and expectations on the one hand and enhancement of community participation, high quality obstetric services, and both provider collaboration and satisfaction on the other. Monitoring and evaluation of these facets need to be an integral part of any safe motherhood programme, not only to assess progress, but also to use this information for subsequent planning and implementation cycles of national programmes. Lessons learned from ten years' implementation of Safe Motherhood programmes indicate that process and outcome indicators are more feasible for short-term evaluation purposes than impact indicators, such as maternal mortality reduction. The former are described in this paper with relevant country examples. This is the third, and last, article in a series on quality of care in reproductive health programmes. The first (Kwast 1998a) contains an overview of concepts, assessments, barriers and improvements of quality of care. The second (Kwast 1998b) addresses education issues for quality improvement.

Evaluation of health benefits and harms of the breast cancer screening programme in the Basque Country using discrete event simulation.

PubMed

Arrospide, Arantzazu; Rue, Montserrat; van Ravesteyn, Nicolien T; Comas, Merce; Larrañaga, Nerea; Sarriugarte, Garbiñe; Mar, Javier

2015-10-12

Since the breast cancer screening programme in the Basque Country (BCSPBC) was started in 1996, more than 400,000 women aged 50 to 69 years have been invited to participate. Based on epidemiological observations and simulation techniques it is possible to extend observed short term data into anticipated long term results. The aim of this study was to assess the effectiveness of the programme through 2011 by quantifying the outcomes in breast cancer mortality, life-years gained, false positive results, and overdiagnosis. A discrete event simulation model was constructed to reproduce the natural history of breast cancer (disease-free, pre-clinical, symptomatic, and disease-specific death) and the actual observed characteristics of the screening programme during the evaluated period in the Basque women population. Goodness-of-fit statistics were applied for model validation. The screening effects were measured as differences in benefits and harms between the screened and unscreened populations. Breast cancer mortality reduction and life-years gained were considered as screening benefits, whereas, overdiagnosis and false positive results were assessed as harms. Results for a single cohort were also obtained. The screening programme yielded a 16 % reduction in breast cancer mortality and a 10 % increase in the incidence of breast cancer through 2011. Almost 2 % of all the women in the programme had a false positive result during the evaluation period. When a single cohort was analysed, the number of deaths decreased by 13 %, and 4 % of screen-detected cancers were overdiagnosed. Each woman with BC detected by the screening programme gained 2.5 life years due to early detection corrected by lead time. Fifteen years after the screening programme started, this study supports an important decrease in breast cancer mortality due to the screening programme, with reasonable risk of overdiagnosis and false positive results, and sustains the continuation of the breast cancer screening programme in the Basque population.

A scoping review of intimate partner violence assistance programmes within health care settings.

PubMed

Sprague, Sheila; Scott, Taryn; Garibaldi, Alisha; Bzovsky, Sofia; Slobogean, Gerard P; McKay, Paula; Spurr, Hayley; Arseneau, Erika; Memon, Muzammil; Bhandari, Mohit; Swaminathan, Aparna

2017-01-01

Background : The lifetime prevalence of intimate partner violence (IPV) for women presenting to health care settings is estimated to be 38-59%. With the goal of providing help to victims of abuse, numerous IPV assistance programmes have been developed and evaluated across multiple health care settings. Objective : Our scoping review provides an overview of this literature to identify key areas for potential evidence-based recommendations and to focus research priorities. Methods : We conducted a search of MEDLINE, Embase, Cumulative Index of Nursing and Allied Health Literature, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, and psycINFO. We used broad eligibility criteria to identify studies that evaluated the effectiveness of IPV assistance programmes delivered within health care settings. We completed all screening and data extraction independently and in duplicate. We used descriptive statistics to summarize all data. Results : Forty-three studies met all eligibility criteria and were included in our scoping review. Nine categories of assistance programmes were identified: counselling/advocacy, safety assessment/planning, referral, providing IPV resources, home visitation, case management, videos, provider cueing, and system changes. Characteristics of programmes amongst studies frequently reporting positive results included those in which one type of active assistance was used (77.8% of studies reported positive results), a counsellor, community worker, or case manager provided the intervention (83.3% of studies reported positive results), and programmes that were delivered over more than five sessions (100.0% of studies reported positive results). Conclusions : IPV assistance programmes are heterogeneous with regards to the types of assistance they include and how they are delivered and evaluated. This heterogeneity creates challenges in identifying which IPV assistance programmes, and which aspects of these programmes, are effective. However, it appears that many different types of IPV assistance programmes can have positive impacts on women.

A scoping review of intimate partner violence assistance programmes within health care settings

PubMed Central

Sprague, Sheila; Scott, Taryn; Garibaldi, Alisha; Bzovsky, Sofia; Slobogean, Gerard P.; McKay, Paula; Spurr, Hayley; Arseneau, Erika; Memon, Muzammil; Bhandari, Mohit; Swaminathan, Aparna

2017-01-01

ABSTRACT Background: The lifetime prevalence of intimate partner violence (IPV) for women presenting to health care settings is estimated to be 38–59%. With the goal of providing help to victims of abuse, numerous IPV assistance programmes have been developed and evaluated across multiple health care settings. Objective: Our scoping review provides an overview of this literature to identify key areas for potential evidence-based recommendations and to focus research priorities. Methods: We conducted a search of MEDLINE, Embase, Cumulative Index of Nursing and Allied Health Literature, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, and psycINFO. We used broad eligibility criteria to identify studies that evaluated the effectiveness of IPV assistance programmes delivered within health care settings. We completed all screening and data extraction independently and in duplicate. We used descriptive statistics to summarize all data. Results: Forty-three studies met all eligibility criteria and were included in our scoping review. Nine categories of assistance programmes were identified: counselling/advocacy, safety assessment/planning, referral, providing IPV resources, home visitation, case management, videos, provider cueing, and system changes. Characteristics of programmes amongst studies frequently reporting positive results included those in which one type of active assistance was used (77.8% of studies reported positive results), a counsellor, community worker, or case manager provided the intervention (83.3% of studies reported positive results), and programmes that were delivered over more than five sessions (100.0% of studies reported positive results). Conclusions: IPV assistance programmes are heterogeneous with regards to the types of assistance they include and how they are delivered and evaluated. This heterogeneity creates challenges in identifying which IPV assistance programmes, and which aspects of these programmes, are effective. However, it appears that many different types of IPV assistance programmes can have positive impacts on women. PMID:28649297

Evaluating the FRIENDS Programme in a Scottish Setting

ERIC Educational Resources Information Center

Liddle, Ian; Macmillan, Susan

2010-01-01

This study used an "indicated prevention" approach to attempt to replicate very positive international evaluations of the FRIENDS for Life programme. Using standardised self-report measures of anxiety, low mood and self esteem with groups of children from four schools, the study found significant improvements in all of these measures…

Evaluation of the 1981 Vocational Preparation Programme.

ERIC Educational Resources Information Center

Hailstone, D. L.; Grosvenor, J. S.

An evaluation project investigated the Vocational Preparation Programme conducted in 1981 by the South Australian Department of Technical and Further Education (TAFE). The vocational preparation program was designed to increase the employability of young unemployed people aged 15 to 19 by providing them with an understanding of a family of related…

Graduate Attribute Development and Employment Outcomes: Tracking PhD Graduates

ERIC Educational Resources Information Center

Manathunga, Catherine; Pitt, Rachael; Critchley, Christa

2009-01-01

The provision of diversified research training is regarded as one of the most significant contributions made by the Australian Cooperative Research Centres (CRC) programme [Howard Partners 2003, Evaluation of the cooperative research centres programme, Department of Education, Science and Training, Canberra, ACT]. Yet, a systematic evaluation of…

Students' Evaluation of Their English Language Learning Experience

ERIC Educational Resources Information Center

Maizatulliza, M.; Kiely, R.

2017-01-01

In the field of English language teaching and learning, there is a long history of investigating students' performance while they are undergoing specific learning programmes. This research study, however, focused on students' evaluation of their English language learning experience after they have completed their programme. The data were gathered…

Making Sense of Bali: Unintended Outcomes of Study Abroad Programs

ERIC Educational Resources Information Center

Hill, Bob; Thomas, Noel

2005-01-01

Study abroad programmes for teacher education students are increasingly being evaluated to determine their effectiveness in achieving intended outcomes. There is a danger, however, that such evaluations will ignore valuable but unintended and serendipitous outcomes of such programmes. This paper investigates an example of such an outcome, the…

Texting Parents: Evaluation Report and Executive Summary

ERIC Educational Resources Information Center

Miller, Sarah; Davison, Jenny; Yohanis, Jamie; Sloan, Seaneen; Gildea, Aideen; Thurston, Allen

2017-01-01

This report presents the findings from an efficacy trial and process evaluation of the Parent Engagement Programme (PEP). The PEP was a school-level intervention designed to improve pupil outcomes by engaging parents in their children's learning. The programme was developed collaboratively by research teams from the University of Bristol and…

Evaluation of the Better Parenting Programme in Jordan

ERIC Educational Resources Information Center

Al-Hassan, Suha M.; Lansford, Jennifer E.

2011-01-01

This study evaluates the Better Parenting Programme (BPP) which has been implemented nationally in Jordan to enhance parents' knowledge, attitudes, and behaviours related to caring for young children. The participants (N = 337, 94% female) were randomly assigned to an experimental group or a control group. The experimental group participated in…

Evaluation of a Health Education Programme about Traumatic Brain Injury

ERIC Educational Resources Information Center

Garcia, Jane Mertz; Sellers, Debra M.; Hilgendorf, Amy E.; Burnett, Debra L.

2014-01-01

Objective: Our aim was to evaluate a health education programme (TBIoptions: Promoting Knowledge) designed to increase public awareness and understanding about traumatic brain injury (TBI) through in-person (classroom) and computer-based (electronic) learning environments. Design: We used a pre-post survey design with randomization of participants…

A leadership programme for critical care.

PubMed

Crofts, Linda

2006-08-01

This paper describes the genesis, design and implementation of a leadership programme for critical care. This was an initiative funded by the National Health Service (NHS) Nursing Leadership Project and had at the core of its design flexibility to meet the needs of the individual hospitals, which took part in it. Participation was from the multi-disciplinary critical care team. Six NHS hospitals took part in the programme which was of 20 days duration and took place on hospital sites. The programme used the leadership model of as its template and had a number of distinct components; a baseline assessment, personal development, principles of leadership and critical case reviews. The programme was underpinned by three themes; working effectively in multi-professional teams to provide patient focussed care, managing change through effective leadership and developing the virtual critical care service. Each group set objectives pertinent to their own organisation's needs. The programme was evaluated by a self-reporting questionnaire; group feedback and feedback from stakeholders. Programme evaluation was positive from all the hospitals but it was clear that the impact of the programme varied considerably between the groups who took part. It was noted that there was some correlation between the success of the programme and organisational 'buy in' as well as the organisational culture within which the participants operated. A key feature of the programme success was the critical case reviews, which were considered to be a powerful learning tool and medium for group learning and change management.

Research capacity building in midwifery: Case study of an Australian Graduate Midwifery Research Intern Programme.

PubMed

Hauck, Yvonne L; Lewis, Lucy; Bayes, Sara; Keyes, Louise

2015-09-01

Having the research capacity to identify problems, create new knowledge and most importantly translate this knowledge into practice is essential within health care. Midwifery, as well as other health professions in Australia, is challenged in building its research capacity to contribute evidence to inform clinical practice. The aim of this project was to evaluate an innovative Graduate Midwifery Research Intern Programme offered at a tertiary obstetric hospital in Western Australia, to determine what was working well and how the programme could be improved. A case study approach was used to gain feedback from graduate midwives within a Graduate Research Intern (GRI) Programme. In addition outcomes were compiled of all projects the GRI midwives contributed to. Six GRI midwives participated in a survey comprising of four open ended questions to provide feedback about the programme. Findings confirm that the GRI programme increased the graduates understanding of how research works, its capacity to define a problem, generate new knowledge and inform clinical practice. The GRI midwives' feedback suggested the programme opened their thinking to future study and gave them enhanced insight into women's experiences around childbirth. To grow our knowledge as a professional group, midwives must develop and promote programmes to build our pool of research capable midwives. By sharing our programme evaluation we hope to entice other clinical settings to consider the value in replicating such a programme within their context. Copyright © 2015 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

AMEE Education Guide no. 29: evaluating educational programmes.

PubMed

Goldie, John

2006-05-01

Evaluation has become an applied science in its own right in the last 40 years. This guide reviews the history of programme evaluation through its initial concern with methodology, giving way to concern with the context of evaluation practice and into the challenge of fitting evaluation results into highly politicized and decentralized systems. It provides a framework for potential evaluators considering undertaking evaluation. The role of the evaluator; the ethics of evaluation; choosing the questions to be asked; evaluation design, including the dimensions of evaluation and the range of evaluation approaches available to guide evaluators; interpreting and disseminating the findings; and influencing decision making are covered.

Evaluation of an innovative nursing exchange programme: health counselling skills and cultural awareness.

PubMed

Lee, Regina L T; Pang, Samantha M C; Wong, Thomas K S; Chan, M F

2007-11-01

In 2006, a two-week summer exchange programme was conducted for nursing students from 15 institutes and/or universities, including places in Taiwan, Macau, Chinese mainland and Hong Kong. This paper evaluates a summer exchange programme focusing on nursing students' professional and personal development within the context of learning health counselling skills and studying cultural aspects of the host Region. The programme was evaluated using a mixed method of both quantitative and qualitative research design. Three dimensions include students' exchange perspective, professional development and personal development were evaluated at the end of the two-week programme. Data for this evaluation were derived from the results of questionnaires completed by the 64 nursing students enrolled in this programme, and from the analysis of five focus group interviews. Overall, students (98%) reported that they were very positive about their experiences during the programme, and felt they had gained a greater awareness of effective health counselling skills, of the latest developments in advanced nursing technology within the host School, and of cultural diversity in relation to their personal and professional development. Comparison of sub-total mean scores and standard deviations (mean+/-SD) of the three dimensions among students from Taiwan, Chinese mainland and Hong Kong/Macau, revealing significant differences in the exchange perspective (Taiwan: 18.6+/-1.4; Chinese mainland: 18.8+/-1.4; and Hong Kong/Macau: 16.5+/-1.1) professional development (Taiwan: 18.4+/-1.6; Chinese mainland: 18.2+/-1.5; and Hong Kong/Macau: 16.2+/-2.0) and personal development dimensions (Taiwan: 18.9+/-1.0; Chinese mainland: 18.6+/-1.4; and Hong Kong/Macau: 17.3+/-1.1) among these three places (p<0.001). For paired comparison (post-hoc test), the findings also show that the sub-total mean scores of the students from Taiwan and Chinese mainland were significantly higher than those of students from Hong Kong and Macau in the exchange perspective (Taiwan versus Hong Kong/Macau, p<0.001; Chinese mainland versus Hong Kong/Macau, p<0.001), professional development (Taiwan versus Hong Kong/Macau, p=0.001; Chinese mainland versus Hong Kong/Macau, p<0.001), and personal development (Taiwan versus Hong Kong/Macau, p<0.001; Chinese mainland versus Hong Kong/Macau, p=0.002). Although the findings cannot be generalized, the programme evaluation highlights the positive impact on one's exchange perspective and professional and personal development of a culturally integrated exchange programme for nursing students, with emphasis on skill practices and cultural diversity.

Cervical cancer screening in Europe: Quality assurance and organisation of programmes.

PubMed

Elfström, K Miriam; Arnheim-Dahlström, Lisen; von Karsa, Lawrence; Dillner, Joakim

2015-05-01

Cervical screening programmes have reduced cervical cancer incidence and mortality but the level of success is highly variable between countries. Organisation of programmes is essential for equity and cost-effectiveness. However, there are differences in effectiveness, also among organised programmes. In order to identify the key organisational components that determine effectiveness, we performed a Europe-wide survey on the current status of organisation and organised quality assurance (QA) measures in cervical cancer prevention programmes, as well as organisation-associated costs. A comprehensive questionnaire was developed through systematic review of literature and existing guidelines. The survey was sent to programme organisers, Ministries of Health and experts in 34 European Union (EU) and European Free Trade Agreement (EFTA) countries. Detailed aspects of programme organisation, quality assurance, monitoring, evaluation and corresponding line-item costs were recorded. Documentation of programme guidelines, protocols and publications was requested. Twenty-nine of 34 countries responded. The results showed that organised efforts for QA, monitoring and evaluation were carried out to a differing extent and were not standardised, making it difficult to compare the cost-effectiveness of organisation and QA strategies. Most countries found it hard to estimate the costs associated with launching and operating the organised programme. To our knowledge, this is the first questionnaire to request detailed information on the actual organisation and QA of programmes. The results of this survey can be used as a basis for further development of standardised guidelines on organisation and QA of cervical cancer screening programmes in Europe. Copyright © 2015 Elsevier Ltd. All rights reserved.

Increased exposure to community-based education and 'below the line' social marketing results in increased fruit and vegetable consumption.

PubMed

Glasson, Colleen; Chapman, Kathy; Wilson, Tamara; Gander, Kristi; Hughes, Clare; Hudson, Nayerra; James, Erica

2013-11-01

To determine if localised programmes that are successful in engaging the community can add value to larger fruit and vegetable mass-media campaigns by evaluating the results of the Eat It To Beat It programme. The Eat It To Beat It programme is a multi-strategy intervention that uses community-based education and ‘below the line’ social marketing to increase fruit and vegetable consumption in parents. This programme was evaluated by a controlled before-and-after study with repeat cross-sectional data collected via computer-assisted telephone interviews with 1403 parents before the intervention (2008) and 1401 following intervention delivery (2011). The intervention area was the Hunter region and the control area was the New England region of New South Wales, Australia. Parents of primary school-aged children (Kindergarten to Year 6). The programme achieved improvements in knowledge of recommended intakes for fruit and vegetables and some positive changes in knowledge of serving size for vegetables. Exposure to the programme resulted in a net increase of 0.5 servings of fruit and vegetables daily for those who recalled the programme compared with those who did not (P = 0.004). Increased intake of fruit and vegetables was significantly associated with increasing exposure to programme strategies. The Eat It To Beat It programme demonstrates that an increase in consumption of fruit and vegetables can be achieved by programmes that build on the successes of larger mass-media and social-marketing campaigns.This suggests that funding for localised, community-based programmes should be increased.

Dementia training programmes for staff working in general hospital settings - a systematic review of the literature.

PubMed

Scerri, Anthony; Innes, Anthea; Scerri, Charles

2017-08-01

Although literature describing and evaluating training programmes in hospital settings increased in recent years, there are no reviews that summarise these programmes. This review sought to address this, by collecting the current evidence on dementia training programmes directed to staff working in general hospitals. Literature from five databases were searched, based on a number of inclusion criteria. The selected studies were summarised and data was extracted and compared using narrative synthesis based on a set of pre-defined categories. Methodological quality was assessed. Fourteen peer-reviewed studies were identified with the majority being pre-test post-test investigations. No randomised controlled trials were found. Methodological quality was variable with selection bias being the major limitation. There was a great variability in the development and mode of delivery although, interdisciplinary ward based, tailor-made, short sessions using experiential and active learning were the most utilised. The majority of the studies mainly evaluated learning, with few studies evaluating changes in staff behaviour/practices and patients' outcomes. This review indicates that high quality studies are needed that especially evaluate staff behaviours and patient outcomes and their sustainability over time. It also highlights measures that could be used to develop and deliver training programmes in hospital settings.

How to use programme theory to evaluate the effectiveness of schemes designed to improve the work environment in small businesses.

PubMed

Olsen, Kirsten; Legg, Stephen; Hasle, Peter

2012-01-01

Due to the many constraints that small businesses (SBs) face in meeting legislative requirements, occupational health and safety (OHS) regulatory authorities and other OSH actors have developed programmes which can reach out to SBs and motivate and assist them in improving the work environment. A number of conceptual models help to enhance our understanding of OHS interventions in SBs and their effectiveness. However, they have mainly been evaluated on output rather than the process relating to the change theory underlying the intervention, and hence have seldom been rigorously evaluated. Thus little is known about how particular features of SBs can be taken into account when designing and implementing national programmes. This paper shows how realist analysis and programme theory may be used as a framework for evaluating, developing and improving national intervention programmes for the improvement of the work environment and reducing injuries in SBs. It illustrates this for a specific New Zealand intervention: the Workplace Safety Discount scheme and its implementation in the agriculture sector. In practice, realist analysis should be performed during the planning, implementation and management stages so that ongoing findings can be fed back to the participant social actors to help them make appropriate changes to enhance the likelihood of success.

Evaluation of a nurse-led dementia education and knowledge translation programme in primary care: A cluster randomized controlled trial.

PubMed

Wang, Yao; Xiao, Lily Dongxia; Ullah, Shahid; He, Guo-Ping; De Bellis, Anita

2017-02-01

The lack of dementia education programmes for health professionals in primary care is one of the major factors contributing to the unmet demand for dementia care services. To determine the effectiveness of a nurse-led dementia education and knowledge translation programme for health professionals in primary care; participants' satisfaction with the programme; and to understand participants' perceptions of and experiences in the programme. A cluster randomized controlled trial was used as the main methodology to evaluate health professionals' knowledge, attitudes and care approach. Focus groups were used at the end of the project to understand health professionals' perceptions of and experiences in the programme. Fourteen community health service centres in a province in China participated in the study. Seven centres were randomly assigned to the intervention or control group respectively and 85 health professionals in each group completed the programme. A train-the-trainer model was used to implement a dementia education and knowledge translation programme. Outcome variables were measured at baseline, on the completion of the programme and at 3-month follow-up. A mixed effect linear regression model was applied to compare the significant differences of outcome measures over time between the two groups. Focus groups were guided by four semi-structured questions and analysed using content analysis. Findings revealed significant effects of the education and knowledge translation programme on participants' knowledge, attitudes and a person-centred care approach. Focus groups confirmed that the programme had a positive impact on dementia care practice. A dementia education and knowledge translation programme for health professionals in primary care has positive effects on their knowledge, attitudes, care approach and care practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of a nurse leadership development programme.

PubMed

West, Margaret; Smithgall, Lisa; Rosler, Greta; Winn, Erin

2016-03-01

The challenge for nursing leaders responsible for workforce planning is to predict the knowledge, skills and abilities required to lead future healthcare delivery systems effectively. Succession planning requires a constant, competitive pool of qualified nursing leader candidates, and retention of those interested in career growth. Formal nursing leadership education in the United States is available through graduate education and professional nursing organisation programmes, such as the Emerging Nurse Leader Institute of the American Organization of Nurse Executives. However, there is also a need for local development programmes tailored to the needs of individual organisations. Leaders at Geisinger Health System, one of the largest rural health systems in the US, identified the need for an internal professional development scheme for nurses. In 2013 the Nurses Emerging as Leaders programme was developed to prepare nurse leaders for effective leadership and successful role transition. This article describes the programme and an evaluation of its effectiveness.

Sustaining Excellence in Experienced Principals? Critique of a Professional Learning Community Approach

ERIC Educational Resources Information Center

Piggot-Irvine, Eileen

2006-01-01

Independent reviewer evaluations of the Ministry of Education (MoE) funded Principal Professional Learning Community (PPLC) programme for experienced principals in New Zealand (NZ) suggest a highly valued and strongly supportive programme. My own critique of the programme, against criteria for "strong" professional learning communities…

Enhancing Entrepreneurial Self-Efficacy through Vocational Entrepreneurship Education Programmes

ERIC Educational Resources Information Center

Maritz, Alex; Brown, Chris

2013-01-01

The purpose of this study is to report the results of a longitudinal evaluation of a vocational entrepreneurship education programme (EEP) using entrepreneurial self-efficacy (ESE) measures. An empirical, mixed methods longitudinal and effectuation scale was used to measure ESE scores. Results indicate that participation in the programme had a…

Academic Outcomes of an Elementary School-Based Family Support Programme

ERIC Educational Resources Information Center

Pullmann, Michael D.; Weathers, Ericka S.; Hensley, Spencer; Bruns, Eric J.

2013-01-01

School-based family support programmes (FSPs) work within schools to build partnerships with families, promote family engagement, address family needs, provide mentorship to students and increase access to community resources. Very few programme evaluation studies of FSPs have been conducted. We report on findings from a participatory evaluation…

Evaluating the Implementation of the Empowering Coaching™ Programme: Balancing Fidelity and Adaptation

ERIC Educational Resources Information Center

Søvik, Margaret L.; Larsen, Torill; Tjomsland, Hege; Samdal, Oddrun

2016-01-01

Purpose: The purpose of this paper is to explore the implementation of a theoretically grounded coach education training programme for youth football coaches in Norway, through observational methods. In particular, it focuses on implementation fidelity and programme adaptation, and possible differences between the coach educators (CEs) according…

Peer Group Learning in Roche Pharma Development

ERIC Educational Resources Information Center

Boulden, George P.; De Laat, Richard

2005-01-01

Pharma Development has used action learning to help participants in their 360[degrees] feedback programme develop their leadership competencies. The article describes how the programme was designed, supported and run across four sites over a period of 2 years. The programme was systematically evaluated and found to be successful in meeting its…

Professional Mentoring in Student Affairs: Evaluation of a Global Programme

ERIC Educational Resources Information Center

Seeto, Eva-Marie

2016-01-01

In January 2016, the International Association of Student Affairs and Services (IASAS) offered a global professional mentoring programme that would link student affairs leaders internationally with new graduates and early career professionals in student services. Protégé participants were primarily new graduates of preparatory programmes in…

Context Matters in Programme Implementation

ERIC Educational Resources Information Center

Clarke, Aleisha M.; O'Sullivan, Maeve; Barry, Margaret M.

2010-01-01

Purpose: This paper seeks to report on the evaluation of Zippy's Friends, an international emotional wellbeing programme, for primary school children in disadvantaged schools in Ireland. The paper aims to present case studies of the profile and ethos of two specific schools participating in the programme, their links with the local community, the…

Evaluating the Prince's Trust's Young People's Business Start-Up Programme, 1994?1999: Reflections and Policy Implications

ERIC Educational Resources Information Center

Koutsoukos, Stratis; Shutt, John; Sutherland, John

2005-01-01

The authors were the principals in the evaluation of the Prince's Trust's Young People's Business Start-up Programme, 1994?1999, as it operated nationally in the UK and in the Yorkshire and the Humber region of England. In this paper they report the methodologies used in the evaluation and the key findings. They then use their reflections on both…

When Outcome Definition Determines the Result in Impact Evaluations: An Illustration Using the Swedish Work-Practice Programme

ERIC Educational Resources Information Center

Månsson, Jonas; Lundin, Christofer

2017-01-01

In this paper we investigate the effect of difference in outcome definitions on the result of impact evaluations. The Swedish workplace practice programme is evaluated, using matching methods. The key findings are that changing how the outcome is defined has a considerable influence on the results of the impact assessment. From the results of this…

The impact of urban regeneration programmes on health and health-related behaviour: Evaluation of the Dutch District Approach 6.5 years from the start.

PubMed

Ruijsbroek, Annemarie; Wong, Albert; Kunst, Anton E; van den Brink, Carolien; van Oers, Hans A M; Droomers, Mariël; Stronks, Karien

2017-01-01

Large-scale regeneration programmes to improve the personal conditions and living circumstances in deprived areas may affect health and the lifestyle of the residents. Previous evaluations concluded that a large-scale urban regeneration programme in the Netherlands had some positive effects within 3.5 years. The aim of the current study was to evaluate the effects at the longer run. With a quasi-experimental research design we assessed changes in the prevalence of general health, mental health, physical activity, overweight, obesity, and smoking between the pre-intervention (2003-04 -mid 2008) and intervention period (mid 2008-2013-14) in 40 deprived target districts and comparably deprived control districts. We used the Difference-in-Difference (DiD) to assess programme impact. Additionally, we stratified analyses by sex and by the intensity of the regeneration programme. Changes in health and health related behaviours from pre-intervention to the intervention period were about equally large in the target districts as in control districts. DiD impact estimates were inconsistent and not statistically significant. Sex differences in DiD estimates were not consistent or significant. Furthermore, DiD impact estimates were not consistently larger in target districts with more intensive intervention programmes. We found no evidence that this Dutch urban regeneration programme had an impact in the longer run on self-reported health and related behaviour at the area level.

Football Fans in Training: the development and optimization of an intervention delivered through professional sports clubs to help men lose weight, become more active and adopt healthier eating habits

PubMed Central

2013-01-01

Background The prevalence of obesity in men is rising, but they are less likely than women to engage in existing weight management programmes. The potential of professional sports club settings to engage men in health promotion activities is being increasingly recognised. This paper describes the development and optimization of the Football Fans in Training (FFIT) programme, which aims to help overweight men (many of them football supporters) lose weight through becoming more active and adopting healthier eating habits. Methods The MRC Framework for the design and evaluation of complex interventions was used to guide programme development in two phases. In Phase 1, a multidisciplinary working group developed the pilot programme (p-FFIT) and used a scoping review to summarize previous research and identify the target population. Phase 2 involved a process evaluation of p-FFIT in 11 Scottish Premier League (SPL) clubs. Participant and coach feedback, focus group discussions and interviews explored the utility/acceptability of programme components and suggestions for changes. Programme session observations identified examples of good practice and problems/issues with delivery. Together, these findings informed redevelopment of the optimized programme (FFIT), whose components were mapped onto specific behaviour change techniques using an evidence-based taxonomy. Results p-FFIT comprised 12, weekly, gender-sensitised, group-based weight management classroom and ‘pitch-side’ physical activity sessions. These in-stadia sessions were complemented by an incremental, pedometer-based walking programme. p-FFIT was targeted at men aged 35-65 years with body mass index ≥ 27 kg/m2. Phase 2 demonstrated that participants in p-FFIT were enthusiastic about both the classroom and physical activity components, and valued the camaraderie and peer-support offered by the programme. Coaches appreciated the simplicity of the key healthy eating and physical activity messages. Suggestions for improvements that were incorporated into the optimized FFIT programme included: more varied in-stadia physical activity with football-related components; post-programme weight management support (emails and a reunion session); and additional training for coaches in SMART goal setting and the pedometer-based walking programme. Conclusions The Football Fans in Training programme is highly acceptable to participants and SPL coaches, and is appropriate for evaluation in a randomised controlled trial. PMID:23496915

Measuring and modelling the quality of 40 post-disaster mental health and psychosocial support programmes.

PubMed

Dückers, Michel L A; Thormar, Sigridur B; Juen, Barbara; Ajdukovic, Dean; Newlove-Eriksson, Lindy; Olff, Miranda

2018-01-01

Disasters can have an enormous impact on the health and well-being of those affected. Internationally, governments and service providers are often challenged to address complex psychosocial problems. Ideally, the potentially broad range of support activities include a coherent, high-quality mental health and psychosocial support (MHPSS) programme. We present a theory-driven quantitative analysis of the quality of 40 MHPSS programmes, mostly implemented in European disaster settings. The objective is to measure quality domains recognized as relevant in the literature and to empirically test associations. During the EU project "Operationalizing Psychosocial Support in Crisis" (OPSIC) an evaluation survey was designed and developed for this purpose and completed by 40 MHPSS programme coordinators involved in different mass emergencies and disasters. We analysed the survey data in two steps. Firstly, we used the data to operationalize quality domains of a MHPSS programme, tested constructs and assessed their internal consistency reliability. A total of 26 out of 44 survey items clustered into three of the four domains identified within the theoretical framework: "planning and delivery system" (Cronbach's alpha 0.82); "general evaluation criteria" (Cronbach's alpha 0.82); and "essential psychosocial principles" (Cronbach's alpha 0.75). "Measures and interventions applied", theoretically a potential fourth domain, could not be confirmed to empirically cluster together. Secondly, several models with associations between domains and measures and interventions were tested and compared. The model with the best fit suggests that in MHPSS programmes with a higher planning and delivery systems score, a larger number of measures and interventions from evidence-informed guidelines are applied. In such programmes, coordinators are more positive about general evaluation criteria and the realization of essential psychosocial principles. Moreover, the analyses showed that some measures and interventions are more likely to be applied in programmes with more evolved planning and delivery systems, yet for most measures and interventions the likelihood of being applied is not linked to planning and delivery system status, nor to coordinator perceptions concerning psychosocial principles and evaluation criteria. Further research is necessary to validate and expand the findings and to learn more about success factors and obstacles for MHPSS programme implementation.

Application of a theoretical model to evaluate COPD disease management.

PubMed

Lemmens, Karin M M; Nieboer, Anna P; Rutten-Van Mölken, Maureen P M H; van Schayck, Constant P; Asin, Javier D; Dirven, Jos A M; Huijsman, Robbert

2010-03-26

Disease management programmes are heterogeneous in nature and often lack a theoretical basis. An evaluation model has been developed in which theoretically driven inquiries link disease management interventions to outcomes. The aim of this study is to methodically evaluate the impact of a disease management programme for patients with chronic obstructive pulmonary disease (COPD) on process, intermediate and final outcomes of care in a general practice setting. A quasi-experimental research was performed with 12-months follow-up of 189 COPD patients in primary care in the Netherlands. The programme included patient education, protocolised assessment and treatment of COPD, structural follow-up and coordination by practice nurses at 3, 6 and 12 months. Data on intermediate outcomes (knowledge, psychosocial mediators, self-efficacy and behaviour) and final outcomes (dyspnoea, quality of life, measured by the CRQ and CCQ, and patient experiences) were obtained from questionnaires and electronic registries. Implementation of the programme was associated with significant improvements in dyspnoea (p < 0.001) and patient experiences (p < 0.001). No significant improvement was found in mean quality of life scores. Improvements were found in several intermediate outcomes, including investment beliefs (p < 0.05), disease-specific knowledge (p < 0.01; p < 0.001) and medication compliance (p < 0.01). Overall, process improvement was established. The model showed associations between significantly improved intermediate outcomes and improvements in quality of life and dyspnoea. The application of a theory-driven model enhances the design and evaluation of disease management programmes aimed at improving health outcomes. This study supports the notion that a theoretical approach strengthens the evaluation designs of complex interventions. Moreover, it provides prudent evidence that the implementation of COPD disease management programmes can positively influence outcomes of care.

Application of a theoretical model to evaluate COPD disease management

PubMed Central

2010-01-01

Background Disease management programmes are heterogeneous in nature and often lack a theoretical basis. An evaluation model has been developed in which theoretically driven inquiries link disease management interventions to outcomes. The aim of this study is to methodically evaluate the impact of a disease management programme for patients with chronic obstructive pulmonary disease (COPD) on process, intermediate and final outcomes of care in a general practice setting. Methods A quasi-experimental research was performed with 12-months follow-up of 189 COPD patients in primary care in the Netherlands. The programme included patient education, protocolised assessment and treatment of COPD, structural follow-up and coordination by practice nurses at 3, 6 and 12 months. Data on intermediate outcomes (knowledge, psychosocial mediators, self-efficacy and behaviour) and final outcomes (dyspnoea, quality of life, measured by the CRQ and CCQ, and patient experiences) were obtained from questionnaires and electronic registries. Results Implementation of the programme was associated with significant improvements in dyspnoea (p < 0.001) and patient experiences (p < 0.001). No significant improvement was found in mean quality of life scores. Improvements were found in several intermediate outcomes, including investment beliefs (p < 0.05), disease-specific knowledge (p < 0.01; p < 0.001) and medication compliance (p < 0.01). Overall, process improvement was established. The model showed associations between significantly improved intermediate outcomes and improvements in quality of life and dyspnoea. Conclusions The application of a theory-driven model enhances the design and evaluation of disease management programmes aimed at improving health outcomes. This study supports the notion that a theoretical approach strengthens the evaluation designs of complex interventions. Moreover, it provides prudent evidence that the implementation of COPD disease management programmes can positively influence outcomes of care. PMID:20346135

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches.

PubMed

van Koperen, Tessa M; Renders, Carry M; Spierings, Eline J M; Hendriks, Anna-Marie; Westerman, Marjan J; Seidell, Jacob C; Schuit, Albertine J

2016-01-01

Background . Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods . Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings . Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion . Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation.

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches

PubMed Central

Spierings, Eline J. M.; Westerman, Marjan J.; Seidell, Jacob C.; Schuit, Albertine J.

2016-01-01

Background. Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods. Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings. Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion. Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation. PMID:28116149

Evaluation of the quality of care of a multi-disciplinary Risk Factor Assessment and Management Programme for Hypertension (RAMP-HT).

PubMed

Yu, Esther Yee Tak; Wan, Eric Yuk Fai; Chan, Karina Hiu Yen; Wong, Carlos King Ho; Kwok, Ruby Lai Ping; Fong, Daniel Yee Tak; Lam, Cindy Lo Kuen

2015-06-19

There is some evidence to support a risk-stratified, multi-disciplinary approach to manage patients with hypertension in primary care. The aim of this study is to evaluate the quality of care (QOC) of a multi-disciplinary Risk Assessment and Management Programme for Hypertension (RAMP-HT) for hypertensive patients in busy government-funded primary care clinics in Hong Kong. The objectives are to develop an evidence-based, structured and comprehensive evaluation framework on quality of care, to enhance the QOC of the RAMP-HT through an audit spiral of two evaluation cycles and to determine the effectiveness of the programme in reducing cardiovascular disease (CVD) risk. A longitudinal study is conducted using the Action Learning and Audit Spiral methodologies to measure whether pre-set target standards of care intended by the RAMP-HT are achieved. A structured evaluation framework on the quality of structure, process and outcomes of care has been developed based on the programme objectives and literature review in collaboration with the programme workgroup and health service providers. Each participating clinic is invited to complete a structure of care evaluation questionnaire in each evaluation cycle. The data of all patients who have enrolled into the RAMP-HT in the pre-defined evaluation periods are used for the evaluation of the process and outcomes of care in each evaluation cycle. For evaluation of the effectiveness of RAMP-HT, the primary outcomes including blood pressure (both systolic and diastolic), low-density lipoprotein cholesterol and estimated 10-year CVD risk of RAMP-HT participants are compared to those of hypertensive patients in usual care without RAMP-HT. The QOC and effectiveness of the RAMP-HT in improving clinical and patient-reported outcomes for patients with hypertension in normal primary care will be determined. Possible areas for quality enhancement and standards of good practice will be established to inform service planning and policy decision making.

Healthwise South Africa: cultural adaptation of a school-based risk prevention programme

PubMed Central

Wegner, L.; Flisher, A. J.; Caldwell, L. L.; Vergnani, T.; Smith, E. A.

2008-01-01

There is a need for effective prevention programmes aimed at reducing risk behaviour among South African adolescents. HealthWise South Africa is a school-based programme designed to reduce sexual and substance use risk behaviour, and promote positive use of leisure time among high-school learners (students). Based on successful programmes in the United States of America, HealthWise was developed for use in South Africa and pilot tested in four South African high schools. We carried out a process evaluation to establish the fidelity of implementation and make sure HealthWise was culturally relevant. Data sources comprised focus groups with educators and learners, lesson evaluations and observations, and interviews with school principals. Qualitative analysis of data highlighted pertinent cultural and contextual factors and identified areas for modifying HealthWise in order to promote better programme-consumer fit. These areas centred on time, language, and leisure. We noted a dynamic tension between the educators' desire to adhere to plan, and to make adaptations in accordance with learners' needs and the context. Ultimately, researchers need to find a balance between fidelity of implementation and programme adaptation to obtain effective programmes that are culturally acceptable to local consumers. PMID:17956882

'We have got the tools': Qualitative evaluation of a mental health Wellness Recovery Action Planning (WRAP) education programme in Ireland.

PubMed

Keogh, B; Higgins, A; Devries, J; Morrissey, J; Callaghan, P; Ryan, D; Gijbels, H; Nash, M

2014-04-01

In recent years, there has been a consistent drive to incorporate Recovery principles into the Irish mental health services. A group of Irish mental health service providers came together and delivered a 5-day Wellness Recovery Action Planning (WRAP) facilitator's programme. The programme was developed and delivered by key stakeholders including people with self-experience of mental health problem. This paper presents the qualitative findings from an evaluation of these facilitator's programmes. Three focus groups were held with 22 people, the majority of who described themselves as mental health professionals and/or people with self-experience of mental health problems. Data were analysed using a thematic approach and yielded four themes. Although the participants were positive about the programme and felt that their knowledge of Recovery and WRAP had improved, they felt that they still lacked confidence in terms of the presentation skills required for facilitating Recovery and WRAP programmes. The findings suggest that mental health service providers who wish to develop service users and clinicians as WRAP facilitators need to put more emphasis on the provision of facilitation and presentation skills in the programmes they develop. © 2013 John Wiley & Sons Ltd.

Evaluation of a social franchising and telemedicine programme and the care provided for childhood diarrhoea and pneumonia, Bihar, India.

PubMed

Mohanan, Manoj; Giardili, Soledad; Das, Veena; Rabin, Tracy L; Raj, Sunil S; Schwartz, Jeremy I; Seth, Aparna; Goldhaber-Fiebert, Jeremy D; Miller, Grant; Vera-Hernández, Marcos

2017-05-01

To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme - the World Health Partners' Sky Program. We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers' performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models. The programme did not significantly improve health-care providers' knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered. Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up.

The use of a modified pairwise comparison method in evaluating critical success factors for community-based rural homestay programmes

NASA Astrophysics Data System (ADS)

Daud, Shahidah Md; Ramli, Razamin; Kasim, Maznah Mat; Kayat, Kalsom; Razak, Rafidah Abd

2014-12-01

Tourism industry has become the highlighted sector which has amazingly increased the national income level. Despite the tourism industry being one of the highest income generating sectors, Homestay Programme as a Community-Based Tourism (CBT) product in Malaysia does not absorbed much of the incoming wealth. Homestay Programme refers to a programme in a community where a tourist stays together with a host family and experiences the everyday way of life of the family in both direct and indirect manner. There are over 100 Homestay Programme currently being registered with the Ministry of Culture and Tourism Malaysia which mostly are located in rural areas, but only a few excel and enjoying the fruit of the booming industry. Hence, this article seeks to identify the critical success factors for a Community-Based Rural Homestay Programme in Malaysia. A modified pairwise method is utilized to further evaluate the identified success factors in a more meaningful way. The findings will help Homestay Programme function as a community development tool that manages tourism resources. Thus, help the community in improving local economy and creating job opportunities.

Health promotion community development and the tyranny of individualism.

PubMed

Shiell, A; Hawe, P

1996-01-01

Economic evaluation of health promotion poses few major difficulties when the theoretical approach of the programme and the evaluation of cost and benefits are confined within the context of the individual. Methodological individualism has a long history in economics and the techniques of microeconomics are well suited to the examination of individually focused behaviour change programmes. However, new developments in community health promotion pose special challenges. These programmes have the community, not the individual, as the focus of programme theory and "community' means something completely different from the sum of individuals. Community empowerment and promotion of the community's capacity to deal with health issues are the goals of such programmes. To reflect these notions, sense of community and community competence should be considered as "functionings', an extra-welfarist constituent of well-being. Their inclusion as outcomes of community health promotion requires a shift from individualist utilitarian economics into a communitarian framework which respects the programme's notion of community. If health economics fails to develop new constructs to deal with these new approaches in health promotion, the application of existing techniques to community programmes will mislead health decision makers about their value and potential.

Economic evaluation of smoke alarm distribution methods in Baltimore, Maryland.

PubMed

Diamond-Smith, Nadia; Bishai, David; Perry, Elise; Shields, Wendy; Gielen, Andrea

2014-08-01

This paper analyses costs and potential lives saved from a door-to-door smoke alarm distribution programme using data from a programme run by the Baltimore City Fire Department in 2010-2011. We evaluate the impact of a standard home visit programme and an enhanced home visit programme that includes having community health workers provide advance notice, promote the programme, and accompany fire department personnel on the day of the home visit, compared with each other and with an option of not having a home visit programme (control). Study data show that the home visit programme increased by 10% the number of homes that went from having no working alarm to having any working alarm, and the enhanced programme added an additional 1% to the number of homes protected. We use published reports on the relative risk of death in homes with and without a working smoke alarm to show that the standard programme would save an additional 0.24 lives per 10,000 homes over 10 years, compared with control areas and the enhanced home visit programme saved an additional 0.07 lives compared with the standard programme. The incremental cost of each life saved for the standard programme compared with control was $28,252 per death averted and $284,501per additional death averted for the enhanced compared with the standard. Following the US guidelines for the value of a life, both programmes are cost effective, however, the standard programme may offer a better value in terms of dollars per death averted. The study also highlights the need for better data on the benefits of current smoke alarm recommendations and their impact on injury, death and property damage. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Situational analysis of infant and young child nutrition policies and programmatic activities in Burkina Faso.

PubMed

Wuehler, Sara E; Ouedraogo, Albertine Wendpagnagdé

2011-04-01

Progress towards reducing mortality and malnutrition among children < 5 years of age has been less than needed to achieve related Millennium Development Goals. Therefore, several international agencies joined to 'Reposition children's right to adequate nutrition in the Sahel', starting with an analysis of current activities related to infant and young child nutrition (IYCN). The objectives of the present paper are to compare relevant national policies, training materials, programmes, and monitoring and evaluation activities with internationally accepted IYCN recommendations. These findings are available to assist countries in identifying inconsistencies and filling gaps in current programming. Between August and November 2008, key informants responsible for conducting IYCN-related activities in Burkina Faso were interviewed, and 153 documents were examined on the following themes: optimal breastfeeding and complementary feeding practices, prevention of micronutrient deficiencies, screening and treatment of acute malnutrition, prevention of mother-to-child transmission of HIV, food security and hygienic practices. National policy documents addressed nearly all of the key IYCN topics, specifically or generally. Formative research has identified some local barriers and beliefs related to general breastfeeding and complementary feeding practices, and other formative research addressed about half of the IYCN topics included in this review. However, there was little evidence that this formative research was being utilized in developing training materials and designing programme interventions. Nevertheless, the training materials that were reviewed do provide specific guidance for nearly all of the key IYCN topics. Although many of the IYCN programmes are intended for national coverage, we could only confirm with available reports that programme coverage extended to certain regions. Some programme monitoring and evaluation were conducted, but few of these provided information on whether the specific IYCN programme components were implemented as designed. Most surveys that were identified reported on general nutrition status indicators, but did not provide the detail necessary for programme impact evaluations. The policy framework is well established for optimal IYCN practices, but greater resources and capacity building are needed to: (i) conduct necessary research and adapt training materials and programme protocols to local needs; (ii) improve, carry out, and document monitoring and evaluation that highlight effective and ineffective programme components; and (iii) apply these findings in developing, expanding, and improving effective programmes. © 2011 Blackwell Publishing Ltd.

Piloting a programme tool to evaluate malaria case investigation and reactive case detection activities: results from 3 settings in the Asia Pacific.

PubMed

Cotter, Chris; Sudathip, Prayuth; Herdiana, Herdiana; Cao, Yuanyuan; Liu, Yaobao; Luo, Alex; Ranasinghe, Neil; Bennett, Adam; Cao, Jun; Gosling, Roly D

2017-08-22

Case investigation and reactive case detection (RACD) activities are widely-used in low transmission settings to determine the suspected origin of infection and identify and treat malaria infections nearby to the index patient household. Case investigation and RACD activities are time and resource intensive, include methodologies that vary across eliminating settings, and have no standardized metrics or tools available to monitor and evaluate them. In response to this gap, a simple programme tool was developed for monitoring and evaluating (M&E) RACD activities and piloted by national malaria programmes. During the development phase, four modules of the RACD M&E tool were created to assess and evaluate key case investigation and RACD activities and costs. A pilot phase was then carried out by programme implementers between 2013 and 2015, during which malaria surveillance teams in three different settings (China, Indonesia, Thailand) piloted the tool over a period of 3 months each. This study describes summary results of the pilots and feasibility and impact of the tool on programmes. All three study areas implemented the RACD M&E tool modules, and pilot users reported the tool and evaluation process were helpful to identify gaps in RACD programme activities. In the 45 health facilities evaluated, 71.8% (97/135; min 35.3-max 100.0%) of the proper notification and reporting forms and 20.0% (27/135; min 0.0-max 100.0%) of standard operating procedures (SOPs) were available to support malaria elimination activities. The tool highlighted gaps in reporting key data indicators on the completeness for malaria case reporting (98.8%; min 93.3-max 100.0%), case investigations (65.6%; min 61.8-max 78.4%) and RACD activities (70.0%; min 64.7-max 100.0%). Evaluation of the SOPs showed that knowledge and practices of malaria personnel varied within and between study areas. Average monthly costs for conducting case investigation and RACD activities showed variation between study areas (min USD $844.80-max USD $2038.00) for the malaria personnel, commodities, services and other costs required to carry out the activities. The RACD M&E tool was implemented in the three pilot areas, identifying key gaps that led to impacts on programme decision making. Study findings support the need for routine M&E of malaria case reporting, case investigation and RACD activities. Scale-up of the RACD M&E tool in malaria-eliminating settings will contribute to improved programme performance to the high level that is required to reach elimination.

[Applying a teaching programme in community-based medical education].

PubMed

Al-Faisal, W

2006-01-01

A community-based medical education programme at Damascus University was applied in a local setting from 2 to 12 July 2004 to assess the advantages and disadvantages. Three families and 10 medical students participated. The programme included teaching objectives, health education and approaches to application and evaluation. The design of the programme was appropriate for the community setting, but it needed a longer period to run and for contact between the students and the community. The students agreed with the structure of the programme and the role of the tutor and community, but were concerned about difficulties in implementation. Community members were enthusiastic about the programme.

How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa.

PubMed

Van Belle, Sara B; Marchal, Bruno; Dubourg, Dominique; Kegels, Guy

2010-11-30

This paper presents the development of a study design built on the principles of theory-driven evaluation. The theory-driven evaluation approach was used to evaluate an adolescent sexual and reproductive health intervention in Mali, Burkina Faso and Cameroon to improve continuity of care through the creation of networks of social and health care providers. Based on our experience and the existing literature, we developed a six-step framework for the design of theory-driven evaluations, which we applied in the ex-post evaluation of the networking component of the intervention. The protocol was drafted with the input of the intervention designer. The programme theory, the central element of theory-driven evaluation, was constructed on the basis of semi-structured interviews with designers, implementers and beneficiaries and an analysis of the intervention's logical framework. The six-step framework proved useful as it allowed for a systematic development of the protocol. We describe the challenges at each step. We found that there is little practical guidance in the existing literature, and also a mix up of terminology of theory-driven evaluation approaches. There is a need for empirical methodological development in order to refine the tools to be used in theory driven evaluation. We conclude that ex-post evaluations of programmes can be based on such an approach if the required information on context and mechanisms is collected during the programme.

How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa

PubMed Central

2010-01-01

Background This paper presents the development of a study design built on the principles of theory-driven evaluation. The theory-driven evaluation approach was used to evaluate an adolescent sexual and reproductive health intervention in Mali, Burkina Faso and Cameroon to improve continuity of care through the creation of networks of social and health care providers. Methods/design Based on our experience and the existing literature, we developed a six-step framework for the design of theory-driven evaluations, which we applied in the ex-post evaluation of the networking component of the intervention. The protocol was drafted with the input of the intervention designer. The programme theory, the central element of theory-driven evaluation, was constructed on the basis of semi-structured interviews with designers, implementers and beneficiaries and an analysis of the intervention's logical framework. Discussion The six-step framework proved useful as it allowed for a systematic development of the protocol. We describe the challenges at each step. We found that there is little practical guidance in the existing literature, and also a mix up of terminology of theory-driven evaluation approaches. There is a need for empirical methodological development in order to refine the tools to be used in theory driven evaluation. We conclude that ex-post evaluations of programmes can be based on such an approach if the required information on context and mechanisms is collected during the programme. PMID:21118510

Barking, Havering and Redbridge University Hospitals NHS Trust Fellowships in Clinical Leadership Programme: An Evaluation.

PubMed

Miani, Celine; Marjanovic, Sonja; Jones, Molly Morgan; Marshall, Martin; Meikle, Samantha; Nolte, Ellen

2013-01-01

Leadership is seen to be central to improving the quality of healthcare and existing research suggests that absence of leadership is related to poor quality and safety performance. Leadership training might therefore provide an important means through which to promote quality improvement and, more widely, performance within the healthcare environment. This article presents an evaluation of the Fellowships in Clinical Leadership Programme, which combines leadership training and quality improvement initiatives with the placement of temporary external clinical champions in Barking, Havering and Redbridge University Hospitals NHS Trust. We assessed impacts of the Programme on individual and organisational change, alongside core enablers and barriers for Programme success. Analyses drew on the principles of a theory-of-change-led realist evaluation, using logic modelling to specify the underlying causal mechanisms of the Programme. Data collection involved a stakeholder workshop, online questionnaires of programme participants, senior managers and support staff (n=114), and follow-up in-depth semi-structured interviews with a subsample of survey participants (n=15). We observed that the Programme had notable impacts at individual and organisational levels. Examples of individual impact included enhanced communication and negotiation skills or increased confidence as a result of multi-modal leadership training. At the organisational level, participants reported indications of behaviour change among staff, with evidence of spill-over effects to non-participants towards a greater focus on patient-centred care. Our findings suggest that there is potential for combined leadership training and quality improvement programmes to contribute to strengthening a culture of care quality in healthcare organisations. Our study provides useful insights into strategies seeking to achieve sustainable improvement in NHS organisations.

Enhancing frontline clinical leadership in an acute hospital trust.

PubMed

Phillips, Natasha; Byrne, Geraldine

2013-09-01

To report on a leadership programme for ward managers in one National Health Service Trust that aimed to enhance their contribution to the delivery of the organisation's key objectives to support excellent patient experience. Effective ward leadership has been recognised as vital to the quality of care, resource management and interprofessional working. However, there is evidence that, at present, front-line nurse leaders are ill equipped to lead effectively and lack confidence in their ability to do so. The project aimed to provide a tailored programme for ward managers to develop their portfolio of skills to perform this pivotal role. The course contained two key elements: an integrated teaching programme to enhance leadership knowledge and skills and action learning to facilitate application to individual's own leadership practice. Both were underpinned by a change project where each individual identified, undertook and evaluated an innovation in practice. Twenty-two ward managers completed the leadership programme. Participants completed semi-structured questionnaires after each taught module. Action learning was evaluated through a combined structured and semi-structured questionnaire. All participants evaluated the programme as increasing their repertoire of leadership skills. Following completion of the programme, ward managers continue to work together as an evolving community of practice. Ward managers' development is enhanced by a programme integrating theory, action learning and completion of a ward-based project. Ward managers cannot be effectively developed in isolation. Leadership development is best supported where the organisation is also committed to developing. A leadership development programme that incorporates knowledge from within the organisation with external expertise can be an effective method to enhance front-line clinical leadership. © 2013 Blackwell Publishing Ltd.

Development and use of the generic WHO/CDC logic model for vitamin and mineral interventions in public health programmes

PubMed Central

De-Regil, Luz Maria; Peña-Rosas, Juan Pablo; Flores-Ayala, Rafael; del Socorro Jefferds, Maria Elena

2015-01-01

Objective Nutrition interventions are critical to achieve the Millennium Development Goals; among them, micronutrient interventions are considered cost-effective and programmatically feasible to scale up, but there are limited tools to communicate the programme components and their relationships. The WHO/CDC (Centers for Disease Control and Prevention) logic model for micronutrient interventions in public health programmes is a useful resource for planning, implementation, monitoring and evaluation of these interventions, which depicts the programme theory and expected relationships between inputs and expected Millennium Development Goals. Design The model was developed by applying principles of programme evaluation, public health nutrition theory and programmatic expertise. The multifaceted and iterative structure validation included feedback from potential users and adaptation by national stakeholders involved in public health programmes' design and implementation. Results In addition to the inputs, main activity domains identified as essential for programme development, implementation and performance include: (i) policy; (ii) products and supply; (iii) delivery systems; (iv) quality control; and (v) behaviour change communication. Outputs encompass the access to and coverage of interventions. Outcomes include knowledge and appropriate use of the intervention, as well as effects on micronutrient intake, nutritional status and health of target populations, for ultimate achievement of the Millennium Development Goals. Conclusions The WHO/CDC logic model simplifies the process of developing a logic model by providing a tool that has identified high-priority areas and concepts that apply to virtually all public health micronutrient interventions. Countries can adapt it to their context in order to support programme design, implementation, monitoring and evaluation for the successful scale-up of nutrition interventions in public health. PMID:23507463

Cancer and the family: assessment, communication and brief interventions-the development of an educational programme for healthcare professionals when a parent has cancer.

PubMed

Grant, Lucy; Sangha, Amrit; Lister, Sara; Wiseman, Theresa

2016-12-01

This study developed and piloted an educational intervention to support healthcare professionals (HCPs) to provide supportive care for families when a parent has cancer. Programme development followed the Medical Research Council (MRC) framework, beginning with examination of theory and research, and consultation with experts. The programme content incorporated attachment theory, child development and family systems theory. It was piloted thrice with HCPs from a cancer centre. The evaluation involved a questionnaire, comprising open-ended questions, completed before and after the programme. Data from the questionnaire were analysed using framework analysis. 31 HCPs from varying disciplines participated. The programme was evaluated positively by participants. Before the programme, participants had significant concerns about their professional competence, which included: managing their own emotions; a perceived sensitivity around raising child and family matters with patients and a lack of specialist experience, skills and knowledge. After completing the programme, participants reported greater understanding and knowledge, increased confidence to approach patients about family matters, greater skill to initiate conversations and explore family concerns and guiding parent-child communication according to the child's level of understanding, and an increased engagement and resilience for caring for parents with cancer. Supporting HCPs to provide family-centred care is likely to reduce psychological difficulties in families where a parent has cancer. Further work is planned to disseminate the programme, evaluate the transfer of skills into practice, assess how HCPs manage the emotional demands of providing supportive care over time, and consider on-going professional support for HCPs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Day patient treatment for traumatic grief: preliminary evaluation of a one-year treatment programme for patients with multiple and traumatic losses

PubMed Central

de Heus, Annemiek; Hengst, Sophie M. C.; de la Rie, Simone M.; Djelantik, A. A. A. Manik J.; Boelen, Paul A.; Smid, Geert E.

2017-01-01

ABSTRACT Background: Bereaved individuals who have lost a loved one under traumatic circumstances can develop symptoms of Persistent Complex Bereavement Disorder (PCBD) and/or Posttraumatic Stress Disorder (PTSD). This is particularly common in refugees, as they frequently have been confronted with multiple traumatic losses. For patients with severe PTSD and traumatic grief a treatment programme was developed, embedding individual traumatic grief focused therapy in a group-based multidisciplinary day patient treatment programme. The day patient treatment comprised a weekly five-hour programme consisting of three phases with a duration of four months each. Objective: To evaluate the feasibility and potential effectiveness of the treatment programme. Method: Data were analyzed from 16 participants treated between October 2013 and March 2014. PTSD severity and PTSD/PCBD diagnoses were measured during the initial and final phases of treatment using the Clinician-Administered PTSD Scale for DSM-IV (CAPS) and the Traumatic Grief Inventory Self Report (TGI-SR). One clinical case is presented in more detail. Treatment attendance was also registered and therapist satisfaction was evaluated in a focus group. Results: Thirteen patients (81%) completed the treatment. Each day of the treatment programme was attended by a mean of 76% of the participants. In the focus group, therapists noted symptom reduction in their patients and they therefore regarded Brief Eclectic Psychotherapy for Traumatic Grief (BEP-TG) as an effective therapy for their patients. During treatment, significant decreases in PTSD severity as well as diagnosable PTSD and PCBD were observed. Conclusions: Results support the feasibility and potential effectiveness of the day patient treatment programme for traumatic grief. The programme appears to be particularly suitable for refugees with severe PTSD and PCBD psychopathology, who may not benefit enough from usual care. PMID:29038679

Clinical Study: Change in Outlook Towards Birth After a Midwife Led Antenatal Education Programme Versus Hypnoreflexogenous Self-Hypnosis Training for Childbirth

PubMed Central

Streibert, L. A.; Reinhard, J.; Yuan, J.; Schiermeier, S.; Louwen, F.

2015-01-01

Aim: To compare the change of maternal outlook towards birth due to a midwife led antenatal education programme versus hypnoreflexogenous self-hypnosis training for childbirth. Method: Before beginning of the classes and after the last class maternal perception on birth was evaluated using Osgood semantic differential questionnaire. The Gießen personality score was evaluated once. Results: 213 patients were enrolled in this study. 155 were in the midwife led education programme and 58 in the self-hypnosis training programme. There was no statistically significant difference between the two groups in regard of participantsʼ characteristics, Gießen personality score and initial Osgood semantic differential scores. After the midwife led course childbirth was emotionally more negatively scored (displeasure, tarnishing, dimension evaluation [p < 0.05]), whereas after the hypnosis course childbirth was emotionally more positively evaluated (pleasure, harmony, dimension evaluation [p < 0.01] and brightness [p < 0.05]). Summary: In this study hypnoreflexogenous self-hypnosis training resulted in a positive maternal outlook towards childbirth, in comparison to the midwife led course. Further prospective randomised studies are required to test these initial results. PMID:26719600

Investigating the efficacy of a whole team, psychologically informed, acute mental health service approach.

PubMed

Araci, David; Clarke, Isabel

2017-08-01

Service user demand and service changes, from hospital based, to community and hospital mix, within acute adult mental health services, focus the need for psychologically informed, holistic, approaches. (1) Describe and report feasibility of a psychologically led Intensive Support Programme (ISP) to meet this need. (2) Present results of a pilot evaluation of this programme. ISP was implemented in four acute mental health services of the Southern Health NHS Trust, available to both inpatient and outpatient acute services. Evaluation of the service one month after data collection, illustrates operation and level of uptake across different professional roles. The programme was evaluated by assessing psychological distress (CORE-10) and confidence in self-management (Mental Health Confidence Scale) of participating service users before and after intervention. The service evaluation demonstrated extensive roll out of this programme across acute services of an extensive NHS Trust. Repeated measure t-tests demonstrated significant decrease in distress (p < 0.0005) and significant increase in confidence in self-management of mental health (p < 0.0005). Evaluation shows that ISP can be delivered in routine care in an acute mental health service and results in improvement in self management skills and facilitation of recovery.

Assessment and the Quality of Educational Programmes: What Constitutes Evidence?

ERIC Educational Resources Information Center

Shay, Sueellen; Jawitz, Jeff

2005-01-01

In a climate of growing accountability for Higher Education, there is an increased demand on assessment to play an evaluative role. National, professional and institutional quality assurance systems expect that the assessment of student performance can be used to evaluate the quality of teachers, learners, programmes and even institutions for the…

Evaluation of an Innovative Interest-Based Post-School Transition Programme for Young People with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Ashburner, Jill K.; Bobir, Natasha I.; van Dooren, Kate

2018-01-01

After leaving school, young people with autism spectrum disorder often struggle with social, educational and employment participation. A post-school transition programme underpinned by individualised case management, where mentees are guided to complete self-selected projects by mentors with multimedia skills, was evaluated using a qualitative…

Evaluation of a School-Based Sex Education Programme Delivered to Grade Nine Students in Canada

ERIC Educational Resources Information Center

Smylie, Lisa; Maticka-Tyndale, Eleanor; Boyd, Dana

2008-01-01

The effectiveness of a multidimensional Canadian sex education programme was evaluated using 240 Grade Nine students. The intervention was offered by representatives from various community groups and involved instructional classes on anatomy/physiology of the reproductive system and sexually transmitted infections, a video and group discussion on…

Evaluating the Effectiveness Roles of Variables in the Novice Programmers Learning

ERIC Educational Resources Information Center

Shi, Nianfeng; Cui, Wen; Zhang, Ping; Sun, Ximing

2018-01-01

This research applies the roles of variables to the novice programmers in the C language programming. The results are evaluated using the Structure of Observed Learning Outcomes (SOLO) taxonomy. The participants were divided into an experimental group and a control group. The students from the control group learned programming in the traditional…

Monitoring and Evaluation of Literacy and Continuing Education Programmes. Practitioners' Manual.

ERIC Educational Resources Information Center

United Nations Educational, Scientific and Cultural Organization, Bangkok (Thailand). Principal Regional Office for Asia and the Pacific.

This manual, which is intended for practitioners involved in the Asia and the Pacific Programme of Education for All, explains the basic concepts and procedures involved in monitoring and evaluating literacy and continuing education programs. The following are among the topics discussed in the manual's eight chapters: (1) understanding monitoring…

Global Experience: The Development and Preliminary Evaluation of a Programme Designed to Enhance Students' Global Engagement

ERIC Educational Resources Information Center

Feast, Vicki; Collyer-Braham, Sarah; Bretag, Tracey

2011-01-01

This paper reports on the development and preliminary evaluation of "Global Experience", an innovative programme at the University of South Australia designed to broaden students' intercultural engagement through a range of international experiential activities. The paper provides the rationale for the establishment of the programme…

Evaluating the Impact of the Graduate Certificate in Academic Practice (GCAP) Programme

ERIC Educational Resources Information Center

Chadha, Deesha

2015-01-01

Graduate teaching assistants (GTAs) and postgraduates in the UK are taking on greater responsibility for teaching, and therefore it has become increasingly necessary to explore the teacher training that supports them in this endeavour. This paper outlines an impact evaluation carried out on a graduate certificate programme primarily aimed at GTAs…

Alternative Placements in Initial Teacher Education: An Evaluation

ERIC Educational Resources Information Center

Purdy, Noel; Gibson, Ken

2008-01-01

The paper evaluates a programme of short alternative placements for final-year B.Ed. students in Northern Ireland, which aims to broaden student teachers' experience and develop their transferable skills. The alternative placement programme is set first in an international context of evolving pre-service field placements and then set in a local…

Effective Teacher? Student Self-Evaluation of Development and Progress on a Teacher Education Programme

ERIC Educational Resources Information Center

Gossman, Peter; Horder, Sue

2016-01-01

This article examines 28 teachers' views about their teacher education requirements. The participants were enrolled on a one-year full-time pre-service teacher education programme with a focus on post-compulsory education and training. The study examines how student teachers' self-evaluations against aspects of teaching professional practice…

An Exploratory Product Evaluation of the Manchester Motor Skills Programme

ERIC Educational Resources Information Center

Lodal, Katherine; Bond, Caroline

2017-01-01

This study is an exploratory product evaluation of the Manchester Motor Skills Programme (MMSP). A mixed methodology was used to explore intended, unintended, positive and negative outcomes for four Key Stage 2 (KS2) children with motor skills difficulties who participated in the MMSP. The children's motor skills, social skills and self-esteem…

Improving Vision Awareness in Autism Services: Evaluation of a Dedicated Education Programme for Support Practitioners

ERIC Educational Resources Information Center

Long, Joseph J.; Butchart, Maggie; Brown, Michael; Bain, Janice; McMillan, Anne; Karatzias, Thanos

2018-01-01

Background: The research reported here sought to evaluate whether a dedicated education programme in vision awareness improved the knowledge and skills of autism support practitioners in identifying visual impairment in autistic people with intellectual disabilities and providing better support to those individuals identified as visually impaired.…

A Causal Modelling Approach to the Development of Theory-Based Behaviour Change Programmes for Trial Evaluation

ERIC Educational Resources Information Center

Hardeman, Wendy; Sutton, Stephen; Griffin, Simon; Johnston, Marie; White, Anthony; Wareham, Nicholas J.; Kinmonth, Ann Louise

2005-01-01

Theory-based intervention programmes to support health-related behaviour change aim to increase health impact and improve understanding of mechanisms of behaviour change. However, the science of intervention development remains at an early stage. We present a causal modelling approach to developing complex interventions for evaluation in…

Development and preliminary evaluation of a behavioural HIV-prevention programme for teenage girls of Latino descent in the USA.

PubMed

Davidson, Tatiana M; Lopez, Cristina M; Saulson, Raelle; Borkman, April L; Soltis, Kathryn; Ruggiero, Kenneth J; de Arellano, Michael; Wingood, Gina M; Diclemente, Ralph J; Danielson, Carla Kmett

2014-01-01

National data suggests that teenage girls of Latino descent in the USA are disproportionately affected by HIV, with the US Centers for Disease Control and Prevention reporting the rate of new infections being approximately four times higher compared to White women of comparable age . This paper highlights the need for an effective single-sex HIV-prevention programme for teenage girls of Latino descent and describes the development and preliminary evaluation of Chicas Healing, Informing, Living and Empowering (CHILE), a culturally-tailored, HIV-prevention programme exclusively for teenage girls of Latino descent that was adapted from Sisters Informing, Healing, Living and Empowering (SiHLE), an evidence-based HIV- prevention program that is culturally tailored for African American young women. Theatre testing, a pre-testing methodology to assess consumer response to a demonstration of a product, was utilised to evaluate the relevance and utility of the HIV programme as well as opportunities for the integration of cultural constructs. Future directions for the evaluation of CHILE are discussed.

Effectiveness of comprehensive tobacco control programmes in reducing teenage smoking in the USA.

PubMed

Wakefield, M; Chaloupka, F

2000-06-01

To describe the extent to which comprehensive statewide tobacco control programmes in the USA have made progress toward reducing teenage smoking. Literature search of Medline for reviews of effectiveness of programme and policy elements, plus journal articles and personal request for copies of publicly released reports and working papers from evaluation staff in each of the state programmes of California, Massachusetts, Arizona, Oregon, and Florida. All studies, reports, and commentaries that provided information on aspects of programme implementation and evaluation. Statewide comprehensive programmes show high levels of advertising recall and generally positive improvement in smoking related beliefs and attitudes among teenagers. More fully funded programmes lead to increased mass media campaign advertising and community initiatives; a greater capacity to implement school based smoking prevention programmes; and an increase in the passage of local ordinances that create smoke free indoor environments and reduce cigarette sales to youth. The combination of programme activity and increased tobacco tax reduce cigarette consumption more than expected as a result of price increases alone, and these effects seem to apply to adolescents as well as adults. Programmes are associated with a decline in adult smoking prevalence, with these effects observed to date in California, Massachusetts, and Oregon. Arizona and Florida have yet to examine change in adult prevalence associated with programme exposure. California and Massachusetts have demonstrated relative beneficial effects in teenage smoking prevalence, and Florida has reported promising indications of reduced prevalence. Arizona has yet to report follow up data, and Oregon has found no change in teenage smoking, but has only two years of follow up available. One of the most critical factors in programme success is the extent of programme funding, and consequent level of programme implementation, and the degree to which this is undermined by the tobacco industry and other competitors for funding. Despite the different strengths and combinations of programme messages and strategies used in these comprehensive programmes, there is evidence that they lead to change in factors that influence teenage smoking, and to reductions in teenage smoking.

Controlling Response Shift Bias: The Use of the Retrospective Pre-Test Design in the Evaluation of a Master's Programme

ERIC Educational Resources Information Center

Drennan, Jonathan; Hyde, Abbey

2008-01-01

Traditionally the measures used to evaluate the impact of an educational programme on student outcomes and the extent to which students change is a comparison of the student's pre-test scores with his/her post-test scores. However, this method of evaluating change may be problematic due to the confounding factor of response shift bias when student…

Project SEARCH UK - Evaluating Its Employment Outcomes.

PubMed

Kaehne, Axel

2016-11-01

The study reports the findings of an evaluation of Project SEARCH UK. The programme develops internships for young people with intellectual disabilities who are about to leave school or college. The aim of the evaluation was to investigate at what rate Project SEARCH provided employment opportunities to participants. The evaluation obtained data from all sites operational in the UK at the time of evaluation (n = 17) and analysed employment outcomes. Data were available for 315 young people (n = 315) in the programme and pay and other employment related data were available for a subsample. The results of the analysis suggest that Project SEARCH achieves on average employment rates of around 50 per cent. Project SEARCH UK represents a valuable addition to the supported employment provision in the UK. Its unique model should inform discussions around best practice in supported employment. Implications for other supported employment programmes are discussed. © 2015 John Wiley & Sons Ltd.

Profitability of Qualified-Labour-Power Production

ERIC Educational Resources Information Center

Baldino, Roberto Ribeiro; Cabral, Tânia Cristina Baptista

2015-01-01

In Baldino and Cabral (2013) we introduced the concept of qualified labour-power as the commodity produced by the school system. In the present article we outline a quantitative model to evaluate the profit rate of educational programmes. We compare a medical school programme with a teacher education programme at a public university in Brazil,…

An Impact Evaluation of the "FoodMate" Programme: Perspectives of Homeless Young People and Staff

ERIC Educational Resources Information Center

Meiklejohn, Sarah J.; Barbour, Liza; Palermo, Claire E.

2017-01-01

Objectives: Food insecurity remains an issue for vulnerable populations in developed countries. The potential dietary and food security impacts of nutrition education programmes in Australia remain largely undocumented. This study investigated the impacts of an eight-session nutrition education programme delivered within community case management…

Essential Components for Success: A Smoking Cessation Programme in a Group Setting

ERIC Educational Resources Information Center

Southard, Carol; Sell, Heather

2013-01-01

Objective: To assess long-term quit rates of a comprehensive smoking cessation group programme and identify factors that may influence outcomes. Design: Data from 199 patients who participated in the programme from June 2009 through June 2010 were evaluated regarding smoking history, nicotine dependence and attitudes toward smoking and quitting.…

"Unplugged": A New European School Programme against Substance Abuse

ERIC Educational Resources Information Center

Kreeft, Peer Van Der; Wiborg, Gudrun; Galanti, Maria Rosaria; Siliquini, Roberta; Bohrn, Karl; Scatigna, Maria; Lindahl, Ann-Marie; Melero, Juan Carlos; Vassara, Maro; Faggiano, Fabrizio

2009-01-01

This paper presents the rationale, development and application of "Unplugged', a new school programme for the prevention of substance abuse, which is based on the comprehensive social influence approach (CSI). The programme was developed, implemented and evaluated by a cross-disciplinary group of experts in the frame of a multi-centre study…

A Statistical Evaluation of the Effects of a Structured Postdoctoral Programme

ERIC Educational Resources Information Center

Bessudnov, Alexey; Guardiancich, Igor; Marimon, Ramon

2015-01-01

Postdoctoral programmes have recently become an important step leading from doctoral education to permanent academic careers in the social sciences. This paper investigates the effects of a large and structured postdoctoral programme in the social sciences on a number of academic and non-academic outcomes of fellows. Propensity score matching is…

Study of an Inclusive Intervention Programme in Pictorial Perception with Blind and Sighted Students

ERIC Educational Resources Information Center

Carpio, Carmen; Amérigo, María; Durán, Manuel

2017-01-01

This study evaluates the effectiveness of an intervention programme administered to blind and sighted school students. The students were given information concerning style, author and technique of three paintings from three different artistic periods, as well as guidelines to assess the overall aesthetics of each image. This programme was…

The Effects of a Professional Development Programme on Primary School Teachers' Perceptions of Physical Education

ERIC Educational Resources Information Center

Harris, Jo; Cale, Lorraine; Musson, Hayley

2011-01-01

The impact of a professional development programme on primary school teachers' perceptions of physical education was investigated. Primary school teachers from five local education authorities in England provided data for the study via pre-course audits, course evaluations immediately following the programme, and focus groups and individual…

Irish nursing students' changing self-esteem and fear of negative evaluation during their preregistration programme.

PubMed

Begley, Cecily M; White, Patricia

2003-05-01

Studies on Irish nursing and midwifery professions have demonstrated that stress and bullying are frequent problems that may lead to depression and low self-esteem. Self-esteem is linked to social anxiety and is therefore related to fear of negative evaluation. It is important to study nursing students' feelings about self-esteem and negative evaluation, and to assess whether or not both these constructs change as students progress through their preregistration education programme. This study explored nursing students' perceived levels of self-esteem and their fear of negative evaluation prior to, and nearing the completion of, their 3-year preregistration programme. A descriptive, quantitative, comparative survey design was used. All students in the first intake of 1995 in two general nursing schools in Southern Ireland agreed to take part (n = 72). A questionnaire developed from the Rosenberg Self-esteem Scale and the Watson and Friend Fear of Negative Evaluation Scale was used to collect data at the start of their programme and again 2 months before completion. In general, students' reported self-esteem rose as they neared the end of their education programme and their fear of negative evaluation decreased; however, their overall self-esteem levels at their highest were only average. Many of the studies examining self-esteem have produced contradictory results. An examination of the organizational factors that contribute to self-esteem may increase our understanding of the phenomenon. Self-esteem is a complex, multifaceted phenomenon. While there is no single factor that can increase or decrease a person's self-esteem, this study has explored the potential impact of the fear of negative evaluation on self-esteem. Nursing students' self-esteem might be increased by expansion of intrinsic job characteristics, improving their job satisfaction and providing frequent positive feedback.

'I am stronger, I'm no longer afraid…', an evaluation of a home-visiting mentor mother support programme for abused women in primary care.

PubMed

Prosman, Gert-Jan; Lo Fo Wong, Sylvie H; Römkens, Renée; Lagro-Janssen, Antoine L M

2014-12-01

We aimed to investigate which factors make a mentor mother support programme for abused women successful. We used semi-structured interviews with abused women and focus group discussions with the mentor mothers to evaluate their experiences and needs within a mentor support programme (MeMoSA). Fourteen abused women were interviewed 6 months after the support programme ended. Mentor mothers participated in two focus group discussions. Abused women emphasised that nonjudgmental listening, equivalence, involvement and bonding are important factors for successful support. Mentor mothers described that empathy, availability, persistence and advocacy fitted the needs of women best to empower them and help them to cope with their violent situation at home. A safe place to meet each other was also an important factor. A good relationship, tailored support provided by home visiting, advocacy and safety are required to effectively help abused women. MeMoSA, a home-visiting support programme, is a promising valuable new support programme in primary care for abused women. © 2013 Nordic College of Caring Science.

An observational study to evaluate three pilot programmes of retesting chlamydia-positive individuals within 6 months in the South West of England

PubMed Central

Angel, Georgina; Horner, Paddy J; O'Brien, Norah; Sharp, Matt; Pye, Karl; Priestley, Cecilia; Macleod, John; Looker, Katharine J; Turner, Katherine M E

2015-01-01

Objectives To evaluate 3 pilot chlamydia retesting programmes in South West England which were initiated prior to the release of new National Chlamydia Screening Programme (NCSP) guidelines recommending retesting in 2014. Methods Individuals testing positive between August 2012 and July 2013 in Bristol (n=346), Cornwall (n=252) and Dorset (n=180) programmes were eligible for inclusion in the retesting pilots. The primary outcomes were retest within 6 months (yes/no) and repeat diagnosis at retest (yes/no), adjusted for area, age and gender. Results Overall 303/778 (39.0%) of participants were retested within 6 months and 31/299 (10.4%) were positive at retest. Females were more likely to retest than males and Dorset had higher retesting rates than the other areas. Conclusions More than a third of those eligible were retested within the time frame of the study. Chlamydia retesting programmes appear feasible within the context of current programmes to identify individuals at continued risk of infection with relatively low resource and time input. PMID:26510723

Description and student self-evaluation of a pilot integrated small group learning and simulation programme for medical students in the first clinical year.

PubMed

Levinson, Michele; Kelly, Diane; Zahariou, Krisoula; Johnson, Matthew; Jackman, Christine; Mackenzie, Sara

2017-02-01

Contemporary education for medical students should be student-centred, integrated and contextualised. Small group learning promotes clinical reasoning and skills for lifelong learning. Simulation can provide experiential learning in a safe and controlled environment. We developed a weekly integrated problem-based learning and simulation programme (IPS) over two semesters in the first clinical year to augment clinical placement experience and contextualise theory into work-relevant practice. To evaluate the new programme at Kirkpatrick level 1. An anonymous survey of participating students. The programme was well liked. Students found the programme relevant and that they had a better understanding of patient safety and the assessment of the deteriorating patient. They felt it contributed to integration of theory and practice, clinical reasoning and the acquisition of non-technical skills, particularly affective and communication elements. This IPS programme in the first clinical year can deliver a student-centred curriculum to complement clinical placement that delivers the important requirements of contemporary medical student education. © 2016 Royal Australasian College of Physicians.

PORT (Programme of Recognition and Therapy): the first Polish recognition and treatment programme for patients with an at-risk mental state.

PubMed

Kotlicka-Antczak, Magdalena; Pawełczyk, Tomasz; Rabe-Jabłońska, Jolanta; Pawełczyk, Agnieszka

2015-08-01

To present the activities of the first early intervention centre in Poland and the Programme of Recognition and Therapy (PORT) run by the centre. An overview of the admission process, diagnostic procedures and therapeutic interventions offered to individuals with an at-risk mental state. The PORT programme, developed in 2010, included 81 individuals, aged 15-29 years so far. The diagnostic procedures consists of evaluation of symptoms with the use of the Comprehensive Assessment of At-Risk Mental State (CAARMS), assessment of premorbid and current personality traits and the evaluation of cognitive functions. Therapeutic interventions include cognitive behavioural therapy, diet supplementation with omega-3 fatty acids and pharmacological treatment. Overall rate of conversion into psychosis within the years 2010-2103 was 18.5%. The programme has also been a source of research in the field of early psychosis. The PORT programme enables young people with an ARMS an easy access to the specialized service offering treatment tailored to their specific needs. © 2014 Wiley Publishing Asia Pty Ltd.

Study protocol: using the Q-STEPS to assess and improve the quality of physical activity programmes for the elderly.

PubMed

Marques, Ana I; Rosa, Maria J; Amorim, Marlene; Soares, Pedro; Oliveira-Tavares, António; Santos, Rute; Mota, Jorge; Carvalho, Joana

2012-07-09

Aging is one of the most important and obvious phenomenon observed in our society. In the past years, there has been a growing concern in designing physical activity (PA) programmes for elderly people, because evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Accordingly, a growing body of literature points to the importance of a sound approach to planning and evaluation in order to improve the quality of PA programmes. However, while numerous PA programmes have been designed for the elderly in recent years, their evaluation has been scarce. Quality management processes and tools provide a practical way for organisations to assess, identify and shed light on the areas requiring improvement. The Quality Self-assessment Tool for Exercise Programmes for Seniors (Q-STEPS) seems to provide a framework tailored to evaluate PA programmes for the elderly. The primary purpose of this study is 1) to determine feasibility, acceptability and usability of the Q-STEPS. Secondary purposes of the study are: 2) to examine the quality of the PA programmes for elderly people developed by the Portuguese Local Administration over a three-year period of self-assessments in terms of: a) Enabler domains (Leadership, Policy and Strategy, People, Partnership and Resources, Processes); b) Result domains (Customer Results, People Results, Society Results and Key Performance Results); 3) to estimate the association between the use of Q-STEPS and some indicators relating to the elderly participants, during the three self-assessments, such as: attendance rates, physical fitness, health-related quality of life and the elderly's perceived quality of the programme. The study will be conducted in PA programmes for elderly adults from mainland Portuguese municipalities over a three-year period. The project will adopt a participative quality improvement approach that features annual learning cycles of: 1) self-assessment with the Q-STEPS; 2) feedback to and interpretation of results involving programme's staff; 3) action planning to achieve system changes; 4) implementation of strategies for change; and 5) review process through further self-assessment. The study will collect a range of process and outcome data that will be used to achieve the research aims. It is our understanding that the results of the Q-STEPS study will contribute directly to the evidence based on effectiveness of continuous quality improvement approaches, in order to improve customer satisfaction and adherence to PA programmes targeting the ageing population. This comprehensive evaluation will also add significant new knowledge regarding the characteristics associated with a sustainable public service.

Monitoring and evaluation of sport-based HIV/AIDS awareness programmes: Strengthening outcome indicators

PubMed Central

Maleka, Elma Nelisiwe

2017-01-01

Abstract There are number of Non-Governmental Organisations (NGOs) in South Africa that use sport as a tool to respond to Human Immunodeficiency Virus/Acquired Immunodeficiency Syndrome (HIV/AIDS), however, little is reported about the outcomes and impact of these programmes. The aim of this study is to contribute to a generic monitoring and evaluation framework by improving the options for the use of outcome indicators of sport-based HIV/AIDS awareness programmes of selected NGOs in South Africa. A qualitative method study was carried out with seven employees of five selected NGOs that integrate sport to deliver HIV/AIDS programmes in South Africa. The study further involved six specialists/experts involved in the field of HIV/AIDS and an official from Sport Recreation South Africa (SRSA). Multiple data collection instruments including desktop review, narrative systematic review, document analysis, one-on-one interviews and focus group interview were used to collect information on outcomes and indicators for sport-based HIV/AIDS awareness programmes. The information was classified according to the determinants of HIV/AIDS. The overall findings revealed that the sport-based HIV/AIDS awareness programmes of five selected NGOs examined in this study focus on similar HIV prevention messages within the key priorities highlighted in the current National Strategic Plan for HIV/AIDS, STIs and TB of South Africa. However, monitoring and evaluating outcomes of sport-based HIV/AIDS programmes of the selected NGOs remains a challenge. A need exists for the improvement of the outcome statements and indicators for their sport-based HIV/AIDS awareness programmes. This study proposed a total of 51 generic outcome indicators focusing on measuring change in the knowledge of HIV/AIDS and change in attitude and intention towards HIV risk behaviours. In addition, this study further proposed a total of eight generic outcome indicators to measure predictors of HIV risk behaviour. The selected NGOs can adapt the proposed generic outcomes and indicators based on the settings of their programmes. A collaborative approach by all stakeholders is required, from international organisations, funders, governments, NGOs and communities to strengthening monitoring and evaluation of sport-based HIV/AIDS awareness programmes including other development programmes. This will assist the NGOs that use sport for development to be able to reflect accurately the information about their HIV/AIDS activities and also be able to contribute to on-going monitoring activities at a national and global level as well as to the Sustainable Development Goals. PMID:27997309

Monitoring and evaluation of sport-based HIV/AIDS awareness programmes: Strengthening outcome indicators.

PubMed

Maleka, Elma Nelisiwe

2017-12-01

There are number of Non-Governmental Organisations (NGOs) in South Africa that use sport as a tool to respond to Human Immunodeficiency Virus/Acquired Immunodeficiency Syndrome (HIV/AIDS), however, little is reported about the outcomes and impact of these programmes. The aim of this study is to contribute to a generic monitoring and evaluation framework by improving the options for the use of outcome indicators of sport-based HIV/AIDS awareness programmes of selected NGOs in South Africa. A qualitative method study was carried out with seven employees of five selected NGOs that integrate sport to deliver HIV/AIDS programmes in South Africa. The study further involved six specialists/experts involved in the field of HIV/AIDS and an official from Sport Recreation South Africa (SRSA). Multiple data collection instruments including desktop review, narrative systematic review, document analysis, one-on-one interviews and focus group interview were used to collect information on outcomes and indicators for sport-based HIV/AIDS awareness programmes. The information was classified according to the determinants of HIV/AIDS. The overall findings revealed that the sport-based HIV/AIDS awareness programmes of five selected NGOs examined in this study focus on similar HIV prevention messages within the key priorities highlighted in the current National Strategic Plan for HIV/AIDS, STIs and TB of South Africa. However, monitoring and evaluating outcomes of sport-based HIV/AIDS programmes of the selected NGOs remains a challenge. A need exists for the improvement of the outcome statements and indicators for their sport-based HIV/AIDS awareness programmes. This study proposed a total of 51 generic outcome indicators focusing on measuring change in the knowledge of HIV/AIDS and change in attitude and intention towards HIV risk behaviours. In addition, this study further proposed a total of eight generic outcome indicators to measure predictors of HIV risk behaviour. The selected NGOs can adapt the proposed generic outcomes and indicators based on the settings of their programmes. A collaborative approach by all stakeholders is required, from international organisations, funders, governments, NGOs and communities to strengthening monitoring and evaluation of sport-based HIV/AIDS awareness programmes including other development programmes. This will assist the NGOs that use sport for development to be able to reflect accurately the information about their HIV/AIDS activities and also be able to contribute to on-going monitoring activities at a national and global level as well as to the Sustainable Development Goals.

Exploring the development of existing sex education programmes for people with intellectual disabilities: an intervention mapping approach.

PubMed

Schaafsma, Dilana; Stoffelen, Joke M T; Kok, Gerjo; Curfs, Leopold M G

2013-03-01

People with intellectual disabilities face barriers that affect their sexual health. Sex education programmes have been developed by professionals working in the field of intellectual disabilities with the aim to overcome these barriers. The aim of this study was to explore the development of these programmes. Sex education programmes geared to people with intellectual disabilities were examined in the context of the Intervention Mapping protocol. Data were obtained via interviews with the programme developers. All programmes lack specific programme outcomes, do not have a theoretical basis, did not involve members of relevant groups in the development process and lack systematic evaluation. Based on our findings and the literature, we conclude that these programmes are unlikely to be effective. Future programmes should be developed using a more systematic and theory- and evidence-based approach. © 2012 Blackwell Publishing Ltd.

Programmes for tobacco and alcohol users in Australian work-places.

PubMed

Richmond, R; Heather, N; Holt, P

1996-12-01

This article presents findings from a survey of programmes available for tobacco and alcohol users working in 455 of Australia's top 600 companies. Companies were twice as likely to have programmes for smokers (43%) as for problem drinkers (24%) and these programmes were more apparent in large companies. The majority of programmes for smoking were delivered within a health promotion context which included other life-style issues, such as nutrition, exercise, weight management and stress management. Although Employee Assistance Programs (EAPs) were the most commonly available type of work-place programme for excessive drinkers and other drug users, followed by Alcoholics Anonymous and local hospital clinics, only 6% had an EAP for alcohol. Only 21% of programmes for smokers and 12% for excessive alcohol users were evaluated. Around one-quarter of companies knew the costs of smoking programmes, and 9% reported costs of conducting programmes for excessive alcohol consumers.

An evaluative study of clinical preceptorship.

PubMed

Kaviani, N; Stillwell, Y

2000-04-01

Clinical preceptorships, in collaboration between clinical agencies and educational institutions have been documented as an effective and innovative means of facilitating student learning, providing advantages for both the clinical and educational settings. A preceptorship programme of 100 hours duration was developed and delivered by the nurse education institute, in consultation with a health care organization. The objectives of the preceptorship programme were to help registered nurses, in partnership with clinical nurse educators, to effectively integrate, support and assist the development of clinical competence in the undergraduate nursing student. Following the implementation of the preceptorship programme a research study was conducted to evaluate programme effectiveness. The purpose of the study was to examine preceptors, preceptees, and nurse managers' preceptions of the preceptor role and factors which influenced the performance of preceptors. The methods used in this study included those commonly found in evaluation research. That is, participants were drawn from those who were involved, either directly or indirectly, in the preceptorship programme, namely preceptors, preceptees and nurse managers. Using focus groups, they were each asked to identify the outcomes of the programme in practice. Study findings highlighted the importance of formal preceptor preparation, which was shown to enhance teaching and learning opportunities for student preceptees, personal and professional development of the preceptors, and the promotion of positive partnerships between nurse educators and nurse practitioners. The need for formal recognition of the preceptor role in practice, particularly in relation to the provision of adequate time and resources, emerged from the study. The research findings enabled the development of an evaluative model of preceptorship, which highlights the intrinsic and extrinsic factors impacting on the preceptor role.

[Individualised parent counselling in paediatric practices for the reduction of second-hand smoke exposure of their children: a feasibility study].

PubMed

Haug, S; Biedermann, A; Ulbricht, S; John, U

2015-05-01

The aim of this study was to test the feasibility of a web-based programme provided by paediatric practices for counselling parents to reduce second-hand smoke exposure of their children. Accompanying persons of children were systematically screened concerning tobacco smoking at their home in 2 Swiss paediatric practices. They were invited for programme participation if they or their partners smoked at home regularly. The web-based programme provided at least 1 computer-tailored counselling letter. Upto 3 additional counselling letters could be requested online by the participants over a period of 3 months. The letters were tailored according to the indoor smoking behaviour of the parents and considered individual barriers and resources for the establishment of a smoke-free home. Additionally, further information and advice could be requested on the programme website. Feasibility indicators were the participation rate, programme use, and programme evaluation by the participants. 3 055 (82.3%) of 3 712 accompanying persons of children in the paediatric practices were screened concerning tobacco smoking at their home. 96 (56.8%) of 169 eligible persons participated in the programme. 68 (70.8%) of the 96 programme participants could be reassessed at post assessment. 9 (15.0%) of 60 participants who provided a valid e-mail address requested more than one counselling letter. The counselling letters and the web-based programme were evaluated positively by the programme participants. Systematic screening combined with the provision of individually tailored counselling letters for parents to reduce second-hand smoke exposure of their children was feasible in paediatric practices. Possible strategies to in-crease the use and reach of the programme are -discussed. © Georg Thieme Verlag KG Stuttgart · New York.

Economic benefit of the PHLAME wellness programme on firefighter injury.

PubMed

Kuehl, K S; Elliot, D L; Goldberg, L; Moe, E L; Perrier, E; Smith, J

2013-04-01

Work-related injuries and illness are prevalent and costly. Firefighting is especially hazardous and many firefighters sustain work-related injuries. Workplace health promotion programmes have shown positive return on investment (ROI). Little is known about how similar programmes would impact injury and cost among firefighters. To evaluate the impact of a workplace health promotion intervention on workers' compensation (WC) claims and medical costs among Oregon fire departments participating in the PHLAME (Promoting Healthy Lifestyles: Alternative Models' Effects) health promotion programme compared with Oregon fire departments not participating in PHLAME. Data from firefighters from four large urban fire departments in Oregon were evaluated using a retrospective quasi-experimental study design. Outcomes were (i) total annual firefighter WC claims, (ii) total annual incurred medical costs prior to and after implementation of the PHLAME firefighter worksite health promotion programme (iii) and an ROI analysis. Data were obtained from 1369 firefighters (mean age of 42 years, 91% white, 93% male). WC claims (P < 0.001) and medical costs (P < 0.01) were significantly lower among PHLAME fire departments compared with Oregon fire departments not participating in the programme. Fire departments participating in the PHLAME TEAM programme demonstrated a positive ROI of 4.61-1.00 (TEAM is used to indicate the 12-session peer-led health promotion programme). Fire department WC claims and medical costs were reduced after implementation of the PHLAME workplace health promotion programme. This is a low cost, team-based, peer-led, wellness programme that may provide a feasible, cost-effective means to reduce firefighter injury and illness rates.

Economic benefit of the PHLAME wellness programme on firefighter injury

PubMed Central

2013-01-01

Background Work-related injuries and illness are prevalent and costly. Firefighting is especially hazardous and many firefighters sustain work-related injuries. Workplace health promotion programmes have shown positive return on investment (ROI). Little is known about how similar programmes would impact injury and cost among firefighters. Aims To evaluate the impact of a workplace health promotion intervention on workers’ compensation (WC) claims and medical costs among Oregon fire departments participating in the PHLAME (Promoting Healthy Lifestyles: Alternative Models’ Effects) health promotion programme compared with Oregon fire departments not participating in PHLAME. Methods Data from firefighters from four large urban fire departments in Oregon were evaluated using a retrospective quasi-experimental study design. Outcomes were (i) total annual firefighter WC claims, (ii) total annual incurred medical costs prior to and after implementation of the PHLAME firefighter worksite health promotion programme (iii) and an ROI analysis. Results Data were obtained from 1369 firefighters (mean age of 42 years, 91% white, 93% male). WC claims (P < 0.001) and medical costs (P < 0.01) were significantly lower among PHLAME fire departments compared with Oregon fire departments not participating in the programme. Fire departments participating in the PHLAME TEAM programme demonstrated a positive ROI of 4.61–1.00 (TEAM is used to indicate the 12-session peer-led health promotion programme). Conclusions Fire department WC claims and medical costs were reduced after implementation of the PHLAME workplace health promotion programme. This is a low cost, team-based, peer-led, wellness programme that may provide a feasible, cost-effective means to reduce firefighter injury and illness rates. PMID:23416849

Process evaluation of the implementation of scorecard-based antenatal risk assessment, care pathways and interdisciplinary consultation: the Healthy Pregnancy 4 All study.

PubMed

Vos, A A; van Voorst, S F; Posthumus, A G; Waelput, A J M; Denktaş, S; Steegers, E A P

2017-09-01

To evaluate the implementation of a complex intervention in the antenatal healthcare field in 14 Dutch municipalities. The intervention consisted of the implementation of a systematic scorecard-based risk assessment in pregnancy, subsequent patient-tailored care pathways, and consultations of professionals from different medical and social disciplines. Saunders's seven-step method was used for the development of a programme implementation monitoring plan, with specific attention to the setting and context of the programme. Data were triangulated from multiple sources, and prespecified criteria were applied to examine the evidence for implementation. Six out of 11 municipalities (54%) met the implementation criteria for the entire risk assessment programme, whereas three municipalities (27%) met the criteria if the three components of implementation were analysed separately. A process evaluation of implementation of a complex intervention is possible. The results can be used to improve understanding of the associations between specific programme elements and programme outcomes on effectiveness of the intervention. Additionally, the results are important for formative purposes to assess how future implementation of antenatal risk assessment can be improved in comparable contexts. Copyright © 2017. Published by Elsevier Ltd.

The NIHR Invention for Innovation (i4i) Programme: A Review of Progress and Contributions to Innovation in Healthcare Technologies.

PubMed

Marjanovic, Sonja; Krapels, Joachim; Sousa, Sonia; Castle-Clarke, Sophie; Horvath, Veronika; Chataway, Joanna

2015-11-30

The National Institute for Health Research (NIHR) Invention for Innovation (i4i) programme supports the development of innovative medical technologies for patient benefit. The i4i product development stream involves collaborative projects between at least two partners from academia, the NHS and industry. Medical technology innovators apply for funding for one to three years, through a peer review-based process that includes presentation to a selection panel. The funding and business advice provided by i4i support the development of early-stage innovations, generally at proof of concept and prototype stages. Since its inception the product development stream has identified and supported 170 projects, led by 146 principal investigators (PIs). RAND Europe evaluated the programme, with the aim of identifying its outputs and impacts and examining the factors influencing performance. The evaluation findings should help inform the future of the programme. The evaluation used a multi-method approach, including a focused review of background information from i4i, scoping interviews with key informants, a survey of programme participants and case studies of projects representing diverse technologies and health needs.

oneED: Embedding a mindfulness-based wellness programme into an emergency department.

PubMed

Braganza, Shahina; Young, Jessica; Sweeny, Amy; Brazil, Victoria

2018-03-30

ED staff are subject to many stressors, but there are few descriptions of collective approaches to enhancing wellness in this setting. We aim to describe a programme developed to address these issues at department level, to report the feasibility and sustainability of the programme, and its impact on staff. The oneED programme was developed and delivered in a tertiary ED. The programme included a 1 day mindfulness workshop, followed by ongoing mindfulness activities embedded in clinical areas over the subsequent 12 months. A mixed-methods evaluation of the programme was conducted, which included quantitative validated psychological tools to measure anxiety, depression and emotional exhaustion, and pragmatic evaluation using surveys of participants and iterative appreciative inquiry. Eighty staff members attended the mindfulness workshop; 66 from ED. Following the workshop, understanding and frequency of mindfulness practice increased significantly in 47% of participants. Free-text survey results demonstrated that staff found the programme to be acceptable (80% survey participants) and of perceived value to themselves (50%) and the ED (60%). Appreciative inquiry led to modification of the programme: the 4 min pause is now conducted weekly rather than daily, the pause consists of a variety of activities, and group activities are made more overtly optional. A departmental wellness programme embedding mindfulness practice is feasible and sustainable. Potential for success is enhanced by an approach that is open to modification according to each institution's culture. © 2018 Australasian College for Emergency Medicine and Australasian Society for Emergency Medicine.

Developing an evaluation framework for clinical redesign programs: lessons learnt.

PubMed

Samaranayake, Premaratne; Dadich, Ann; Fitzgerald, Anneke; Zeitz, Kathryn

2016-09-19

Purpose The purpose of this paper is to present lessons learnt through the development of an evaluation framework for a clinical redesign programme - the aim of which was to improve the patient journey through improved discharge practices within an Australian public hospital. Design/methodology/approach The development of the evaluation framework involved three stages - namely, the analysis of secondary data relating to the discharge planning pathway; the analysis of primary data including field-notes and interview transcripts on hospital processes; and the triangulation of these data sets to devise the framework. The evaluation framework ensured that resource use, process management, patient satisfaction, and staff well-being and productivity were each connected with measures, targets, and the aim of clinical redesign programme. Findings The application of business process management and a balanced scorecard enabled a different way of framing the evaluation, ensuring measurable outcomes were connected to inputs and outputs. Lessons learnt include: first, the importance of mixed-methods research to devise the framework and evaluate the redesigned processes; second, the need for appropriate tools and resources to adequately capture change across the different domains of the redesign programme; and third, the value of developing and applying an evaluative framework progressively. Research limitations/implications The evaluation framework is limited by its retrospective application to a clinical process redesign programme. Originality/value This research supports benchmarking with national and international practices in relation to best practice healthcare redesign processes. Additionally, it provides a theoretical contribution on evaluating health services improvement and redesign initiatives.

Parenting for Autism, Language, And Communication Evaluation Study (PALACES): protocol for a pilot randomised controlled trial.

PubMed

Williams, Margiad Elen; Hastings, Richard; Charles, Joanna Mary; Evans, Sue; Hutchings, Judy

2017-02-16

Children with autistic spectrum disorder (ASD) often have associated behavioural difficulties that can present a challenge for parents and parenting. There are several effective social learning theory-based parenting programmes for dealing with behavioural difficulties, including the Incredible Years (IY) parent programmes. However, these programmes typically do not specifically target parents of children with ASD. Recently, a new addition to the IY suite of programmes known as the IY Autistic Spectrum and Language Delays (IY-ASLD) parent programme was developed. The main aims of the present study are to examine the feasibility of delivering this programme within child health services and to provide initial evidence for effectiveness and economic costs. The Parenting for Autism, Language, And Communication Evaluation Study (PALACES) trial is a pragmatic, multicentre, pilot randomised controlled trial comparing the IY-ASLD programme with a wait-list control condition. 72 parents of children with ASD (aged 3-8 years) will be randomly allocated to either the intervention or control condition. Data will be collected prior to randomisation and 6 months postrandomisation for all families. Families in the intervention condition only will also be followed up at 12 and 18 months postrandomisation. This study will provide initial evidence of effectiveness for the newly developed IY-ASLD parenting programme. It will also add to the limited economic evidence for an intervention targeting parents of children with ASD and provide longer term data, an important component for evaluations of parenting programmes. Approval for the study was granted by the Research Ethics Committee at the School of Psychology, Bangor University (reference number: 2016-15768) and the North Wales Research Ethics Committee, UK (reference number: 16/WA/0224). The findings will be disseminated through research conferences and peer-reviewed journals. ISRCTN57070414; Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Parenting for Autism, Language, And Communication Evaluation Study (PALACES): protocol for a pilot randomised controlled trial

PubMed Central

Williams, Margiad Elen; Hastings, Richard; Charles, Joanna Mary; Evans, Sue; Hutchings, Judy

2017-01-01

Introduction Children with autistic spectrum disorder (ASD) often have associated behavioural difficulties that can present a challenge for parents and parenting. There are several effective social learning theory-based parenting programmes for dealing with behavioural difficulties, including the Incredible Years (IY) parent programmes. However, these programmes typically do not specifically target parents of children with ASD. Recently, a new addition to the IY suite of programmes known as the IY Autistic Spectrum and Language Delays (IY-ASLD) parent programme was developed. The main aims of the present study are to examine the feasibility of delivering this programme within child health services and to provide initial evidence for effectiveness and economic costs. Methods and analysis The Parenting for Autism, Language, And Communication Evaluation Study (PALACES) trial is a pragmatic, multicentre, pilot randomised controlled trial comparing the IY-ASLD programme with a wait-list control condition. 72 parents of children with ASD (aged 3–8 years) will be randomly allocated to either the intervention or control condition. Data will be collected prior to randomisation and 6 months postrandomisation for all families. Families in the intervention condition only will also be followed up at 12 and 18 months postrandomisation. This study will provide initial evidence of effectiveness for the newly developed IY-ASLD parenting programme. It will also add to the limited economic evidence for an intervention targeting parents of children with ASD and provide longer term data, an important component for evaluations of parenting programmes. Ethics and dissemination Approval for the study was granted by the Research Ethics Committee at the School of Psychology, Bangor University (reference number: 2016–15768) and the North Wales Research Ethics Committee, UK (reference number: 16/WA/0224). The findings will be disseminated through research conferences and peer-reviewed journals. Trial registration number ISRCTN57070414; Pre-results. PMID:28209607

Setting priorities for safe motherhood programme evaluation: a participatory process in three developing countries.

PubMed

Madi, Banyana Cecilia; Hussein, Julia; Hounton, Sennen; D'Ambruoso, Lucia; Achadi, Endang; Arhinful, Daniel Kojo

2007-09-01

A participatory approach to priority setting in programme evaluation may help improve the allocation and more efficient use of scarce resources especially in low-income countries. Research agendas that are the result of collaboration between researchers, programme managers, policy makers and other stakeholders have the potential to ensure rigorous studies are conducted on matters of local priority, based on local, expert knowledge. This paper describes a process involving key stakeholders to elicit and prioritise evaluation needs for safe motherhood in three developing countries. A series of reiterative consultations with safe motherhood stakeholders from each country was conducted over a period of 36 months. In each country, the consultation process consisted of a series of participatory workshops; firstly, stakeholder's views on evaluation were elicited with parallel descriptive work on the contexts. Secondly, priorities for evaluation were identified from stakeholders; thirdly, the evaluation-priorities were refined; and finally, the evaluation research questions, reflecting the identified priorities, were agreed and finalised. Three evaluation-questions were identified in each country, and one selected, on which a full scale evaluation was undertaken. While there is a great deal written about the importance of transparent and participatory priority setting in evaluation; few examples of how such processes could be implemented exist, particularly for maternal health programmes. Our experience demonstrates that the investment in a participatory priority-setting effort is high but the process undertaken resulted in both globally and contextually-relevant priorities for evaluation. This experience provides useful lessons for public health practitioners committed to bridging the research-policy interface.

Implementing economic evaluation in simulation-based medical education: challenges and opportunities.

PubMed

Lin, Yiqun; Cheng, Adam; Hecker, Kent; Grant, Vincent; Currie, Gillian R

2018-02-01

Simulation-based medical education (SBME) is now ubiquitous at all levels of medical training. Given the substantial resources needed for SBME, economic evaluation of simulation-based programmes or curricula is required to demonstrate whether improvement in trainee performance (knowledge, skills and attitudes) and health outcomes justifies the cost of investment. Current literature evaluating SBME fails to provide consistent and interpretable information on the relative costs and benefits of alternatives. Economic evaluation is widely applied in health care, but is relatively scarce in medical education. Therefore, in this paper, using a focus on SBME, we define economic evaluation, describe the key components, and discuss the challenges associated with conducting an economic evaluation of medical education interventions. As a way forward to the rigorous and state of the art application of economic evaluation in medical education, we outline the steps to gather the necessary information to conduct an economic evaluation of simulation-based education programmes and curricula, and describe the main approaches to conducting an economic evaluation. A properly conducted economic evaluation can help stakeholders (i.e., programme directors, policy makers and curriculum designers) to determine the optimal use of resources in selecting the modality or method of assessment in simulation. It also helps inform broader decision making about allocation of scarce resources within an educational programme, as well as between education and clinical care. Economic evaluation in medical education research is still in its infancy, and there is significant potential for state-of-the-art application of these methods in this area. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

The impact of a faculty development programme for health professions educators in sub-Saharan Africa: an archival study.

PubMed

Frantz, José M; Bezuidenhout, Juanita; Burch, Vanessa C; Mthembu, Sindi; Rowe, Michael; Tan, Christina; Van Wyk, Jacqueline; Van Heerden, Ben

2015-03-03

In 2008 the sub-Saharan FAIMER Regional Institute launched a faculty development programme aimed at enhancing the academic and research capacity of health professions educators working in sub-Saharan Africa. This two-year programme, a combination of residential and distance learning activities, focuses on developing the leadership, project management and programme evaluation skills of participants as well as teaching the key principles of health professions education-curriculum design, teaching and learning and assessment. Participants also gain first-hand research experience by designing and conducting an education innovation project in their home institutions. This study was conducted to determine the perceptions of participants regarding the personal and professional impact of the SAFRI programme. A retrospective document review, which included data about fellows who completed the programme between 2008 and 2011, was performed. Data included fellows' descriptions of their expectations, reflections on achievements and information shared on an online discussion forum. Data were analysed using Kirkpatrick's evaluation framework. Participants (n=61) came from 10 African countries and included a wide range of health professions educators. Five key themes about the impact of the SAFRI programme were identified: (1) belonging to a community of practice, (2) personal development, (3) professional development, (4) capacity development, and (5) tools/strategies for project management and/or advancement. The SAFRI programme has a positive developmental impact on both participants and their respective institutions.

Planning a graduate programme in public health nutrition for experienced nutrition professionals.

PubMed

Fox, Ann; Beyers, Joanne

2011-08-01

Public health renewal in Canada has highlighted the need for development and expansion of the public health nutrition workforce, particularly in northern and rural communities. The purpose of the present paper is to describe the planning of a more accessible graduate programme for experienced nutrition professionals. The planning effort was challenged by a short timeframe between programme approval and implementation and required intense collaboration with stakeholders and students. The programme planning model developed by The Health Communication Unit (THCU) at the Centre for Health Promotion was used to guide the process. This six-step model was familiar to key stakeholders and involved pre-planning, conducting a situational assessment, establishing goals and objectives, developing strategies and outcome indicators, and monitoring feedback. Resource constraints, short timelines and debates around distance education options presented challenges that were overcome by conducting a thorough needs assessment, creating an advisory committee, engaging key stakeholders in the planning process, and building on existing resources. Extensive involvement of the first cohort of students in ongoing planning and evaluation was particularly helpful in informing the evolution of the programme. The THCU planning model provided a useful framework for stakeholder collaboration and for planning and implementing the new graduate programme in public health nutrition. Preliminary data suggest that graduates are benefiting from their educational experiences through career enhancement opportunities. The evaluation strategies built into the programme design will be useful in informing ongoing programme development.

Health-related quality of life of medical students in a Brazilian student loan programme.

PubMed

Lins, Liliane; Carvalho, Fernando Martins; Menezes, Marta Silva; Porto-Silva, Larissa; Damasceno, Hannah

2016-08-01

This study aimed to evaluate the health-related quality of life of medical students participating in a large Brazilian government loan programme for undergraduate students in private schools.A cross-sectional study in a stratified sample of students from a private medical school in Salvador, Brazil, evaluated their health-related quality of life by using a Brazilian Portuguese version of the 36-item Short Form Health Survey questionnaire (SF-36).Students supported by the loan programme consistently presented lower mean scores in all SF-36 domains and in the physical and mental component summary scores than those who were not in the programme. Students supported by the loan programme presented systematically lower physical and mental component mean scores, after stratification by age, gender, school year, physical activity, sleepiness, headache, having a car, having a housemaid, living with family, and living in a rented house.The loan programme has enabled less wealthy undergraduate students to attend private medical schools in Brazil. However, this support is insufficient to improve students' health-related quality of life during medical school, as compared with students who do not participate in the programme. Because of a poorer health-related quality of life, students supported by the loan programme deserve special attention from private medical schools.

The effect of a Web-based education programme (WBEP) on disease severity, quality of life and mothers' self-efficacy in children with atopic dermatitis.

PubMed

Son, Hae Kyoung; Lim, Jiyoung

2014-10-01

To develop and evaluate the effects of a web-based education programme in early childhood for children with atopic dermatitis. The prevalence rate of atopic dermatitis is highest in early childhood. A holistic approach is urgently needed for young children with respect to disease severity, quality of life and management, particularly parental knowledge about atopic dermatitis and adherence to treatment. A quasi-experimental study design was used. A total of 40 mother-child dyads participated in the study from 1 July-30 November 2011 in Korea. All children were under 3 years of age. The programme was based on the Network-Based Instructional System Design model, which consists of five phases: analysis, design, development, implementation and evaluation. The experimental group participated in the programme for 2 weeks. Participants took part in a learning session during the first week and then conducted the practice session at home during the second week. Participant knowledge and compliance were evaluated through online quizzes and self-checklists. Statistical analyses (chi-square test and t-test) were performed using the Statistical Analysis System, Version 9.13. There was a significant improvement in disease severity, quality of life and mothers' self-efficacy in the experimental group; thus, the web-based education programme was effective. The web-based education programme as an advanced intervention may be useful in providing basic data for future atopic dermatitis-related studies. Moreover, the programme may serve as a nursing educational intervention tool for clinical nursing practices. © 2014 John Wiley & Sons Ltd.

Searching for the mechanisms of change: a protocol for a realist review of batterer treatment programmes

PubMed Central

Cheff, Rebecca; Finn, Debbie; Davloor, Whitney; O'Campo, Patricia

2016-01-01

Introduction Conflicting results reported by evaluations of typical batterer intervention programmes leave many judicial officials and policymakers uncertain about the best way to respond to domestic violence, and whether to recommend and fund these programmes. Traditional evaluations and systematic reviews tend to focus predominantly on whether the programmes ‘worked’ (eg, reduced recidivism) often at the exclusion of understanding for whom they may or may not have worked, under what circumstances, and why. Methods and analysis We are undertaking a realist review of the batterer treatment programme literature with the aim of addressing this gap. Keeping with the goals of realist review, our primary aims are to identify the theory that underlies these programmes, highlight the mechanisms that trigger changes in participant behaviour and finally explain why these programmes help some individuals reduce their use of violence and under what conditions they are effective or not effective. We begin by describing the process of perpetrator treatment, and by proposing an initial theoretical model of behaviour change that will be tested by our review. We then describe the criteria for inclusion of an evaluation into the review, the search strategy we will use to identify the studies, and the plan for data extraction and analysis. Ethics and dissemination The results of this review will be written up using the RAMESES Guidelines for Realist Synthesis, and disseminated through peer-reviewed publications aimed at the practitioner community as well as presented at community forums, and at violence against women conferences. Ethics approval was not needed. PMID:27053268

A qualitative evaluation of a pilot leadership programme for dentists.

PubMed

Walsh, Jonathan; Taylor, Nicholas; Hough, Donna; Brocklehurst, Paul

2015-07-06

The purpose of this paper was to evaluate a pilot training programme run by Health Education North West to promote clinical leadership amongst general dental practitioners (GDPs). New powers and responsibilities for clinicians have caused a fundamental shift in the way that local services are planned and delivered in England. GDPs are being appointed onto the boards of local professional networks (LPNs) to influence the way that services are delivered at a local level. Analogous to clinical commissioning groups in medicine, the role of LPNs is to ensure that GDPs lead change and drive up the quality of service provision. Clinical leadership has been argued to be fundamentally important in these new structures, but has received little attention in the dental literature. Semi-structured interviews and a focus group were held with participants of the pilot to explore their understanding and experience of clinical leadership. These were recorded, transcribed verbatim and underwent thematic analysis. Nineteen codes were identified and organized into four themes: nature of clinical leadership, challenges for clinical leaders in dentistry, Leadership Exploration and Discovery programme evaluation and future direction. The research provides an understanding of how GDPs conceptualise clinical leadership and provides recommendations for future leadership training programmes. This is the first evaluation of a leadership programme for GDPs and so helps address the paucity of evidence in the dental literature.

The role and utilisation of public health evaluations in Europe: a case study of national hand hygiene campaigns

PubMed Central

2014-01-01

Background Evaluations are essential to judge the success of public health programmes. In Europe, the proportion of public health programmes that undergo evaluation remains unclear. The European Centre for Disease Prevention and Control sought to determine the frequency of evaluations amongst European national public health programmes by using national hand hygiene campaigns as an example of intervention. Methods A cohort of all national hand hygiene campaigns initiated between 2000 and 2012 was utilised for the analysis. The aim was to collect information about evaluations of hand hygiene campaigns and their frequency. The survey was sent to nominated contact points for healthcare-associated infection surveillance in European Union and European Economic Area Member States. Results Thirty-six hand hygiene campaigns in 20 countries were performed between 2000 and 2012. Of these, 50% had undergone an evaluation and 55% of those utilised the WHO hand hygiene intervention self-assessment tool. Evaluations utilised a variety of methodologies and indicators in assessing changes in hand hygiene behaviours pre and post intervention. Of the 50% of campaigns that were not evaluated, two thirds reported that both human and financial resource constraints posed significant barriers for the evaluation. Conclusion The study identified an upward trend in the number of hand hygiene campaigns implemented in Europe. It is likely that the availability of the internationally-accepted evaluation methodology developed by the WHO contributed to the evaluation of more hand hygiene campaigns in Europe. Despite this rise, hand hygiene campaigns appear to be under-evaluated. The development of simple, programme-specific, standardised guidelines, evaluation indicators and other evidence-based public health materials could help promote evaluations across all areas of public health. PMID:24507086

Empowering change: realist evaluation of a Scottish Government programme to support normal birth.

PubMed

Cheyne, Helen; Abhyankar, Purva; McCourt, Christine

2013-10-01

midwife-led care has consistently been found to be safe and effective in reducing routine childbirth interventions and improving women's experience of care. Despite consistent UK policy support for maximising the role of the midwife as the lead care provider for women with healthy pregnancies, implementation has been inconsistent and the persistent use of routine interventions in labour has given rise to concern. In response the Scottish Government initiated Keeping Childbirth Natural and Dynamic (KCND), a maternity care programme that aimed to support normal birth by implementing multiprofessional care pathways and making midwife-led care for healthy pregnant women the national norm. the evaluation was informed by realist evaluation. It aimed to explore and explain the ways in which the KCND programme worked or did not work in different maternity care contexts. the evaluation was conducted in three phases. In phase one semi-structured interviews and focus groups were conducted with key informants to elicit the programme theory. At phase two, this theory was tested using a multiple case study approach. Semi-structured interviews and focus groups were conducted and a case record audit was undertaken. In the final phase the programme theory was refined through analyses and interpretation of the data. the setting for the evaluation was NHS Scotland. In phase one, 12 national programme stakeholders and 13 consultant midwives participated. In phase two case studies were undertaken in three health boards; overall 73 participants took part in interviews or focus groups. A case record audit was undertaken of all births in Scotland during one week in two consecutive years before and after pathway implementation. government and health board level commitment to, and support of, the programme signalled its importance and facilitated change. Consultant midwives tailored change strategies, using different approaches in response to the culture of care and inter-professional relationships within contexts. In contexts where practice was already changing KCND was seen as validating and facilitating. In areas where a more medical culture existed there was strong resistance to change from midwives and medical staff and robust implementation strategies were required. Overall the pathways appeared to enable midwives to achieve change. our study highlighted the importance of those involved in a change programme working across levels of hierarchy within an organisation and from the macro-context of national policy and institutions to the meso-context of regional health service delivery and the micro-context of practitioner's experiences of providing care. The assumptions and propositions that inform programmes of change, which are often left at a tacit level and unexamined by those charged with implementing them, were made explicit. This examination illuminated the roles of the three key change mechanisms adopted in the KCND programme - appointment of consultant midwives as programme champions, multidisciplinary care pathways, and midwife-led care. It revealed the role of the commitment mechanism, which built on the appointment of the local change champions. The analysis indicated that the process of change, despite these clear mechanisms, needed to be adapted to local contexts and responses to the implementation of KCND. initial formative evaluation should be conducted prior to development of complex healthcare programmes to ensure that (1) the interventions will address the changes required, (2) key stakeholders who may support or resist change are identified, and (3) appropriate facilitation strategies are developed tailored to context. © 2013 Elsevier Ltd. All rights reserved.

Self-imposed evaluation of the Helmholtz Research School MICMoR as a tool for quality assurance and advancement of a structured graduate programme

NASA Astrophysics Data System (ADS)

Elija Bleher, Bärbel; Schmid, Hans Peter; Scholz, Beate

2015-04-01

The Helmholtz Research School MICMoR (Mechanisms and Interactions of Climate Change in Mountain Regions) offers a structured graduate programme for doctoral students in the field of climate change research. It is hosted by the Institute of Meteorology and Climate Research (KIT/IMK-IFU) in Garmisch-Partenkirchen, in collaboration with 7 Bavarian partner universities and research institutions. Hence, MICMoR brings together a considerably large network with currently 20 doctoral students and 55 scientists. MICMoR offers scientific and professional skills training, provides a state-of-the-art supervision concept, and fosters international exchange and interdisciplinary collaboration. In order to develop and advance its programme, MICMoR has committed itself to a self-imposed mid-term review in its third year, to monitor to which extent its original objectives have been reached, and to explore and identify where MICMoR has room for improvement. The evaluation especially focused on recruitment, supervision, training, networking and cooperation. Carried out by an external expert (Beate Scholz from scholz ctc), the evaluation was based on a mixed methods approach, i.e. combining a quantitative survey involving all doctoral candidates as well as their supervisors and focus groups with different MICMoR stakeholders. The evaluation has brought forward some highly interesting results, pinpointing challenges and opportunities of setting up a structured doctoral programme. Overall, the evaluation proved to be a useful tool for evidence-based programme and policy planning, and demonstrated a high level of satisfaction of supervisors and fellows. Supervision, with facets ranging from disciplinary feedback to career advice, is demanding and requires strong commitment and adequate human resources development by all parties involved. Thus, MICMoR plans to offer mentor coaching and calls on supervisors and mentors to form a community of learners with their doctoral students. To realize this vision, a long way lies ahead for all participants. Here, the evaluation provided useful suggestions on how to best use scarce time resources. Due to the fact that MICMoR's fellowships provide only supplemental funding for its fellows to participate in the programme, their base funding (salaries, stipends) needs to be secured independently, e.g. through project funds. However, this created a significant challenge as doctoral topics were determined more by the projects' research questions than by the research school's research focus. To improve this situation, MICMoR introduced some full stipends in its third year. We conclude that, in order to successfully run an interdisciplinary, multi-network research school, sufficient funds for its general framework, but also for doctoral stipends/salaries are needed to obtain a more accurate fit between the programme's research focus and the doctoral topics. Furthermore, a high level of commitment and identification with the programme of both, doctoral students and their supervisors, is required. Finally, regular review and programme assessment are essential for tailored programme development and strategy planning.

Evaluation of a Core Team Centred Professional Development Programme for Building a Whole-School Cooperative Problem Solving Approach to Conflict

ERIC Educational Resources Information Center

White, Andrew Jonathan; Wertheim, Eleanor H.; Freeman, Elizabeth; Trinder, Margot

2013-01-01

This study evaluated a professional learning approach using a core team (CT) model to assist primary (elementary) schools to develop whole-school collaborative conflict resolution processes. Thirteen schools were matched and randomly assigned to the enhancing relationships in school communities programme ("n"?=?10) or a non-programme…

Evaluating the Impact of an Academic Teacher Development Program: Practical Realities of an Evidence-Based Study

ERIC Educational Resources Information Center

Rathbun, Gail A.; Leatherman, Jane; Jensen, Rebecca

2017-01-01

This study aimed to assess the impact of an entire academic teacher development programme at a Midwestern masters comprehensive university in the United States over a period of five years by examining changes in teaching and student outcomes of nine randomly selected programme participants. Researchers analysed syllabi, course evaluations, grade…

Embedding Mental Health Support in Schools: Learning from the Targeted Mental Health in Schools (TaMHS) National Evaluation

ERIC Educational Resources Information Center

Wolpert, Miranda; Humphrey, Neil; Belsky, Jay; Deighton, Jessica

2013-01-01

The Targeted Mental Health in Schools (TaMHS) programme was a nationwide initiative that funded mental health provision in schools for pupils at risk of or already experiencing mental health problems. The implementation, impact and experience of this programme was evaluated using quantitative and qualitative methodology involving three main…

An Evaluation of a Community Health Intervention Programme Aimed at Improving Health and Wellbeing

ERIC Educational Resources Information Center

Strachan, G.; Wright, G. D.; Hancock, E.

2007-01-01

Objective: The objective of this evaluation was to examine the extent to which participants in the Tailor Made Leisure Package programme experienced any improvement in their health and wellbeing. Design: A quantitative survey. Setting: The Healthy Living Centre initiative is an example of a community-based intervention which was formalized as part…

Evaluation of a Phonological Reading Programme for Children with Down Syndrome

ERIC Educational Resources Information Center

Baylis, Pamela; Snowling, Margaret J.

2012-01-01

This article reports the evaluation of a 10-week phonologically-based literacy programme involving 10 children with Down syndrome (DS). At the outset, each child relied on a whole word method of reading with no apparent use of decoding strategies. The reading and phonological skills of the children were assessed twice prior to undertaking the…

Organising, Providing and Evaluating Technical Training for Early Career Researchers: A Case Study

ERIC Educational Resources Information Center

van Besouw, Rachel M.; Rogers, Katrine S.; Powles, Christopher J.; Papadopoulos, Timos; Ku, Emery M.

2013-01-01

This paper considers the importance of providing technical training opportunities for Early Career Researchers (ECRs) worldwide through the case study of a MATLAB training programme, which was proposed, organised, managed and evaluated by a team of five ECRs at the University of Southampton. The effectiveness of the programme in terms of the…

An Evaluation of an Interdisciplinary Rural School Mental Health Programme in Appalachia

ERIC Educational Resources Information Center

Albright, Abby; Michael, Kurt; Massey, Cameron; Sale, Rafaella; Kirk, Alex; Egan, Theresa

2013-01-01

School mental health (SMH) programmes serve as a necessary niche within rural communities and aim to bring accessible care to youth who may otherwise go without mental health services. The following study evaluated the impact of mental health treatment provided by the Assessment, Support, and Counseling (ASC) Center, an SMH health initiative…

Learning about the Effects of Development Education Programmes: Strengthening Planning, Monitoring, and Evaluation (PME) through Reflective Practice

ERIC Educational Resources Information Center

Van Ongevalle, Jan; Huyse, Huib; Van Petegem, Peter

2013-01-01

This article reports on the results of an action research project (2010-13) in which ten Belgian organizations who implement development education programmes explored different planning, monitoring, and evaluation (PME) approaches with the aim of learning more effectively about their results. PME approaches piloted included outcome mapping, most…

Preparing Pre-Service Teachers to Integrate Technology into K-12 Instruction: Evaluation of a Technology-Infused Approach

ERIC Educational Resources Information Center

Admiraal, Wilfried; van Vugt, Felix; Kranenburg, Frans; Koster, Bob; Smit, Ben; Weijers, Sanne; Lockhorst, Ditte

2017-01-01

The quality of how technology is addressed in teacher education programmes is conditional for how student teachers apply technology in secondary schools after their graduation. Two technology-infused courses of one teacher education programme were evaluated. In line with studies on the development of pre-service teachers' technological,…

Process Evaluation of the Teacher Training for an AIDS Prevention Programme

ERIC Educational Resources Information Center

Ahmed, Nazeema; Flisher, Alan J.; Mathews, Catherine; Jansen, Shahieda; Mukoma, Wanjiru; Schaalma, Herman

2006-01-01

This paper provides a process evaluation of a 6-day teacher training programme which forms part of a sexuality education project. The training aimed at providing teachers with the necessary knowledge and skills to effectively teach a 16-lesson Grade 8 (14 year olds) life skills curriculum consisting of participatory exercises on sexual…

An Evaluation of Participation in a Schools-Based Youth Mental Health Peer Education Training Programme

ERIC Educational Resources Information Center

O'Reilly, Aileen; Barry, James; Neary, Marie-Louise; Lane, Sabrina; O'Keeffe, Lynsey

2016-01-01

The use of peer education has been well documented within the discipline of health promotion, but not within the youth mental health domain. This paper describes an evaluation of an innovative schools-based peer education training programme that involved preparing young people to deliver a mental health workshop to their peers. Participants…

Monitoring and Evaluation of an Early Childhood Development Programme: Implications for Leadership and Management

ERIC Educational Resources Information Center

Hodgson, Sarah; Papatheodorou, Theodora; James, Mary

2014-01-01

The article aims to discuss preliminary findings from a participatory monitoring and evaluation (M&E) framework, used in a community-based early childhood development (ECD) programme in KwaZulu-Natal South Africa, and their implications for leadership and management. The purposes of the M&E were for LETCEE, the implementing organization,…

The Impact of Professional Development: A Theoretical Model for Empirical Research, Evaluation, Planning and Conducting Training and Development Programmes

ERIC Educational Resources Information Center

Huber, Stephan Gerhard

2011-01-01

This paper considers several trends in professional development programmes found internationally. The use of multiple learning approaches and of different modes and types of learning in PD is described. Various theories and models of evaluation are discussed in the light of common professional development activities. Several recommendations are…

Evaluating the Impact of Leadership Development: A Case Study

ERIC Educational Resources Information Center

Dexter, Barbara; Prince, Christopher

2007-01-01

Purpose: The relevance of business education is coming under increasing challenge from many quarters, who argue that business schools are not delivering research and programmes that are relevant to the needs of business and society. The purpose of this paper is to test these claims by evaluating the impact of a leadership development programme on…

Programme for Learning Enrichment. A Van Leer Project: An Evaluation.

ERIC Educational Resources Information Center

Ghani, Zainal

This paper reports the evaluation of a project undertaken by the Sarawak Education Department to improve the quality of education in upper primary classes in rural Sarawak, Malaysia. The project is known officially as the Programme for Learning Enrichment, and commonly as the Van Leer Project, after the international agency which provides the main…

Teacher Performance and Student Learning: Linking Evidence from Two National Assessment Programmes

ERIC Educational Resources Information Center

Taut, Sandy; Valencia, Edgar; Palacios, Diego; Santelices, Maria V.; Jiménez, Daniela; Manzi, Jorge

2016-01-01

This paper investigates the validity of a national, standards-based teacher evaluation programme by examining the relationship between teachers' evaluation results and their students' learning progress. We used census achievement data that assessed the same cohort of students at the end of 8th and 10th grade. We applied multilevel modelling and…

Evaluation of Follow-Up Effects of the International Child Development Programme on Caregivers in Mozambique

ERIC Educational Resources Information Center

Skar, Ane-Marthe Solheim; Sherr, Lorraine; Clucas, Claudine; von Tetzchner, Stephen

2014-01-01

Parenting programs have been used to good effect in many settings, yet few are systematically introduced and evaluated in developing countries. This study explores the relative long-term effect of participation in the International Child Development Programme (ICDP) in a group of caregivers in Mozambique. A quasi-experimental design was used to…

"Ehrr ... What's Up Doc?": Using Cartoon Tests To Evaluate Educational Drama Programmes.

ERIC Educational Resources Information Center

Pearce, Glenn

2003-01-01

Discusses how a projective technique known as "cartoon tests" can be used by drama educators for programme evaluation and for learning-needs analysis and monitoring. Provides findings in which cartoon tests were used as one of several methods to explore student perceptions of a drama-based marketing subject at an Australian university.…

Introducing new diagnostics into STI control programmes: the importance of programme science.

PubMed

Peeling, Rosanna W; Mabey, David; Ballard, Ronald C

2013-03-01

Many innovative diagnostic technologies will become commercially available over the next 5-10 years. These tests can potentially transform the diagnosis of sexually transmitted infections but their introduction into control programmes can be hampered by health system constraints, and political, cultural, socioeconomic and behavioural factors. We used the introduction of syphilis rapid tests to illustrate the importance of programme science to address the gap between accruing evidence of acceptable test performance and the complexity of programme design, implementation and evaluation of test deployment to address public health needs and improve patient-important outcomes.

A cleaner burning biomass-fuelled cookstove intervention to prevent pneumonia in children under 5 years old in rural Malawi (the Cooking and Pneumonia Study): a cluster randomised controlled trial

PubMed Central

Mortimer, Kevin; Ndamala, Chifundo B; Naunje, Andrew W; Malava, Jullita; Katundu, Cynthia; Weston, William; Havens, Deborah; Pope, Daniel; Bruce, Nigel G; Nyirenda, Moffat; Wang, Duolao; Crampin, Amelia; Grigg, Jonathan; Balmes, John; Gordon, Stephen B

2018-01-01

Summary Background WHO estimates exposure to air pollution from cooking with solid fuels is associated with over 4 million premature deaths worldwide every year including half a million children under the age of 5 years from pneumonia. We hypothesised that replacing open fires with cleaner burning biomass-fuelled cookstoves would reduce pneumonia incidence in young children. Methods We did a community-level open cluster randomised controlled trial to compare the effects of a cleaner burning biomass-fuelled cookstove intervention to continuation of open fire cooking on pneumonia in children living in two rural districts, Chikhwawa and Karonga, of Malawi. Clusters were randomly allocated to intervention and control groups using a computer-generated randomisation schedule with stratification by site, distance from health centre, and size of cluster. Within clusters, households with a child under the age of 4·5 years were eligible. Intervention households received two biomass-fuelled cookstoves and a solar panel. The primary outcome was WHO Integrated Management of Childhood Illness (IMCI)-defined pneumonia episodes in children under 5 years of age. Efficacy and safety analyses were by intention to treat. The trial is registered with ISRCTN, number ISRCTN59448623. Findings We enrolled 10 750 children from 8626 households across 150 clusters between Dec 9, 2013, and Feb 28, 2016. 10 543 children from 8470 households contributed 15 991 child-years of follow-up data to the intention-to-treat analysis. The IMCI pneumonia incidence rate in the intervention group was 15·76 (95% CI 14·89–16·63) per 100 child-years and in the control group 15·58 (95% CI 14·72–16·45) per 100 child-years, with an intervention versus control incidence rate ratio (IRR) of 1·01 (95% CI 0·91–1·13; p=0·80). Cooking-related serious adverse events (burns) were seen in 19 children; nine in the intervention and ten (one death) in the control group (IRR 0·91 [95% CI 0·37–2·23]; p=0·83). Interpretation We found no evidence that an intervention comprising cleaner burning biomass-fuelled cookstoves reduced the risk of pneumonia in young children in rural Malawi. Effective strategies to reduce the adverse health effects of household air pollution are needed. Funding Medical Research Council, UK Department for International Development, and Wellcome Trust. PMID:27939058

Advancing the "One Health" Workforce by Integrating Ecosystem Health Practice into Veterinary Medical Education: The Envirovet Summer Institute

ERIC Educational Resources Information Center

Schwind, Jessica S.; Gilardi, Kirsten V. K.; Beasley, Val R.; Mazet, Jonna A. K.; Smith, Woutrina A.

2016-01-01

Objectives: The objectives of this study were to assess whether the Envirovet programme served to increase the number of practising ecosystem health professionals, as well as to measure the lasting professional and personal impact of the programme on participants. Design: Impact programme evaluation. Setting: An emerging strategy among global…

Accreditation of Library and Information Science Programmes in the Gulf Cooperation Council Nations

ERIC Educational Resources Information Center

Rehman, Sajjad ur

2012-01-01

This paper investigates the accreditation possibilities and prospects for the library and information science education programmes located in the six member nations of the Gulf Cooperation Council. This paper has been based on the findings of a study focused on the evaluation practices of these programmes and the perceptions of the leading…

Rural Adult Education and the Health Transformation of Pastoral Women of Northern Nigeria

ERIC Educational Resources Information Center

Usman, Lantana M.

2009-01-01

Recently, politics of education in Nigeria have shifted from urban to rural literacy, which led to the development of programmes such as the nomadic women's adult education programme. The primary objective of this study was to evaluate the efficacy of the programme's implementation strategies, and the extent to which the health educational…

Teacher Effectiveness Enhancement Programme: Evaluation Report and Executive Summary

ERIC Educational Resources Information Center

Education Endowment Foundation, 2016

2016-01-01

The Teacher Effectiveness Enhancement Programme (TEEP) is a CPD programme that aims to improve teachers' classroom practice. TEEP training is offered as a whole-school approach by the Schools, Students and Teachers Network (SSAT). All staff in a school received three days of training over a period of two terms. A smaller cohort of teachers, chosen…

Evaluation of a Peer-Led Smoking Prevention Programme for Romanian Adolescents

ERIC Educational Resources Information Center

Lotrean, L. M.; Dijk, F.; Mesters, I.; Ionut, C.; De Vries, H.

2010-01-01

The goal of this study was to assess the effects of a school-based smoking prevention programme that used both a video and peer-led discussion groups among Romanian junior high school students aged 13-14 years. The programme embraced the social influence approach and concentrated on enhancing self-efficacy and the acquisition of cigarette refusal…

Dublin Institute of Technology's Programme for Students Learning with Communities: A Critical Account of Practice

ERIC Educational Resources Information Center

Gamble, Elena; Bates, Catherine

2011-01-01

Purpose: This paper aims to focus on the process of critically evaluating Dublin Institute of Technology's Programme for Students Learning With Communities after its first year of operation. The programme supports and promotes community-based learning/service-learning across DIT. Design/methodology/approach: The paper is presented in the form of a…

Evaluation of the Massage in Schools Programme in One Primary School

ERIC Educational Resources Information Center

Marsh, Lesley J.

2011-01-01

This article discusses the potential benefits of the Massage in Schools Programme (MISP), a programme originating in Scandinavia, which has been introduced into schools in the United Kingdom (UK) since 2001. Meeting four out of five outcomes of the Every Child Matters agenda, the review of the literature aims to separate anecdotal and media…

Training, supervision and quality of care in selected integrated community case management (iCCM) programmes: A scoping review of programmatic evidence.

PubMed

Bosch-Capblanch, Xavier; Marceau, Claudine

2014-12-01

To describe the training, supervision and quality of care components of integrated Community Case Management (iCCM) programmes and to draw lessons learned from existing evaluations of those programmes. Scoping review of reports from 29 selected iCCM programmes purposively provided by stakeholders containing any information relevant to understand quality of care issues. The number of people reached by iCCM programmes varied from the tens of thousands to more than a million. All programmes aimed at improving access of vulnerable populations to health care, focusing on the main childhood illnesses, managed by Community Health Workers (CHW), often selected bycommunities. Training and supervision were widely implemented, in different ways and intensities, and often complemented with tools (eg, guides, job aids), supplies, equipment and incentives. Quality of care was measured using many outcomes (eg, access or appropriate treatment). Overall, there seemed to be positive effects for those strategies that involved policy change, organisational change, standardisation of clinical practices and alignment with other programmes. Positive effects were mostly achieved in large multi-component programmes. Mild or no effects have been described on mortality reduction amongst the few programmes for which data on this outcome was available to us. Promising strategies included teaming-up of CHW, micro-franchising or social franchising. On-site training and supervision of CHW have been shown to improve clinical practices. Effects on caregivers seemed positive, with increases in knowledge, care seeking behaviour, or caregivers' basic disease management. Evidence on iCCM is often of low quality, cannot relate specific interventions or the ways they are implemented with outcomes and lacks standardisation; this limits the capacity to identify promising strategies to improve quality of care. Large, multi-faceted, iCCM programmes, with strong components of training, supervision, which included additional support of equipment and supplies, seemed to improve selected quality of care outcomes. However, current evaluation and reporting practices need to be revised in a new research agenda to address the methodological challenges of iCCM evaluations.

Training a medical workforce to meet the needs of diverse minority communities.

PubMed

Sopoaga, Faafetai; Zaharic, Tony; Kokaua, Jesse; Covello, Sahra

2017-01-21

The growing demand for a competent health workforce to meet the needs of increasingly diverse societies has been widely acknowledged. One medical school in New Zealand explored the integration of the commonly used patient-centred model approach, with an intersectional framework in the development of a cultural competency training programme. In the Pacific Immersion Programme, medical students in their fourth year of training are given the opportunity to learn about different factors that influence the health and health care of a minority community through immersion in that community. The programme objectives include enabling students to learn through experience living within the local community context, and supporting them to re-evaluate their own personal beliefs, assumptions and/or prior prejudices. This study evaluates the usefulness of this programme in the training of medical students to work in diverse communities. Two analytical approaches were used for evaluation. Deductive and inductive analyses were conducted on 235 reflective essays completed by three cohorts of students from 2011 to 2013 to ascertain the value of the programme for student learning. In addition, one cohort was invited to complete a pre and post-programme questionnaire. Overall, the students found the programme to be a valued learning environment. They found living within a Pacific family environment to be an eye opening experience. It increased students comfort level in cross cultural engagement and emphasised the importance of patient's perspectives in health care provision. Students' self-reported knowledge about Pacific cultural values, protocols, traditional beliefs and the main health challenges increased significantly after the programme. They appreciated learning directly from community members, and through observations about how culture, beliefs and the socio-economic environment influence peoples' health and wellbeing. Medical schools are required to train a competent health workforce to meet the needs of diverse communities. The Pacific Immersion Programme provides a unique learning environment which can improve the training of doctors to work in diverse communities. The key to its success is enabling students to be engaged learners from "the inside" rather than an "outsider looking in". The Programme enables experiential learning in a sensitive and meaningful way and can be useful for training in other institutions.

Training, supervision and quality of care in selected integrated community case management (iCCM) programmes: A scoping review of programmatic evidence

PubMed Central

Bosch–Capblanch, Xavier; Marceau, Claudine

2014-01-01

Aim To describe the training, supervision and quality of care components of integrated Community Case Management (iCCM) programmes and to draw lessons learned from existing evaluations of those programmes. Methods Scoping review of reports from 29 selected iCCM programmes purposively provided by stakeholders containing any information relevant to understand quality of care issues. Results The number of people reached by iCCM programmes varied from the tens of thousands to more than a million. All programmes aimed at improving access of vulnerable populations to health care, focusing on the main childhood illnesses, managed by Community Health Workers (CHW), often selected bycommunities. Training and supervision were widely implemented, in different ways and intensities, and often complemented with tools (eg, guides, job aids), supplies, equipment and incentives. Quality of care was measured using many outcomes (eg, access or appropriate treatment). Overall, there seemed to be positive effects for those strategies that involved policy change, organisational change, standardisation of clinical practices and alignment with other programmes. Positive effects were mostly achieved in large multi–component programmes. Mild or no effects have been described on mortality reduction amongst the few programmes for which data on this outcome was available to us. Promising strategies included teaming–up of CHW, micro–franchising or social franchising. On–site training and supervision of CHW have been shown to improve clinical practices. Effects on caregivers seemed positive, with increases in knowledge, care seeking behaviour, or caregivers’ basic disease management. Evidence on iCCM is often of low quality, cannot relate specific interventions or the ways they are implemented with outcomes and lacks standardisation; this limits the capacity to identify promising strategies to improve quality of care. Conclusion Large, multi–faceted, iCCM programmes, with strong components of training, supervision, which included additional support of equipment and supplies, seemed to improve selected quality of care outcomes. However, current evaluation and reporting practices need to be revised in a new research agenda to address the methodological challenges of iCCM evaluations. PMID:25520793

Five-year follow-up of persons with brain injury entering the French vocational and social rehabilitation programme UEROS: Return-to-work, life satisfaction, psychosocial and community integration.

PubMed

Cogné, M; Wiart, L; Simion, A; Dehail, P; Mazaux, J-M

2017-01-01

Social and vocational reintegration of persons with brain injury is an important element in their rehabilitation. To evaluate the 5-year outcome of persons with brain injury included in 2008 in the Aquitaine Unit for Evaluation, Training and Social and Vocational Counselling programme (UEROS). 57 persons with brain injury were recruited from those who completed the 2008 UEROS programme. Five years later, an interview was done to assess family and vocational status, autonomy and life satisfaction. These results were compared with those from persons completing the 1997-1999 programme. The typical person entered the 2008 UEROS programme 6 years after a severe brain injury (42%) and was male, single and 35 years. At the 5-year follow-up, more persons lived with a partner (+23%) and lived in their own home (+21%). 47% were working vs 11% on entering the programme. Approximately half were satisfied or very satisfied with their quality of life. Having a job in 2013 was associated with a high education level, less cognitive sequelae, having a job in 2008 and no health condition. The UEROS programme is effective with regard to return-to-work and improvement of autonomy in persons with brain injury, irrespective of length of time from injury.

Evaluation of a Sexual and Reproductive Health Education Programme: Students' Knowledge, Attitude and Behaviour in Bolgatanga Municipality, Northern Ghana.

PubMed

van der Geugten, Jolien; van Meijel, Berno; den Uyl, Marion H G; de Vries, Nanne K

2015-09-01

Evaluation research concerning the impact of sexual and reproductive health (SRH) education in sub-Saharan Africa is scarce. This study obtained more insight into the knowledge, attitudes and behavioural intentions of students concerning SRH in Bolgatanga municipality in northern Ghana, and studied the effects of an SRH programme for this group. This quasi-experimental study used a pre-post-intervention design, with an SRH programme as intervention. A questionnaire was filled in by 312 students before, and by 272 students after the SRH programme. The results showed that before the programme, students answered half of the knowledge questions correctly, they thought positively about deciding for themselves whether to have a relationship and whether to have sex, and their intentions towards SRH behaviour, such as condom use were positive. The SRH intervention led to a small but significant increase in the students' knowledge. It was also found that the attitude of the students aged 18-20 significantly improved. Finally, it was found that female students aged 18-20 were more positive towards changing their behaviour after following the SRH programme. It can be concluded that the impact of the SRH programme in general was positive. Significant effects were found for gender and age.

Evaluation of a social franchising and telemedicine programme and the care provided for childhood diarrhoea and pneumonia, Bihar, India

PubMed Central

Giardili, Soledad; Das, Veena; Rabin, Tracy L; Raj, Sunil S; Schwartz, Jeremy I; Seth, Aparna; Goldhaber-Fiebert, Jeremy D; Miller, Grant; Vera-Hernández, Marcos

2017-01-01

Abstract Objective To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme – the World Health Partners’ Sky Program. Methods We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers’ performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models. Findings The programme did not significantly improve health-care providers’ knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered. Conclusion Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up. PMID:28479635

Preliminary evaluation of STRIDE programme in primary schools of Malaysia.

PubMed

Hanjeet, K; Wan Rozita, W M; How, T B; Santhana Raj, L; Baharudin, Omar

2007-12-01

The Students' Resilience and Interpersonal Skills Development Education (STRIDE) is a preventive drug education programme. The rational of this programme is that preventive drug education has to begin early in age, before the development of social attitudes and behaviour of students. A pre and a post intervention surveys were performed to evaluate the impact of this programme. Nine schools from three states were identified to participate in the intervention. These schools were selected based on their locations in high-drug-use areas (where the prevalence of drug use exceeds 0.5% of the student population). The new intervention curriculum was put into practice for three months in the nine schools. The overall scores obtained by each respondent to assess their knowledge on drugs and its implications were analysed. The results showed that the programme made a positive impact from the pre to post intervention programme by using the Wilcoxon Signed Rank Test (p < 0.05). A high percentage of the questions showed significant evidence through the McNemar matched pair Chi-Squared test with Bonferonni correction that there were positive shifts in the answers by comparing the pre and post intervention results (p < 0.05). Recommendations have been discussed with the Ministry of Education to integrate this programme into the national primary school curriculum.

[Improving the control of food allergy and intolerance risks in school settings: qualitative inputs from focus groups].

PubMed

Londoño, Teresa; Trabado, Verónica; García-Rodríguez, Alejo; Balfagón, Pere; Villalbí, Joan R

2018-04-21

This paper describes the use of focus groups as part of the evaluation of programmes to control food allergy and intolerance (FAI) in school settings in the city of Barcelona (Spain). After fostering their adoption and as a qualitative component of their evaluation, the public health services ran two focus groups, one with people from schools that manage their own kitchen, and another from companies that outsource this service. There were 28 participants from 46% of the centres invited. All the schools seem to have implemented a self-control programme on FAI. Although outsourcing companies already had a programme, the schools that managed their own service mostly adopted the programme promoted by the public health services. The number of schoolchildren with reported FAI reduced after the programme, as it required more rigorous documentation from families. Copyright © 2018 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Evaluation of Return to Practice: the views of nurse returnees from three NHS Hospital Trusts.

PubMed

Barriball, K Louise; Coopamah, Vinoda; Roberts, Julia; Watts, Suzanne

2007-05-01

Exploration of the views and experiences of returnees on a Return to Practice programme based in three NHS Hospital Trusts. In the light of nursing shortages in Britain, there is an ongoing need to encourage nurses to re-enter the profession through Return to Practice programmes. In order to maximize returnees' participation in the nursing workforce; however, evaluation of the effectiveness of Return to Practice programmes is necessary. 17 returnees were recruited to the study completing self-report questionnaires at programme commencement and participating in focus group discussions on programme completion. Three key issues emerged from the data: the varied personal circumstances and professional histories of returnees; the challenge of providing adequate support in practice that reflected returnees' individual needs and aspirations and the importance of flexible employment opportunities to meet returnees' expectations of an appropriate work life balance. It is important that any schemes to attract nurses back to the profession are targeted at their specific needs.

Pre-market version of a commercially available hearing instrument with a tinnitus sound generator: feasibility of evaluation in a clinical trial.

PubMed

Sereda, Magdalena; Davies, Jeff; Hall, Deborah A

2017-04-01

This report considers feasibility of conducting a UK trial of combination devices for tinnitus, using data from the study which evaluated different listener programmes available within the pre-market version of Oticon Alta with Tinnitus Sound Generator. Open and closed questions addressed the following feasibility issues: (1) Participant recruitment; (2) Device acceptability; (3) Programme preferences in different self-nominated listening situations; (4) Usability; (5) Compliance; (6) Adverse events. Eight current combination hearing aid users (all males) aged between 62-72 years (mean age 67.25 years, SD = 3.8). All eight participants reported the physical aspects and noise options on the experimental device to be acceptable. Programmes with amplification and masking features were equally preferred over the basic amplification-only programme. Individual preferences for the different programme options varied widely, both across participants and across listening situations. A set of recommendations for future trials were formulated which calls for more "real world" trial design rather than tightly controlling the fitting procedure.

Evaluation of the quality of care of a haemodialysis public-private partnership programme for patients with end-stage renal disease.

PubMed

Chen, Julie Y; Wan, Eric Y F; Chan, Karina H Y; Chan, Anca K C; Chan, Frank W K; Lam, Cindy L K

2016-07-11

Haemodialysis (HD) is one of the life-saving options for patients with end stage renal disease but demand for this treatment exceeds capacity in publicly funded hospitals. One novel approach to addressing this problem is through a shared-care model whereby government hospitals partner with qualified private HD service providers to increase the accessibility of HD for needy patients. The aim of this study is to evaluate and enhance the quality of care (QOC) provided in such a shared-care programme in Hong Kong, the Haemodialysis Public-Private Partnership Programme (HD-PPP). This is a longitudinal study based on Action Learning and Audit Spiral methodologies to measure the achievement of pre-set target standards for the HD-PPP programme over three evaluation cycles. The QOC evaluation framework is comprised of structure, process and outcome criteria with target standards in each domain developed from review of the evidence and in close collaboration with the HD-PPP working group. During each evaluation cycle, coordinators of each study site complete a questionnaire to determine adherence with structural criteria of care. Process and clinical outcomes, such as adverse events and dialysis adequacy, are extracted from the patient records of consenting study participants while face-to-face interviews are conducted to ascertain patient-reported outcomes such as self-efficacy and health-related quality of life. The study relies on the successful implementation of partnership-based action research to develop an evidence-based and pragmatic framework for evaluation of quality of care in an iterative fashion, and to use it to identify possible areas of quality enhancements in a shared-care programme for HD patients. The approach we take in this study emphasizes partnership and engagement with the clinical and administrative programme team, a robust but flexible evaluation framework, direct observation and the potential to realize positive change. The experience will be useful to inform the process of coordinating research studies involving multiple stakeholders and results will help to guide service planning and policy decision making. US Clinical Trial Registry NCT02307903.

Rationale, design and baseline data of a mixed methods study examining the clinical impact of a brief transition programme for young people with juvenile idiopathic arthritis: the DON'T RETARD project.

PubMed

Hilderson, Deborah; Westhovens, Rene; Wouters, Carine; Van der Elst, Kristien; Goossens, Eva; Moons, Philip

2013-12-02

To describe (1) the content of a transition programme for young people with juvenile idiopathic arthritis (JIA) designed as a brief intervention, (2) the rationale and design of a mixed-methods study evaluating the clinical impact of this transition programme and (3) to provide baseline data of the intervention group. An 'embedded experimental' design is used for the evaluation of the transition programme. A 'one-group pretest-posttest, with a non-equivalent posttest-only comparison group design' is used to quantitatively evaluate the impact of the transition programme, applying both longitudinal and comparative analyses. Subsequently, experiences of adolescents and their parents who participated in the experimental group will be analysed qualitatively using content analysis. Participants in the intervention are recruited at a tertiary care centre in Belgium. The comparison group participants are recruited from one tertiary and three secondary care centres in Belgium. The intervention group consists of 33 young people (25 females; 8 males) with a median age of 16 years. Main diagnoses are persistent or extended oligoarticular JIA (33%), polyarticular JIA (30%), enthesitis-related JIA (21%) or systemic arthritis (15%). The transition programme comprises eight key components: (1) transition coordinator; (2) providing information and education; (3) availability by telephone; (4) information about and contact with an adult care programme; (5) guidance of parents; (6) meeting with peers; (7) transfer plan; and (8) actual transfer to adult care. The primary outcome is health status, as perceived by the adolescents. Secondary outcomes are health status, as perceived by the parents; medication adherence; illness-related knowledge; quality of life; fatigue; promotion of independence; support of autonomy; behavioural control and psychological control. At baseline, the median score was 69.2 (Q1=60.0;Q3=92.9) on psychosocial health and 68.8 (Q1=56.3; Q3=89.1) on physical health. Rheumatic-specific health scores ranged from 62.5 to 100. We present the rationale and design of a study intended to evaluate a transition programme for adolescents with JIA as a brief intervention.

Evaluating factors influencing the delivery and outcomes of an incentive-based behaviour change strategy targeting child obesity: protocol for a qualitative process and impact evaluation.

PubMed

Enright, Gemma; Gyani, Alex; Raadsma, Simon; Allman-Farinelli, Margaret; Rissel, Chris; Innes-Hughes, Christine; Lukeis, Sarah; Rodgers, Anthony; Redfern, Julie

2016-12-16

Community-based weight management programmes are important in addressing childhood obesity. However, the mechanisms that lead to behaviour change within the programmes are rarely studied within the context of the programmes themselves once they have been implemented. This means that further potential gains in the effectiveness of the programme are often not made and any potential losses of efficacy are often not noticed. Qualitative research alongside randomised controlled trials (RCTs) can tell us the context in which these programmes are implemented and elucidate potential mediators or modifiers of the programmes' effectiveness. The aim of this evaluation is to determine the barriers and enablers to the delivery and impact of an incentive-based behaviour change strategy targeting child obesity to inform future translation. Qualitative analysis, including stakeholder and family interviews, focus groups and a survey, will be used. The research will be conducted in collaboration with policymakers, researchers and community health professionals. Participants will be selected from programme providers, and parents/carers and children participating in an Australian community weight management programme during an RCT examining the effectiveness of incentives for improving behaviour change. A maximum variation sampling method based on participant demographics and group characteristics will be used. Thematic analysis will be carried out inductively based on emergent themes, using NVivo V.9. This research is approved by the South West Sydney Human Ethics Committee review body (HREC/14/LPOOL/480). The evaluation will provide information about the contextual and influencing factors related to the outcomes of the RCT. The results will assist researchers, community health practitioners and policymakers regarding the development, implementation and translation of behaviour change strategies in community initiatives for obese children. Insights gained may be applicable to a range of chronic conditions where similar preventive intervention approaches are indicated. ACTRN12615000558527, Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Controlled ecological evaluation of an implemented exercise training programme to prevent lower limb injuries in sport: differences in implementation activity.

PubMed

Donaldson, Alex; Gabbe, Belinda J; Lloyd, David G; Cook, Jill; Finch, Caroline F

2018-04-24

The public health benefits of injury prevention programmes are maximised when programmes are widely adopted and adhered to. Therefore, these programmes require appropriate implementation support. This study evaluated implementation activity outcomes associated with the implementation of FootyFirst, an exercise training injury prevention programme for community Australian football, both with (FootyFirst+S) and without (FootyFirst+NS) implementation support. An evaluation plan based on the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) Sports Setting Matrix was applied in a controlled ecological evaluation of the implementation of FootyFirst. RE-AIM dimension-specific (range: 0-2) and total RE-AIM scores (range: 0-10) were derived by triangulating data from a number of sources (including surveys, interviews, direct observations and notes) describing FootyFirst implementation activities. The mean dimension-specific and total scores were compared for clubs in regions receiving FootyFirst+S and FootyFirst+NS, through analysis of variance. The mean total RE-AIM score forclubs in the FootyFirst+S regions was 2.4 times higher than for clubs in the FootyFirst+NS region (4.73 vs 1.94; 95% CI for the difference: 1.64 to 3.74). Similarly, all dimension-specific scores were significantly higher for clubs in the FootyFirst+S regions compared with clubs in the FootyFirst+NS region. In all regions, the dimension-specific scores were highest for reach and adoption, and lowest for implementation. Implementing exercise training injury prevention programmes in community sport is challenging. Delivering programme content supported by a context-specific and evidence-informed implementation plan leads to greater implementation activity, which is an important precursor to injury reductions. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A pilot study of an online universal school-based intervention to prevent alcohol and cannabis use in the UK

PubMed Central

Newton, Nicola C; Conrod, Patricia J; Rodriguez, Daniel M; Teesson, Maree

2014-01-01

Objectives The online universal Climate Schools intervention has been found to be effective in reducing the use of alcohol and cannabis among Australian adolescents. The aim of the current study was to examine the feasibility of implementing this prevention programme in the UK. Design A pilot study examining the feasibility of the Climate Schools programme in the UK was conducted with teachers and students from Year 9 classes at two secondary schools in southeast London. Teachers were asked to implement the evidence-based Climate Schools programme over the school year with their students. The intervention consisted of two modules (each with six lessons) delivered approximately 6 months apart. Following completion of the intervention, students and teachers were asked to evaluate the programme. Results 11 teachers and 222 students from two secondary schools evaluated the programme. Overall, the evaluations were extremely positive. Specifically, 85% of students said the information on alcohol and cannabis and how to stay safe was easy to understand, 84% said it was easy to learn and 80% said the online cartoon-based format was an enjoyable way to learn health theory topics. All teachers said the students were able to recall the information taught, 82% said the computer component was easy to implement and all teachers said the teacher's manual was easy to use to prepare class activities. Importantly, 82% of teachers said it was likely that they would use the programme in the future and recommend it to others. Conclusions The Internet-based universal Climate Schools prevention programme to be both feasible and acceptable to students and teachers in the UK. A full evaluation trial of the intervention is now required to examine its effectiveness in reducing alcohol and cannabis use among adolescents in the UK before implementation in the UK school system. PMID:24840248

Economic evaluation of the breast cancer screening programme in the Basque Country: retrospective cost-effectiveness and budget impact analysis.

PubMed

Arrospide, Arantzazu; Rue, Montserrat; van Ravesteyn, Nicolien T; Comas, Merce; Soto-Gordoa, Myriam; Sarriugarte, Garbiñe; Mar, Javier

2016-06-01

Breast cancer screening in the Basque Country has shown 20 % reduction of the number of BC deaths and an acceptable overdiagnosis level (4 % of screen detected BC). The aim of this study was to evaluate the breast cancer early detection programme in the Basque Country in terms of retrospective cost-effectiveness and budget impact from 1996 to 2011. A discrete event simulation model was built to reproduce the natural history of breast cancer (BC). We estimated for lifetime follow-up the total cost of BC (screening, diagnosis and treatment), as well as quality-adjusted life years (QALY), for women invited to participate in the evaluated programme during the 15-year period in the actual screening scenario and in a hypothetical unscreened scenario. An incremental cost-effectiveness ratio was calculated with the use of aggregated costs. Besides, annual costs were considered for budget impact analysis. Both population level and single-cohort analysis were performed. A probabilistic sensitivity analysis was applied to assess the impact of parameters uncertainty. The actual screening programme involved a cost of 1,127 million euros and provided 6.7 million QALYs over the lifetime of the target population, resulting in a gain of 8,666 QALYs for an additional cost of 36.4 million euros, compared with the unscreened scenario. Thus, the incremental cost-effectiveness ratio was 4,214€/QALY. All the model runs in the probabilistic sensitivity analysis resulted in an incremental cost-effectiveness ratio lower than 10,000€/QALY. The screening programme involved an increase of the annual budget of the Basque Health Service by 5.2 million euros from year 2000 onwards. The BC screening programme in the Basque Country proved to be cost-effective during the evaluated period and determined an affordable budget impact. These results confirm the epidemiological benefits related to the centralised screening system and support the continuation of the programme.

An application of Extended Normalisation Process Theory in a randomised controlled trial of a complex social intervention: Process evaluation of the Strengthening Families Programme (10-14) in Wales, UK.

PubMed

Segrott, Jeremy; Murphy, Simon; Rothwell, Heather; Scourfield, Jonathan; Foxcroft, David; Gillespie, David; Holliday, Jo; Hood, Kerenza; Hurlow, Claire; Morgan-Trimmer, Sarah; Phillips, Ceri; Reed, Hayley; Roberts, Zoe; Moore, Laurence

2017-12-01

Process evaluations generate important data on the extent to which interventions are delivered as intended. However, the tendency to focus only on assessment of pre-specified structural aspects of fidelity has been criticised for paying insufficient attention to implementation processes and how intervention-context interactions influence programme delivery. This paper reports findings from a process evaluation nested within a randomised controlled trial of the Strengthening Families Programme 10-14 (SFP 10-14) in Wales, UK. It uses Extended Normalisation Process Theory to theorise how interaction between SFP 10-14 and local delivery systems - particularly practitioner commitment/capability and organisational capacity - influenced delivery of intended programme activities: fidelity (adherence to SFP 10-14 content and implementation requirements); dose delivered; dose received (participant engagement); participant recruitment and reach (intervention attendance). A mixed methods design was utilised. Fidelity assessment sheets (completed by practitioners), structured observation by researchers, and routine data were used to assess: adherence to programme content; staffing numbers and consistency; recruitment/retention; and group size and composition. Interviews with practitioners explored implementation processes and context. Adherence to programme content was high - with some variation, linked to practitioner commitment to, and understanding of, the intervention's content and mechanisms. Variation in adherence rates was associated with the extent to which multi-agency delivery team planning meetings were held. Recruitment challenges meant that targets for group size/composition were not always met, but did not affect adherence levels or family engagement. Targets for staffing numbers and consistency were achieved, though capacity within multi-agency networks reduced over time. Extended Normalisation Process Theory provided a useful framework for assessing implementation and explaining variation by examining intervention-context interactions. Findings highlight the need for process evaluations to consider both the structural and process components of implementation to explain whether programme activities are delivered as intended and why.

VIP in construction: systematic development and evaluation of a multifaceted health programme aiming to improve physical activity levels and dietary patterns among construction workers

PubMed Central

2012-01-01

Background The prevalence of both overweight and musculoskeletal disorders (MSD) in the construction industry is high. Many interventions in the occupational setting aim at the prevention and reduction of these health problems, but it is still unclear how these programmes should be designed. To determine the effectiveness of interventions on these health outcomes randomised controlled trials (RCTs) are needed. The aim of this study is to systematically develop a tailored intervention for prevention and reduction of overweight and MSD among construction workers and to describe the evaluation study regarding its (cost-)effectiveness. Methods/Design The Intervention Mapping (IM) protocol was applied to develop and implement a tailored programme aimed at the prevention and reduction of overweight and MSD. The (cost-) effectiveness of the intervention programme will be evaluated using an RCT. Furthermore, a process evaluation will be conducted. The research population will consist of blue collar workers of a large construction company in the Netherlands. Intervention The intervention programme will be aimed at improving (vigorous) physical activity levels and healthy dietary behaviour and will consist of tailored information, face-to-face and telephone counselling, training instruction (a fitness "card" to be used for exercises), and materials designed for the intervention (overview of the company health promoting facilities, waist circumference measuring tape, pedometer, BMI card, calorie guide, recipes, and knowledge test). Main study parameters/endpoints The intervention effect on body weight and waist circumference (primary outcome measures), as well as on lifestyle behaviour, MSD, fitness, CVD risk indicators, and work-related outcomes (i.e. productivity, sick leave) (secondary outcome measures) will be assessed. Discussion The development of the VIP in construction intervention led to a health programme tailored to the needs of construction workers. This programme, if proven effective, can be directly implemented. Trial registration Netherlands Trial Register (NTR): NTR2095 PMID:22289212

Evaluating process and clinical outcomes of a primary care mental health integration project in rural Rwanda: a prospective mixed-methods protocol.

PubMed

Smith, Stephanie L; Misago, Claire Nancy; Osrow, Robyn A; Franke, Molly F; Iyamuremye, Jean Damascene; Dusabeyezu, Jeanne D'Arc; Mohand, Achour A; Anatole, Manzi; Kayiteshonga, Yvonne; Raviola, Giuseppe J

2017-02-28

Integrating mental healthcare into primary care can reduce the global burden of mental disorders. Yet data on the effective implementation of real-world task-shared mental health programmes are limited. In 2012, the Rwandan Ministry of Health and the international healthcare organisation Partners in Health collaboratively adapted the Mentoring and Enhanced Supervision at Health Centers (MESH) programme, a successful programme of supported supervision based on task-sharing for HIV/AIDS care, to include care of neuropsychiatric disorders within primary care settings (MESH Mental Health). We propose 1 of the first studies in a rural low-income country to assess the implementation and clinical outcomes of a programme integrating neuropsychiatric care into a public primary care system. A mixed-methods evaluation will be conducted. First, we will conduct a quantitative outcomes evaluation using a pretest and post-test design at 4 purposively selected MESH MH participating health centres. At least 112 consecutive adults with schizophrenia, bipolar disorder, depression or epilepsy will be enrolled. Primary outcomes are symptoms and functioning measured at baseline, 8 weeks and 6 months using clinician-administered scales: the General Health Questionnaire and the brief WHO Disability Assessment Scale. We hypothesise that service users will experience at least a 25% improvement in symptoms and functioning from baseline after MESH MH programme participation. To understand any outcome improvements under the intervention, we will evaluate programme processes using (1) quantitative analyses of routine service utilisation data and supervision checklist data and (2) qualitative semistructured interviews with primary care nurses, service users and family members. This evaluation was approved by the Rwanda National Ethics Committee (Protocol #736/RNEC/2016) and deemed exempt by the Harvard University Institutional Review Board. Results will be submitted for peer-reviewed journal publication, presented at conferences and disseminated to communities served by the programme. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

The Stopit! programme to reduce bullying and undermining behaviour in hospitals.

PubMed

Benmore, Graham; Henderson, Steven; Mountfield, Joanna; Wink, Brian

2018-05-21

Purpose The impact of bullying and undermining behaviours on the National Health Service on costs, patient safety and retention of staff was well understood even before the Illing report, published in 2013, that reviewed the efficacy of training interventions designed to reduce bullying and harassment in the outputs. The purpose of this paper is to provide an example of a good programme well evaluated. Design/methodology/approach The methodology follows a broad realist approach, by specifying the underlying programme assumptions and intention of the designers. Three months after the event, Q-sort methodology was employed to group participants into one of three contexts - mechanism - output groups. Interviews were then undertaken with members of two of these groups, to evaluate how the programme had influenced each. Findings Q-sort identified a typology of three beneficiaries from the Stopit! workshops, characterised as professionals, colleagues and victims. Each group had acted upon different parts of the programme, depending chiefly upon their current and past experiences of bullying in hospitals. Research limitations/implications The paper demonstrates the effectiveness of using Q-sort method to identify relevant CMOs in a realist evaluation framework. Practical implications The paper considers the effectiveness of the programme to reduce bullying, rather than teach victims to cope, and how it may be strengthened based upon the research findings and Illing recommendations. Social implications Workplace bullying is invariably implicated in scandals concerning poor hospital practice, poor patient outcomes and staff illness. All too frequently, the sector responds by offering training in resilience, which though helpful, places the onus on the victim to cope rather than the employer to reduce or eliminate the practice. This paper documents and evaluates an attempt to change workplace practices to directly address bullying and undermining. Originality/value The paper describes a new programme broadly consistent with Illing report endorsements. Second, it illustrates a novel evaluation method that highlights rigorously the contexts, mechanisms and outcomes at the pilot stage of an intervention identifies contexts and mechanisms via factor analysis using Q-sort methodology.

The use of arithmetic average method in identifying critical success criteria for Homestay Programmes

NASA Astrophysics Data System (ADS)

Daud, Shahidah Md; Ramli, Razamin; Kasim, Maznah Mat; Kayat, Kalsom; Razak, Rafidah Abd

2015-12-01

Malaysian Homestay is very unique. It is classified as Community Based Tourism (CBT). Homestay Programme which is a community events where a tourist stays together with a host family for a period of time and enjoying cultural exchange besides having new experiences. Homestay programme has booming the tourism industry since there is over 100 Homestay Programme currently being registered with the Ministry of Culture and Tourism Malaysia. However, only few Homestay Programme enjoying the benefits of success Homestay Programme. Hence, this article seeks to identify the critical success factors for a Homestay Programme in Malaysia. An Arithmetic Average method is utilized to further evaluate the identified success factors in a more meaningful way. The findings will help Homestay Programme function as a community development tool that manages tourism resources. Thus, help the community in improving local economy and creating job opportunities.

Global health diplomacy in Iraq: international relations outcomes of multilateral tuberculosis programmes.

PubMed

Kevany, Sebastian; Jaf, Payman; Workneh, Nibretie Gobezie; Abu Dalod, Mohammad; Tabena, Mohammed; Rashid, Sara; Al Hilfi, Thamer Kadum Yousif

2014-01-01

International development programmes, including global health interventions, have the capacity to make important implicit and explicit benefits to diplomatic and international relations outcomes. Conversely, in the absence of awareness of these implications, such programmes may generate associated threats. Due to heightened international tensions in conflict and post-conflict settings, greater attention to diplomatic outcomes may therefore be necessary. We examine related 'collateral' effects of Global Fund-supported tuberculosis programmes in Iraq. During site visits to Iraq conducted during 2012 and 2013 on behalf of the Global Fund to Fight AIDS, Tuberculosis and Malaria, on-site service delivery evaluations, unstructured interviews with clinical and operational staff, and programme documentary review of Global Fund-supported tuberculosis treatment and care programmes were conducted. During this process, a range of possible external or collateral international relations and diplomatic effects of global health programmes were assessed according to predetermined criteria. A range of positive diplomatic and international relations effects of Global Fund-supported programmes were observed in the Iraq setting. These included (1) geo-strategic accessibility and coverage; (2) provisions for programme sustainability and alignment; (3) contributions to nation-building and peace-keeping initiatives; (4) consistent observation of social, cultural and religious norms in intervention selection; and (5) selection of the most effective and cost-effective tuberculosis treatment and care interventions. Investments in global health programmes have valuable diplomatic, as well as health-related, outcomes, associated with their potential to prevent, mitigate or reverse international tension and hostility in conflict and post-conflict settings, provided that they adhere to appropriate criteria. The associated international presence in such regions may also contribute to peace-keeping efforts. Global health programmes may frequently produce a wider range of 'collateral benefits' that conventional monitoring and evaluation systems should be expanded to assess, in keeping with contemporary efforts to leverage development programmes from a 'global health diplomacy' perspective.

A suicide education programme for nurses to educate the family caregivers of suicidal individuals: a longitudinal study.

PubMed

Sun, Fan-Ko; Chiang, Chun-Ying; Yu, Pei-Jane; Lin, Ching-Hsing

2013-10-01

Family members lack the ability to care for suicidal relatives. Nurses have a responsibility to improve family members' ability to care for their suicidal relatives. The aims of this study were to design a suicide education programme for nurses to educate family caregivers and to evaluate the longitudinal (12 months after the educational programme) effects of a suicide care education programme on the ability of families to care for suicidal relatives. A randomised controlled trial was conducted. The study population (n=61) was composed of the family caregivers of suicidal individuals. Several caregivers (n=26) were randomly allocated to an experimental group who attended a two-hour suicide care education programme, and the other caregivers (n=35) represented a control group who did not attend the education programme. All of the participants were given a questionnaire at baseline, 3 months, and 12 months during the period from 2009 to 2011. The results of the longitudinal effects of the suicide care education programme demonstrated that there were statistically significant differences after the educational programme as compared to before the programme with regard to "seeking assistance from resources" and the ability to care for those who were once suicidal. The longitudinal results of both groups showed that there was a significant difference in terms of "caring ability" at 12 months. The results of a multiple linear regression analysis indicated that evaluations performed at the three-month time point were able to effectively predict success in "seeking assistance from resources", "caring ability"; caring ability was also significantly improved among those who engaged in the educational programme at the 12-month time point. The suicide care education programme had long-term effects for family caregivers caring for their suicidal relatives. Nurses could employ this suicide care education programme to improve the ability of family caregivers to care for their suicidal relatives. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Designing evaluation studies to optimally inform policy: what factors do policy-makers in China consider when making resource allocation decisions on healthcare worker training programmes?

PubMed

Wu, Shishi; Legido-Quigley, Helena; Spencer, Julia; Coker, Richard James; Khan, Mishal Sameer

2018-02-23

In light of the gap in evidence to inform future resource allocation decisions about healthcare provider (HCP) training in low- and middle-income countries (LMICs), and the considerable donor investments being made towards training interventions, evaluation studies that are optimally designed to inform local policy-makers are needed. The aim of our study is to understand what features of HCP training evaluation studies are important for decision-making by policy-makers in LMICs. We investigate the extent to which evaluations based on the widely used Kirkpatrick model - focusing on direct outcomes of training, namely reaction of trainees, learning, behaviour change and improvements in programmatic health indicators - align with policy-makers' evidence needs for resource allocation decisions. We use China as a case study where resource allocation decisions about potential scale-up (using domestic funding) are being made about an externally funded pilot HCP training programme. Qualitative data were collected from high-level officials involved in resource allocation at the national and provincial level in China through ten face-to-face, in-depth interviews and two focus group discussions consisting of ten participants each. Data were analysed manually using an interpretive thematic analysis approach. Our study indicates that Chinese officials not only consider information about the direct outcomes of a training programme, as captured in the Kirkpatrick model, but also need information on the resources required to implement the training, the wider or indirect impacts of training, and the sustainability and scalability to other settings within the country. In addition to considering findings presented in evaluation studies, we found that Chinese policy-makers pay close attention to whether the evaluations were robust and to the composition of the evaluation team. Our qualitative study indicates that training programme evaluations that focus narrowly on direct training outcomes may not provide sufficient information for policy-makers to make decisions on future training programmes. Based on our findings, we have developed an evidence-based framework, which incorporates but expands beyond the Kirkpatrick model, to provide conceptual and practical guidance that aids in the design of training programme evaluations better suited to meet the information needs of policy-makers and to inform policy decisions.

Design of the Resistance and Endurance exercise After ChemoTherapy (REACT) study: a randomized controlled trial to evaluate the effectiveness and cost-effectiveness of exercise interventions after chemotherapy on physical fitness and fatigue.

PubMed

Kampshoff, Caroline S; Buffart, Laurien M; Schep, Goof; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J M

2010-11-30

Preliminary studies suggest that physical exercise interventions can improve physical fitness, fatigue and quality of life in cancer patients after completion of chemotherapy. Additional research is needed to rigorously test the effects of exercise programmes among cancer patients and to determine optimal training intensity accordingly. The present paper presents the design of a randomized controlled trial evaluating the effectiveness and cost-effectiveness of a high intensity exercise programme compared to a low-to-moderate intensity exercise programme and a waiting list control group on physical fitness and fatigue as primary outcomes. After baseline measurements, cancer patients who completed chemotherapy are randomly assigned to either a 12-week high intensity exercise programme or a low-to-moderate intensity exercise programme. Next, patients from both groups are randomly assigned to immediate training or a waiting list (i.e. waiting list control group). After 12 weeks, patients of the waiting list control group start with the exercise programme they have been allocated to.Both interventions consist of equal bouts of resistance and endurance interval exercises with the same frequency and duration, but differ in training intensity. Additionally, patients of both exercise programmes are counselled to improve compliance and achieve and maintain an active lifestyle, tailored to their individual preferences and capabilities.Measurements will be performed at baseline (t = 0), 12 weeks after randomization (t = 1), and 64 weeks after randomization (t = 2). The primary outcome measures are cardiorespiratory fitness and muscle strength assessed by means of objective performance indicators, and self-reported fatigue. Secondary outcome measures include health-related quality of life, self-reported physical activity, daily functioning, body composition, mood and sleep disturbances, and return to work. In addition, compliance and satisfaction with the interventions will be evaluated. Potential moderation by pre- and post-illness lifestyle, health and exercise-related attitudes, beliefs and motivation will also be assessed. Finally, the cost-effectiveness of both exercise interventions will be evaluated. This randomized controlled trial will be a rigorous test of effects of exercise programmes for cancer patients after chemotherapy, aiming to contribute to evidence-based practice in cancer rehabilitation programmes. This study is registered at the Netherlands Trial Register (NTR2153).

Measuring and modelling the quality of 40 post-disaster mental health and psychosocial support programmes

PubMed Central

Thormar, Sigridur B.; Juen, Barbara; Ajdukovic, Dean; Newlove-Eriksson, Lindy; Olff, Miranda

2018-01-01

Disasters can have an enormous impact on the health and well-being of those affected. Internationally, governments and service providers are often challenged to address complex psychosocial problems. Ideally, the potentially broad range of support activities include a coherent, high-quality mental health and psychosocial support (MHPSS) programme. We present a theory-driven quantitative analysis of the quality of 40 MHPSS programmes, mostly implemented in European disaster settings. The objective is to measure quality domains recognized as relevant in the literature and to empirically test associations. During the EU project “Operationalizing Psychosocial Support in Crisis” (OPSIC) an evaluation survey was designed and developed for this purpose and completed by 40 MHPSS programme coordinators involved in different mass emergencies and disasters. We analysed the survey data in two steps. Firstly, we used the data to operationalize quality domains of a MHPSS programme, tested constructs and assessed their internal consistency reliability. A total of 26 out of 44 survey items clustered into three of the four domains identified within the theoretical framework: “planning and delivery system” (Cronbach’s alpha 0.82); “general evaluation criteria” (Cronbach’s alpha 0.82); and “essential psychosocial principles” (Cronbach’s alpha 0.75). “Measures and interventions applied”, theoretically a potential fourth domain, could not be confirmed to empirically cluster together. Secondly, several models with associations between domains and measures and interventions were tested and compared. The model with the best fit suggests that in MHPSS programmes with a higher planning and delivery systems score, a larger number of measures and interventions from evidence-informed guidelines are applied. In such programmes, coordinators are more positive about general evaluation criteria and the realization of essential psychosocial principles. Moreover, the analyses showed that some measures and interventions are more likely to be applied in programmes with more evolved planning and delivery systems, yet for most measures and interventions the likelihood of being applied is not linked to planning and delivery system status, nor to coordinator perceptions concerning psychosocial principles and evaluation criteria. Further research is necessary to validate and expand the findings and to learn more about success factors and obstacles for MHPSS programme implementation. PMID:29489888

International variation in programmes for assessment of children's neurodevelopment in the community: Understanding disparate approaches to evaluation of motor, social, emotional, behavioural and cognitive function.

PubMed

Wilson, Philip; Wood, Rachael; Lykke, Kirsten; Hauskov Graungaard, Anette; Ertmann, Ruth Kirk; Andersen, Merethe Kirstine; Haavet, Ole Rikard; Lagerløv, Per; Abildsnes, Eirik; Dahli, Mina P; Mäkelä, Marjukka; Varinen, Aleksi; Hietanen, Merja

2018-05-01

Few areas of medicine demonstrate such international divergence as child development screening and surveillance. Many countries have nationally mandated surveillance policies, but the content of programmes and mechanisms for delivery vary enormously. The cost of programmes is substantial but no economic evaluations have been carried out. We have critically examined the history, underlying philosophy, content and delivery of programmes for child development assessment in five countries with comprehensive publicly funded health services (Denmark, Finland, Norway, Scotland and Sweden). The specific focus of this article is on motor, social, emotional, behavioural and global cognitive functioning including language. Variations in developmental surveillance programmes are substantially explained by historical factors and gradual evolution although Scotland has undergone radical changes in approach. No elements of universal developmental assessment programmes meet World Health Organization screening criteria, although some assessments are configured as screening activities. The roles of doctors and nurses vary greatly by country as do the timing, content and likely costs of programmes. Inter-professional communication presents challenges to all the studied health services. No programme has evidence for improved health outcomes or cost effectiveness. Developmental surveillance programmes vary greatly and their structure appears to be driven by historical factors as much as by evidence. Consensus should be reached about which surveillance activities constitute screening, and the predictive validity of these components needs to be established and judged against World Health Organization screening criteria. Costs and consequences of specific programmes should be assessed, and the issue of inter-professional communication about children at remediable developmental risk should be prioritised.

Feasibility, safety and preliminary evidence of the effectiveness of a home-based exercise programme for older people with Alzheimer's disease: a pilot randomized controlled trial.

PubMed

Suttanon, Plaiwan; Hill, Keith D; Said, Catherine M; Williams, Susan B; Byrne, Karin N; LoGiudice, Dina; Lautenschlager, Nicola T; Dodd, Karen J

2013-05-01

To evaluate the feasibility and safety of a home-based exercise programme for people with Alzheimer's disease, and to provide preliminary evidence of programme effectiveness in improving balance and mobility and reducing falls risk. A randomized controlled trial. Community. Forty people with mild to moderate Alzheimer's disease (mean age 81.9, SD 5.72; 62.5% female). Participants were randomized to a six-month home-based individually tailored balance, strengthening and walking exercise programme (physiotherapist) or a six-month home-based education programme (control) (occupational therapist). Both programmes provided six home-visits and five follow-up phone calls. Balance, mobility, falls and falls risk were measured at baseline and programme completion. Intention-to-treat analysis using a generalized linear model with group allocation as a predictor variable was performed to evaluate programme effectiveness. Feasibility and adverse events were systematically recorded at each contact. Fifty-eight per cent of the exercise group finished the programme, completing an average of 83% of prescribed sessions, with no adverse events reported. Functional Reach improved significantly (P = 0.002) in the exercise group (mean (SD), 2.28 (4.36)) compared to the control group (-2.99 (4.87)). Significant improvement was also observed for the Falls Risk for Older People - Community score (P = 0.008) and trends for improvement on several other balance, mobility, falls and falls risk measures for the exercise group compared to the control group. The exercise programme was feasible and safe and may help improve balance and mobility performance and reduce falls risk in people with Alzheimer's disease.

Parental experiences with a hospital-based bead programme for children with congenital heart disease.

PubMed

Wilson, Valerie; Chando, Shingisai

2015-02-01

To present survey findings on parental experiences with a hospital-based bead programme for children with congenital heart disease. The Heart Beads programme commenced at a paediatric hospital in Australia in 2008. Children enrolled in the programme are awarded a distinctive bead for every procedure/treatment they have while in hospital. A previous evaluation study on the programme revealed that the beads are therapeutic for the child and parents; however, due to a small sample size, the results were representative of the experiences of a small number of families who participated in the programme. This was an evaluation study which employed a nonexperimental descriptive design. Surveys were mailed to all eligible families who enrolled in the programme. Data collection occurred between July-December 2012. Questions on parental experiences with the Heart Beads programme were divided into three categories: understanding, acknowledgement and quality. Descriptive statistics were obtained and analysed. One hundred and sixty-two mothers and 136 fathers responded to the survey. Heart Beads assisted mothers (83%) and fathers (80%) with understanding their child's condition and helped them with communication (mothers 80%, fathers 58%). The majority of fathers felt that their experience was acknowledged by nursing staff (64%) and medical staff (62%), while mothers indicated a higher response from nurses (76%) compared to medical staff (67%). Overall, parents rated the programme positively; however, there was some concern that children at times missed out on beads. Understanding how mothers and fathers experience the programme differently can guide staff in their communication with parents and inform future initiatives. The Heart Beads help nurses understand how parents are experiencing care and ways in which they can provide support and acknowledgement of the parent's experience. © 2014 John Wiley & Sons Ltd.

[Evaluation of disease management programmes--assessing methods and initial outcomes from a health economic perspective].

PubMed

Birnbaum, Dana Sophie; Braun, Sebastian

2010-01-01

Evaluation represents a substantial component of the concept of Disease Management Programmes. This and the fact that the implementation of Disease Management Programmes constitutes a major change in the German healthcare system require that the criteria established by the German Federal Social Insurance Authority (Bundesversicherungsamt) be carefully reviewed. The present paper focuses on the evaluation method and the economic data. The pre-/-post study design used in the evaluation is known to be vulnerable to threats to internal validity. The objective of this paper is to analyze whether these threats to internal validity which have been known theoretically are confirmed by the results of the final reports. A review of the final reports of health insurance companies like the AOK, Barmer and a group of the BKK in Westfalen-Lippe shows that this question can be answered in the affirmative. The pre-/-post design without control groups is unable to recognize the failure or success of the Disease Management concept. The reasons include a high drop-out rate as well as the lack of consideration of the characteristics of chronic disease. Hence the evaluation method has failed to prove the quality of Disease Management Programmes in Germany. This is why consistent further development is needed.

Clinical leadership training: an evaluation of the Welsh Fellowship programme.

PubMed

Phillips, Suzanne; Bullock, Alison

2018-05-08

Purpose UK fellowship schemes have been set up to address low-level engagement of doctors with leadership roles. Established in 2013, the Welsh Clinical Leadership Fellowship (WCLF) programme aims to recruit aspiring future clinical leaders and equip them with knowledge and skills to lead improvements in healthcare delivery. This paper aims to evaluate the 12-month WCLF programme in its first two years of operation. Design/methodology/approach Focused on the participants ( n = 8), the authors explored expectations of the programme, reactions to academic components (provided by Academi Wales) and learning from workplace projects and other opportunities. The authors adopted a qualitative approach, collecting data from four focus groups, 20 individual face-to-face or telephone interviews with fellows and project supervisors and observation of Academi Wales training days. Findings Although from diverse specialties and stages in training, all participants reported that the Fellowship met expectations. Fellows learned leadership theory, developing understanding of leadership and teamwork in complex organisations. Through workplace projects, they applied their knowledge, learning from both success and failure. The quality of communication with fellows distinguished the better supervisors and impacted on project success. Research limitations/implications Small participant numbers limit generalisability. The authors did not evaluate longer-term impact. Practical implications Doctors are required to be both clinically proficient and influence service delivery and improve patient care. The WCLF programme addresses both the need for leadership theory (through the Academi Wales training) and the application of learning through the performance of leadership roles in the projects. Originality/value This work represents an evaluation of the only leadership programme in Wales, and outcomes have led to improvements.

Preventing alcohol misuse in young people aged 9-11 years through promoting family communication: an exploratory evaluation of the Kids, Adults Together (KAT) Programme

PubMed Central

2011-01-01

Background Alcohol misuse by young people is an important public health issue, and has led to the development of a range of prevention interventions. Evidence concerning the most effective approaches to intervention design and implementation is limited. Parental involvement in school-based interventions is important, but many programmes fail to recruit large numbers of parents. This paper reports findings from an exploratory evaluation of a new alcohol misuse prevention programme - Kids, Adults Together (KAT), which comprised a classroom component, engagement with parents through a fun evening for families with children aged 9-11 years, and a DVD. The evaluation aimed to establish the programme's theoretical basis, explore implementation processes and acceptability, and identify plausible precursors of the intended long-term outcomes. Methods Documentary analysis and interviews with key personnel examined the programme's development. Classroom preparation and KAT family events in two schools were observed. Focus groups with children, and interviews with parents who attended KAT family events were held immediately after programme delivery, and again after three months. Interviews with head teachers and with teachers who delivered the classroom preparation were conducted. Follow-up interviews with programme personnel were undertaken. Questionnaires were sent to parents of all children involved in classroom preparation. Results KAT achieved high levels of acceptability and involvement among both children and parents. Main perceived impacts of the programme were increased pro-social communication within families (including discussions about harmful parental alcohol consumption), heightened knowledge and awareness of the effects of alcohol consumption and key legal and health issues, and changes in parental drinking behaviours. Conclusions KAT demonstrated promise as a prevention intervention, primarily through its impact on knowledge and communication processes within families, and its ability to engage with large numbers of parents. A key programme mechanism was the classroom preparation's facilitation of parental involvement in the family fun evening. The programme also incorporated features identified in the literature as likely to increase effectiveness, including a focus on harm reduction, interactive delivery, and targeting primary-school-age children. Further research is needed to test and develop programme theory through implementation in different school contexts, and to examine potential longer-term impacts, and the feasibility of large scale delivery. PMID:22004185

Governance in community based health programmes in I.R of Iran.

PubMed

Falahat, Katayoun; Eftekhari, Monir Baradaran; Malekafzali, Hossein; Forouzan, Ameneh Setareh; Dejman, Masoumeh

2013-02-01

To assess the nature of community-based health programme experience in Iran, and use the results in order to advocate more friendly policies in community, academy and funding organisations. The qualitative study was done in 2010-11 at various locations in Iran using semi structural in-depth interviews with the principals and managers of programmes, and focus group discussions with volunteers and service users of 13 Community Based Health Programmes which were active for at least five years. A total of 21 in-depth interviews and 20 focus group discussions were conducted. Data analysis was based on deductive-inductive content analysis approach considering the pre-determined structure in accordance with the study questions. The participants' views were analysed within the main category of governance, including the three sub-categories of leadership, monitoring and evaluation, and resource mobilisation. According to the participants, governmental programmes have centralised decision-making and management processes and local volunteers have no role in selecting managers at different levels of a programme. Such programmes are funded by the governmental core resources. In non-government organisations, resources available for such purposes mainly come through charitable individuals, service delivery fees and profitable economical activities, financial participation of volunteers and by using other organisations' facilities. In most programmes, there were no systematic process for monitoring and evaluation. Community-based Health programmes in Iran need to be revised in line with the positive input.There is a need to have community-based units within the Ministry of Health and Medical Education and other relevant organisations.

Development and evaluation of a dietary self-management programme for older adults with low literacy and heart disease: pilot study of feasibility and acceptability.

PubMed

Shao, Jung-Hua; Chen, Su-Hui

2016-12-01

To develop a dietary self-management programme for salt-, fluid-, fat- and cholesterol-intake behaviours for older adults with low literacy and heart disease and evaluate the feasibility and acceptability of the programme. Eating behaviours such as fluid, salt, fat and cholesterol intake are an important factor related to heart disease outcomes. People with low literacy have difficulty following recommended health behaviours, but limited research has investigated intervention programmes for this population. Programme development and pilot testing its feasibility and acceptability. Recommendations were also collected from participants and the research assistant for future large-scale interventions. The study had two phases. Phase I consisted of programme development based on previous qualitative findings, a systematic review of the literature, clinical practice experience and expert opinion. In Phase II, we pilot tested the programme from January - June 2014 in a convenience sample of 10 older adults with low literacy, heart disease and recruited from a medical centre in northern Taiwan. Pilot testing showed that our programme was feasible and acceptable to older adults with low literacy and heart disease. Moreover, the final version of the programme was revised based on participants' and the research assistant's recommendations. Our study results suggest that with guidance and assistance, older adults with low literacy and heart disease can be motivated to take action for their health and are empowered by learning how to self-manage their heart-healthy eating behaviours. © 2016 John Wiley & Sons Ltd.

Accelerated Reader as a Literacy Catch-Up Intervention during Primary to Secondary School Transition Phase

ERIC Educational Resources Information Center

Siddiqui, Nadia; Gorard, Stephen; See, Beng Huat

2016-01-01

This paper describes an evaluation of an internet-based reading programme called Accelerated Reader (AR), which is widely used in UK schools and worldwide. AR is a whole-group reading management and monitoring programme that aims to stimulate the habit of independent reading among primary and secondary age pupils. The evaluation involved 349…

Preliminary Evaluation of a Social Skills Training and Facilitated Play Early Intervention Programme for Extremely Shy Young Children in China

ERIC Educational Resources Information Center

Li, Yan; Coplan, Robert J.; Wang, Yuemin; Yin, Jingtong; Zhu, Jingjing; Gao, Zhuqing; Li, Linhui

2016-01-01

The goal of this study was to provide a preliminary evaluation of a social skills and facilitated play early intervention programme to promote social interaction, prosocial behaviours and socio-communicative skills among young extremely shy children in China. Participants were a sample of n = 16 extremely shy young children attending kindergarten…

Drawing Instead of Answering to Evaluate the Effectiveness of Food Safety Programmes in Primary School

ERIC Educational Resources Information Center

Faccio, Elena; Costa, Norberto; Losasso, Carmen; Barrucci, Federica; Mantovani, Claudio; Cibin, Veronica; Andrighetto, Iginio; Ricci, Antonia

2017-01-01

Objective: The high incidence of foodborne disease among children suggests the value of health promotion. Children are a high-risk group so far as foodborne disease is concerned, although they may be hard to reach with training programmes. This research investigated the use of drawings, compared with questionnaires, to evaluate the impact of a…

A Mixed-Methods Evaluation of the Longer-Term Implementation and Utility of a Teacher Classroom Management Training Programme in Irish Primary Schools

ERIC Educational Resources Information Center

Leckey, Yvonne; Hyland, Lynda; Hickey, Gráinne; Lodge, Anne; Kelly, Paul; Bywater, Tracey; Comiskey, Catherine; Donnelly, Michael; McGilloway, Sinéad

2016-01-01

Inappropriate, aggressive and disruptive behaviour in the classroom can be detrimental to child and teacher well-being. This study involved a longer-term evaluation of the "Incredible Years Teacher [Classroom Management]" programme (IYTP) undertaken mainly within disadvantaged schools in south-west Ireland. The IYTP is designed to…

Effects of the Dutch Skills for Life Program on the Health Behavior, Bullying, and Suicidal Ideation of Secondary School Students

ERIC Educational Resources Information Center

Fekkes, M.; van de Sande, M. C. E.; Gravesteijn, J. C.; Pannebakker, F. D.; Buijs, G. J.; Diekstra, R. F. W.; Kocken, P. L.

2016-01-01

Purpose: The purpose of this paper is to evaluate the effects of the Dutch "Skills for Life" programme on students' health behaviours, bullying behaviour and suicidal ideation. Design/methodology/approach: The effectiveness of the "Skills for Life" programme on health behaviour outcomes was evaluated at three points in time in…

Augmentative and Alternative Communication for Children with Autism Spectrum Disorder: An Evidence-Based Evaluation of the Language Acquisition through Motor Planning (LAMP) Programme

ERIC Educational Resources Information Center

Bedwani, Mary-Ann Naguib; Bruck, Susan; Costley, Debra

2015-01-01

Children diagnosed with autism spectrum disorder often have restricted verbal communication. For children who do not use functional speech, augmentative and alternative communication (AAC) devices can be an important support. We evaluated the effectiveness of one AAC programme, the Language Acquisition through Motor Planning (LAMP) using a Vantage…

Evaluation of the Learning to Teach for Social Justice-Beliefs Scale in an Australian Context

ERIC Educational Resources Information Center

Ginns, Paul; Loughland, Anthony; Tierney, Robert J.; Fryer, Luke; Amazan, Rose; McCormick, Alexandra

2015-01-01

A concern for social justice pervades the espoused curriculum of many pre-service teaching programmes, but the extent to which that curriculum influences the beliefs students hold is an open question. With the goal of developing an instrument suitable for evaluating such beliefs at the degree programme level, the present study analysed responses…

An Evaluation of the First Year Experience from the Mature Students' Perspective: A Multi-Institutional Comparison

ERIC Educational Resources Information Center

Chapman, Amanda; Parmar, Deeba; Trotter, Eileen

2007-01-01

This study investigates the experiences of mature students across three higher education institutions in the UK. The issues arising are of relevance to academics who are involved in widening participation and in evaluating support in their own programmes for the diversity of students. The sample includes mature students from programmes in Health,…

Embedding Weight-Related Messages within a General Parenting Programme: Development and Feasibility Evaluation of Parents and Tots Together

ERIC Educational Resources Information Center

Haines, Jess; Mayorga, Angela M.; McDonald, Julia; O'Brien, Ashley; Gross, Deborah; Taveras, Elsie M.; Epee-Bounya, Alexandra; Gillman, Matthew W.

2012-01-01

In this article, we describe the development and feasibility evaluation of Parents and Tots Together (PTT), a family-based obesity prevention intervention that embeds weight-related messages within a general parenting programme. To inform the development of PTT, we conducted 5 focus groups with 19 racially/ethnically diverse parents to examine…

Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson's heuristics.

PubMed

Joshi, Ashish; Perin, Douglas M Puricelli; Amadi, Chioma; Trout, Kate

2015-03-05

The study purpose was to conduct heuristic evaluation of an interactive, bilingual touchscreen-enabled breastfeeding educational programme for Hispanic women living in rural settings in Nebraska. Three raters conducted the evaluation during May 2013 using principles of Nielson's heuristics. A total of 271 screens were evaluated and included: interface (n = 5), programme sections (n = 223) and educational content (n = 43). A total of 97 heuristic violations were identified and were mostly related to interface (8 violations/5 screens) and programme components (89 violations/266 screens). The most common heuristic violations reported were recognition rather than recall (62%, n = 60), consistency and standards (14%, n = 14) and match between the system and real world (9%, n = 9). Majority of the heuristic violations had minor usability issues (73%, n = 71). The only grade 4 heuristic violation reported was due to the visibility of system status in the assessment modules. The results demonstrated that the system was more consistent with Nielsen's usability heuristics. With Nielsen's usability heuristics, it is possible to identify problems in a timely manner, and help facilitate the identification and prioritisation of problems needing urgent attention at an earlier stage before the final deployment of the system.

Effectiveness of Teacher Education Programmes in Developing Teaching Skills for Secondary Level

ERIC Educational Resources Information Center

Ullah, S. Zia; Farooq, M. S.; Memon, R. A.

2008-01-01

The purpose of the study was to evaluate the effectiveness of secondary school teacher education programme in terms of development of selected teaching skills and suggesting ways and means to improve the programme. The population of the study comprised of the pre-service teachers of all the government colleges of education for men and women in…

Learning about Domestic Violence: Young People's Responses to a Healthy Relationships Programme

ERIC Educational Resources Information Center

Bell, Jo; Stanley, Nicky

2006-01-01

This paper reports on an evaluation of a drama-based Healthy Relationships programme on domestic violence delivered on a pilot basis to Year 8 pupils. The programme included a play delivered by a local theatre-in-education company followed by a series of weekly workshops. Eighty-five pupils in a secondary school located in an area with high rates…

Contribution of a Professional Development Programme to the Quality and Retention of Teachers in an Urban Environment

ERIC Educational Resources Information Center

Gaikhorst, Lisa; Beishuizen, Jos J.; Zijlstra, Bonne J. H.; Volman, Monique L. L.

2015-01-01

This study examined the effects of a professional development programme aimed at equipping teachers for the challenges of teaching in urban schools. The contribution of the programme to teacher quality and teacher retention was evaluated using a mixed research design in which both quantitative (N?=?133) and qualitative (N?=?42) approaches were…

"Crazy? So what!": A School Programme to Promote Mental Health and Reduce Stigma--Results of a Pilot Study

ERIC Educational Resources Information Center

Conrad, Ines; Dietrich, Sandra; Heider, Dirk; Blume, Anne; Angermeyer, Matthias C.; Riedel-Heller, Steffi

2009-01-01

Purpose: The purpose of this paper is to evaluate the health-promoting and stigma-reducing effect of the German school-based programme "Crazy? So what!". Design/methodology/approach: A quasi-experimental longitudinal control-study was carried out with assessments one week prior to the school programme, immediately after it and three…

Young Women's Lived Experience of Participating in a Positive Youth Development Programme: The "Teens & Toddlers" Pregnancy Prevention Intervention

ERIC Educational Resources Information Center

Sorhaindo, Annik; Mitchell, Kirstin; Fletcher, Adam; Jessiman, Patricia; Keogh, Peter; Bonell, Chris

2016-01-01

Purpose: Evaluation of the Teens & Toddlers (T&T) positive youth development (PYD) and teenage pregnancy prevention programme suggested that the intervention had minimal effectiveness partly due to its unclear theory of change. The purpose of this paper is to examine the lived experiences of young women participating in the programme to…

"Please, Give Me Space": Findings and Implications from an Evaluation of the GLOMUS Intercultural Music Camp, Ghana 2011

ERIC Educational Resources Information Center

Hebert, David G.; Saether, Eva

2014-01-01

Folk music programmes have been a major feature of higher education music departments across the Nordic region for several decades. Still, programmes that offer the opportunity to deeply study non-European music (other than jazz) are very rare in most of Europe, and programmes in music "education" that offer such opportunities at…

Learning globally to enhance local practice: an international programme in primary care & family health.

PubMed

Godoy-Ruiz, Paula; Rodas, Jamie; Talbot, Yves; Rouleau, Katherine

2016-09-01

In a global context of growing health inequities, international learning experiences have become a popular strategy for equipping health professionals with skills, knowledge, and competencies required to work with the populations they serve. This study sought to analyse the Chilean Interprofessional Programme in Primary Health Care (CIPPHC), a 5 week international learning experience funded by the Ministry of Health in Chile targeted at Chilean primary care providers and delivered in Toronto by the Department of Family and Community Medicine at the University of Toronto. The study focused on three cohorts of students (2010-2012). Anonymous programme evaluations were analysed and semi-structured interviews conducted with programme alumni. Simple descriptive statistics were gathered from the evaluations and the interviews were analysed via thematic content analysis. The majority of participants reported high levels of satisfaction with the training programme, knowledge gain, particularly in the areas of the Canadian model of primary care, and found the materials delivered to be applicable to their local context. The CIPPHC has proven to be a successful educational initiative and provides valuable lessons for other academic centres in developing international interprofessional training programmes for primary care health care providers.

[Post-academic dental specialties 18. The graduate programme in periodontology].

PubMed

van der Velden, U

2008-07-01

In 1987, the Dutch Society of Periodontology (NVvP) made it possible for dentists to be recognized as specialists in periodontology. This recognition lasts for 5 years after which, on the basis of an evaluation of the Consilium Parodontologicum of the NVvP, continuation of the recognition for another period of 5 years is possible. The Academic Centre for Dentistry at the University of Amsterdam and the University Medical Centre St Radboud at Nijmegen University provide a 3 year full time specialisation programme in periodontology. These programmes are approved by the European Federation of Periodontology. After successful completion of one of these programmes, recognition as periodontist by the Dutch Society of Periodontology can be requested. Possible recognition is based on an extensive evaluation during a one day site visit in the practice by the Consilium Parodontologicum.

The safety of magnetic resonance imaging in patients with programmable implanted intrathecal drug delivery systems: a 3-year prospective study.

PubMed

De Andres, Jose; Villanueva, Vicente; Palmisani, Stefano; Cerda-Olmedo, German; Lopez-Alarcon, Maria Dolores; Monsalve, Vicente; Minguez, Ana; Martinez-Sanjuan, Vicente

2011-05-01

It is common clinical practice to perform magnetic resonance imaging (MRI) in patients with indwelling programmable intrathecal drug delivery (IDD) systems, although the safety of the procedure has never been documented. We performed a single-center, 3-year, prospective evaluation in patients with a programmable implanted IDD to assess patient discomfort, IDD technical failures, and adverse effects during and after exposure to MRI. Forty-three consecutive patients with an implanted programmable IDD system (SynchroMed® EL Implantable Infusion Pump, Model 8626L-18, and SynchroMed® II Model 8637-20, 8637-40; Medtronic, Inc., Minneapolis, MN) requiring a scheduled MRI evaluation were studied during a 3-year period. All MRI scans were performed with a 1.5-tesla clinical use magnet and a specific absorption rate of no more than 0.9 W/kg. Radiograph control was used to confirm postexposure pump rotor movement and detect system dislocations. IDD system failures, patient satisfaction, and discomfort were recorded. None of the patients experienced signs of drug overinfusion that could lead to hemodynamic, respiratory, or neurologic alterations. Radiologic evaluation after MRI revealed no spatial displacements of the intrathecal catheter tip or body pump, and programmer telemetry confirmed the infusion recovery. Patients' satisfaction after the procedure was high. Performing an MRI scan with the proposed protocol in patients with an implanted Medtronic programmable IDD system resulted in virtually no technical or medical complications. © 2011 International Anesthesia Research Society

Quality of nursing doctoral education in Korea: towards policy development.

PubMed

Ja Kim, Mi; Gi Park, Chang; Kim, Minju; Lee, Hyeonkyeong; Ahn, Yang-Heui; Kim, Euisook; Yun, Soon-Nyoung; Lee, Kwang-Ja

2012-07-01

This article is a report on an international study of the quality of nursing doctoral education; herein, we report findings for Korea. Specific aims were to: examine the validity and reliability of the quality of nursing doctoral education questionnaire; and identify contributing factors and domain(s) for improvement. The quality of nursing doctoral education has been a worldwide concern with the recent rapid increase in number of nursing doctoral programmes around the world, and comprehensive evaluation is needed for policy recommendations. A cross-sectional descriptive study, conducted from October 2006 to January 2007, used an online questionnaire evaluating four domains: programme, faculty, resources and evaluation. Seven deans, 48 faculty, 52 graduates and 87 students from 14 nursing schools participated. Content and construct validity, and construct reliability of the questionnaire were established. Overall, participants reported that the perceived quality of private universities/schools was significantly higher than that of public/national universities. A higher ratio of doctoral to non-doctoral students was significantly associated with higher quality. The domains of programme, faculty and resources were highly correlated. The programme was the most important domain; availability of sufficient materials and information for students most needed improvement. Overall, faculty perceived the quality of the programme, faculty and resources as more positively than did the graduates and students. This study provides useful policy guidance for nurse educators worldwide for improving doctoral programmes and faculty's role in educating students. Further study is recommended that examines contributing factors to quality doctoral education. © 2011 Blackwell Publishing Ltd.

Effectiveness of a regional self-study perinatal education programme: a successful adaptation in Yucatan, Mexico.

PubMed

Osorno, Lorenzo R; Campos, Miriam C; Cook, Lynn J; Vela, Gabriela R; Dávila, Jorge R

2006-08-01

To evaluate the effectiveness of the Perinatal Continuing Education Programme (PCEP) in a Latin American country. We carried out a study within secondary and tertiary care, and rural Mexican Institute of Social Security (IMSS) hospitals on the Yucatan Peninsula. Participants were doctors, nurses and nursing assistants working with pregnant women and newborns at each hospital. The PCEP was translated into Spanish and then implemented between January 1998 and December 2001. Two nurses at each hospital were trained to co-ordinate the programme and the personnel were invited to participate. Participation involved purchasing the self-teaching books, study outside work hours and participation in skills demonstration and practice sessions. Evaluation included the percentage of personnel who participated in and those who completed the programme, an opinion survey of the programme, level of pre- and post-intervention knowledge, and the quality of neonatal care according to expert-recommended routines. Results were analysed with chi-square and Student's t-tests. A total of 65.3% of the 1421 people in the study population began the programme and 72% of those completed it. Improvement was observed in 14 of 23 (P<0.05) evaluated neonatal care practices. Participants rated the written material as very clear and useful in daily practice. The PCEP is an effective strategy for improving the level of knowledge and perinatal care in all regional hospitals on the Yucatan Peninsula, Mexico. This initial application of the PCEP in a Spanish-speaking country was successful.

Evaluating the implementation of a quality improvement process in General Practice using a realist evaluation framework.

PubMed

Moule, Pam; Clompus, Susan; Fieldhouse, Jon; Ellis-Jones, Julie; Barker, Jacqueline

2018-05-25

Underuse of anticoagulants in atrial fibrillation is known to increase the risk of stroke and is an international problem. The National Institute for Health Care and Excellence guidance CG180 seeks to reduce atrial fibrillation related strokes through prescriptions of Non-vitamin K antagonist Oral Anticoagulants. A quality improvement programme was established by the West of England Academic Health Science Network (West of England AHSN) to implement this guidance into General Practice. A realist evaluation identified whether the quality improvement programme worked, determining how and in what circumstances. Six General Practices in 1 region, became the case study sites. Quality improvement team, doctor, and pharmacist meetings within each of the General Practices were recorded at 3 stages: initial planning, review, and final. Additionally, 15 interviews conducted with the practice leads explored experiences of the quality improvement process. Observation and interview data were analysed and compared against the initial programme theory. The quality improvement resources available were used variably, with the training being valued by all. The initial programme theories were refined. In particular, local workload pressures and individual General Practitioner experiences and pre-conceived ideas were acknowledged. Where key motivators were in place, such as prior experience, the programme achieved optimal outcomes and secured a lasting quality improvement legacy. The employment of a quality improvement programme can deliver practice change and improvement legacy outcomes when particular mechanisms are employed and in contexts where there is a commitment to improve service. © 2018 John Wiley & Sons, Ltd.

Understanding the motivation and performance of community health volunteers involved in the delivery of health programmes in Kampala, Uganda: a realist evaluation protocol

PubMed Central

Vareilles, Gaëlle; Pommier, Jeanine; Kane, Sumit; Pictet, Gabriel; Marchal, Bruno

2015-01-01

Introduction The recruitment of community health volunteers to support the delivery of health programmes is a well-established approach in many countries, particularly where health services are not readily available. However, studies on management of volunteers are scarce and current research on human resource management of volunteers faces methodological challenges. This paper presents the protocol of a realist evaluation that aims at identifying the factors influencing the performance of community health volunteers involved in the delivery of a Red Cross immunisation programme in Kampala (Uganda) with a specific focus on motivation. Methods and analysis The realist evaluation cycle structures the protocol. To develop the theoretical basis for the evaluation, the authors conducted interviews and reviewed the literature on community health volunteers’ performance, management and organisational behaviour. This led to the formulation of the initial programme theory, which links the intervention inputs (capacity-building strategies) to the expected outcomes (positive work behaviour) with mechanisms that point in the direction of drivers of motivation. The contextual elements include components such as organisational culture, resource availability, etc. A case study design will be adopted. We define a case as a Red Cross branch, run by a programme manager, and will select two cases at the district level in Kampala. Mixed methods will be used in data collection, including individual interviews of volunteers, participant observation and document review. The thematic analysis will be based on the initial programme theory and will seek for context-mechanism-outcome configurations. Findings from the two cases will be compared. Discussion We discuss the scope for applying realist evaluation and the methodological challenges we encountered in developing this protocol. Ethics and dissemination The study was approved by the Ethical Committee at Rennes University Hospital, France. Results will be published in scientific journals, and communicated to respondents and relevant institutions. PMID:25631314

Searching for the mechanisms of change: a protocol for a realist review of batterer treatment programmes.

PubMed

Velonis, Alisa J; Cheff, Rebecca; Finn, Debbie; Davloor, Whitney; O'Campo, Patricia

2016-04-06

Conflicting results reported by evaluations of typical batterer intervention programmes leave many judicial officials and policymakers uncertain about the best way to respond to domestic violence, and whether to recommend and fund these programmes. Traditional evaluations and systematic reviews tend to focus predominantly on whether the programmes 'worked' (eg, reduced recidivism) often at the exclusion of understanding for whom they may or may not have worked, under what circumstances, and why. We are undertaking a realist review of the batterer treatment programme literature with the aim of addressing this gap. Keeping with the goals of realist review, our primary aims are to identify the theory that underlies these programmes, highlight the mechanisms that trigger changes in participant behaviour and finally explain why these programmes help some individuals reduce their use of violence and under what conditions they are effective or not effective. We begin by describing the process of perpetrator treatment, and by proposing an initial theoretical model of behaviour change that will be tested by our review. We then describe the criteria for inclusion of an evaluation into the review, the search strategy we will use to identify the studies, and the plan for data extraction and analysis. The results of this review will be written up using the RAMESES Guidelines for Realist Synthesis, and disseminated through peer-reviewed publications aimed at the practitioner community as well as presented at community forums, and at violence against women conferences. Ethics approval was not needed. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A mixed method, multiperspective evaluation of a near peer teaching programme.

PubMed

Lydon, Sinéad; O'Connor, Paul; Mongan, Orla; Gorecka, Miroslawa; McVicker, Lyle; Stankard, Aiden; Byrne, Dara

2017-09-01

Peer teaching (PT) has become increasingly popular. PT may offer benefits for students, tutors and institutions. Although resistance to PT has been identified among faculty, research has typically focused on students' experiences and perceptions, rather than those of the peer tutors or senior doctors/medical faculty. The current study comprised of a comprehensive, multiperspective evaluation of a near PT programme delivered by interns to final-year medical students in the Republic of Ireland. This study employed a mixed methods design, using both interviews and questionnaires to assess students' (n=130), interns' (n=49) and medical faculty's or senior doctors' (n=29) perceptions of the programme. All three groups were emphatic about the programme's benefits, although senior doctors and faculty reported significantly more positive attitudes than the others. Mean ratings of the programme's value, out of 10, were 8.2 among students, 8.2 among interns and 9.1 among senior doctors and faculty. Challenges identified were largely organisational in nature. Perceived benefits for students included the informality of teaching sessions, increased opportunities in the clinical environment and improvements in exam preparedness. Perceived benefits for the interns included improvements in knowledge and teaching ability and experience as a role model. PT programmes have been posited as an 'easy fix' to growing numbers of students. However, it is apparent that PT has substantial value outside of this. Future research that conducts economic evaluations of such programmes and that collects objective data on teaching quality and student learning would be of much interest. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Quality indicators for in-hospital geriatric co-management programmes: a systematic literature review and international Delphi study

PubMed Central

Van Grootven, Bastiaan; McNicoll, Lynn; Mendelson, Daniel A; Friedman, Susan M; Fagard, Katleen; Milisen, Koen; Flamaing, Johan; Deschodt, Mieke

2018-01-01

Objective To find consensus on appropriate and feasible structure, process and outcome indicators for the evaluation of in-hospital geriatric co-management programmes. Design An international two-round Delphi study based on a systematic literature review (searching databases, reference lists, prospective citations and trial registers). Setting Western Europe and the USA. Participants Thirty-three people with at least 2 years of clinical experience in geriatric co-management were recruited. Twenty-eight experts (16 from the USA and 12 from Europe) participated in both Delphi rounds (85% response rate). Measures Participants rated the indicators on a nine-point scale for their (1) appropriateness and (2) feasibility to use the indicator for the evaluation of geriatric co-management programmes. Indicators were considered appropriate and feasible based on a median score of seven or higher. Consensus was based on the level of agreement using the RAND/UCLA Appropriateness Method. Results In the first round containing 37 indicators, there was consensus on 14 indicators. In the second round containing 44 indicators, there was consensus on 31 indicators (structure=8, process=7, outcome=16). Experts indicated that co-management should start within 24 hours of hospital admission using defined criteria for selecting appropriate patients. Programmes should focus on the prevention and management of geriatric syndromes and complications. Key areas for comprehensive geriatric assessment included cognition/delirium, functionality/mobility, falls, pain, medication and pressure ulcers. Key outcomes for evaluating the programme included length of stay, time to surgery and the incidence of complications. Conclusion The indicators can be used to assess the performance of geriatric co-management programmes and identify areas for improvement. Furthermore, the indicators can be used to monitor the implementation and effect of these programmes. PMID:29549210

[Development and implementation of a state-wide "train the trainer" model of the school-based prevention programme "Join the Healthy Boat - Primary School"].

PubMed

Wartha, O; Koch, B; Kobel, S; Drenowatz, C; Kettner, S; Schreiber, A; Wirt, T; Kesztyüs, D; Steinacker, J M

2014-10-01

This paper shows how a state-wide health-promotion intervention at primary schools can be implemented by considering the example of the programme "Join the Healthy Boat - Primary School". Additionally, it is illustrated how quality control throughout the whole process can be incorporated. To operate long-term and target-group orientated in the whole state of Baden-Württemberg, the school-based prevention programme "Join the Healthy Boat" uses a "train the trainer" model. The trainers are teachers who were instructed by the project team. In the school year 2009/10, these trainers offered quadrinominal training courses for further teachers. Every urban and rural district is covered by 1 trainer. The trainers evaluated the 6 preparatory training courses they had been given using questionnaires. The following 4 training courses the trainers offered to the teachers were reviewed by the trainers as well as the teachers using questionnaires, too. Additionally, at the end of the school year 2009/10, the teachers completed a questionnaire about their satisfaction regarding the programme itself and the work with the trainer. During the school year 2009/10, 453 teachers were trained by 32 trainers. According to indications on the questionnaires about the preparatory training courses, all trainers felt themselves "very well" or "well" prepared for their task. The teachers evaluated the expertise of the respective trainer, the quality of the training courses and the satisfaction with the programme itself throughout highly. Based on the excellent results of the process evaluation and the programme's wide coverage, an adoption of a "train the trainer" model seems worthwhile for other school-based prevention programmes, as well. © Georg Thieme Verlag KG Stuttgart · New York.

Past and Ongoing Tsetse and Animal Trypanosomiasis Control Operations in Five African Countries: A Systematic Review

PubMed Central

Holt, Hannah R.; Selby, Richard; Guitian, Javier

2016-01-01

Background Control operations targeting Animal African Trypanosomiasis and its primary vector, the tsetse, were covering approximately 128,000 km2 of Africa in 2001, which is a mere 1.3% of the tsetse infested area. Although extensive trypanosomiasis and tsetse (T&T) control operations have been running since the beginning of the 20th century, Animal African Trypanosomiasis is still a major constraint of livestock production in sub-Saharan Africa. Methodology/Principal Findings We performed a systematic review of the existing literature describing T&T control programmes conducted in a selection of five African countries, namely Burkina Faso, Cameroon, Ethiopia, Uganda and Zambia, between 1980 and 2015. Sixty-eight documents were eventually selected from those identified by the database search. This was supplemented with information gathered through semi-structured interviews conducted with twelve key informants recruited in the study countries and selected based on their experience and knowledge of T&T control. The combined information from these two sources was used to describe the inputs, processes and outcomes from 23 major T&T control programmes implemented in the study countries. Although there were some data gaps, involvement of the target communities and sustainability of the control activities were identified as the two main issues faced by these programmes. Further, there was a lack of evaluation of these control programmes, as well as a lack of a standardised methodology to conduct such evaluations. Conclusions/Significance Past experiences demonstrated that coordinated and sustained control activities require careful planning, and evidence of successes, failures and setbacks from past control programmes represent a mine of information. As there is a lack of evaluation of these programmes, these data have not been fully exploited for the design, analyses and justification of future control programmes. PMID:28027299

Assessment of human resources for health programme implementation in 15 Latin American and Caribbean countries.

PubMed

Dal Poz, Mario Roberto; Sepulveda, Hernan Rodrigo; Costa Couto, Maria Helena; Godue, Charles; Padilla, Monica; Cameron, Rick; Vidaurre Franco, Thais de Andrade

2015-04-28

The health systems in the Americas region are characterized by fragmentation and segmentation, which constitute an important barrier to expanding coverage, achieving integrated primary health care, and reducing inefficiency and discontinuity of care. An assessment of the human resources for health (HRH) programmes that have been implemented at the country level was developed as part of the measurement of the 20 HRH regional goals for 2007-2015, adopted in 2007 by the Pan American Sanitary Conference (CSPA). The exercise was a combination of academic research and the development/application of an advocacy tool involving policy makers and stakeholders to influence the decision-making in the development, implementation, or change of HRH programmes while building evidence through a structured approach based on qualitative and quantitative information and the exchange and dissemination of best practices. This paper covers the methodological challenges, as well as a summary of the main findings of the study, which included 15 countries: Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua and Panama in the Central America, Dominican Republic in the Caribbean, Chile, Colombia, Ecuador and Peru in the Andean sub region, and Argentina, Paraguay, and Uruguay in the South Cone. Despite the different contexts, the results showed that the programmes evaluated faced common challenges, such as lack of political support and financial unsustainability. The evaluation process allowed the exchange and dissemination of practices, interventions, and programmes currently running in the region. A shared lesson was the importance of careful planning of the implementation of programmes and interventions. The similarities in the problems and challenges of HRH among the participating countries highlighted the need for a cooperation programme on the evaluation and assessment of implementation strategies in the Americas region.

The development and evaluation of a web-based programme to support problem-solving skills following brain injury.

PubMed

Powell, Laurie Ehlhardt; Wild, Michelle R; Glang, Ann; Ibarra, Summer; Gau, Jeff M; Perez, Amanda; Albin, Richard W; O'Neil-Pirozzi, Therese M; Wade, Shari L; Keating, Tom; Saraceno, Carolyn; Slocumb, Jody

2017-10-24

Cognitive impairments following brain injury, including difficulty with problem solving, can pose significant barriers to successful community reintegration. Problem-solving strategy training is well-supported in the cognitive rehabilitation literature. However, limitations in insurance reimbursement have resulted in fewer services to train such skills to mastery and to support generalization of those skills into everyday environments. The purpose of this project was to develop and evaluate an integrated, web-based programme, ProSolv, which uses a small number of coaching sessions to support problem solving in everyday life following brain injury. We used participatory action research to guide the iterative development, usability testing, and within-subject pilot testing of the ProSolv programme. The finalized programme was then evaluated in a between-subjects group study and a non-experimental single case study. Results were mixed across studies. Participants demonstrated that it was feasible to learn and use the ProSolv programme for support in problem solving. They highly recommended the programme to others and singled out the importance of the coach. Limitations in app design were cited as a major reason for infrequent use of the app outside of coaching sessions. Results provide mixed evidence regarding the utility of web-based mobile apps, such as ProSolv to support problem solving following brain injury. Implications for Rehabilitation People with cognitive impairments following brain injury often struggle with problem solving in everyday contexts. Research supports problem solving skills training following brain injury. Assistive technology for cognition (smartphones, selected apps) offers a means of supporting problem solving for this population. This project demonstrated the feasibility of a web-based programme to address this need.

Clinical leadership and pre-registration nursing programmes: A model for clinical leadership and a prospective curriculum implementation and evaluation research strategy.

PubMed

Brown, Angela; Dewing, Jan; Crookes, Patrick

2016-07-01

To present for wider debate a conceptual model for clinical leadership development in pre-registration nursing programmes and a proposed implementation plan. Globally, leadership in nursing has become a significant issue. Whilst there is continued support for leadership preparation in pre-registration nursing programmes, there have been very few published accounts of curriculum content and/or pedagogical approaches that foster clinical leadership development in pre-registration nursing. A doctoral research study has resulted in the creation of an overarching model for clinical leadership. A multi-method research study using theoretical and empirical literature 1974-2015, a focus group, expert opinion and a national on-line survey. A conceptual model of clinical leadership development in pre-registration nursing programme is presented, including the infinity loop of clinical leadership, an integral curriculum thread and a conceptual model: a curriculum-pedagogy nexus for clinical leadership. In order to test out usability and evaluate effectiveness, a multi method programme of research in one school of nursing in Australia is outlined. Implementation of the proposed conceptual model for clinical leadership development in pre-registration nursing programmes and a programme of (post-doctoral) research will contribute to what is known about curriculum content and pedagogy for nurse academics. Importantly, for nursing students and the profession as a whole, there is a clearer expectation of what clinical leadership might look like in the novice registered nurse. For nurse academics a model is offered for consideration in curriculum design and implementation with an evaluation strategy that could be replicated. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and evaluation of an online, interactive information and advice tool for pre-registration nursing students.

PubMed

Ryan, Gemma Sinead; Davies, Fiona

2016-03-01

Attrition rates for student nurses on academic programmes is a challenge for UK Higher Education Institutions. Reasons for leaving a programme of study include personal, financial issues or practice placement experiences. Research has shown systematic and integrated support mechanisms may improve attrition rates and student experience. This project explored the sources of, and support needs of nursing and allied health students, develop and evaluate and interactive online tool: 'SignpOSt'. Enabling students to access 'the right support, at the right time, from the right place'. Focus groups were carried out with 14, 3rd year students and 8 academic staff including personal tutors, programme/module leaders. Thematic analysis of transcribed data under four key themes for support and advice: 1. Financial 2. Programme 3. Personal 4. Study/academic, found poor student knowledge and little clarity of responsibilities of academic staff and services leads to students sourcing support from the wrong place at the wrong time. Students valued the speed and accessibility of information from informal, programme specific Facebook groups. Conversely, there were also concerns about the accuracy of these. Further research into the use of informal Facebook groups may be useful along with additional evaluation of the SOS tool. Copyright © 2016 Elsevier Ltd. All rights reserved.

Better health at work? An evaluation of the effects and cost-benefits of a structured workplace health improvement programme in reducing sickness absence.

PubMed

Braun, T; Bambra, C; Booth, M; Adetayo, K; Milne, E

2015-03-01

This paper presents the results of an evaluation of the Better Health at Work Award-a structured regional workplace health programme which combined changes to the work environment with lifestyle interventions. Baseline and follow-up data on sickness-absence rates and programme costs were collected retrospectively via a web survey of all participating organizations. Changes over time were calculated using 95% confidence intervals of the mean, supplemented by hypothesis testing using a t-test. The indicative cost-benefits of the intervention were also calculated. Participation was associated with a mean reduction in sickness absence of 0.26-1.6 days per employee per year depending on the length and level of participation in the programme. The estimated cost for the programme was £3 per sickness-absence day saved. These results suggest that the Better Health at Work Award could be a cost-effective way of improving health and reducing sickness absence particularly in the public sector. However, controlled evaluations of future interventions are needed. © The Author 2014. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Peer mentoring: evaluation of a novel programme in paediatrics

PubMed Central

Eisen, Sarah; Sukhani, Seema; Brightwell, Alex; Stoneham, Sara; Long, Andrew

2014-01-01

Background Mentoring is important for personal and professional development of doctors. Peer mentoring is a core skill in the UK paediatric postgraduate curriculum. However, there is a paucity of peer mentoring programmes aimed at postgraduate doctors in training (postgraduate trainees), and there are no such schemes within paediatrics described in the literature. We developed a regional peer mentoring programme for postgraduate trainees in paediatrics to assess demand and need for peer mentoring and to explore the benefits for both peer mentees and mentors. Programme design Junior postgraduate trainees, randomly selected from volunteers, received peer mentoring from more senior trainees for 1 year. Peer mentors were selected by competitive application and undertook tailored training followed by an experiential learning programme. The programme was evaluated using structured questionnaires. Results 90% (76/84) of first-year postgraduate trainees in paediatrics applied to participate, demonstrating high demand. 18 peer mentor–mentee pairs were matched. Peer mentors and mentees reported high satisfaction rates, acquisition of new and transferable skills and changed behaviours. All peer mentors intended to use the skills in their workplace and, later, as an educational supervisor. Conclusions Our programme represents a novel approach to meeting the demonstrated demand and the curriculum requirement for peer mentoring, and enabled peer mentors and mentees to develop a valuable and versatile skill set. To our knowledge, it is the first such programme in paediatrics and provides a feasibility model that may be adapted locally to allow education providers to offer this important experience to postgraduate trainees. PMID:24152570

Bacterial infections in HIV-infected children admitted with severe acute malnutrition in Durban, South Africa.

PubMed

Archary, Moherndran; Adler, Hugh; La Russa, Philip; Mahabeer, Prasha; Bobat, Raziya A

2017-02-01

Bacterial infections in HIV-infected children admitted with severe acute malnutrition (SAM) contribute to higher mortality and poorer outcomes. This study describes the spectrum of bacterial infections in antiretroviral treatment (ART)-naïve, HIV-infected children admitted with SAM. Between July 2012 and February 2015, 82 children were prospectively enrolled in the King Edward VIII Hospital, Durban. Specimens obtained on and during admission for microbiological evaluation, if clinically indicated, included blood, urine (obtained by catheterisation or suprapubic aspiration), induced sputum and cerebrospinal fluid. All positive bacterial cultures between admission and 30 days after enrollment were documented and characterised into samples taken either within 2 days of admission (infections on admission) or within 2-30 days of admission (hospital-acquired infections, HAIs). On admission, 67% of patients had abnormal white blood cell counts (WBCC) (>12 or <4 × 10 9 /L) and 70% had elevated CRP; 65% were classified as severely immunosuppressed according to the WHO immunological classification. 1 A pathogen was isolated on the admission blood culture in four patients (6%) and in 27% of urine specimens. HAIs were predominately Gram-negative (39/43), and 39.5% were extended-spectrum β-lactamase-positive. Mortality was not significantly associated with isolation of a bacterial pathogen. Routine pre-hospital administration of antibiotics as per the Integrated Management of Childhood Illness (IMCI) guidelines may be responsible for the low rates of positive admission blood cultures. HAIs with drug-resistant Gram-negative organisms are an area of concern and strategies to improve the prevention of HAIs in this vulnerable population are urgently needed.

Supervision, support and mentoring interventions for health practitioners in rural and remote contexts: an integrative review and thematic synthesis of the literature to identify mechanisms for successful outcomes.

PubMed

Moran, Anna M; Coyle, Julia; Pope, Rod; Boxall, Dianne; Nancarrow, Susan A; Young, Jennifer

2014-02-13

To identify mechanisms for the successful implementation of support strategies for health-care practitioners in rural and remote contexts. This is an integrative review and thematic synthesis of the empirical literature that examines support interventions for health-care practitioners in rural and remote contexts. This review includes 43 papers that evaluated support strategies for the rural and remote health workforce. Interventions were predominantly training and education programmes with limited evaluations of supervision and mentoring interventions. The mechanisms associated with successful outcomes included: access to appropriate and adequate training, skills and knowledge for the support intervention; accessible and adequate resources; active involvement of stakeholders in programme design, implementation and evaluation; a needs analysis prior to the intervention; external support, organisation, facilitation and/or coordination of the programme; marketing of the programme; organisational commitment; appropriate mode of delivery; leadership; and regular feedback and evaluation of the programme. Through a synthesis of the literature, this research has identified a number of mechanisms that are associated with successful support interventions for health-care practitioners in rural and remote contexts. This research utilised a methodology developed for studying complex interventions in response to the perceived limitations of traditional systematic reviews. This synthesis of the evidence will provide decision-makers at all levels with a collection of mechanisms that can assist the development and implementation of support strategies for staff in rural and remote contexts.

Supervision, support and mentoring interventions for health practitioners in rural and remote contexts: an integrative review and thematic synthesis of the literature to identify mechanisms for successful outcomes

PubMed Central

2014-01-01

Objective To identify mechanisms for the successful implementation of support strategies for health-care practitioners in rural and remote contexts. Design This is an integrative review and thematic synthesis of the empirical literature that examines support interventions for health-care practitioners in rural and remote contexts. Results This review includes 43 papers that evaluated support strategies for the rural and remote health workforce. Interventions were predominantly training and education programmes with limited evaluations of supervision and mentoring interventions. The mechanisms associated with successful outcomes included: access to appropriate and adequate training, skills and knowledge for the support intervention; accessible and adequate resources; active involvement of stakeholders in programme design, implementation and evaluation; a needs analysis prior to the intervention; external support, organisation, facilitation and/or coordination of the programme; marketing of the programme; organisational commitment; appropriate mode of delivery; leadership; and regular feedback and evaluation of the programme. Conclusion Through a synthesis of the literature, this research has identified a number of mechanisms that are associated with successful support interventions for health-care practitioners in rural and remote contexts. This research utilised a methodology developed for studying complex interventions in response to the perceived limitations of traditional systematic reviews. This synthesis of the evidence will provide decision-makers at all levels with a collection of mechanisms that can assist the development and implementation of support strategies for staff in rural and remote contexts. PMID:24521004

Evaluation of a web-based ECG-interpretation programme for undergraduate medical students.

PubMed

Nilsson, Mikael; Bolinder, Gunilla; Held, Claes; Johansson, Bo-Lennart; Fors, Uno; Ostergren, Jan

2008-04-23

Most clinicians and teachers agree that knowledge about ECG is of importance in the medical curriculum. Students at Karolinska Institute have asked for more training in ECG-interpretation during their undergraduate studies. Clinical tutors, however, have difficulties in meeting these demands due to shortage of time. Thus, alternative ways to learn and practice ECG-interpretation are needed. Education offered via the Internet is readily available, geographically independent and flexible. Furthermore, the quality of education may increase and become more effective through a superior educational approach, improved visualization and interactivity. A Web-based comprehensive ECG-interpretation programme has been evaluated. Medical students from the sixth semester were given an optional opportunity to access the programme from the start of their course. Usage logs and an initial evaluation survey were obtained from each student. A diagnostic test was performed in order to assess the effect on skills in ECG interpretation. Students from the corresponding course, at another teaching hospital and without access to the ECG-programme but with conventional teaching of ECG served as a control group. 20 of the 32 students in the intervention group had tested the programme after 2 months. On a five-graded scale (1- bad to 5 - very good) they ranked the utility of a web-based programme for this purpose as 4.1 and the quality of the programme software as 3.9. At the diagnostic test (maximal points 16) by the end of the 5-month course at the 6th semester the mean result for the students in the intervention group was 9.7 compared with 8.1 for the control group (p = 0.03). Students ranked the Web-based ECG-interpretation programme as a useful instrument to learn ECG. Furthermore, Internet-delivered education may be more effective than traditional teaching methods due to greater immediacy, improved visualisation and interactivity.

The effectiveness of community-based rehabilitation programmes: an impact evaluation of a quasi-randomised trial.

PubMed

Mauro, Vincenzo; Biggeri, Mario; Deepak, Sunil; Trani, Jean-Francois

2014-11-01

Community-based rehabilitation (CBR) programmes have been described as highly effective means of promoting the rights and opportunities of persons with disabilities (PwD). Although CBR is often the main way in which PwD in low-income and middle-income countries access rehabilitation services, there is little literature providing rigorous evaluation of their impact on people's well-being. Data were collected in the Mandya and Ramanagar districts (Karnataka state, India), between December 2009 and May 2010. In total 2540 PwD were interviewed using stratified random sampling: 1919 CBR beneficiaries (who joined the programme between 1997 and 2009) and 621 persons who were living in villages not covered by the programme. We controlled for the systematic differences between people joining and not joining the programme using the propensity score matching method controlling for covariates at individual and village level. We evaluated the impact of the programme on the subgroups of PwD who are disadvantaged on the dimensions of interest: access to pensions, use of aid appliances, access to paid jobs and improvement in personal-practical autonomy after 4 and 7 years of joining the CBR. We observed a positive and significant impact of the programme on access to services, rights and opportunities of PwD. The results indicate that compared with the control group access to pensions and allowances, aid appliances, access to paid jobs and personal-practical autonomy increased by 29.7%, 9.4%, 12.3% and 36.2%, respectively, after 7 years. The CBR programme analysed has a positive impact on access to services and the well-being of PwD who are particularly deprived on outcomes of interest. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Confidence and authority through new knowledge: An evaluation of the national educational programme in paediatric oncology nursing in Sweden.

PubMed

Pergert, Pernilla; Af Sandeberg, Margareta; Andersson, Nina; Márky, Ildikó; Enskär, Karin

2016-03-01

There is a lack of nurse specialists in many paediatric hospitals in Sweden. This lack of competence is devastating for childhood cancer care because it is a highly specialised area that demands specialist knowledge. Continuing education of nurses is important to develop nursing practice and also to retain them. The aim of this study was to evaluate a Swedish national educational programme in paediatric oncology nursing. The nurses who participated came from all of the six paediatric oncology centres as well as from general paediatric wards. At the time of the evaluation, three groups of registered nurses (n=66) had completed this 2year, part-time educational programme. A study specific questionnaire, including closed and open-ended questions was sent to the 66 nurses and 54 questionnaires were returned. Answers were analysed using descriptive statistics and qualitative content analysis. The results show that almost all the nurses (93%) stayed in paediatric care after the programme. Furthermore, 31% had a position in management or as a consultant nurse after the programme. The vast majority of the nurses (98%) stated that the programme had made them more secure in their work. The nurses were equipped, through education, for paediatric oncology care which included: knowledge generating new knowledge; confidence and authority; national networks and resources. They felt increased confidence in their roles as paediatric oncology nurses as well as authority in their encounters with families and in discussions with co-workers. New networks and resources were appreciated and used in their daily work in paediatric oncology. The programme was of importance to the career of the individual nurse and also to the quality of care given to families in paediatric oncology. The national educational programme for nurses in Paediatric Oncology Care meets the needs of the highly specialised care. Copyright © 2015 Elsevier Ltd. All rights reserved.