25 CFR 32.5 - Evaluation of implementation of Pub. L. 95-561.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 25 Indians 1 2014-04-01 2014-04-01 false Evaluation of implementation of Pub. L. 95-561. 32.5... POLICIES § 32.5 Evaluation of implementation of Pub. L. 95-561. The Director, Office Indian Education Programs will develop guidelines for evaluating all functional and programmatic responsibilities associated...

25 CFR 32.5 - Evaluation of implementation of Pub. L. 95-561.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 25 Indians 1 2011-04-01 2011-04-01 false Evaluation of implementation of Pub. L. 95-561. 32.5... POLICIES § 32.5 Evaluation of implementation of Pub. L. 95-561. The Director, Office Indian Education Programs will develop guidelines for evaluating all functional and programmatic responsibilities associated...

25 CFR 32.5 - Evaluation of implementation of Pub. L. 95-561.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 25 Indians 1 2013-04-01 2013-04-01 false Evaluation of implementation of Pub. L. 95-561. 32.5... POLICIES § 32.5 Evaluation of implementation of Pub. L. 95-561. The Director, Office Indian Education Programs will develop guidelines for evaluating all functional and programmatic responsibilities associated...

It's just the right thing to do: Conceptualizing a theory of change for a school food and beverage sales environment intervention and implications for implementation evaluation.

PubMed

Levay, Adrienne V; Chapman, Gwen E; Seed, Barbara; Wittman, Hannah

2018-04-30

School food environments are the target of nutrition interventions and evaluations across the globe. Yet little work to-date has articulated the importance of developing a theory of change upon which to base evaluation of both implementation and outcomes. This paper undertakes an interpretive approach to develop a retrospective theory of change for an implementation evaluation of British Columbia's school food and beverage sales Guidelines. This study contributes broadly to a nuanced conceptualization of this type of public health intervention and provides a methodological contribution on how to develop a retrospective theory of change with implications for effective evaluation. Data collection strategies included document analysis, semi-structured interviews with key stakeholders, and participant observation. Developing the logic model revealed that, despite the broad population health aims of the intervention, the main focus of implementation is to change behaviors of adults who create school food environments. Derived from the analysis and interpretation of the data, the emergent program theory focuses on the assumption that if adults are responsibilized through information and education campaigns and provided implementation tools, they will be 'convinced' to implement changes to school food environments to foster broader public health goals. These findings highlight the importance of assessing individual-level implementation indicators as well as the more often evaluated measures of food and beverage availability. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Development, implementation, and evaluation of an integrated multidisciplinary Objective Structured Clinical Examination (OSCE) in primary health care settings within limited resources.

PubMed

Abdelaziz, Adel; Hany, Mohamed; Atwa, Hani; Talaat, Wagdy; Hosny, Somaya

2016-01-01

In ordinary circumstances, objective structured clinical examination (OSCE) is a resource-intensive assessment method. In case of developing and implementing multidisciplinary OSCE, there is no doubt that the cost will be greater. Through this study a research project was conducted to develop, implement and evaluate a multidisciplinary OSCE model within limited resources. This research project went through the steps of blueprinting, station writing, resources reallocation, implementation and finally evaluation. The developed model was implemented in the Primary Health Care (PHC) program which is one of the pillars of the Community-Based undergraduate curriculum of the Faculty of Medicine, Suez Canal University (FOM-SCU). Data for evaluation of the implemented OSCE model were derived from two resources. First, feedback of the students and assessors through self-administered questionnaires was obtained. Second, evaluation of the OSCE psychometrics was done. The deliverables of this research project included a set of validated integrated multi-disciplinary and low cost OSCE stations with an estimated reliability index of 0.6. After having this experience, we have a critical mass of faculty members trained on blueprinting and station writing and a group of trained assessors, facilitators and role players. Also there is a state of awareness among students on how to proceed in this type of OSCE which renders future implementation more feasible.

3 CFR - Demonstration Grants for the Development, Implementation, and Evaluation of Alternatives to the...

Code of Federal Regulations, 2010 CFR

2010-01-01

..., Implementation, and Evaluation of Alternatives to the Current Medical Liability System Presidential Documents..., Implementation, and Evaluation of Alternatives to the Current Medical Liability System Memorandum for the... report that fear of lawsuits leads them to practice defensive medicine, which may contribute to higher...

Development, Implementation and Evaluation of a Modular Approach to a Pharmacist-Oriented Course in Oncology.

ERIC Educational Resources Information Center

Abate, Marie A.; And Others

1982-01-01

A project to develop, implement, and evaluate a slide/text modular oncology course teaching disease state and pharmacist-oriented information to pharmacy students, with potential adaptation for pharmacist continuing education, is described. Module effectiveness was evaluated using a pretest, posttest design, with group mean comparisons across both…

Development and Implementation of a Web-based Evaluation System for an Internal Medicine Residency Program.

ERIC Educational Resources Information Center

Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.

2001-01-01

Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…

Validating and determining the weight of items used for evaluating clinical governance implementation based on analytic hierarchy process model.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Vafaee Najar, Ali; Meraji, Marziye; Ebrahimipour, Hossein

2015-04-08

The purpose of implementing a system such as Clinical Governance (CG) is to integrate, establish and globalize distinct policies in order to improve quality through increasing professional knowledge and the accountability of healthcare professional toward providing clinical excellence. Since CG is related to change, and change requires money and time, CG implementation has to be focused on priority areas that are in more dire need of change. The purpose of the present study was to validate and determine the significance of items used for evaluating CG implementation. The present study was descriptive-quantitative in method and design. Items used for evaluating CG implementation were first validated by the Delphi method and then compared with one another and ranked based on the Analytical Hierarchy Process (AHP) model. The items that were validated for evaluating CG implementation in Iran include performance evaluation, training and development, personnel motivation, clinical audit, clinical effectiveness, risk management, resource allocation, policies and strategies, external audit, information system management, research and development, CG structure, implementation prerequisites, the management of patients' non-medical needs, complaints and patients' participation in the treatment process. The most important items based on their degree of significance were training and development, performance evaluation, and risk management. The least important items included the management of patients' non-medical needs, patients' participation in the treatment process and research and development. The fundamental requirements of CG implementation included having an effective policy at national level, avoiding perfectionism, using the expertise and potentials of the entire country and the coordination of this model with other models of quality improvement such as accreditation and patient safety. © 2015 by Kerman University of Medical Sciences.

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Classroom Modules for Nanotechnology Undergraduate Education: Development, Implementation and Evaluation

ERIC Educational Resources Information Center

Shabani, R.; Massi, L.; Zhai, L.; Seal, S.; Cho, H. J.

2011-01-01

In order to address the challenges and restrictions given by a traditional classroom lecture environment, the top-down and bottom-up nanotechnology teaching modules were developed, implemented and evaluated. Then based on the hypothesis that instructors could further develop students' interest in this emerging area through the introduction of the…

Evaluating Action-Learning and Professional Networking as a Framework for Educational Leadership Capacity Development

ERIC Educational Resources Information Center

Gunn, Cathy; Lefoe, Geraldine

2013-01-01

This article describes the responsive evaluation component of an educational leadership capacity-building initiative developed at one Australian university and implemented by three others. The project aimed to develop, implement and disseminate an innovative framework to address the national strategic goal to increase the pool of qualified…

Clinical guidelines in the European Union: mapping the regulatory basis, development, quality control, implementation and evaluation across member states.

PubMed

Legido-Quigley, Helena; Panteli, Dimitra; Brusamento, Serena; Knai, Cécile; Saliba, Vanessa; Turk, Eva; Solé, Meritxell; Augustin, Uta; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

Clinical guidelines are advocated to improve the quality of care, especially for chronic diseases. However, the regulatory basis of clinical guidelines, their development, quality control, implementation and use as well as evaluation within countries across the European Union is not systematically known. Using information collected from key informants in each country by means of a structured questionnaire, this mapping exercise illustrates the varied status of guideline production in European Union countries. Most European Union countries have an established national, regional or local clinical guideline programme, and a substantial proportion have developed guidelines on the prevention and management of chronic diseases. Several countries have mechanisms in place to ensure the quality of scientific evidence used for the development of guidelines is high and that the process is consistent and transparent. Others are only now taking an interest in guideline development and are taking the first steps towards establishing ways of implementing them. The majority of countries have no legal basis for the development of guidelines and those that have well established systems mostly implement them on a voluntary basis. The process of guideline development varies in its degrees of decentralisation across countries with many different types of organisations taking on this responsibility. There is general acceptance of the value of the instrument developed by the AGREE collaboration for evaluating the methodological robustness of guidelines. However, the extent to which guidelines are implemented in Europe is unknown, as there is no systematic data collection and, in most countries, no structure to enable it. There are few examples of formal evaluations of the development, quality, implementation and use of guidelines. Our findings call for renewed efforts to respond to the severe lack of standardized guideline terminology and accessibility as well as rigorous studies to evaluate the relationship between different ways to develop guidelines and their methodological quality, between their quality and the actual implementation and usage, and finally between implementation and health outcomes. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Developing and Implementing a Process for the Review of Nonacademic Units.

ERIC Educational Resources Information Center

Brown, Marilyn K.

1989-01-01

A major research university's recently developed process for systematic evaluation of nonacademic units is described, and the steps in its development and implementation are outlined: review of literature on organizational effectiveness; survey of peer institutions; development of guidelines for review; and implementation in several campus units.…

Development, Implementation, and Evaluation of a Professional Skills Development Program: The Case of Concordia University's GradProSkills

ERIC Educational Resources Information Center

Venkatesh, Vivek; Rabah, Jihan; Lamoureux-Scholes, Laurie; Pelczer, Ildiko; Urbaniak, Kathryn; Martin, Frédérica

2014-01-01

The Graduate and Professional Skills (GradProSkills) program is an initiative developed and run by Concordia University's School of Graduate Studies and the university's Office of the Vice-President, Research and Graduate Studies. This paper presents a case study in which we describe the development, implementation, and evaluative components of…

A required course in the development, implementation, and evaluation of clinical pharmacy services.

PubMed

Skomo, Monica L; Kamal, Khalid M; Berdine, Hildegarde J

2008-10-15

To develop, implement, and assess a required pharmacy practice course to prepare pharmacy students to develop, implement, and evaluate clinical pharmacy services using a business plan model. Course content centered around the process of business planning and pharmacoeconomic evaluations. Selected business planning topics included literature evaluation, mission statement development, market evaluation, policy and procedure development, and marketing strategy. Selected pharmacoeconomic topics included cost-minimization analysis, cost-benefit analysis, cost-effectiveness analysis, cost-utility analysis, and health-related quality of life (HRQoL). Assessment methods included objective examinations, student participation, performance on a group project, and peer evaluation. One hundred fifty-three students were enrolled in the course. The mean scores on the objective examinations (100 points per examination) ranged from 82 to 85 points, with 25%-35% of students in the class scoring over 90, and 40%-50% of students scoring from 80 to 89. The mean scores on the group project (200 points) and classroom participation (50 points) were 183.5 and 46.1, respectively. The mean score on the peer evaluation was 30.8, with scores ranging from 27.5 to 31.7. The course provided pharmacy students with the framework necessary to develop and implement evidence-based disease management programs and to assure efficient, cost-effective utilization of pertinent resources in the provision of patient care.

A Required Course in the Development, Implementation, and Evaluation of Clinical Pharmacy Services

PubMed Central

Kamal, Khalid M.; Berdine, Hildegarde J.

2008-01-01

Objective To develop, implement, and assess a required pharmacy practice course to prepare pharmacy students to develop, implement, and evaluate clinical pharmacy services using a business plan model. Design Course content centered around the process of business planning and pharmacoeconomic evaluations. Selected business planning topics included literature evaluation, mission statement development, market evaluation, policy and procedure development, and marketing strategy. Selected pharmacoeconomic topics included cost-minimization analysis, cost-benefit analysis, cost-effectiveness analysis, cost-utility analysis, and health-related quality of life (HRQoL). Assessment methods included objective examinations, student participation, performance on a group project, and peer evaluation. Assessment One hundred fifty-three students were enrolled in the course. The mean scores on the objective examinations (100 points per examination) ranged from 82 to 85 points, with 25%-35% of students in the class scoring over 90, and 40%-50% of students scoring from 80 to 89. The mean scores on the group project (200 points) and classroom participation (50 points) were 183.5 and 46.1, respectively. The mean score on the peer evaluation was 30.8, with scores ranging from 27.5 to 31.7. Conclusion The course provided pharmacy students with the framework necessary to develop and implement evidence-based disease management programs and to assure efficient, cost-effective utilization of pertinent resources in the provision of patient care. PMID:19214263

Implementing Teacher Evaluation: Lattice of Leadership

ERIC Educational Resources Information Center

Derrington, Mary Lynne

2016-01-01

This case study describes how all leaders in one elementary school focused their collective work implementing a dramatically changed, state-mandated teacher-evaluation system. The article describes how multiple leaders created new professional development structures based on staff feedback and adapted exiting professional development structures to…

Development of the evaluation instrument use CIPP on the implementation of project assessment topic optik

NASA Astrophysics Data System (ADS)

Asfaroh, Jati Aurum; Rosana, Dadan; Supahar

2017-08-01

This research aims to develop an evaluation instrument models CIPP valid and reliable as well as determine the feasibility and practicality of an evaluation instrument models CIPP. An evaluation instrument models CIPP to evaluate the implementation of the project assessment topic optik to measure problem-solving skills of junior high school class VIII in the Yogyakarta region. This research is a model of development that uses 4-D. Subject of product trials are students in class VIII SMP N 1 Galur and SMP N 1 Sleman. Data collection techniques in this research using non-test techniques include interviews, questionnaires and observations. Validity in this research was analyzed using V'Aikens. Reliability analyzed using ICC. This research uses 7 raters are derived from two lecturers expert (expert judgment), two practitioners (science teacher) and three colleagues. The results of this research is the evaluation's instrument model of CIPP is used to evaluate the implementation of the implementation of the project assessment instruments. The validity result of evaluation instrument have V'Aikens values between 0.86 to 1, which means a valid and 0.836 reliability values into categories so well that it has been worth used as an evaluation instrument.

Implementation and evaluation of LMS mobile application: scele mobile based on user-centered design

NASA Astrophysics Data System (ADS)

Banimahendra, R. D.; Santoso, H. B.

2018-03-01

The development of mobile technology is now increasing rapidly, demanding all activities including learning should be done on mobile devices. It shows that the implementation of mobile application as a learning medium needs to be done. This study describes the process of developing and evaluating the Moodle-based mobile Learning Management System (LMS) application called Student Centered e-Learning Environment (SCeLE). This study discusses the process of defining features, implementing features into the application, and evaluating the application. We define the features using user research and literature study, then we implement the application with user-centered design basis, at the last phase we evaluated the application using usability testing and system usability score (SUS). The purpose of this study is to determine the extent to which this application can help the users doing their tasks and provide recommendation for the next research and development.

Distributed Simulation as a modelling tool for the development of a simulation-based training programme for cardiovascular specialties.

PubMed

Kelay, Tanika; Chan, Kah Leong; Ako, Emmanuel; Yasin, Mohammad; Costopoulos, Charis; Gold, Matthew; Kneebone, Roger K; Malik, Iqbal S; Bello, Fernando

2017-01-01

Distributed Simulation is the concept of portable, high-fidelity immersive simulation. Here, it is used for the development of a simulation-based training programme for cardiovascular specialities. We present an evidence base for how accessible, portable and self-contained simulated environments can be effectively utilised for the modelling, development and testing of a complex training framework and assessment methodology. Iterative user feedback through mixed-methods evaluation techniques resulted in the implementation of the training programme. Four phases were involved in the development of our immersive simulation-based training programme: ( 1) initial conceptual stage for mapping structural criteria and parameters of the simulation training framework and scenario development ( n  = 16), (2) training facility design using Distributed Simulation , (3) test cases with clinicians ( n  = 8) and collaborative design, where evaluation and user feedback involved a mixed-methods approach featuring (a) quantitative surveys to evaluate the realism and perceived educational relevance of the simulation format and framework for training and (b) qualitative semi-structured interviews to capture detailed feedback including changes and scope for development. Refinements were made iteratively to the simulation framework based on user feedback, resulting in (4) transition towards implementation of the simulation training framework, involving consistent quantitative evaluation techniques for clinicians ( n  = 62). For comparative purposes, clinicians' initial quantitative mean evaluation scores for realism of the simulation training framework, realism of the training facility and relevance for training ( n  = 8) are presented longitudinally, alongside feedback throughout the development stages from concept to delivery, including the implementation stage ( n  = 62). Initially, mean evaluation scores fluctuated from low to average, rising incrementally. This corresponded with the qualitative component, which augmented the quantitative findings; trainees' user feedback was used to perform iterative refinements to the simulation design and components (collaborative design), resulting in higher mean evaluation scores leading up to the implementation phase. Through application of innovative Distributed Simulation techniques, collaborative design, and consistent evaluation techniques from conceptual, development, and implementation stages, fully immersive simulation techniques for cardiovascular specialities are achievable and have the potential to be implemented more broadly.

Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial.

PubMed

Jabbour, Mona; Curran, Janet; Scott, Shannon D; Guttman, Astrid; Rotter, Thomas; Ducharme, Francine M; Lougheed, M Diane; McNaughton-Filion, M Louise; Newton, Amanda; Shafir, Mark; Paprica, Alison; Klassen, Terry; Taljaard, Monica; Grimshaw, Jeremy; Johnson, David W

2013-05-22

The clinical pathway is a tool that operationalizes best evidence recommendations and clinical practice guidelines in an accessible format for 'point of care' management by multidisciplinary health teams in hospital settings. While high-quality, expert-developed clinical pathways have many potential benefits, their impact has been limited by variable implementation strategies and suboptimal research designs. Best strategies for implementing pathways into hospital settings remain unknown. This study will seek to develop and comprehensively evaluate best strategies for effective local implementation of externally developed expert clinical pathways. We will develop a theory-based and knowledge user-informed intervention strategy to implement two pediatric clinical pathways: asthma and gastroenteritis. Using a balanced incomplete block design, we will randomize 16 community emergency departments to receive the intervention for one clinical pathway and serve as control for the alternate clinical pathway, thus conducting two cluster randomized controlled trials to evaluate this implementation intervention. A minimization procedure will be used to randomize sites. Intervention sites will receive a tailored strategy to support full clinical pathway implementation. We will evaluate implementation strategy effectiveness through measurement of relevant process and clinical outcomes. The primary process outcome will be the presence of an appropriately completed clinical pathway on the chart for relevant patients. Primary clinical outcomes for each clinical pathway include the following: Asthma--the proportion of asthmatic patients treated appropriately with corticosteroids in the emergency department and at discharge; and Gastroenteritis--the proportion of relevant patients appropriately treated with oral rehydration therapy. Data sources include chart audits, administrative databases, environmental scans, and qualitative interviews. We will also conduct an overall process evaluation to assess the implementation strategy and an economic analysis to evaluate implementation costs and benefits. This study will contribute to the body of evidence supporting effective strategies for clinical pathway implementation, and ultimately reducing the research to practice gaps by operationalizing best evidence care recommendations through effective use of clinical pathways. ClinicalTrials.gov: NCT01815710.

Development and Evaluation of a Parent-Engagement Curriculum to Connect Latino Families and Schools

ERIC Educational Resources Information Center

Hurtado, Ghaffar A.; Olson, Kathleen A.; de Davila, Silvia Alvarez; Campoverde, Victoria

2018-01-01

Parent-school engagement is a contributor to student achievement, but few relevant programs exist for immigrant Latino families. This article describes the design, pilot implementation, and evaluation of a parent-engagement Extension program, developed and implemented in Spanish. The purpose of the program is to help parents develop and/or…

The researchers' role in knowledge translation: a realist evaluation of the development and implementation of diagnostic pathways for cancer in two United Kingdom localities.

PubMed

Banks, Jon; Wye, Lesley; Hall, Nicola; Rooney, James; Walter, Fiona M; Hamilton, Willie; Gjini, Ardiana; Rubin, Greg

2017-12-13

In examining an initiative to develop and implement new cancer diagnostic pathways in two English localities, this paper evaluates 'what works' and examines the role of researchers in facilitating knowledge translation amongst teams of local clinicians and policy-makers. Using realist evaluation with a mixed methods case study approach, we conducted documentary analysis of meeting minutes and pathway iterations to map pathway development. We interviewed 14 participants to identify the contexts, mechanisms and outcomes (CMOs) that led to successful pathway development and implementation. Interviews were analysed thematically and four CMO configurations were developed. One site produced three fully implemented pathways, while the other produced two that were partly implemented. In explaining the differences, we found that a respected, independent, well-connected leader modelling partnership working and who facilitates a local, stable group that agree about the legitimacy of the data and project (context) can empower local teams to become sufficiently autonomous (mechanism) to develop and implement research-based pathways (outcome). Although both teams designed relevant, research-based cancer pathways, in the site where the pathways were successfully implemented the research team merely assisted, while, in the other, the research team drove the initiative. Based on our study findings, local stakeholders can apply local and research knowledge to develop and implement research-based pathways. However, success will depend on how academics empower local teams to create autonomy. Crucially, after re-packaging and translating research for local circumstances, identifying fertile environments with the right elements for implementation and developing collaborative relationships with local leaders, academics must step back.

Implementing and evaluating early intervention for children with autism: Where are the gaps and what should we do?

PubMed

Vivanti, Giacomo; Kasari, Connie; Green, Jonathan; Mandell, David; Maye, Melissa; Hudry, Kristelle

2018-01-01

Despite recent advances, the evidence base supporting early intervention for young children with autism spectrum disorder (ASD) remains relatively sparse. The International Society for Autism Research (INSAR) recently sponsored a Special Interest Group (SIG) on Implementing and Evaluating Community-Based Early Intervention. Across three meetings, in 2015, 2016, and 2017, conveners of this SIG engaged >200 members to identify knowledge gaps and research priorities for moving the field forward. Here, we summarize the perspectives that emerged from group discussion at the SIG meetings as represented by scholars working actively in the field. Despite encouraging progress, critical gaps and research priorities were identified across all the stages of intervention development and testing from conceptualization to community implementation. Key issues include the need for (a) formal theories to guide early intervention development, evaluation, and implementation; and alignment of intervention goals with scientific knowledge and societal changes that have occurred in the decades since interventions were originally developed; (b) increased focus on feasibility of treatment procedures and alignment with stakeholder values during pilot evaluations; (c) use of research designs that allow for comparisons of different interventions and formats, analyses of active ingredients of treatment, and identification of moderators and mediators of outcome; (d) use of community-partnered participatory research to guide adaptation of intervention models to community settings; (e) inclusion of constructs related to implementation processes and outcomes in treatment trials and; (f) an iterative approach to the progression of knowledge from intervention development to implementation. Autism Res 2018, 11: 16-23. © 2017 International Society for Autism Research, Wiley Periodicals, Inc. In this article, we summarize the themes discussed at the INSAR Special Interest Group (SIG) on Implementing and Evaluating Community-Based Early Intervention. Priorities for moving the field forward identified in the SIG included the need for (a) formal theories to guide the development and evaluation of interventions, (b) pilot evaluations that investigate feasibility and acceptability of interventions, (c) methodologies that allow us to determine for whom different interventions bring most benefit and why this is so, (d) strategies to include community members and other stakeholders in the process of developing and evaluating interventions, and (e) understanding of factors that make interventions more likely to be adopted and successfully implemented in the real world. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

Making the Connection--Factors Influencing Implementation of Evidence Supported and Non-Evaluated Lifestyle Interventions in Healthcare: A Multiple Case Study

ERIC Educational Resources Information Center

van de Glind, Irene; Heinen, Maud; Geense, Wytske; Mesters, Ilse; Wensing, Michel; van Achterberg, Theo

2015-01-01

Many implementation barriers relate to lifestyle interventions (LIs) being developed by scientists. Exploring whether implementation of non-evaluated LIs is less complicated, might offer insight how to improve the use of effective interventions. This study aimed to identify influencing factors for implementation and compare factors between…

Ottawa Model of Implementation Leadership and Implementation Leadership Scale: mapping concepts for developing and evaluating theory-based leadership interventions.

PubMed

Gifford, Wendy; Graham, Ian D; Ehrhart, Mark G; Davies, Barbara L; Aarons, Gregory A

2017-01-01

Leadership in health care is instrumental to creating a supportive organizational environment and positive staff attitudes for implementing evidence-based practices to improve patient care and outcomes. The purpose of this study is to demonstrate the alignment of the Ottawa Model of Implementation Leadership (O-MILe), a theoretical model for developing implementation leadership, with the Implementation Leadership Scale (ILS), an empirically validated tool for measuring implementation leadership. A secondary objective is to describe the methodological process for aligning concepts of a theoretical model with an independently established measurement tool for evaluating theory-based interventions. Modified template analysis was conducted to deductively map items of the ILS onto concepts of the O-MILe. An iterative process was used in which the model and scale developers (n=5) appraised the relevance, conceptual clarity, and fit of each ILS items with the O-MILe concepts through individual feedback and group discussions until consensus was reached. All 12 items of the ILS correspond to at least one O-MILe concept, demonstrating compatibility of the ILS as a measurement tool for the O-MILe theoretical constructs. The O-MILe provides a theoretical basis for developing implementation leadership, and the ILS is a compatible tool for measuring leadership based on the O-MILe. Used together, the O-MILe and ILS provide an evidence- and theory-based approach for developing and measuring leadership for implementing evidence-based practices in health care. Template analysis offers a convenient approach for determining the compatibility of independently developed evaluation tools to test theoretical models.

Ottawa Model of Implementation Leadership and Implementation Leadership Scale: mapping concepts for developing and evaluating theory-based leadership interventions

PubMed Central

Gifford, Wendy; Graham, Ian D; Ehrhart, Mark G; Davies, Barbara L; Aarons, Gregory A

2017-01-01

Purpose Leadership in health care is instrumental to creating a supportive organizational environment and positive staff attitudes for implementing evidence-based practices to improve patient care and outcomes. The purpose of this study is to demonstrate the alignment of the Ottawa Model of Implementation Leadership (O-MILe), a theoretical model for developing implementation leadership, with the Implementation Leadership Scale (ILS), an empirically validated tool for measuring implementation leadership. A secondary objective is to describe the methodological process for aligning concepts of a theoretical model with an independently established measurement tool for evaluating theory-based interventions. Methods Modified template analysis was conducted to deductively map items of the ILS onto concepts of the O-MILe. An iterative process was used in which the model and scale developers (n=5) appraised the relevance, conceptual clarity, and fit of each ILS items with the O-MILe concepts through individual feedback and group discussions until consensus was reached. Results All 12 items of the ILS correspond to at least one O-MILe concept, demonstrating compatibility of the ILS as a measurement tool for the O-MILe theoretical constructs. Conclusion The O-MILe provides a theoretical basis for developing implementation leadership, and the ILS is a compatible tool for measuring leadership based on the O-MILe. Used together, the O-MILe and ILS provide an evidence- and theory-based approach for developing and measuring leadership for implementing evidence-based practices in health care. Template analysis offers a convenient approach for determining the compatibility of independently developed evaluation tools to test theoretical models. PMID:29355212

Cochrane Qualitative and Implementation Methods Group guidance series-paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses.

PubMed

Flemming, Kate; Booth, Andrew; Hannes, Karin; Cargo, Margaret; Noyes, Jane

2018-05-01

To outline contemporary and novel developments for the presentation and reporting of syntheses of qualitative, implementation, and process evaluation evidence and provide recommendations for the use of reporting guidelines. An overview of reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses drawing on current international literature and the collective expert knowledge of the Cochrane Qualitative and Implementation Methods Group. Several reporting guidelines exist that can be used or adapted to report syntheses of qualitative, implementation, and process evaluation evidence. Methods to develop individual guidance varied. The use of a relevant reporting guideline can enhance the transparency, consistency, and quality of reporting. Guidelines that exist are generic, method specific, and for particular aspects of the reviewing process, searching. Caution is expressed over the potential for reporting guidelines to produce a mechanistic approach moving the focus away from the content and toward the procedural aspects of the review. The use of a reporting guideline is recommended and a five-step decision flowchart to guide the choice of reporting guideline is provided. Gaps remain in method-specific reporting guidelines such as mixed-study, implementation, and process evaluation evidence syntheses. Copyright © 2017 Elsevier Inc. All rights reserved.

Who needs inpatient detox? Development and implementation of a hospitalist protocol for the evaluation of patients for alcohol detoxification.

PubMed

Stephens, John R; Liles, E Allen; Dancel, Ria; Gilchrist, Michael; Kirsch, Jonathan; DeWalt, Darren A

2014-04-01

Clinicians caring for patients seeking alcohol detoxification face many challenges, including lack of evidence-based guidelines for treatment and high recidivism rates. To develop a standardized protocol for determining which alcohol dependent patients seeking detoxification need inpatient versus outpatient treatment, and to study the protocol's implementation. Review of best evidence by ad hoc task force and subsequent creation of standardized protocol. Prospective observational evaluation of initial protocol implementation. Patients presenting for alcohol detoxification. Development and implementation of a protocol for evaluation and treatment of patients requesting alcohol detoxification. Number of admissions per month with primary alcohol related diagnosis (DRG), 30-day readmission rate, and length of stay, all measured before and after protocol implementation. We identified one randomized clinical trial and three cohort studies to inform the choice of inpatient versus outpatient detoxification, along with one prior protocol in this population, and combined that data with clinical experience to create an institutional protocol. After implementation, the average number of alcohol related admissions was 15.9 per month, compared with 18.9 per month before implementation (p = 0.037). There was no difference in readmission rate or length of stay. Creation and utilization of a protocol led to standardization of care for patients requesting detoxification from alcohol. Initial evaluation of protocol implementation showed a decrease in number of admissions.

[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].

PubMed

Nagahama, Elizabeth Eriko Ishida

2009-01-01

The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.

Evaluating Community College Personnel: A Research Report.

ERIC Educational Resources Information Center

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

Web Services Security - Implementation and Evaluation Issues

NASA Astrophysics Data System (ADS)

Pimenidis, Elias; Georgiadis, Christos K.; Bako, Peter; Zorkadis, Vassilis

Web services development is a key theme in the utilization the commercial exploitation of the semantic web. Paramount to the development and offering of such services is the issue of security features and they way these are applied in instituting trust amongst participants and recipients of the service. Implementing such security features is a major challenge to developers as they need to balance these with performance and interoperability requirements. Being able to evaluate the level of security offered is a desirable feature for any prospective participant. The authors attempt to address the issues of security requirements and evaluation criteria, while they discuss the challenges of security implementation through a simple web service application case.

An Implementation Strategy to Improve the Guideline Adherence of Insurance Physicians: A Process Evaluation Alongside an Experiment in a Controlled Setting

ERIC Educational Resources Information Center

Zwerver, Feico; Bonefaas-Groenewoud, Karin; Schellart, Antonius J. M.; Anema, Johannes R.; van der Beek, Allard J.

2013-01-01

Background: We developed an implementation strategy for the insurance medicine guidelines for depression, which we implemented via a post-graduate course for insurance physicians (IPs). In this study we evaluate the physicians' experiences of the implementation strategy by measuring the following aspects: recruitment and reach, dose delivered and…

EVALUATION OF THE IMPLEMENTATION OF OPERATIONS AND MAINTENANCE PROGRAMS IN NEW JERSEY SCHOOLS

EPA Science Inventory

The Asbestos Hazard Emergency Response Act (AHERA) required all schools to develop and implement an asbestos management plan (AMP). The key component of the AMP is the operations and maintenance (O&M) program. A study was conducted to evaluate the implementation of O&M programs a...

Measuring quality of care: considering conceptual approaches to quality indicator development and evaluation.

PubMed

Stelfox, Henry T; Straus, Sharon E

2013-12-01

In this article, we describe one approach for developing and evaluating quality indicators. We focus on describing different conceptual approaches to quality indicator development, review one approach for developing quality indicators, outline how to evaluate quality indicators once developed, and discuss quality indicator maintenance. The key steps for developing quality indicators include specifying a clear goal for the indicators; using methodologies to incorporate evidence, expertise, and patient perspectives; and considering contextual factors and logistics of implementation. The Strategic Framework Board and the National Quality Measure Clearinghouse have developed criteria for evaluating quality indicators that complement traditional psychometric evaluations. Optimal strategies for quality indicator maintenance and dissemination have not been determined, but experiences with clinical guideline maintenance may be informative. For quality indicators to effectively guide quality improvement efforts, they must be developed, evaluated, maintained, and implemented using rigorous evidence-informed practices. Copyright © 2013 Elsevier Inc. All rights reserved.

The Design, Implementation, and Formative Evaluation of a Classroom Aide Professional Development Training Program

ERIC Educational Resources Information Center

Dulfer, Katherine J.

2013-01-01

This dissertation focused on the process of designing, implementing, and formatively evaluating an eight week Classroom Aide Professional Development Training Program (CAPD-TP) on behavior management and academic instruction within the context of a New Jersey state approved private special education school for students with behavioral and/or…

The Development, Implementation, and Evaluation of a Problem Solving Heuristic

ERIC Educational Resources Information Center

Lorenzo, Mercedes

2005-01-01

Problem-solving is one of the main goals in science teaching and is something many students find difficult. This research reports on the development, implementation and evaluation of a problem-solving heuristic. This heuristic intends to help students to understand the steps involved in problem solving (metacognitive tool), and to provide them…

Improving the adaptability of WHO evidence-informed guidelines for nutrition actions: results of a mixed methods evaluation.

PubMed

Dedios, Maria Cecilia; Esperato, Alexo; De-Regil, Luz Maria; Peña-Rosas, Juan Pablo; Norris, Susan L

2017-03-21

Over the past decade, the World Health Organization (WHO) has implemented a standardized, evidence-informed guideline development process to assure technically sound and policy-relevant guidelines. This study is an independent evaluation of the adaptability of the guidelines produced by the Evidence and Programme Guidance unit, at the Department of Nutrition for Health and Development (NHD). The study systematizes the lessons learned by the NHD group at WHO. We used a mixed methods approach to determine the adaptability of the nutrition guidelines. Adaptability was defined as having two components; methodological quality and implementability of guidelines. Additionally, we gathered recommendations to improve future guideline development in nutrition actions for health and development. Data sources for this evaluation were official documentation and feedback (both qualitative and quantitative) from key stakeholders involved in the development of nutrition guidelines. The qualitative data was collected through a desk review and two waves of semi-structured interviews (n = 12) and was analyzed through axial coding. Guideline adaptability was assessed quantitatively using two standardized instruments completed by key stakeholders. The Appraisal Guideline for Research and Evaluation questionnaire, version II was used to assess guideline quality (n = 6), while implementability was assessed with the electronic version of the GuideLine Implementability Appraisal (n = 7). The nutrition evidence-informed guideline development process has several strengths, among them are the appropriate management of conflicts of interest of guideline developers and the systematic use of high-quality evidence to inform the recommendations. These features contribute to increase the methodological quality of the guidelines. The key areas for improvement are the limited implementability of the recommendations, the lack of explicit and precise implementation advice in the guidelines and challenges related to collaborative work within interdisciplinary groups. Overall, our study found that the nutrition evidence-informed guidelines are of good methodological quality but that the implementability requires improvement. The recommendations to improve guideline adaptability address the guideline content, the dynamics shaping interdisciplinary work, and actions for implementation feasibility. As WHO relies heavily on a standardized procedure to develop guidelines, the lessons learned may be applicable to guideline development across the organization and to other groups developing guidelines.

Realistic nurse-led policy implementation, optimization and evaluation: novel methodological exemplar.

PubMed

Noyes, Jane; Lewis, Mary; Bennett, Virginia; Widdas, David; Brombley, Karen

2014-01-01

To report the first large-scale realistic nurse-led implementation, optimization and evaluation of a complex children's continuing-care policy. Health policies are increasingly complex, involve multiple Government departments and frequently fail to translate into better patient outcomes. Realist methods have not yet been adapted for policy implementation. Research methodology - Evaluation using theory-based realist methods for policy implementation. An expert group developed the policy and supporting tools. Implementation and evaluation design integrated diffusion of innovation theory with multiple case study and adapted realist principles. Practitioners in 12 English sites worked with Consultant Nurse implementers to manipulate the programme theory and logic of new decision-support tools and care pathway to optimize local implementation. Methods included key-stakeholder interviews, developing practical diffusion of innovation processes using key-opinion leaders and active facilitation strategies and a mini-community of practice. New and existing processes and outcomes were compared for 137 children during 2007-2008. Realist principles were successfully adapted to a shorter policy implementation and evaluation time frame. Important new implementation success factors included facilitated implementation that enabled 'real-time' manipulation of programme logic and local context to best-fit evolving theories of what worked; using local experiential opinion to change supporting tools to more realistically align with local context and what worked; and having sufficient existing local infrastructure to support implementation. Ten mechanisms explained implementation success and differences in outcomes between new and existing processes. Realistic policy implementation methods have advantages over top-down approaches, especially where clinical expertise is low and unlikely to diffuse innovations 'naturally' without facilitated implementation and local optimization. © 2013 John Wiley & Sons Ltd.

Tai Chi: moving for better balance -- development of a community-based falls prevention program.

PubMed

Li, Fuzhong; Harmer, Peter; Mack, Karin A; Sleet, David; Fisher, K John; Kohn, Melvin A; Millet, Lisa M; Xu, Junheng; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-05-01

This study was designed to develop an evidence- and community based falls prevention program -- Tai Chi: Moving for Better Balance. A mixed qualitative and quantitative approach was used to develop a package of materials for program implementation and evaluation. The developmental work was conducted in 2 communities in the Pacific Northwest. Participants included a panel of experts, senior service program managers or activity coordinators, and older adults. Outcome measures involved program feasibility and satisfaction. Through an iterative process, a program package was developed. The package contained an implementation plan and class training materials (ie, instructor's manual, videotape, and user's guidebook). Pilot testing of program materials showed that the content was appropriate for the targeted users (community-living older adults) and providers (local senior service organizations). A feasibility survey indicated interest and support from users and providers for program implementation. A 2-week pilot evaluation showed that the program implementation was feasible and evidenced good class attendance, high participant satisfaction, and interest in continuing Tai Chi. The package of materials developed in this study provides a solid foundation for larger scale implementation and evaluation of the program in community settings.

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial

PubMed Central

2013-01-01

Background The clinical pathway is a tool that operationalizes best evidence recommendations and clinical practice guidelines in an accessible format for ‘point of care’ management by multidisciplinary health teams in hospital settings. While high-quality, expert-developed clinical pathways have many potential benefits, their impact has been limited by variable implementation strategies and suboptimal research designs. Best strategies for implementing pathways into hospital settings remain unknown. This study will seek to develop and comprehensively evaluate best strategies for effective local implementation of externally developed expert clinical pathways. Design/methods We will develop a theory-based and knowledge user-informed intervention strategy to implement two pediatric clinical pathways: asthma and gastroenteritis. Using a balanced incomplete block design, we will randomize 16 community emergency departments to receive the intervention for one clinical pathway and serve as control for the alternate clinical pathway, thus conducting two cluster randomized controlled trials to evaluate this implementation intervention. A minimization procedure will be used to randomize sites. Intervention sites will receive a tailored strategy to support full clinical pathway implementation. We will evaluate implementation strategy effectiveness through measurement of relevant process and clinical outcomes. The primary process outcome will be the presence of an appropriately completed clinical pathway on the chart for relevant patients. Primary clinical outcomes for each clinical pathway include the following: Asthma—the proportion of asthmatic patients treated appropriately with corticosteroids in the emergency department and at discharge; and Gastroenteritis—the proportion of relevant patients appropriately treated with oral rehydration therapy. Data sources include chart audits, administrative databases, environmental scans, and qualitative interviews. We will also conduct an overall process evaluation to assess the implementation strategy and an economic analysis to evaluate implementation costs and benefits. Discussion This study will contribute to the body of evidence supporting effective strategies for clinical pathway implementation, and ultimately reducing the research to practice gaps by operationalizing best evidence care recommendations through effective use of clinical pathways. Trial registration ClinicalTrials.gov: NCT01815710 PMID:23692634

Developing, implementing, and evaluating a condom promotion program targeting sexually active adolescents.

PubMed

Alstead, M; Campsmith, M; Halley, C S; Hartfield, K; Goldbaum, G; Wood, R W

1999-12-01

This article describes the development, implementation, and evaluation of the Condom Campaign, a 1995 HIV prevention program promoting condom use among sexually active adolescents in three King County, Washington, urban communities. This program employed three main strategies: (a) mobilizing all levels of the target communities to support and guide program development and implementation; (b) creating and implementing a mass media campaign targeting sexually active teenagers that promoted correct condom use and favorable attitudes toward condoms; and (c) recruiting public agencies, community organizations, and businesses to distribute condoms from bins and vending machines. We evaluated the program through a series of cross-sectional interviews conducted in the three communities chosen for their elevated levels of adolescent sexual risk behavior. Overall, 73% of target youth reported exposure to the Condom Campaign; exposure did not differ by age, gender, race, or level of sexual experience. Levels of sexual activity remained stable throughout the media campaign.

[Psychosocial Risk Evaluation in the Workplace: Expert-based Development of a Checklist for Occupational Physicians].

PubMed

Weigl, M; Müller, A; Angerer, P; Petru, R

2016-03-01

The implementation of psychosocial risk assessment at the workplace often fails in practice. One reason is the lack of competence of those who are in charge of the process. We present a checklist for the effective implementation of psychosocial risk assessment at workplace. This tool shall support occupational physicians in the preparation, planning and implementation of a psychosocial risks assessment process. Based on a stepwise development and validation process, specific steps and factors for the successful implementation were identified qualitatively with 15 occupational physicians and experts. This was conducted in a 2-stage Delphi study. In the following, the identified steps and factors were transferred into a checklist. Subsequently, the checklist was evaluated in a focus group of occupational physicians (user evaluation). Thereafter, the contents were subjected to an expert evaluation. Our checklist for the effective implementation of the process of psychosocial risk management in the workplace aims to strengthen the competence of occupational physicians, especially in the implementation of risk assessments in small and medium-sized enterprises (SMEs). © Georg Thieme Verlag KG Stuttgart · New York.

KSC management training system project

NASA Technical Reports Server (NTRS)

Sepulveda, Jose A.

1993-01-01

The stated objectives for the summer of 1993 were: to review the Individual Development Plan Surveys for 1994 in order to automate the analysis of the Needs Assessment effort; and to develop and implement evaluation methodologies to perform ongoing program-wide course-to-course assessment. This includes the following: to propose a methodology to develop and implement objective, performance-based assessment instruments for each training effort; to mechanize course evaluation forms and develop software to facilitate the data gathering, analysis, and reporting processes; and to implement the methodology, forms, and software in at lease one training course or seminar selected among those normally offered in the summer at KSC. Section two of this report addresses the work done in regard to the Individual Development Plan Surveys for 1994. Section three presents the methodology proposed to develop and implement objective, performance-based assessment instruments for each training course offered at KSC.

Planning, Implementation, and Evaluation of AIDS Education Programs for Dentists.

ERIC Educational Resources Information Center

Gerbert, Barbara; And Others

1991-01-01

An office-based continuing education program on acquired immune deficiency syndrome (AIDS) for dentists is described, including needs assessment, model development, local piloting, national implementation with 119 dentists, and evaluation phases. Program evaluation indicated an improvement in risk perception, knowledge, and practice resulted, but…

A Process Evaluation of Project Developmental Continuity. Interim Report IV, Volume 2: Development of the Implementation and Cost Studies.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This interim report describes the development of program implementation and cost studies for Year II of the process evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Specific areas focused…

Design, Development, Implementation, and Evaluation of the Computer Aided Interactive Testing System (CAITS). Focus on the Trained Person.

ERIC Educational Resources Information Center

1983

This report describes the design, development, implementation, and evaluation of the Computer Aided Interactive Testing System (CAITS) and addresses the applicability of the system in the Naval Education and Training Command. In addition to an introduction (section one), the report contains four sections and three appendices. Section two describes…

Evaluating an Online E-Module for Portuguese Primary Teachers: Trainees' Perceptions

ERIC Educational Resources Information Center

Pombo, L.; Smith, M.; Abelha, M.; Caixinha, H.; Costa, N.

2012-01-01

The work reported in this article is part of a wider project that aims to develop and implement a web-based, pan-European, in-service professional development platform for teachers to enhance their role in promoting education through science. This article aims to evaluate the implementation of the e-module on Assessment of Children's Learning in…

Development, Implementation, and Evaluation of Leadership/Management Training Within Army Battalions: Volume I: Summary of Findings.

ERIC Educational Resources Information Center

Fry, John P.; Cliborn, Robert E.

The report describes the development and evaluation of an in-unit, leadership/management training program (based on experimental training methodology for providing Army leaders with behavioral skills and techniques) implemented within three battalion-sized combat units at Fort Bliss, Texas, in 1974. The program was organized around workshops…

A Preliminary Evaluation of Instructional Effectiveness of Online Training Implemented at a Government Agency in Thailand

ERIC Educational Resources Information Center

Supanakorn-Davila, Supawan; Bolliger, Doris U.

2012-01-01

Online training has become popular in the professional development of government employees in Thailand. One large government agency developed an online program to provide training to its employees across the country using two systems: an Internet and Intranet-based system. With the new program implemented, the evaluation of the instructional…

Eccomi Pronto: Implementation of a Socio-Emotional Development Curriculum in a South Korean Elementary School

ERIC Educational Resources Information Center

Kim, Donghyun; Hyun, Jung H.; Lee, Jihee; Bertolani, Jessica; Mortari, Luigina; Carey, John

2015-01-01

"Eccomi Pronto" (EP), an elementary school socio-emotional learning curriculum that was originally developed and evaluated in Italy was translated in Korean and implemented and evaluated in 4th grade classrooms of a primary school in South Korea. Qualitative data from teachers indicated that EP improved the self-reflection and…

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences.

PubMed

Kraft, Matthew A; Gilmour, Allison

2016-12-01

New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. We found that the evaluation reforms provided a common framework and language that helped facilitate principals' feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development.

Activating a Teaching Philosophy in Social Work Education: Articulation, Implementation, and Evaluation

ERIC Educational Resources Information Center

Owens, Larry W.; Miller, J. Jay; Grise-Owens, Erlene

2014-01-01

This article describes how to develop a comprehensive teaching philosophy from articulation through implementation to evaluation. Using literature and teaching-learning experiences, we discuss pragmatic steps for using a teaching philosophy to inform, engage, and evaluate teaching-learning. We promote an integrated teaching philosophy to ensure…

School Safety Project: Product Evaluation, 1990-1991.

ERIC Educational Resources Information Center

Saginaw Public Schools, MI. Dept. of Evaluation Services.

A districtwide school safety project implemented in Saginaw, Michigan, in 1990-91, the third year of its operation, is evaluated in this report. The project is evaluated on the basis of the following objectives: employment and training of home-school liaison officers; establishment of an advisory council; development and implementation of…

Implementation of clinical decision rules in the emergency department.

PubMed

Stiell, Ian G; Bennett, Carol

2007-11-01

Clinical decision rules (CDRs) are tools designed to help clinicians make bedside diagnostic and therapeutic decisions. The development of a CDR involves three stages: derivation, validation, and implementation. Several criteria need to be considered when designing and evaluating the results of an implementation trial. In this article, the authors review the results of implementation studies evaluating the effect of four CDRs: the Ottawa Ankle Rules, the Ottawa Knee Rule, the Canadian C-Spine Rule, and the Canadian CT Head Rule. Four implementation studies demonstrated that the implementation of CDRs in the emergency department (ED) safely reduced the use of radiography for ankle, knee, and cervical spine injuries. However, a recent trial failed to demonstrate an impact on computed tomography imaging rates. Well-developed and validated CDRs can be successfully implemented into practice, efficiently standardizing ED care. However, further research is needed to identify barriers to implementation in order to achieve improved uptake in the ED.

A "Common Factors" Approach to Developing Culturally Tailored HIV Prevention Interventions

ERIC Educational Resources Information Center

Owczarzak, Jill; Phillips, Sarah D.; Filippova, Olga; Alpatova, Polina; Mazhnaya, Alyona; Zub, Tatyana; Aleksanyan, Ruzanna

2016-01-01

The current dominant model of HIV prevention intervention dissemination involves packaging interventions developed in one context, training providers to implement that specific intervention, and evaluating the extent to which providers implement it with fidelity. Research shows that providers rarely implement these programs with fidelity due to…

Using health promotion guidelines for persons with disabilities to develop and evaluate a physical activity program for individuals with multiple sclerosis: A feasibility study.

PubMed

Dixon-Ibarra, Alicia; Nery-Hurwit, Mara; Driver, Simon; MacDonald, Megan

2017-04-01

The Health Education for Persons with Multiple Sclerosis (HEMS) program was developed in response to the need for interventions aimed at increasing physical activity for individuals with Multiple Sclerosis (MS). It was developed and evaluated using Drum and colleagues (2009) guidelines for implementing health promotion programs for individuals with disabilities. The purpose of this feasibility study is to describe the development, implementation, and evaluation of the HEMS program. Thirteen individuals with MS completed the 8-week health education program. A mixed method approach for evaluation was implemented (i.e., survey and focus groups). Process and resource feasibility demonstrated that over half of the participants attended at least 80% of the weekly sessions. Focus group data provided valuable feedback for future iterations of the program including critiques on the delivery, content, and group support provided. Outcome evaluation showed increases in self-efficacy (survey), improvements in theoretical constructs (focus groups), and increased physical activity (focus groups). Results show that health promotion programs for persons with MS can improve physical activity and related constructs. Next steps will be to revise, implement, and reevaluate the HEMS program in a larger randomized control trial. Published by Elsevier Ltd.

Development, Implementation, and Evaluation of Leadership/Management Training within Army Battalions. Volume 2. Technical Appendices

DTIC Science & Technology

1975-06-01

8217- r AD-A012 774 DEVELOPMENT, IMPLEMENTATION, AND EVALUATION OF LEADERSHIP / MANAGEMENT TRAINING WITHIN ARMY BATTALIONS. VOLUME 2. TECHNICAL...and Identify by block numbera) This report describes the development and eva.L.uuLion of an experiential-based, leadership / management trai iing...organizational intervention and change similar to that presented in Figure H-1. According to this approach, training in more effective leadership / management skills

Implementation of the Master Plan for Statewide Professional Staff Development for 2012-2013: An Evaluation Study

ERIC Educational Resources Information Center

Hammer, Patricia Cahape

2014-01-01

In this evaluation, as in previous years, four main aspects of the implementation of the West Virginia Board of Education's Master Plan for Statewide Professional Development were examined: (a) basic information reported by providers about the size and scope of the effort, including attendance, and adherence to the newly adopted standards for…

The Boston Middle School-Corner Store Initiative: Development, Implementation, and Initial Evaluation of a Program Designed to Improve Adolescents' Beverage-Purchasing Behaviors

ERIC Educational Resources Information Center

Hoffman, Jessica A.; Morris, Vivien; Cook, John

2009-01-01

The Boston Middle School Corner Store Initiative (CSI) brought together schools, businesses, and community partners to develop, implement, and evaluate a multicomponent pilot program designed to promote healthier beverage purchasing at corner stores among 3,500 middle school students living in Boston, Massachusetts. Healthy drinks were defined for…

The First Generation of the Implementation of Teachers Teaching Teachers, An Indiana Staff Development Model.

ERIC Educational Resources Information Center

Swan, Edward T.; And Others

This study evaluated the success of Teachers Teaching Teachers, an Indiana staff development model in its first implementation. The project consisted of a cadre of teachers from one school system who trained teachers from four other school systems. Participants were evaluated on nine Likert-type pre- and post-measures at each of the four training…

Development, Implementation, and Evaluation of a Comprehensive Course on Suicide in a Master's of Social Work Program

ERIC Educational Resources Information Center

Almeida, Joanna; O'Brien, Kimberly H. M.; Gironda, Christina M.; Gross, Emma B.

2017-01-01

Most master of social work (MSW) programs provide minimal education or training on suicide prevention, intervention, and postvention despite that the majority of social workers encounter suicidal clients during their professional careers. This study describes the development, implementation, and evaluation of a course on suicide in an MSW program.…

Implementation of a Project-Based Concept Mapping Developmental Programme to Facilitate Children's Experiential Reasoning and Comprehension of Relations

ERIC Educational Resources Information Center

Habok, Anita

2015-01-01

School readiness evaluations are becoming increasingly popular, and their implementation has become compulsory in an increasing number of kindergartens and schools in Hungary. In recent years, Diagnostic System for Evaluating Development (DIFER), developed by Nagy et al. has been used extensively for the diagnostic study of four- to eight-year-old…

Implementation and Evaluation of Weather Responsive Traffic Estimation and Prediction System

DOT National Transportation Integrated Search

2012-06-01

The objective of the project is to develop a framework and procedures for implementing and evaluating weather-responsive traffic management (WRTM) strategies using Traffic Estimation and Prediction System (TrEPS) methodologies. In a previous FHWA-fun...

Web Based GIS System For Monitoring the Implementation of County Integrated Development Plan a Case Study of Nandi County, Kenya.

NASA Astrophysics Data System (ADS)

Kurui, P. K.; Mutua, F.

2016-12-01

The paper seek to propose a conceptual framework of a way of monitoring and evaluating the implementation of the projects listed in the county integrated development plan by applying the use of the geospatial technologies with the focus being developing a web based GIS system in which the public can be able to track and monitor the progress of implementation of the projects in various parts of the county , although the guidelines developed by the ministry of devolution provides for the inclusion of the implementation monitoring and evaluation framework specifying projects to be implemented during the plan period and specification of veriable indicators it does not provide mechanisms for public participation during implementation and monitoring stage. This calls for a system that the public can interact with. The web based GIS system has been developed using the free open source softwares. Development projects have been categorized into; ongoing, completed and planned It can also be shown that a web based GIS system can be used as an important tool for monitoring the implementation of the CIDP due to its easy to use nature and supported by the fact that internet is easily accessed by the majority of the public making it a powerful tool for public participation.

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success.

PubMed

Briggs, Andrew M; Jordan, Joanne E; Jennings, Matthew; Speerin, Robyn; Bragge, Peter; Chua, Jason; Woolf, Anthony D; Slater, Helen

2017-04-01

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs). Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel. A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively. An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs. © 2016, American College of Rheumatology.

Evolution of a multilevel framework for health program evaluation.

PubMed

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Developing a Common Framework for Evaluating the Implementation of Genomic Medicine Interventions in Clinical Care: The IGNITE Network’s Common Measures Working Group

PubMed Central

Orlando, Lori A.; Sperber, Nina R.; Voils, Corrine; Nichols, Marshall; Myers, Rachel A.; Wu, R. Ryanne; Rakhra-Burris, Tejinder; Levy, Kenneth D.; Levy, Mia; Pollin, Toni I.; Guan, Yue; Horowitz, Carol R.; Ramos, Michelle; Kimmel, Stephen E.; McDonough, Caitrin W.; Madden, Ebony B.; Damschroder, Laura J.

2017-01-01

Purpose Implementation research provides a structure for evaluating the clinical integration of genomic medicine interventions. This paper describes the Implementing GeNomics In PracTicE (IGNITE) Network’s efforts to promote: 1) a broader understanding of genomic medicine implementation research; and 2) the sharing of knowledge generated in the network. Methods To facilitate this goal the IGNITE Network Common Measures Working Group (CMG) members adopted the Consolidated Framework for Implementation Research (CFIR) to guide their approach to: identifying constructs and measures relevant to evaluating genomic medicine as a whole, standardizing data collection across projects, and combining data in a centralized resource for cross network analyses. Results CMG identified ten high-priority CFIR constructs as important for genomic medicine. Of those, eight didn’t have standardized measurement instruments. Therefore, we developed four survey tools to address this gap. In addition, we identified seven high-priority constructs related to patients, families, and communities that did not map to CFIR constructs. Both sets of constructs were combined to create a draft genomic medicine implementation model. Conclusion We developed processes to identify constructs deemed valuable for genomic medicine implementation and codified them in a model. These resources are freely available to facilitate knowledge generation and sharing across the field. PMID:28914267

Developing a common framework for evaluating the implementation of genomic medicine interventions in clinical care: the IGNITE Network's Common Measures Working Group.

PubMed

Orlando, Lori A; Sperber, Nina R; Voils, Corrine; Nichols, Marshall; Myers, Rachel A; Wu, R Ryanne; Rakhra-Burris, Tejinder; Levy, Kenneth D; Levy, Mia; Pollin, Toni I; Guan, Yue; Horowitz, Carol R; Ramos, Michelle; Kimmel, Stephen E; McDonough, Caitrin W; Madden, Ebony B; Damschroder, Laura J

2018-06-01

PurposeImplementation research provides a structure for evaluating the clinical integration of genomic medicine interventions. This paper describes the Implementing Genomics in Practice (IGNITE) Network's efforts to promote (i) a broader understanding of genomic medicine implementation research and (ii) the sharing of knowledge generated in the network.MethodsTo facilitate this goal, the IGNITE Network Common Measures Working Group (CMG) members adopted the Consolidated Framework for Implementation Research (CFIR) to guide its approach to identifying constructs and measures relevant to evaluating genomic medicine as a whole, standardizing data collection across projects, and combining data in a centralized resource for cross-network analyses.ResultsCMG identified 10 high-priority CFIR constructs as important for genomic medicine. Of those, eight did not have standardized measurement instruments. Therefore, we developed four survey tools to address this gap. In addition, we identified seven high-priority constructs related to patients, families, and communities that did not map to CFIR constructs. Both sets of constructs were combined to create a draft genomic medicine implementation model.ConclusionWe developed processes to identify constructs deemed valuable for genomic medicine implementation and codified them in a model. These resources are freely available to facilitate knowledge generation and sharing across the field.

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren.

PubMed

Helitzer, D L; Davis, S M; Gittelsohn, J; Going, S B; Murray, D M; Snyder, P; Steckler, A B

1999-04-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used.

Development and Implementation of a Mental Health Work Rehabilitation Program: Results of a Developmental Evaluation.

PubMed

Sylvain, Chantal; Durand, Marie-José; Velasquez Sanchez, Astrid; Lessard, Nathalie; Maillette, Pascale

2018-05-23

Purpose Long-term work disability due to common mental disorders (CMDs) is a growing problem. Yet optimal interventions remain unclear and little is known about implementation challenges in everyday practice. This study aimed to support and evaluate, in real time, the development and implementation of a work rehabilitation program (WRP) designed to promote post-CMD return-to-work (RTW). Methods A 2-year developmental evaluation was performed using a participatory approach. At program outset, the researchers held five work meetings to revise the program's logic model and discuss its underlying change theory with clinicians. Data collection tools used throughout the study period were structured charts of activities conducted with workers (n = 41); in-depth interviews with program clinicians and managers (n = 9); and participant observation during work meetings. Quantitative data were analyzed using descriptive statistics. Qualitative data underwent thematic analysis using a processual approach. Results Three types of activity were developed and implemented: individual and group interventions targeting workers, and joint activities targeting partners (physicians, employers, others). While worker-targeted activities were generally implemented as planned, joint activities were sporadic. Analysis of the implementation process revealed five challenges faced by clinicians. Determinants included clinicians, host organization, sociopolitical context and resources provided by the evaluation. Conclusion The program studied is original in that it is based on the best available scientific knowledge, yet adapted to contextual particularities. The identified implementation challenges highlight the need for greater importance to be placed on the external, non-program context to ensure sustainable implementation in everyday practice.

Alternative Student Growth Measures for Teacher Evaluation: Implementation Experiences of Early-Adopting Districts. REL 2015-093

ERIC Educational Resources Information Center

McCullough, Moira; English, Brittany; Angus, Megan Hague; Gill, Brian

2015-01-01

Alternative student growth measures for teacher evaluation: Implementation experiences of early-adopting districts: State requirements to include student achievement growth in teacher evaluations are prompting the development of alternative ways to measure growth in grades and subjects not covered by state assessments. These alternative growth…

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

A study of systems implementation languages for the POCCNET system

NASA Technical Reports Server (NTRS)

Basili, V. R.; Franklin, J. W.

1976-01-01

The results are presented of a study of systems implementation languages for the Payload Operations Control Center Network (POCCNET). Criteria are developed for evaluating the languages, and fifteen existing languages are evaluated on the basis of these criteria.

Using a Systematic Conceptual Model for a Process Evaluation of a Middle School Obesity Risk-Reduction Nutrition Curriculum Intervention: Choice, Control & Change

PubMed Central

Lee, Heewon; Contento, Isobel R.; Koch, Pamela

2012-01-01

Objective To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. Design A process evaluation study based on a systematic conceptual model. Setting Five middle schools in New York City. Participants 562 students in 20 classes and their science teachers (n=8). Main Outcome Measures Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers’ curriculum evaluation, and satisfaction with teaching the curriculum. Analysis Descriptive statistics and Spearman’s Rho Correlation for quantitative analysis and content analysis for qualitative data were used. Results Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teachers’ satisfaction with teaching the curriculum was highly correlated with students’ satisfaction (p <.05). Teachers’ perception of amount of student work was negatively correlated with implementation and with student satisfaction (p<.05). Conclusions and implications Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. PMID:23321021

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change.

PubMed

Lee, Heewon; Contento, Isobel R; Koch, Pamela

2013-03-01

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. A process evaluation study based on a systematic conceptual model. Five middle schools in New York City. Five hundred sixty-two students in 20 classes and their science teachers (n = 8). Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum. Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used. Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05). Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Twelve tips for developing, implementing, and sustaining medical education fellowship programs: Building on new trends and solid foundations.

PubMed

Dewey, Charlene M; Turner, Teri L; Perkowski, Linda; Bailey, Jean; Gruppen, Larry D; Riddle, Janet; Singhal, Geeta; Mullan, Patricia; Poznanski, Ann; Pillow, Tyson; Robins, Lynne S; Rougas, Steven C; Horn, Leora; Ghulyan, Marine V; Simpson, Deborah

2016-01-01

Medical education fellowship programs (MEFPs) are a form of faculty development contributing to an organization's educational mission and participants' career development. Building an MEFP requires a systematic design, implementation, and evaluation approach which aligns institutional and individual faculty goals. Implementing an MEFP requires a team of committed individuals who provide expertise, guidance, and mentoring. Qualified MEFP directors should utilize instructional methods that promote individual and institutional short and long term growth. Directors must balance the use of traditional design, implementation, and evaluation methodologies with advancing trends that may support or threaten the acceptability and sustainability of the program. Drawing on the expertise of 28 MEFP directors, we provide twelve tips as a guide to those implementing, sustaining, and/or growing a successful MEFP whose value is demonstrated by its impacts on participants, learners, patients, teaching faculty, institutions, the greater medical education community, and the population's health.

Implementation of cold risk management in occupational safety, occupational health and quality practices. Evaluation of a development process and its effects at the finnish maritime administration.

PubMed

Risikko, Tanja; Remes, Jouko; Hassi, Juhani

2008-01-01

Cold is a typical environmental risk factor in outdoor work in northern regions. It should be taken into account in a company's occupational safety, health and quality systems. A development process for improving cold risk management at the Finnish Maritime Administration (FMA) was carried out by FMA and external experts. FMA was to implement it. Three years after the development phase, the outcomes and implementation were evaluated. The study shows increased awareness about cold work and few concrete improvements. Concrete improvements in occupational safety and health practices could be seen in the pilot group. However, organization-wide implementation was insufficient, the main reasons being no organization-wide practices, unclear process ownership, no resources and a major reorganization process. The study shows a clear need for expertise supporting implementation. The study also presents a matrix for analyzing the process.

Improving Teachers' In-Service Professional Development in Mathematics and Science: The Role of Postsecondary Institutions.

ERIC Educational Resources Information Center

Desimone Laura; Garet, Michael S.; Birman, Beatrice F.; Porter, Andrew; Yoon, Kwang Suk

2003-01-01

As part of national evaluation of Eisenhower Professional Development Program, examines management and implementation strategies contributing to high-quality inservice teacher professional development in mathematics and science. Finds higher quality professional development is related to management and implementation strategies such as continuous…

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals’ Views and Experiences

PubMed Central

Kraft, Matthew A.; Gilmour, Allison

2017-01-01

Purpose New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals’ ability to promote teacher development through the evaluation process. We conducted a case study of principals’ perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. Research Methods We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. Findings We found that the evaluation reforms provided a common framework and language that helped facilitate principals’ feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. Implications The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development. PMID:28729742

Clinical ladder program implementation: a project guide.

PubMed

Ko, Yu Kyung; Yu, Soyoung

2014-11-01

This article describes the development of a clinical ladder program (CLP) implementation linked to a promotion system for nurses. The CLP task force developed criteria for each level of performance and a performance evaluation tool reflecting the self-motivation of the applicant for professional development. One year after implementation, the number of nurses taking graduate courses increased, and 7 nurses were promoted to nurse manager positions.

Systematic evaluation of implementation fidelity of complex interventions in health and social care

PubMed Central

2010-01-01

Background Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes. The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care. Methods A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods. Discussion This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified. Trial Registration Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024. PMID:20815872

Comparison of the adaptive implementation and evaluation of the Meeting Centers Support Program for people with dementia and their family carers in Europe; study protocol of the MEETINGDEM project.

PubMed

Dröes, R M; Meiland, F J M; Evans, S; Brooker, D; Farina, E; Szcześniak, D; Van Mierlo, L D; Orrell, M; Rymaszewska, J; Chattat, R

2017-04-04

The MEETINGDEM study aims to implement and evaluate an innovative, inclusive, approach to supporting community dwelling people with mild to moderate dementia and their family carers, called the Meeting Centers Support Program (MCSP), in three countries in the European Union (EU): Italy, Poland and United Kingdom. Demonstrated benefits of this person-centered approach, developed in The Netherlands, include high user satisfaction, reduced behavioral and mood problems, delayed admission to residential care, lower levels of caregiving-related stress, higher carer competence, and improved collaboration between care and welfare organizations. The project will be carried out over a 36 month period. Project partners in the three countries will utilize, and adapt, strategies and tools developed in the Netherlands. In Phase One (month 1-18) activities will focus on establishing an initiative group of relevant organizations and user representatives in each country, exploring pathways to care and potential facilitators and barriers to implementing the program, and developing country specific implementation plans and materials. In Phase Two (month 19‑36) training will be provided to organizations and staff, after which the meeting centers will be established and evaluated for impact on behavior, mood and quality of life of people with dementia and carers, cost-effectiveness, changes in service use, user satisfaction and implementation process. An overall evaluation will draw together findings from the three countries to develop recommendations for successful implementation of MCSP across the EU. If the Meeting Centers approach can be widely implemented, this could lead to major improvements in dementia care across Europe and beyond. The trial was retrospectively registered in May 2016: trial number: NTR5936 .

The Development, Implementation, and Evaluation of a Model for Teaching Intercultural Competency through the Content Areas at Faith School of Theology.

ERIC Educational Resources Information Center

Algee, Alan

In light of the cross cultural understanding and communications skills likely to be demanded of those in evangelical Christian ministry working all over the world, this project developed, implemented, and evaluated a model for infusing intercultural competency (ICC) into a seminary curriculum at the Faith School of Theology in Maine. From a study…

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

A Mixed Methods Approach to Evaluate Partnerships and Implementation of the Massachusetts Prevention and Wellness Trust Fund.

PubMed

Lee, Rebekka M; Ramanadhan, Shoba; Kruse, Gina R; Deutsch, Charles

2018-01-01

Background: Strong partnerships are critical to integrate evidence-based prevention interventions within clinical and community-based settings, offering multilevel and sustainable solutions to complex health issues. As part of Massachusetts' 2012 health reform, The Prevention and Wellness Trust Fund (PWTF) funded nine local partnerships throughout the state to address hypertension, pediatric asthma, falls among older adults, and tobacco use. The initiative was designed to improve health outcomes through prevention and disease management strategies and reduce healthcare costs. Purpose: Describe the mixed-methods study design for investigating PWTF implementation. Methods: The Consolidated Framework for Implementation Research guided the development of this evaluation. First, the study team conducted semi-structured qualitative interviews with leaders from each of nine partnerships to document partnership development and function, intervention adaptation and delivery, and the influence of contextual factors on implementation. The interview findings were used to develop a quantitative survey to assess the implementation experiences of 172 staff from clinical and community-based settings and a social network analysis to assess changes in the relationships among 72 PWTF partner organizations. The quantitative survey data on ratings of perceived implementation success were used to purposively select 24 staff for interviews to explore the most successful experiences of implementing evidence-based interventions for each of the four conditions. Conclusions: This mixed-methods approach for evaluation of implementation of evidence-based prevention interventions by PWTF partnerships can help decision-makers set future priorities for implementing and assessing clinical-community partnerships focused on prevention.

Development , Implementation and Evaluation of a Physics-Base Windblown Dust Emission Model

EPA Science Inventory

A physics-based windblown dust emission parametrization scheme is developed and implemented in the CMAQ modeling system. A distinct feature of the present model includes the incorporation of a newly developed, dynamic relation for the surface roughness length, which is important ...

Principal Concerns and Superintendent Support during Teacher Evaluation Changes

ERIC Educational Resources Information Center

Derrington, Mary Lynne; Campbell, John W.

2015-01-01

Teacher evaluation is a major reform initiative in public education's high accountability policy environment. Principals' effective implementation of this high-stakes reform is challenged by time management, policy coherence, communication with teachers, district support, and staff development imperatives. Effective implementation requires moving…

Electronic health records implementation: an evaluation of information system impact and contingency factors.

PubMed

Nguyen, Lemai; Bellucci, Emilia; Nguyen, Linh Thuy

2014-11-01

This paper provides a review of EHR (electronic health record) implementations around the world and reports on findings including benefits and issues associated with EHR implementation. A systematic literature review was conducted from peer-reviewed scholarly journal publications from the last 10 years (2001-2011). The search was conducted using various publication collections including: Scopus, Embase, Informit, Medline, Proquest Health and Medical Complete. This paper reports on our analysis of previous empirical studies of EHR implementations. We analysed data based on an extension of DeLone and McLean's information system (IS) evaluation framework. The extended framework integrates DeLone and McLean's dimensions, including information quality, system quality, service quality, intention of use and usage, user satisfaction and net benefits, together with contingent dimensions, including systems development, implementation attributes and organisational aspects, as identified by Van der Meijden and colleagues. A mix of evidence-based positive and negative impacts of EHR was found across different evaluation dimensions. In addition, a number of contingent factors were found to contribute to successful implementation of EHR. This review does not include white papers or industry surveys, non-English papers, or those published outside the review time period. This review confirms the potential of this technology to aid patient care and clinical documentation; for example, in improved documentation quality, increased administration efficiency, as well as better quality, safety and coordination of care. Common negative impacts include changes to workflow and work disruption. Mixed observations were found on EHR quality, adoption and satisfaction. The review warns future implementers of EHR to carefully undertake the technology implementation exercise. The review also informs healthcare providers of contingent factors that potentially affect EHR development and implementation in an organisational setting. Our findings suggest a lack of socio-technical connectives between the clinician, the patient and the technology in developing and implementing EHR and future developments in patient-accessible EHR. In addition, a synthesis of DeLone and McLean's framework and Van der Meijden and colleagues' contingent factors has been found useful in comprehensively understanding and evaluating EHR implementations. Crown Copyright © 2014. Published by Elsevier Ireland Ltd. All rights reserved.

User-centered design in clinical handover: exploring post-implementation outcomes for clinicians.

PubMed

Wong, Ming Chao; Cummings, Elizabeth; Turner, Paul

2013-01-01

This paper examines the outcomes for clinicians from their involvement in the development of an electronic clinical hand-over tool developed using principles of user-centered design. Conventional e-health post-implementation evaluations tend to emphasize technology-related (mostly positive) outcomes. More recently, unintended (mostly negative) consequences arising from the implementation of e-health technologies have also been reported. There remains limited focus on the post-implementation outcomes for users, particularly those directly involved in e-health design processes. This paper presents detailed analysis and insights into the outcomes experienced post-implementation by a cohort of junior clinicians involved in developing an electronic clinical handover tool in Tasmania, Australia. The qualitative methods used included observations, semi-structured interviews and analysis of clinical handover notes. Significantly, a number of unanticipated flow-on effects were identified that mitigated some of the challenges arising during the design and implementation of the tool. The paper concludes by highlighting the importance of identifying post-implementation user outcomes beyond conventional system adoption and use and also points to the need for more comprehensive evaluative frameworks to encapsulate these broader socio-technical user outcomes.

Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting.

PubMed

Smith, Katherine; Firth, Kimberly; Smeeding, Sandra; Wolever, Ruth; Kaufman, Joanna; Delgado, Roxana; Bellanti, Dawn; Xenakis, Lea

2016-01-01

Research suggests that the development of mind-body skills can improve individual and family resilience, particularly related to the stresses of illness, trauma, and caregiving. To operationalize the research evidence that mind-body skills help with health and recovery, Samueli Institute, in partnership with experts in mind-body programming, created a set of guidelines for developing and evaluating mind-body programs for service members, veterans, and their families. The Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting outline key strategies and issues to consider when developing, implementing, and evaluating a mind-body focused family empowerment approach in a military healthcare setting. Although these guidelines were developed specifically for a military setting, most of the same principles can be applied to the development of programs in the civilian setting as well. The guidelines particularly address issues unique to mind-body programs, such as choosing evidence-based modalities, licensure and credentialing, safety and contraindications, and choosing evaluation measures that capture the holistic nature of these types of programs. The guidelines are practical, practice-based guidelines, developed by experts in the fields of program development and evaluation, mind-body therapies, patient- and family-centered care, as well as, experts in military and veteran's health systems. They provide a flexible framework to create mind-body family empowerment programs and describe important issues that program developers and evaluators are encouraged to address to ensure the development of the most impactful, successful, evidence-supported programs possible. Copyright © 2016 Elsevier Inc. All rights reserved.

Principal Roles, Work Demands, and Supports Needed to Implement New Teacher Evaluation

ERIC Educational Resources Information Center

Cosner, Shelby; Kimball, Steven M.; Barkowski, Elizabeth; Carl, Bradley; Jones, Curtis

2015-01-01

Policy makers at the federal level have embraced an educator effectiveness agenda, which in turn has driven many states across the country to rapidly develop and implement new and more complex teacher evaluation systems. It is increasingly clear that the success of these nascent teacher evaluation systems partly depends on the will, skill, and…

Teacher Performance Evaluation Plan: A Personalized Approach to Supervision, Staff Development, and Evaluation. An Implementation Guide. Revised Edition.

ERIC Educational Resources Information Center

Knight, Jeanne; And Others

This guide provides assistance to New Mexico school districts in implementing a state-sponsored teacher performance evaluation plan (Provision III of the New Mexico Staff Accountability Plan, adopted by the State Board of Education). This plan involves five basic procedures: (1) determine specific definitions of the six essential teaching…

The development, implementation and evaluation of clinical practice guidelines in Gulf Cooperation Council (GCC) countries: a systematic review of literature.

PubMed

Koornneef, Erik; Robben, Paul; Hajat, Cother; Ali, Azhar

2015-12-01

Our aim was to examine and describe the current situation in Gulf Cooperation Council (GCC) member countries regarding the development, implementation and evaluation of clinical practice guidelines (CPG). The objectives were to describe from where the studies originated, what the clinical focus was of each study and examine the methodology and the status of each study (i.e. development, dissemination, implementation and evaluation). Review of literature - two stages: stage 1: screening through an abstract review, followed by independent adjudicator; stage 2: detailed assessment and classification. Considering the widespread acceptance that CPG's are useful and effective tools for quality improvement in health care, it is worth noting that relatively few studies have been conducted in the GCC region that examine CPG. Furthermore, the reviewers found that the quality of the research methods used could be improved. The majority of the studies that were conducted evaluated the effects of guidelines and focused on the 'lifestyle diseases', in particular diabetes and cardiovascular diseases. It is also worth noting that there has been a steady increase in the number of publications over the 10 years period. More attention needs to be given to developing, disseminating, implementing and evaluating CPG's in the GCC region in order to improve the quality and safety of health care. © 2015 John Wiley & Sons, Ltd.

Computer Animation with Adobe Flash Professional Cs6 in Newton’s Law

NASA Astrophysics Data System (ADS)

Aji, S. D.; Hudha, M. N.; Huda, C.; Gufran, G.

2018-01-01

The purpose of this research is to develop computer-based physics learning media with Adobe Flash Professional CS6 on Newton’s Law of physics subject for senior high school (SMA / MA) class X. Type of research applied is Research and Development with ADDIE development model covering 5 stages: Analysis (Analysis), Design (Design), Development (Production), Implementation (Implementation) and Evaluation (Evaluation). The results of this study were tested toward media experts, media specialists, physics teachers, and students test results with media outcomes that are declared very feasible.

An Investigation into the Development, Implementation, and Evaluation of Online Learning Programs for Small Rural Public Schools in Texas

ERIC Educational Resources Information Center

Tabor, Bruce

2012-01-01

This qualitative study investigated the experiences of 10 superintendents in Pre-K-8, 1A, and small 2A schools located in rural areas of Texas, who have implemented an online learning program or programs. Narrative techniques were used to explore the challenges that they faced in the pre-planning, planning, implementation and evaluation of their…

Implementation Evaluation in a Private Nonprofit Setting: A Mixed-Methods Approach

ERIC Educational Resources Information Center

Walker, Jacquelyn Ann

2013-01-01

Demand for quality service provision in the human services industry requires that private nonprofit organizations have the administrative and management capacities to ensure successful implementation and sustain staff development programs. Unfamiliarity with implementation challenges, and limited awareness of implementation strategies, can trigger…

Development, Validation, and Evaluation of Literacy 3D: A Package Supporting Tier 1 Preschool Literacy Instruction Implementation and Intervention

ERIC Educational Resources Information Center

Greenwood, Charles R.; Abbott, Mary; Beecher, Constance; Atwater, Jane; Petersen, Sarah

2017-01-01

Increasingly, prekindergarten programs with literacy outcome goals are seeking to implement evidence-based practices to improve results. Such efforts require instructional intervention strategies to engage children as well as strategies to support teacher implementation. Reported is the iterative development of Literacy 3D, an enhanced support…

Development, Implementation and Evaluation of an Audiotape and Accompanying Visuals in Hemodynamics as a Supplementary Teaching Aid for Human Anatomy and Physiology: Curriculum and Program Planning.

ERIC Educational Resources Information Center

Selvadurai, Ranjani H.

The purpose of this study was to develop, implement, and evaluate an audiotape and accompanying handouts on hemodynamics as a supplemental teaching aid in the Health Science Learning Center of New York City Technical College. It was hypothesized that there would be a significant difference between the mean examination grade on hemodynamics of…

Developing and Implementing a Counselor Evaluation Program.

ERIC Educational Resources Information Center

Bell, Priscilla J.; Acker, Kathleen E.

In the past several years, Tacoma Community College (TCC) has devoted increasing attention to evaluating faculty and staff performance. In recognition of the benefits of a growth-oriented evaluation process over a summative evaluation, the counselors and the Dean for Student Services at TCC developed a comprehensive evaluation system for…

Development of a School Leadership Evaluation System

ERIC Educational Resources Information Center

Orlando, Nik

2014-01-01

This action research study examined the effectiveness of the process implemented by Partnerships to Uplift Communities (PUC) Schools Charter Management Organization to develop their school leader evaluation system in collaboration with current PUC school leaders. The development of the leadership evaluation system included the collective voices of…

Practical Team-Based Learning from Planning to Implementation

PubMed Central

Bell, Edward; Eng, Marty; Fuentes, David G.; Helms, Kristen L.; Maki, Erik D.; Vyas, Deepti

2015-01-01

Team-based learning (TBL) helps instructors develop an active teaching approach for the classroom through group work. The TBL infrastructure engages students in the learning process through the Readiness Assessment Process, problem-solving through team discussions, and peer feedback to ensure accountability. This manuscript describes the benefits and barriers of TBL, and the tools necessary for developing, implementing, and critically evaluating the technique within coursework in a user-friendly method. Specifically, the manuscript describes the processes underpinning effective TBL development, preparation, implementation, assessment, and evaluation, as well as practical techniques and advice from authors’ classroom experiences. The paper also highlights published articles in the area of TBL in education, with a focus on pharmacy education. PMID:26889061

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren1–3

PubMed Central

Helitzer, Deborah L; Davis, Sally M; Gittelsohn, Joel; Going, Scott B; Murray, David M; Snyder, Patricia; Steckler, Allan B

2016-01-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used. PMID:10195608

ThermoData Engine (TDE): software implementation of the dynamic data evaluation concept. 9. Extensible thermodynamic constraints for pure compounds and new model developments.

PubMed

Diky, Vladimir; Chirico, Robert D; Muzny, Chris D; Kazakov, Andrei F; Kroenlein, Kenneth; Magee, Joseph W; Abdulagatov, Ilmutdin; Frenkel, Michael

2013-12-23

ThermoData Engine (TDE) is the first full-scale software implementation of the dynamic data evaluation concept, as reported in this journal. The present article describes the background and implementation for new additions in latest release of TDE. Advances are in the areas of program architecture and quality improvement for automatic property evaluations, particularly for pure compounds. It is shown that selection of appropriate program architecture supports improvement of the quality of the on-demand property evaluations through application of a readily extensible collection of constraints. The basis and implementation for other enhancements to TDE are described briefly. Other enhancements include the following: (1) implementation of model-validity enforcement for specific equations that can provide unphysical results if unconstrained, (2) newly refined group-contribution parameters for estimation of enthalpies of formation for pure compounds containing carbon, hydrogen, and oxygen, (3) implementation of an enhanced group-contribution method (NIST-Modified UNIFAC) in TDE for improved estimation of phase-equilibrium properties for binary mixtures, (4) tools for mutual validation of ideal-gas properties derived through statistical calculations and those derived independently through combination of experimental thermodynamic results, (5) improvements in program reliability and function that stem directly from the recent redesign of the TRC-SOURCE Data Archival System for experimental property values, and (6) implementation of the Peng-Robinson equation of state for binary mixtures, which allows for critical evaluation of mixtures involving supercritical components. Planned future developments are summarized.

The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search

PubMed Central

2014-01-01

Background Health promotion by and with Aboriginal and Torres Strait Islander (hereafter Indigenous) Australians is critically important given a wide gap in health parity compared to other Australians. The development and implementation of step-by-step guides, instruments, packages, frameworks or resources has provided a feasible and low-resource strategy for strengthening evidence-informed health promotion practice. Yet there has been little assessment of where and how these tools are implemented or their effectiveness. This paper reviews the characteristics, implementation and effects of Indigenous health promotion tools. Methods Indigenous health promotion tools were identified through a systematic literature search including a prior scoping study, eight databases, references of other reviews and the authors’ knowledge (n = 1494). Documents in the peer reviewed and grey literature were included if they described or evaluated tools designed, recommended or used for strengthening Indigenous Australian health promotion. Eligible publications were entered into an Excel spreadsheet and documented tools classified according to their characteristics, implementation and effects. Quality was appraised using the Dictionary for Effective Public Health Practice Project (EPHPP) and Critical Appraisal Skills Program (CASP) tools for quantitative and qualitative studies respectively. Results The review found that Indigenous health promotion tools were widely available. Of 74 publications that met inclusion criteria, sixty (81%) documented tools developed specifically for the Indigenous Australian population. All tools had been developed in reference to evidence; but only 22/74 (30%) publications specified intended or actual implementation, and only 11/74 (15%) publications evaluated impacts of the implemented tools. Impacts included health, environmental, community, organisational and health care improvements. The quality of impact evaluations was strong for only five (7%) studies. Conclusions The small number and generally moderate quality of implementation and evaluation studies means that little is known about how tools work to strengthen Indigenous health promotion practice. The findings suggest that rather than continuing to invest in tool development, practitioners, policy makers and researchers could evaluate the implementation and effects of existing tools and publish the results. There is a need for long-term investment in research to review the current use of health promotion tools and the factors that are likely to enhance their implementation. PMID:25012401

Designing, implementing, and evaluating a media campaign illustrating the bystander role.

PubMed

Potter, Sharyn J; Stapleton, Jane G; Moynihan, Mary M

2008-01-01

Recent research found that training men and women to understand the role of bystanders in situations where violence against women (VAW) is occurring may reduce the incidence of VAW (Moynihan & Banyard, 2004). Therefore a public awareness campaign to increase understanding of the prosocial role of bystanders in reducing VAW was developed and implemented. The current article discusses the role of media campaigns in addressing public health issues and describes the initial development, implementation, and evaluation of a media campaign focused on the bystander role in reducing the incidence of VAW. Conclusions and future directions of this exploratory project are discussed.

Project Developmental Continuity Evaluation: Implementation Rating Instrument.

ERIC Educational Resources Information Center

High/Scope Educational Research Foundation, Ypsilanti, MI.

This instrument is part of a series of documents on the evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. The Implementation Rating Instrument (IRI) was developed to provide a quantitative…

Technical Adequacy of the SWPBIS Tiered Fidelity Inventory

ERIC Educational Resources Information Center

McIntosh, Kent; Massar, Michelle M.; Algozzine, Robert F.; George, Heather Peshak; Horner, Robert H.; Lewis, Timothy J.; Swain-Bradway, Jessica

2017-01-01

Full and durable implementation of school-based interventions is supported by regular evaluation of fidelity of implementation. Multiple assessments have been developed to evaluate the extent to which schools are applying the core features of school-wide positive behavioral interventions and supports (SWPBIS). The "SWPBIS Tiered Fidelity…

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

The Implementation and Evaluation of Teacher Training in Gaming Instruction for Secondary Science: An Action Research Project

ERIC Educational Resources Information Center

Sanders, Veronica

2016-01-01

This study implemented and evaluated gaming instruction as a professional development for science teachers at a Georgia high school. It was guided by four research questions that (a) assessed the impact of training in gaming instruction and evaluation of that training on science teachers' ability to use games; (b) examined evidence showing that…

A Practitioner Implementation of a Tier 2 First-Grade Mathematics Intervention

ERIC Educational Resources Information Center

Strand Cary, Mari G.; Clarke, Ben; Doabler, Christian T.; Smolkowski, Keith; Fien, Hank; Baker, Scott K.

2017-01-01

We report on a practitioner implementation of Fusion, a first-grade mathematics intervention. Studies such as this evaluation of a loose implementation under realistic conditions are important to curriculum developers' understanding of how evidence-based programs and tools work under a variety of implementation scenarios. In this…

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

Stakeholder engagement and public policy evaluation: factors contributing to the development and implementation of a regional network for geriatric care.

PubMed

Glover, Catherine; Hillier, Loretta M; Gutmanis, Iris

2007-01-01

The development and implementation of a regional network that provides universally accessible and consistent services to the frail elderly living in Southwestern Ontario is described. Through continuous stakeholder engagement, clear network goals were identified and operationalized. Stakeholder commitment to the integration of expertise and specialized services, to evidence-based public policy and to iterative evaluation cycles were key to network success.

The Effect of a Computer Program Based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) in Improving Ninth Graders' Listening and Reading Comprehension Skills in English in Jordan

ERIC Educational Resources Information Center

Alodwan, Talal; Almosa, Mosaab

2018-01-01

The study aimed to assess the effectiveness of a computer program based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) Model on the achievement of Ninth Graders' listening and Reading Comprehension Skills in English. The study sample comprised 70 ninth graders during the second semester of the academic year 2016/2017. The…

Extension Sustainability Camp: Design, Implementation, and Evaluation

ERIC Educational Resources Information Center

Brain, Roslynn; Upton, Sally; Tingey, Brett

2015-01-01

Sustainability Camps provide an opportunity for Extension educators to be in the forefront of sustainability outreach and to meet the growing demand for sustainability education. This article shares development, implementation, and evaluation of an Extension Sustainability Camp for youth, grades 4-6. Camp impact was measured via daily pre-and…

Evaluating the Effectiveness of Student Assistance Programs in Pennsylvania.

ERIC Educational Resources Information Center

Fertman, Carl I.; Fichter, Cele; Schlesinger, Jo; Tarasevich, Susan; Wald, Holly; Zhang, Xiaoyan

2001-01-01

This evaluation of the Pennsylvania Student Assistance Program (SAP) was conducted to determine overall efficacy of SAPs and, more specifically, how SAP is currently implemented. Findings indicate that SAP is being implemented as designed. Recommended is the development of benchmarks and indicators focusing on best SAP practices and effectiveness.…

Insights from the evaluation of a provincial healthy eating strategy in Nova Scotia, Canada.

PubMed

Sim, S Meaghan; Kirk, Sara F L

2013-10-01

Healthy Eating Nova Scotia represents the first provincial comprehensive healthy eating strategy in Canada and a strategy that is framed within a population-health model. Five years after strategy launch, our objective was to evaluate Healthy Eating Nova Scotia to determine perceptions of strategy implementation and strategy outputs. The focus of the current paper is on the findings of this evaluation. We conducted an evaluation of the strategy through three activities that included a document review, survey of key stakeholders and in-depth interviews with key strategy informants. The findings from each of the activities were integrated to determine what has worked well with strategy implementation, what could be improved and what outputs have resulted. The evaluation was conducted in the Canadian province of Nova Scotia. Participants for this evaluation included survey respondents (n 120) and key informants (n 16). A total of 156 documents were also reviewed. Significant investments have been made towards inter-sectoral partnerships and resourcing that has provided the necessary leadership and momentum for the strategy. Policy development has been leveraged through the strategy primarily in the health and education sectors and is perceived as a visible success. Clarity of human resource roles and funding within the context of a provincial strategy may be beneficial for continued strategy implementation, as is expansion of policy development. Known to be the first evaluation of its kind, these findings and related considerations will be of interest to policy makers developing and implementing similar strategies in their own jurisdictions.

Evaluating an integrated approach to clinical quality improvement: clinical guidelines, quality measurement, and supportive system design.

PubMed

Cretin, S; Farley, D O; Dolter, K J; Nicholas, W

2001-08-01

Implementing clinical practice guidelines to change patient outcomes presents a challenge. Studies of single interventions focused on changing provider behavior demonstrate modest effects, suggesting that effective guideline implementation requires a multifaceted approach. Traditional biomedical research designs are not well suited to evaluating systems interventions. RAND and the Army Medical Department collaborated to develop and evaluate a system for implementing guidelines and documenting their effects on patient care. The evaluation design blended quality improvement, case study, and epidemiologic methods. A formative evaluation of implementation process and an outcome evaluation of patient impact were combined. Guidelines were implemented in 3 successive demonstrations targeting low back pain, asthma, and diabetes. This paper reports on the first wave of 4 facilities implementing a low back pain guideline. Organizational climate and culture, motivation, leadership commitment, and resources were assessed. Selected indicators of processes and outcomes of care were compared before, during, and after guideline implementation at the demonstration facilities and at comparison facilities. Logistic regression analysis was used to test for guideline effects on patient care. Process evaluation documented varied approaches to quality improvement across sites. Outcome evaluation revealed a significant downward trend in the percentage of acute low back pain patients referred to physical therapy or chiropractic care (10.7% to 7.2%) at demonstration sites and no such trend at control sites. Preliminary results suggest the power of this design to stimulate improvements in guideline implementation while retaining the power to evaluate rigorously effects on patient care.

Using formative evaluation in an implementation project to increase vaccination rates in high-risk veterans: QUERI Series

PubMed Central

Wallace, Carolyn M; Legro, Marcia W

2008-01-01

Background Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project. Methods This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers. Results Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers. Conclusion Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions. PMID:18430201

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT).

PubMed

Murray, Elizabeth; May, Carl; Mair, Frances

2010-10-18

The use of Information and Communication Technology (ICT) or e-Health is seen as essential for a modern, cost-effective health service. However, there are well documented problems with implementation of e-Health initiatives, despite the existence of a great deal of research into how best to implement e-Health (an example of the gap between research and practice). This paper reports on the development and formative evaluation of an e-Health Implementation Toolkit (e-HIT) which aims to summarise and synthesise new and existing research on implementation of e-Health initiatives, and present it to senior managers in a user-friendly format. The content of the e-HIT was derived by combining data from a systematic review of reviews of barriers and facilitators to implementation of e-Health initiatives with qualitative data derived from interviews of "implementers", that is people who had been charged with implementing an e-Health initiative. These data were summarised, synthesised and combined with the constructs from the Normalisation Process Model. The software for the toolkit was developed by a commercial company (RocketScience). Formative evaluation was undertaken by obtaining user feedback. There are three components to the toolkit--a section on background and instructions for use aimed at novice users; the toolkit itself; and the report generated by completing the toolkit. It is available to download from http://www.ucl.ac.uk/pcph/research/ehealth/documents/e-HIT.xls. The e-HIT shows potential as a tool for enhancing future e-Health implementations. Further work is needed to make it fully web-enabled, and to determine its predictive potential for future implementations.

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT)

PubMed Central

2010-01-01

Background The use of Information and Communication Technology (ICT) or e-Health is seen as essential for a modern, cost-effective health service. However, there are well documented problems with implementation of e-Health initiatives, despite the existence of a great deal of research into how best to implement e-Health (an example of the gap between research and practice). This paper reports on the development and formative evaluation of an e-Health Implementation Toolkit (e-HIT) which aims to summarise and synthesise new and existing research on implementation of e-Health initiatives, and present it to senior managers in a user-friendly format. Results The content of the e-HIT was derived by combining data from a systematic review of reviews of barriers and facilitators to implementation of e-Health initiatives with qualitative data derived from interviews of "implementers", that is people who had been charged with implementing an e-Health initiative. These data were summarised, synthesised and combined with the constructs from the Normalisation Process Model. The software for the toolkit was developed by a commercial company (RocketScience). Formative evaluation was undertaken by obtaining user feedback. There are three components to the toolkit - a section on background and instructions for use aimed at novice users; the toolkit itself; and the report generated by completing the toolkit. It is available to download from http://www.ucl.ac.uk/pcph/research/ehealth/documents/e-HIT.xls Conclusions The e-HIT shows potential as a tool for enhancing future e-Health implementations. Further work is needed to make it fully web-enabled, and to determine its predictive potential for future implementations. PMID:20955594

Implementing hospital quality assurance policies in Iran: balancing licensing, annual evaluation, inspections and quality management systems.

PubMed

Aghaei Hashjin, Asgar; Delgoshaei, Bahram; Kringos, Dionne S; Tabibi, Seyed Jamaladin; Manouchehri, Jila; Klazinga, Niek S

2015-01-01

The purpose of this paper is to provide an overview of applied hospital quality assurance (QA) policies in Iran. A mixed method (quantitative data and qualitative document analysis) study was carried out between 1996 and 2010. The QA policy cycle forms a tight monitoring system to assure hospital quality by combining mandatory and voluntary methods in Iran. The licensing, annual evaluation and grading, and regulatory inspections statutorily implemented by the government as a national package to assure and improve hospital care quality, while implementing quality management systems (QMS) was voluntary for hospitals. The government's strong QA policy legislation role and support has been an important factor for successful QA implementation in Iran, though it may affected QA assessment independency and validity. Increased hospital evaluation independency and repositioning, updating standards, professional involvement and effectiveness studies could increase QA policy impact and maturity. The study highlights the current QA policy implementation cycle in Iranian hospitals. It provides a basis for further quality strategy development in Iranian hospitals and elsewhere. It also raises attention about finding the optimal balance between different QA policies, which is topical for many countries. This paper describes experiences when implementing a unique approach, combining mandatory and voluntary QA policies simultaneously in a developing country, which has invested considerably over time to improve hospital quality. The experiences with a mixed obligatory/voluntary approach and comprehensive policies in Iran may contain lessons for policy makers in developing and developed countries.

The Development and Implementation of the Kennedy Space Center Umbilical Clearance Tool

NASA Technical Reports Server (NTRS)

Chesnutt, David

2016-01-01

In preparation for NASAs upcoming Space Launch System program, the Kennedy Space Center is currently developing subsystems to provide fuel, purges and communications to the flight vehicle, known as umbilicals. It is vital to the crew and mission that these umbilicals release at T-0 without re-contacting the vehicle as it is accelerating from the launch pad. To help ensure this requirement is met by the program, a methodology of evaluating the moving bodies was developed and implemented into a tool using MATLAB. The tool, known as the KSC Umbilical Clearance Tool, takes a given elevation of interest and an umbilical retract profile within the plane to evaluate the clearance between the umbilical arm and thousands of independent flight vehicle drift profiles from a Monte Carlo analysis. The presentation will delve into the challenges associated with developing and implementing the tool framed in the context of evaluating the clearance for one of the SLS umbilicals.

Safe Patient Handling and Mobility: Development and Implementation of a Large-Scale Education Program.

PubMed

Lee, Corinne; Knight, Suzanne W; Smith, Sharon L; Nagle, Dorothy J; DeVries, Lori

This article addresses the development, implementation, and evaluation of an education program for safe patient handling and mobility at a large academic medical center. The ultimate goal of the program was to increase safety during patient mobility/transfer and reduce nursing staff injury from lifting/pulling. This comprehensive program was designed on the basis of the principles of prework, application, and support at the point of care. A combination of online learning, demonstration, skill evaluation, and coaching at the point of care was used to achieve the goal. Specific roles and responsibilities were developed to facilitate implementation. It took 17 master trainers, 88 certified trainers, 176 unit-based trainers, and 98 coaches to put 3706 nurses and nursing assistants through the program. Evaluations indicated both an increase in knowledge about safe patient handling and an increased ability to safely mobilize patients. The challenge now is sustainability of safe patient-handling practices and the growth and development of trainers and coaches.

Low cost MATLAB-based pulse oximeter for deployment in research and development applications.

PubMed

Shokouhian, M; Morling, R C S; Kale, I

2013-01-01

Problems such as motion artifact and effects of ambient lights have forced developers to design different signal processing techniques and algorithms to increase the reliability and accuracy of the conventional pulse oximeter device. To evaluate the robustness of these techniques, they are applied either to recorded data or are implemented on chip to be applied to real-time data. Recorded data is the most common method of evaluating however it is not as reliable as real-time measurements. On the other hand, hardware implementation can be both expensive and time consuming. This paper presents a low cost MATLAB-based pulse oximeter that can be used for rapid evaluation of newly developed signal processing techniques and algorithms. Flexibility to apply different signal processing techniques, providing both processed and unprocessed data along with low implementation cost are the important features of this design which makes it ideal for research and development purposes, as well as commercial, hospital and healthcare application.

A Model for Statewide Evaluation of a Universal Positive Behavior Support Initiative

ERIC Educational Resources Information Center

Elfner Childs, Karen; Kincaid, Don; George, Heather Peshak

2010-01-01

Several statewide evaluations of Tier 1/Universal Level Positive Behavior Support (PBS) implementation efforts have been conducted, adhering to the evaluation template developed by Horner, Sugai, and Lewis-Palmer in 2005. Building on these examples, Florida's Positive Behavior Support Project developed a comprehensive evaluation system that sought…

Developing, delivering and evaluating primary mental health care: the co-production of a new complex intervention.

PubMed

Reeve, Joanne; Cooper, Lucy; Harrington, Sean; Rosbottom, Peter; Watkins, Jane

2016-09-06

Health services face the challenges created by complex problems, and so need complex intervention solutions. However they also experience ongoing difficulties in translating findings from research in this area in to quality improvement changes on the ground. BounceBack was a service development innovation project which sought to examine this issue through the implementation and evaluation in a primary care setting of a novel complex intervention. The project was a collaboration between a local mental health charity, an academic unit, and GP practices. The aim was to translate the charity's model of care into practice-based evidence describing delivery and impact. Normalisation Process Theory (NPT) was used to support the implementation of the new model of primary mental health care into six GP practices. An integrated process evaluation evaluated the process and impact of care. Implementation quickly stalled as we identified problems with the described model of care when applied in a changing and variable primary care context. The team therefore switched to using the NPT framework to support the systematic identification and modification of the components of the complex intervention: including the core components that made it distinct (the consultation approach) and the variable components (organisational issues) that made it work in practice. The extra work significantly reduced the time available for outcome evaluation. However findings demonstrated moderately successful implementation of the model and a suggestion of hypothesised changes in outcomes. The BounceBack project demonstrates the development of a complex intervention from practice. It highlights the use of Normalisation Process Theory to support development, and not just implementation, of a complex intervention; and describes the use of the research process in the generation of practice-based evidence. Implications for future translational complex intervention research supporting practice change through scholarship are discussed.

A Faculty Development Program for Nurse Educators Learning to Teach Online

ERIC Educational Resources Information Center

Lee, Debra; Paulus, Trena M.; Loboda, Iryna; Phipps, Gina; Wyatt, Tami H.; Myers, Carole R.; Mixer, Sandra J.

2010-01-01

As the College of Nursing at the University of Tennessee, Knoxville prepared to move their graduate programs online, a nursing faculty grass-roots movement led to the implementation of a faculty development program. This instructional design portfolio describes the design, development, implementation, and evaluation of this program, with the goal…

The design of a real-time formative evaluation of the implementation process of lifestyle interventions at two worksites using a 7-step strategy (BRAVO@Work).

PubMed

Wierenga, Debbie; Engbers, Luuk H; van Empelen, Pepijn; Hildebrandt, Vincent H; van Mechelen, Willem

2012-08-07

Worksite health promotion programs (WHPPs) offer an attractive opportunity to improve the lifestyle of employees. Nevertheless, broad scale and successful implementation of WHPPs in daily practice often fails. In the present study, called BRAVO@Work, a 7-step implementation strategy was used to develop, implement and embed a WHPP in two different worksites with a focus on multiple lifestyle interventions.This article describes the design and framework for the formative evaluation of this 7-step strategy under real-time conditions by an embedded scientist with the purpose to gain insight into whether this this 7-step strategy is a useful and effective implementation strategy. Furthermore, we aim to gain insight into factors that either facilitate or hamper the implementation process, the quality of the implemented lifestyle interventions and the degree of adoption, implementation and continuation of these interventions. This study is a formative evaluation within two different worksites with an embedded scientist on site to continuously monitor the implementation process. Each worksite (i.e. a University of Applied Sciences and an Academic Hospital) will assign a participating faculty or a department, to implement a WHPP focusing on lifestyle interventions using the 7-step strategy. The primary focus will be to describe the natural course of development, implementation and maintenance of a WHPP by studying [a] the use and adherence to the 7-step strategy, [b] barriers and facilitators that influence the natural course of adoption, implementation and maintenance, and [c] the implementation process of the lifestyle interventions. All data will be collected using qualitative (i.e. real-time monitoring and semi-structured interviews) and quantitative methods (i.e. process evaluation questionnaires) applying data triangulation. Except for the real-time monitoring, the data collection will take place at baseline and after 6, 12 and 18 months. This is one of the few studies to extensively and continuously monitor the natural course of the implementation process of a WHPP by a formative evaluation using a mix of quantitative and qualitative methods on different organizational levels (i.e. management, project group, employees) with an embedded scientist on site. NTR2861.

Evaluation of America's Career Kit.

ERIC Educational Resources Information Center

Office of Inspector General (DOL), Washington, DC.

The Employment and Training Administration's (ETA's) development and implementation of America's Career Kit (ACK), which is an online career development resource for individuals needing job search assistance, career guidance, salary data, and training and educational resources, was evaluated. The evaluation was designed to determine whether ACK…

Evaluation Framework for Telemedicine Using the Logical Framework Approach and a Fishbone Diagram

PubMed Central

2015-01-01

Objectives Technological advances using telemedicine and telehealth are growing in healthcare fields, but the evaluation framework for them is inconsistent and limited. This paper suggests a comprehensive evaluation framework for telemedicine system implementation and will support related stakeholders' decision-making by promoting general understanding, and resolving arguments and controversies. Methods This study focused on developing a comprehensive evaluation framework by summarizing themes across the range of evaluation techniques and organized foundational evaluation frameworks generally applicable through studies and cases of diverse telemedicine. Evaluation factors related to aspects of information technology; the evaluation of satisfaction of service providers and consumers, cost, quality, and information security are organized using the fishbone diagram. Results It was not easy to develop a monitoring and evaluation framework for telemedicine since evaluation frameworks for telemedicine are very complex with many potential inputs, activities, outputs, outcomes, and stakeholders. A conceptual framework was developed that incorporates the key dimensions that need to be considered in the evaluation of telehealth implementation for a formal structured approach to the evaluation of a service. The suggested framework consists of six major dimensions and the subsequent branches for each dimension. Conclusions To implement telemedicine and telehealth services, stakeholders should make decisions based on sufficient evidence in quality and safety measured by the comprehensive evaluation framework. Further work would be valuable in applying more comprehensive evaluations to verify and improve the comprehensive framework across a variety of contexts with more factors and participant group dimensions. PMID:26618028

Evaluation Framework for Telemedicine Using the Logical Framework Approach and a Fishbone Diagram.

PubMed

Chang, Hyejung

2015-10-01

Technological advances using telemedicine and telehealth are growing in healthcare fields, but the evaluation framework for them is inconsistent and limited. This paper suggests a comprehensive evaluation framework for telemedicine system implementation and will support related stakeholders' decision-making by promoting general understanding, and resolving arguments and controversies. This study focused on developing a comprehensive evaluation framework by summarizing themes across the range of evaluation techniques and organized foundational evaluation frameworks generally applicable through studies and cases of diverse telemedicine. Evaluation factors related to aspects of information technology; the evaluation of satisfaction of service providers and consumers, cost, quality, and information security are organized using the fishbone diagram. It was not easy to develop a monitoring and evaluation framework for telemedicine since evaluation frameworks for telemedicine are very complex with many potential inputs, activities, outputs, outcomes, and stakeholders. A conceptual framework was developed that incorporates the key dimensions that need to be considered in the evaluation of telehealth implementation for a formal structured approach to the evaluation of a service. The suggested framework consists of six major dimensions and the subsequent branches for each dimension. To implement telemedicine and telehealth services, stakeholders should make decisions based on sufficient evidence in quality and safety measured by the comprehensive evaluation framework. Further work would be valuable in applying more comprehensive evaluations to verify and improve the comprehensive framework across a variety of contexts with more factors and participant group dimensions.

A Preliminary Evaluation of Reach: Training Early Childhood Teachers to Support Children's Social and Emotional Development

ERIC Educational Resources Information Center

Conners-Burrow, Nicola A.; Patrick, Terese; Kyzer, Angela; McKelvey, Lorraine

2017-01-01

This paper describes the development, implementation and preliminary evaluation of the Reaching Educators and Children (REACH) program, a training and coaching intervention designed to increase the capacity of early childhood teachers to support children's social and emotional development. We evaluated REACH with 139 teachers of toddler and…

Alternative Education: Evaluation and Implementation of EBCE.

ERIC Educational Resources Information Center

Shively, Joe E.; Sanders, Jack

Increasing student disenchantment with traditional schooling prompted the development of an alternative educational program: Experience-Based Career Education (EBCE). During three years of development, evaluation provided student, parent, and employer data on program impact and effectiveness. Stakeholders' involvement in program development and…

Developing Leadership in Managers to Facilitate the Implementation of National Guideline Recommendations: A Process Evaluation of Feasibility and Usefulness

PubMed Central

Tistad, Malin; Palmcrantz, Susanne; Wallin, Lars; Ehrenberg, Anna; Olsson, Christina B.; Tomson, Göran; Holmqvist, Lotta Widén; Gifford, Wendy; Eldh, Ann Catrine

2016-01-01

Background: Previous research supports the claim that managers are vital players in the implementation of clinical practice guidelines (CPGs), yet little is known about interventions aiming to develop managers’ leadership in facilitating implementation. In this pilot study, process evaluation was employed to study the feasibility and usefulness of a leadership intervention by exploring the intervention’s potential to support managers in the implementation of national guideline recommendations for stroke care in outpatient rehabilitation. Methods: Eleven senior and frontline managers from five outpatient stroke rehabilitation centers participated in a four-month leadership intervention that included workshops, seminars, and teleconferences. The focus was on developing knowledge and skills to enhance the implementation of CPG recommendations, with a particular focus on leadership behaviors. Each dyad of managers was assigned to develop a leadership plan with specific goals and leadership behaviors for implementing three rehabilitation recommendations. Feasibility and usefulness were explored through observations and interviews with the managers and staff members prior to the intervention, and then one month and one year after the intervention. Results: Managers considered the intervention beneficial, particularly the participation of both senior and frontline managers and the focus on leadership knowledge and skills for implementing CPG recommendations. All the managers developed a leadership plan, but only two units identified goals specific to implementing the three stroke rehabilitation recommendations. Of these, only one identified leadership behaviors that support implementation. Conclusion: Managers found that the intervention was delivered in a feasible way and appreciated the focus on leadership to facilitate implementation. However, the intervention appeared to have limited impact on managers’ behaviors or clinical practice at the units. Future interventions directed towards managers should have a stronger focus on developing leadership skills and behaviors to tailor implementation plans and support implementation of CPG recommendations. PMID:27694661

Developing Leadership in Managers to Facilitate the Implementation of National Guideline Recommendations: A Process Evaluation of Feasibility and Usefulness.

PubMed

Tistad, Malin; Palmcrantz, Susanne; Wallin, Lars; Ehrenberg, Anna; Olsson, Christina B; Tomson, Göran; Holmqvist, Lotta Widén; Gifford, Wendy; Eldh, Ann Catrine

2016-04-11

Previous research supports the claim that managers are vital players in the implementation of clinical practice guidelines (CPGs), yet little is known about interventions aiming to develop managers' leadership in facilitating implementation. In this pilot study, process evaluation was employed to study the feasibility and usefulness of a leadership intervention by exploring the intervention's potential to support managers in the implementation of national guideline recommendations for stroke care in outpatient rehabilitation. Eleven senior and frontline managers from five outpatient stroke rehabilitation centers participated in a four-month leadership intervention that included workshops, seminars, and teleconferences. The focus was on developing knowledge and skills to enhance the implementation of CPG recommendations, with a particular focus on leadership behaviors. Each dyad of managers was assigned to develop a leadership plan with specific goals and leadership behaviors for implementing three rehabilitation recommendations. Feasibility and usefulness were explored through observations and interviews with the managers and staff members prior to the intervention, and then one month and one year after the intervention. Managers considered the intervention beneficial, particularly the participation of both senior and frontline managers and the focus on leadership knowledge and skills for implementing CPG recommendations. All the managers developed a leadership plan, but only two units identified goals specific to implementing the three stroke rehabilitation recommendations. Of these, only one identified leadership behaviors that support implementation. Managers found that the intervention was delivered in a feasible way and appreciated the focus on leadership to facilitate implementation. However, the intervention appeared to have limited impact on managers' behaviors or clinical practice at the units. Future interventions directed towards managers should have a stronger focus on developing leadership skills and behaviors to tailor implementation plans and support implementation of CPG recommendations. © 2016 by Kerman University of Medical Sciences

29 CFR 1960.56 - Training of safety and health specialists.

Code of Federal Regulations, 2010 CFR

2010-07-01

..., laboratory experiences, field study, and other formal learning experiences to prepare them to perform the... program development and implementation, as well as hazard recognition, evaluation and control, equipment... tasks. (b) Each agency shall implement career development programs for their occupational safety and...

Physical interpretation and development of ultrasonic nondestructive evaluation techniques applied to the quantitative characterization of textile composite materials

NASA Technical Reports Server (NTRS)

Miller, James G.

1993-01-01

In this Progress Report, we describe our current research activities concerning the development and implementation of advanced ultrasonic nondestructive evaluation methods applied to the characterization of stitched composite materials and bonded aluminum plate specimens. One purpose of this investigation is to identify and characterize specific features of polar backscatter interrogation which enhance the ability of ultrasound to detect flaws in a stitched composite laminate. Another focus is to explore the feasibility of implementing medical linear array imaging technology as a viable ultrasonic-based nondestructive evaluation method to inspect and characterize bonded aluminum lap joints. As an approach to implementing quantitative ultrasonic inspection methods to both of these materials, we focus on the physics that underlies the detection of flaws in such materials.

Right timing in formative program evaluation.

PubMed

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of Professional Development in the Use of Arts-Integrated Activities with Mathematics Content: Findings about Program Implementation

ERIC Educational Resources Information Center

Ludwig, Meredith Jane; Mengli, Song; Kouyate-Tate, Akua; Cooper, Jennifer E.; Phillips, Lori; Greenbaum, Sarah

2014-01-01

In 2010, the Wolf Trap Foundation for the Performing Arts, Institute for Early Learning Through the Arts, was awarded an Arts in Education Model Development and Dissemination (AEMDD) grant to develop, implement, and disseminate a research-based program of professional development (PD) that equips prekindergarten and kindergarten teachers to infuse…

Implementing a Game for Supporting Learning in Mathematics

ERIC Educational Resources Information Center

Katmada, Aikaterini; Mavridis, Apostolos; Tsiatsos, Thrasyvoulos

2014-01-01

This paper focuses on the design, implementation and evaluation of an online game for elementary and middle school mathematics. Its aim is twofold: (a) the development of the prototype of a flexible and adaptable computer game, and (b) the evaluation of this prototype, as to its usability and technical aspects. The particular computer game was…

California Curriculum Frameworks: A Handbook for Production, Implementation, and Evaluation Activities.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento.

This booklet describes the characteristics and role of curriculum frameworks and describes how they can be used in developing educational programs. It is designed as a guide for writers of frameworks, for educators who are responsible for implementing frameworks, or for evaluators of educational programs. It provides a concise description of the…

A Transition Program for Underprepared Students in General Chemistry: Diagnosis, Implementation, and Evaluation

ERIC Educational Resources Information Center

Shields, Shawn P.; Hogrebe, Mark C.; Spees, William M.; Handlin, Larry B.; Noelken, Greg P.; Riley, Julie M.; Frey, Regina F.

2012-01-01

We developed an online exam to diagnose students who are underprepared for college-level general chemistry and implemented a program to support them during the general chemistry sequence. This transition program consists of extended-length recitations, peer-led team-learning (PLTL) study groups, and peer-mentoring groups. We evaluated this…

AATA AOS evaluation : transfer and on-time performance study : before and after AOS implementation, October 1996 - May 1999

DOT National Transportation Integrated Search

1999-01-01

This study develops, using data before AOS in 1996 and 1997 and after AOS in 1998 and 1999, implementation data on AATAs on-time performance and vehicle-to-vehicle timing of transfers at four major transfer location. Systematic evaluation of on-ti...

Evaluation of the implementation of entrepreneurial potential (on the example of the Republic of Tatarstan)

NASA Astrophysics Data System (ADS)

Guzelbaeva, G. T.; Rakhmatullina, D. K.; Akhmetshina, E. R.

2017-12-01

Increase in the number of small businesses and the lack of effectiveness of existing support at local and regional level have led to curb the development of entrepreneurial activity. The article presents the methodological tools for assessing the effectiveness, which allows to identify existing municipalities in the advantages and disadvantages for the implementation of entrepreneurial potential, including the effectiveness of state and municipal support measures, as well as calculate the degree of progress in the implementation of entrepreneurial potential. In order to evaluate the implementation of the business potential of the Republic of Tatarstan and the impact of their public support at the regional level was calculated indexes of business activity in the municipal districts (MD) of the republic. It should be noted that a major breakthrough in share of small and medium-sized businesses is important to the whole ecosystem. The method of evaluation of the implementation of entrepreneurial potential which is presented in this paper can be used by every competent organization to analyze and form the effective programs of the economic and finance development.

[Evaluation of hospital admissions: admission guidelines implementation in a pediatric emergency department].

PubMed

Katz, Manuel; Warshawsky, Sheila S; Rosen, Shirley; Barak, Nurit; Press, Joseph

2004-10-01

To develop and implement locally tailored pediatric admission guidelines for use in a pediatric emergency department and evaluate the appropriateness of admissions based on these guidelines. Our Study was based on the development of admission guidelines by senior physicians, using the Delphi Consensus Process, for use in the Pediatric Emergency Department (PED) at Soroka University Medical Center (Soroka). We evaluated the appropriateness of admissions to the pediatric departments of Soroka on 33 randomly selected days in 1999 and 2000 prior to guideline implementation and 30 randomly selected days in 2001, after guideline implementation. A total of 1037 files were evaluated. A rate of 12.4% inappropriate admissions to the pediatric departments was found based on locally tailored admission guidelines. There was no change in the rate of inappropriate admissions after implementation of admission guidelines in PED. Inappropriate admissions were associated with age above 3 years, hospital stay of two days or less and the season. The main reasons for evaluating an admission as inappropriate were that the admission did not comply with the guidelines and that the case could be managed in an ambulatory setting. There were distinctive differences in the characteristics of the Bedouin and Jewish populations admitted to the pediatric departments, although no difference was found in the rate of inappropriate admissions between these populations. Patient management in Soroka PED is tailored to the conditions of this medical center and to the characteristics of the population it serves. The admission guidelines developed reflect these special conditions. Lack of change in the rate of inappropriate admissions following implementation of the guidelines indicates that the guidelines reflect the physicians' approach to patient management that existed in Soroka PED prior to guideline implementation. Hospital admission guidelines have a role in the health management system; however, these guidelines must be tailored to reflect local characteristics and needs.

Examen des politiques institutionnelles d'evaluation des apprentissages et de leur mise en oeuvre: L'etat et les besoin de l'enseignement collegial en evaluation (An Investigation of the Institutional Policies of Evaluation of Learning and Their Implementation: The Status and the Needs of Evaluation in Collegial Education).

ERIC Educational Resources Information Center

Conseil des Colleges, Quebec (Quebec).

This two-part report by the Commission on Evaluation of Quebec's Council of Colleges focuses on the progress of the province's colleges in developing and implementing legislatively mandated policies concerning the evaluation of learning. Chapter 1 identifies the 107 of 112 colleges with written policies meeting the criteria established by the…

L'Examen des politiques institutionnelles d'evaluation des apprentissages et de leur mise en oeuvre: rapport sur l'etat et les besoins de l'enseignement collegial en evaluation (An Investigation of the Institutional Policies of Evaluation of Apprenticeships and Their Implementation: Report on the Status and the Needs of Evaluation in Collegial Education).

ERIC Educational Resources Information Center

Conseil des Colleges, Quebec (Quebec).

This two-part report by the Commission on Evaluation of the Council of Colleges in Quebec focuses on the progress of the province's colleges in developing and implementing legislatively mandated policies concerning the evaluation of apprenticeships. Chapter 1 identifies the 95 colleges with policies meeting the criteria established by the…

Signal analysis techniques for incipient failure detection in turbomachinery

NASA Technical Reports Server (NTRS)

Coffin, T.

1985-01-01

Signal analysis techniques for the detection and classification of incipient mechanical failures in turbomachinery were developed, implemented and evaluated. Signal analysis techniques available to describe dynamic measurement characteristics are reviewed. Time domain and spectral methods are described, and statistical classification in terms of moments is discussed. Several of these waveform analysis techniques were implemented on a computer and applied to dynamic signals. A laboratory evaluation of the methods with respect to signal detection capability is described. Plans for further technique evaluation and data base development to characterize turbopump incipient failure modes from Space Shuttle main engine (SSME) hot firing measurements are outlined.

American Indian Breast Cancer Project: Educational Development and Implementation.

ERIC Educational Resources Information Center

Hodge, Felicia Schanche; Casken, John

1999-01-01

Describes the development, implementation, and evaluation of Pathways to Health, a breast cancer education program targeting American Indian women in California. Discusses initial focus group results concerning belief in breast cancer risk, barriers to cancer screening and treatment, culturally sensitive issues, and illness beliefs. Describes…

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences

ERIC Educational Resources Information Center

Kraft, Matthew A.; Gilmour, Allison F.

2016-01-01

Purpose: New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to…

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions

PubMed Central

Egan, M; Bambra, C; Petticrew, M; Whitehead, M

2009-01-01

Background: The reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions was appraised. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socioeconomic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Methods: Data on implementation were obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially developed checklist and by means of an unstructured reading of the text. Results: 103 studies were identified and appraised, evaluating four types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation, but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Conclusions: Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. The checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, however, the more qualitative appraisals appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing. PMID:18718981

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions.

PubMed

Egan, M; Bambra, C; Petticrew, M; Whitehead, M

2009-01-01

The reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions was appraised. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socioeconomic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Data on implementation were obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially developed checklist and by means of an unstructured reading of the text. 103 studies were identified and appraised, evaluating four types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation, but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. The checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, however, the more qualitative appraisals appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing.

Development of an Implementation and Evaluation Plan for Strong Teens, a Social and Emotional Learning Curriculum

ERIC Educational Resources Information Center

Ross, Tajara Dovie

2012-01-01

Recent research on social emotional learning (SEL) curricula has shown that implementing SEL instruction within the classroom is a qualified evidenced-based intervention to help students develop fundamental skills for success in life. SEL curricula help teach students essential skills such as recognizing and managing emotions, developing caring…

A Framework for the Study of Complex mHealth Interventions in Diverse Cultural Settings

PubMed Central

Yeates, Karen; Perkins, Nancy; Boesch, Lisa; Hua-Stewart, Diane; Liu, Peter; Sleeth, Jessica; Tobe, Sheldon W

2017-01-01

Background To facilitate decision-making capacity between options of care under real-life service conditions, clinical trials must be pragmatic to evaluate mobile health (mHealth) interventions under the variable conditions of health care settings with a wide range of participants. The mHealth interventions require changes in the behavior of patients and providers, creating considerable complexity and ambiguity related to causal chains. Process evaluations of the implementation are necessary to shed light on the range of unanticipated effects an intervention may have, what the active ingredients in everyday practice are, how they exert their effect, and how these may vary among recipients or between sites. Objective Building on the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth) statement and participatory evaluation theory, we present a framework for the process evaluations for mHealth interventions in multiple cultural settings. We also describe the application of this evaluation framework to the implementation of DREAM-GLOBAL (Diagnosing hypertension—Engaging Action and Management in Getting Lower BP in Indigenous and LMIC [low- and middle-income countries]), a pragmatic randomized controlled trial (RCT), and mHealth intervention designed to improve hypertension management in low-resource environments. We describe the evaluation questions and the data collection processes developed by us. Methods Our literature review revealed that there is a significant knowledge gap related to the development of a process evaluation framework for mHealth interventions. We used community-based participatory research (CBPR) methods and formative research data to develop a process evaluation framework nested within a pragmatic RCT. Results Four human organizational levels of participants impacted by the mHealth intervention were identified that included patients, providers, community and organizations actors, and health systems and settings. These four levels represent evaluation domains and became the core focus of the evaluation. In addition, primary implementation themes to explore in each of the domains were identified as follows: (1) the major active components of the intervention, (2) technology of the intervention, (3) cultural congruence, (4) task shifting, and (5) unintended consequences. Using the four organizational domains and their interaction with primary implementation themes, we developed detailed evaluation research questions and identified the data or information sources to best answer our questions. Conclusions Using DREAM-GLOBAL to illustrate our approach, we succeeded in developing an uncomplicated process evaluation framework for mHealth interventions that provide key information to stakeholders, which can optimize implementation of a pragmatic trial as well as inform scale up. The human organizational level domains used to focus the primary implementation themes in the DREAM-GLOBAL process evaluation framework are sufficiently supported in our research, and the literature and can serve as a valuable tool for other mHealth process evaluations. Trial Registration ClinicalTrials.gov NCT02111226; https://clinicaltrials.gov/ct2/show/NCT02111226 (Archived by WebCite at http://www.webcitation.org/6oxfHXege) PMID:28428165

Designing next-generation platforms for evaluating scientific output: what scientists can learn from the social web

PubMed Central

Yarkoni, Tal

2012-01-01

Traditional pre-publication peer review of scientific output is a slow, inefficient, and unreliable process. Efforts to replace or supplement traditional evaluation models with open evaluation platforms that leverage advances in information technology are slowly gaining traction, but remain in the early stages of design and implementation. Here I discuss a number of considerations relevant to the development of such platforms. I focus particular attention on three core elements that next-generation evaluation platforms should strive to emphasize, including (1) open and transparent access to accumulated evaluation data, (2) personalized and highly customizable performance metrics, and (3) appropriate short-term incentivization of the userbase. Because all of these elements have already been successfully implemented on a large scale in hundreds of existing social web applications, I argue that development of new scientific evaluation platforms should proceed largely by adapting existing techniques rather than engineering entirely new evaluation mechanisms. Successful implementation of open evaluation platforms has the potential to substantially advance both the pace and the quality of scientific publication and evaluation, and the scientific community has a vested interest in shifting toward such models as soon as possible. PMID:23060783

Development of an existential support training program for healthcare professionals.

PubMed

Henoch, Ingela; Strang, Susann; Browall, Maria; Danielson, Ella; Melin-Johansson, Christina

2015-12-01

Our aim was to describe the developmental process of a training program for nurses to communicate existential issues with severely ill patients. The Medical Research Council (MRC) framework for the development and evaluation of complex interventions was used to develop a training program for nurses to communicate about existential issues with their patients. The steps in the framework were employed to describe the development of the training intervention, and the development, feasibility and piloting, evaluation, and implementation phases. The development and feasibility phases are described in the Methods section. The evaluation and implementation phases are described in the Results section. In the evaluation phase, the effectiveness of the intervention was shown as nurses' confidence in communication increased after training. The understanding of the change process was considered to be that the nurses could describe their way of communicating in terms of prerequisites, process, and content. Some efforts have been made to implement the training intervention, but these require further elaboration. Existential and spiritual issues are very important to severely ill patients, and healthcare professionals need to be attentive to such questions. It is important that professionals be properly prepared when patients need this communication. An evidence-based training intervention could provide such preparation. Healthcare staff were able to identify situations where existential issues were apparent, and they reported that their confidence in communication about existential issues increased after attending a short-term training program that included reflection. In order to design a program that should be permanently implemented, more knowledge is needed of patients' perceptions of the quality of the healthcare staff's existential support.

Use of health information technology to advance evidence-based care: lessons from the VA QUERI program.

PubMed

Hynes, Denise M; Weddle, Timothy; Smith, Nina; Whittier, Erika; Atkins, David; Francis, Joseph

2010-01-01

As the Department of Veterans Affairs (VA) Health Services Research and Development Service's Quality Enhancement Research Initiative (QUERI) has progressed, health information technology (HIT) has occupied a crucial role in implementation research projects. We evaluated the role of HIT in VA QUERI implementation research, including HIT use and development, the contributions implementation research has made to HIT development, and HIT-related barriers and facilitators to implementation research. Key informants from nine disease-specific QUERI Centers. Documentation analysis of 86 implementation project abstracts followed up by semi-structured interviews with key informants from each of the nine QUERI centers. We used qualitative and descriptive analyses. We found: (1) HIT provided data and information to facilitate implementation research, (2) implementation research helped to further HIT development in a variety of uses including the development of clinical decision support systems (23 of 86 implementation research projects), and (3) common HIT barriers to implementation research existed but could be overcome by collaborations with clinical and administrative leadership. Our review of the implementation research progress in the VA revealed interdependency on an HIT infrastructure and research-based development. Collaboration with multiple stakeholders is a key factor in successful use and development of HIT in implementation research efforts and in advancing evidence-based practice.

Development and demonstration of marketing techniques for establishment of ridesharing corporations in New York State: Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Peters, E.W.; Matthews, N.P.

1987-10-01

The intent of this project was to develop, demonstrate and evaluate marketing techniques for the establishment of ridesharing corporations in New York State. The objectives of the first phase of the project were to: (1) develop a ''how-to'' guide for establishing a ridesharing corporation; and (2) conduct a market assessment to identify specific methods for capturing potential users of the service. The objectives of the second phase of the project were to: (1) prepare and implement a marketing strategy to address the various major users and evaluate the viability of new marketing techniques developed in Phase 1 and marketing techniquesmore » developed during the first year of operations; and (2) develop and disseminate a ''how-to'' guide regarding the development, implementation and evaluation of marketing strategies for ridesharing in New York State.« less

Modeling and Simulation Roadmap to Enhance Electrical Energy Security of U.S. Naval Bases

DTIC Science & Technology

2012-03-01

evaluating power system architectures and technologies and, therefore, can become a valuable tool for the implementation of the described plan for Navy...a well validated and consistent process for evaluating power system architectures and technologies and, therefore, can be a valuable tool for the...process for evaluating power system architectures and component technologies is needed to support the development and implementation of these new

"Compassion, pleasantry, and hope": a process evaluation of a volunteer-based nonprofit.

PubMed

Mye, Sarah C; Moracco, Kathryn E

2015-06-01

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Alberta: evaluation of nursing retention and recruitment programs.

PubMed

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care. However, no formal implementation plan had been developed or made available to assist employers with implementation of the programs. The findings highlight the need for more discipline in communicating, implementing and evaluating initiatives such as those evaluated retrospectively in this project. In particular, key performance indicators, baseline data, monitoring mechanisms and an evaluation plan need to be developed prior to implementation.

Building system capacity for the integration of mental health at the level of primary care in Tunisia: a study protocol in global mental health.

PubMed

Spagnolo, Jessica; Champagne, François; Leduc, Nicole; Piat, Myra; Melki, Wahid; Charfi, Fatma; Laporta, Marc

2017-01-17

In low- and middle-income countries (LMICs), addressing the high prevalence of mental disorders is a challenge given the limited number and unequal distribution of specialists, as well as scarce resources allocated to mental health. The Mental Health Gap Action Programme (mhGAP) and its accompanying Intervention Guide (IG), developed by the World Health Organization (WHO), aim to address this challenge by training non-specialists such as general practitioners (GPs) in mental health care. This trial aims to implement and evaluate an adapted version of the mhGAP-IG (version 1.0) offered to GPs in 2 governorates of Tunisia (i.e., Tunis and Sousse), in order to uncover important information regarding implementation process and study design before country-wide implementation and evaluation. First, a systematic review will be conducted to explore types and effectiveness of mental health training programs offered to GPs around the world, with a specific focus on programs implemented and evaluated in LMICs. Second, a cluster randomized controlled trial (RCT) will be conducted to evaluate the effectiveness of the implemented training based on the mhGAP-IG (version 1.0). Third, multiple case study design will be used to explore how contextual factors impact the successful implementation of the training and desired outcomes. In Tunisia, an important need exists to further develop proximity health services and to address the growing mental health treatment gap. One solution is to train GPs in the detection, treatment, and management of mental health problems, given their strategic role in the healthcare system. This trial thus aims to implement and evaluate an adapted version of a training based on the mhGAP-IG (version 1.0) in Tunis and Sousse before country-wide implementation and evaluation. Several contributions are envisioned: adding to the growing evidence on the mhGAP and its accompanying guide, especially in French-speaking nations; building research capacity in Tunisia and more generally in LMICs by employing rigorous designs; evaluating an adapted version of the mhGAP-IG (version 1.0) on a sample of GPs; generating important information regarding implementation process and study design before country-wide implementation; and complimenting the trial results with implementation analysis, a priority in global mental health.

An Information System Development Method Connecting Business Process Modeling and its Experimental Evaluation

NASA Astrophysics Data System (ADS)

Okawa, Tsutomu; Kaminishi, Tsukasa; Kojima, Yoshiyuki; Hirabayashi, Syuichi; Koizumi, Hisao

Business process modeling (BPM) is gaining attention as a measure of analysis and improvement of the business process. BPM analyses the current business process as an AS-IS model and solves problems to improve the current business and moreover it aims to create a business process, which produces values, as a TO-BE model. However, researches of techniques that connect the business process improvement acquired by BPM to the implementation of the information system seamlessly are rarely reported. If the business model obtained by BPM is converted into UML, and the implementation can be carried out by the technique of UML, we can expect the improvement in efficiency of information system implementation. In this paper, we describe a method of the system development, which converts the process model obtained by BPM into UML and the method is evaluated by modeling a prototype of a parts procurement system. In the evaluation, comparison with the case where the system is implemented by the conventional UML technique without going via BPM is performed.

Development of a tailored strategy to improve postpartum hemorrhage guideline adherence.

PubMed

de Visser, Suzan M; Woiski, Mallory D; Grol, Richard P; Vandenbussche, Frank P H A; Hulscher, Marlies E J L; Scheepers, Hubertina C J; Hermens, Rosella P M G

2018-02-08

Despite the introduction of evidence based guidelines and practical courses, the incidence of postpartum hemorrhage shows an increasing trend in developed countries. Substandard care is often found, which implies an inadequate implementation in high resource countries. We aimed to reduce the gap between evidence-based guidelines and clinical application, by developing a strategy, tailored to current barriers for implementation. The development of the implementation strategy consisted of three phases, supervised by a multidisciplinary expert panel. In the first phase a framework of the strategy was created, based on barriers to optimal adherence identified among professionals and patients together with evidence on effectiveness of strategies found in literature. In the second phase, the tools within the framework were developed, leading to a first draft. In the third phase the strategy was evaluated among professionals and patients. The professionals were asked to give written feedback on tool contents, clinical usability and inconsistencies with current evidence care. Patients evaluated the tools on content and usability. Based on the feedback of both professionals and patients the tools were adjusted. We developed a tailored strategy to improve guideline adherence, covering the trajectory of the third trimester of pregnancy till the end of the delivery. The strategy, directed at professionals, comprehending three stop moments includes a risk assessment checklist, care bundle and time-out procedure. As patient empowerment tools, a patient passport and a website with patient information was developed. The evaluation among the expert panel showed all professionals to be satisfied with the content and usability and no discrepancies or inconsistencies with current evidence was found. Patients' evaluation revealed that the information they received through the tools was incomplete. The tools were adjusted accordingly to the missing information. A usable, tailored strategy to implement PPH guidelines and practical courses was developed. The next step is the evaluation of the strategy in a feasibility trial. Clinical trial registration: The Fluxim study, registration number: NCT00928863 .

Factors that affect implementation of a nurse staffing directive: results from a qualitative multi-case evaluation.

PubMed

Robinson, Claire H; Annis, Ann M; Forman, Jane; Krein, Sarah L; Yankey, Nicholas; Duffy, Sonia A; Taylor, Beth; Sales, Anne E

2016-08-01

To assess implementation of the Veterans Health Administration staffing methodology directive. In 2010 the Veterans Health Administration promulgated a staffing methodology directive for inpatient nursing units to address staffing and budget forecasting. A qualitative multi-case evaluation approach assessed staffing methodology implementation. Semi-structured telephone interviews were conducted from March - June 2014 with Nurse Executives and their teams at 21 facilities. Interviews focused on the budgeting process, implementation experiences, use of data, leadership support, and training. An implementation score was created for each facility using a 4-point rating scale. The scores were used to select three facilities (low, medium and high implementation) for more detailed case studies. After analysing interview summaries, the evaluation team developed a four domain scoring structure: (1) integration of staffing methodology into budget development; (2) implementation of the Directive elements; (3) engagement of leadership and staff; and (4) use of data to support the staffing methodology process. The high implementation facility had leadership understanding and endorsement of staffing methodology, confidence in and ability to work with data, and integration of staffing methodology results into the budgeting process. The low implementation facility reported poor leadership engagement and little understanding of data sources and interpretation. Implementation varies widely across facilities. Implementing staffing methodology in facilities with complex and changing staffing needs requires substantial commitment at all organizational levels especially for facilities that have traditionally relied on historical levels to budget for staffing. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

MOBILE EMISSIONS ASSESSMENT SYSTEM FOR URBAN AND REGIONAL EVALUATION

EPA Science Inventory

A working research model for Atlanta, GA has been developed by Georgia Tech, and is called the Mobile Emissions Assessment System for Urban and Regional Evaluation (MEASURE). The EPA Office of Research and Development has developed an additional implementation of the MEASURE res...

Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

NASA Astrophysics Data System (ADS)

Kurnia, Feni; Rosana, Dadan; Supahar

2017-08-01

This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

Evaluating the implementation process of a participatory organizational level occupational health intervention in schools.

PubMed

Schelvis, Roosmarijn M C; Wiezer, Noortje M; Blatter, Birgitte M; van Genabeek, Joost A G M; Oude Hengel, Karen M; Bohlmeijer, Ernst T; van der Beek, Allard J

2016-12-01

The importance of process evaluations in examining how and why interventions are (un) successful is increasingly recognized. Process evaluations mainly studied the implementation process and the quality of the implementation (fidelity). However, in adopting this approach for participatory organizational level occupational health interventions, important aspects such as context and participants perceptions are missing. Our objective was to systematically describe the implementation process of a participatory organizational level occupational health intervention aimed at reducing work stress and increasing vitality in two schools by applying a framework that covers aspects of the intervention and its implementation as well as the context and participants perceptions. A program theory was developed, describing the requirements for successful implementation. Each requirement was operationalized by making use of the framework, covering: initiation, communication, participation, fidelity, reach, communication, satisfaction, management support, targeting, delivery, exposure, culture, conditions, readiness for change and perceptions. The requirements were assessed by quantitative and qualitative data, collected at 12 and 24 months after baseline in both schools (questionnaire and interviews) or continuously (logbooks). The intervention consisted of a needs assessment phase and a phase of implementing intervention activities. The needs assessment phase was implemented successfully in school A, but not in school B where participation and readiness for change were insufficient. In the second phase, several intervention activities were implemented at school A, whereas this was only partly the case in school B (delivery). In both schools, however, participants felt not involved in the choice of intervention activities (targeting, participation, support), resulting in a negative perception of and only partial exposure to the intervention activities. Conditions, culture and events hindered the implementation of intervention activities in both schools. The framework helped us to understand why the implementation process was not successful. It is therefore considered of added value for the evaluation of implementation processes in participatory organizational level interventions, foremost because of the context and mental models dimensions. However, less demanding methods for doing detailed process evaluations need to be developed. This can only be done if we know more about the most important process components and this study contributes to that knowledge base. Netherlands Trial Register NTR3284 .

Evaluating Comprehensive School Reform Models at Scale: Focus on Implementation

ERIC Educational Resources Information Center

Vernez, Georges; Karam, Rita; Mariano, Louis T.; DeMartini, Christine

2006-01-01

This study was designed to fill the "implementation measurement" gap. A methodology to quantitatively measure the level of Comprehensive School Reform (CSR) implementation that can be used across a variety of CSR models was developed, and then applied to measure actual implementation of four different CSR models in a large number of schools. The…

Evaluation and development plan of NRTA measurement methods for the Rokkasho Reprocessing Plant

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, T.K.; Hakkila, E.A.; Flosterbuer, S.F.

Near-real-time accounting (NRTA) has been proposed as a safeguards method at the Rokkasho Reprocessing Plant (RRP), a large-scale commercial boiling water and pressurized water reactors spent-fuel reprocessing facility. NRTA for RRP requires material balance closures every month. To develop a more effective and practical NRTA system for RRP, we have evaluated NRTA measurement techniques and systems that might be implemented in both the main process and the co-denitration process areas at RRP to analyze the concentrations of plutonium in solutions and mixed oxide powder. Based on the comparative evaluation, including performance, reliability, design criteria, operation methods, maintenance requirements, and estimatedmore » costs for each possible measurement method, recommendations for development were formulated. This paper discusses the evaluations and reports on the recommendation of the NRTA development plan for potential implementation at RRP.« less

Measuring performance to drive improvement: development of a clinical indicator set for general medicine.

PubMed

Brand, C; Lam, S K L; Roberts, C; Gorelik, A; Amatya, B; Smallwood, D; Russell, D

2009-06-01

There are delays in implementing evidence about effective therapy into clinical practice. Clinical indicators may support implementation of guideline recommendations. To develop and evaluate the short-term impact of a clinical indicator set for general medicine. A set of clinical process indicators was developed using a structured process. The indicator set was implemented between January 2006 and December 2006, using strategies based on evidence about effectiveness and local contextual factors. Evaluation included a structured survey of general medical staff to assess awareness and attitudes towards the programme and qualitative assessment of barriers to implementation. Impact on documentation of adherence to clinical indicators was assessed by auditing a random sample of medical records before (2003-2005) and after (2006) implementation. Clinical indicators were developed for the following areas: venous thromboembolism, cognition, chronic heart failure, chronic obstructive pulmonary disease, diabetes, low trauma fracture, patient written care plans. The programme was well supported and incurred little burden to staff. Implementation occurred largely as planned; however, documentation of adherence to clinical indicators was variable. There was a generally positive trend over time, but for most indicators this was independent of the implementation process and may have been influenced by other system improvement activities. Failure to demonstrate a significant impact during the pilot phase is likely to have been influenced by administrative factors, especially lack of an integrative data documentation and collection process. Successful implementation in phase two is likely to depend upon an effective data collection system integrated into usual care.

Lessons learned about collaborative evaluation using the Capacity for Applying Project Evaluation (CAPE) framework with school and district leaders.

PubMed

Corn, Jenifer O; Byrom, Elizabeth; Knestis, Kirk; Matzen, Nita; Thrift, Beth

2012-11-01

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In as much, education leaders need specific guidance and training on how to plan, implement, and use evaluation to critically examine district and school-level initiatives. One specific effort intended to address this need is through the Capacity for Applying Project Evaluation (CAPE) framework. The CAPE framework is composed of three crucial components: a collection of evaluation resources; a professional development model; and a conceptual framework that guides the work to support evaluation planning and implementation in schools and districts. School and district teams serve as active participants in the professional development and ultimately as formative evaluators of their own school or district-level programs by working collaboratively with evaluation experts. The CAPE framework involves the school and district staff in planning and implementing their evaluation. They are the ones deciding what evaluation questions to ask, which instruments to use, what data to collect, and how and to whom results should be reported. Initially this work is done through careful scaffolding by evaluation experts, where supports are slowly pulled away as the educators gain experience and confidence in their knowledge and skills as evaluators. Since CAPE engages all stakeholders in all stages of the evaluation, the philosophical intentions of these efforts to build capacity for formative evaluation strictly aligns with the collaborative evaluation approach. Copyright © 2012 Elsevier Ltd. All rights reserved.

Development and implementation of an independence rating scale and evaluation process for nursing orientation of new graduates.

PubMed

Durkin, Gregory J

2010-01-01

A wide variety of evaluation formats are available for new graduate nurses, but most of them are single-point evaluation tools that do not provide a clear picture of progress for orientee or educator. This article describes the development of a Web-based evaluation tool that combines learning taxonomies with the Synergy model into a rating scale based on independent performance. The evaluation tool and process provides open 24/7 access to evaluation documentation for members of the orientation team, demystifying the process and clarifying expectations. The implementation of the tool has proven to be transformative in the perceptions of evaluation and performance expectations of new graduates. This tool has been successful at monitoring progress, altering education, and opening dialogue about performance for over 125 new graduate nurses since inception.

An Implementation Model for Integrated Learning Systems.

ERIC Educational Resources Information Center

Mills, Steven C.; Ragan, Tillman R.

This paper describes the development, validation, and research application of the Computer-Delivered Instruction Configuration Matrix (CDICM), an instrument for evaluating the implementation of Integrated Learning Systems (ILS). The CDICM consists of a 15-item checklist, describing the major components of implementation of ILS technology, to be…

Evaluation in the Seventies: What We Have Learned About Program Development and Implementation.

ERIC Educational Resources Information Center

Holley, Freda M.

This paper, generated by the Austin, Texas, Independent School District's Office of Research and Evaluation, offers a set of working hypotheses about what a school district must do in the implementation of programs to improve the cost/effectiveness ratio of educational innovations. The author draws on three years of the Austin school district's…

Implementing a Service Learning Model for Teaching Research Methods and Program Evaluation

ERIC Educational Resources Information Center

Shannon, Patrick; Kim, Wooksoo; Robinson, Adjoa

2012-01-01

In an effort to teach students the basic knowledge of research methods and the realities of conducting research in the context of agencies in the community, faculty developed and implemented a service learning model for teaching research and program evaluation to foundation-year MSW students. A year-long foundation course was designed in which one…

Evaluating Integrated Task Based Activities and Computer Assisted Language Learning (CALL)

ERIC Educational Resources Information Center

Anwar, Khoirul; Husniah, Rohmy

2016-01-01

This study is to evaluate the implementation of Task Activities based on CALL which consist of observing, questioning, exploring, and communicating. The developed materials are nine chapters that had been implemented in two different classes of SMPN 1 Gresik and SMPM 4 Gresik in Indonesia. Of quesionnaires and interviews, the results indicate that…

Clinical Problem Solving Exercises for Pre-Clinical Medical Education: A Design, Implementation and Preliminary Evaluation.

ERIC Educational Resources Information Center

Bordage, Georges

Clinical problem solving exercises for preclinical medical education that were developed at Michigan State University School of Osteopathic Medicine are described. Two types of outcomes were set as priorities in the design and implementation of the problem solving sessions: small group peer interactions as instructional and evaluative resources;…

Investing in Development: Six High-Performing, High-Poverty Schools Implement the Massachusetts Teacher Evaluation Policy

ERIC Educational Resources Information Center

Reinhorn, Stefanie K.; Johnson, Susan Moore; Simon, Nicole S.

2017-01-01

We studied how six high-performing, high-poverty schools in one large Massachusetts city implemented the state's new teacher evaluation policy. The sample includes traditional, turnaround, restart, and charter schools, each of which had received the state's highest accountability rating. We sought to learn how these successful schools approached…

Widening Our Evaluative Lenses of Formal, Facilitated, and Spontaneous Academic Development

ERIC Educational Resources Information Center

Hoessler, Carolyn; Godden, Lorraine; Hoessler, Brian

2015-01-01

As conceptions of academic development expand to encompass a more diverse and flexible set of supports, traditional approaches to evaluation, including impact studies of formal programming, become insufficient. A program may appear ineffective when evaluation ignores additional supports that interact to counteract implementation or alternatively…

Space Shuttle Avionics: a Redundant IMU On-Board Checkout and Redundancy Management System

NASA Technical Reports Server (NTRS)

Mckern, R. A.; Brown, D. G.; Dove, D. W.; Gilmore, J. P.; Landey, M. E.; Musoff, H.; Amand, J. S.; Vincent, K. T., Jr.

1972-01-01

A failure detection and isolation philosophy applicable to multiple off-the-shelf gimbaled IMUs are discussed. The equations developed are implemented and evaluated with actual shuttle trajectory simulations. The results of these simulations are presented for both powered and unpowered flight phases and at operational levels of four, three, and two IMUs. A multiple system checkout philosophy is developed and simulation results presented. The final task develops a laboratory test plan and defines the hardware and software requirements to implement an actual multiple system and evaluate the interim study results for space shuttle application.

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Implementing AORN recommended practices for medication safety.

PubMed

Hicks, Rodney W; Wanzer, Linda J; Denholm, Bonnie

2012-12-01

Medication errors in the perioperative setting can result in patient morbidity and mortality. The AORN "Recommended practices for medication safety" provide guidance to perioperative nurses in developing, implementing, and evaluating safe medication use practices. These practices include recognizing risk points in the medication use process, collaborating with pharmacy staff members, conducting preoperative assessments and postoperative evaluations (eg, medication reconciliation), and handling hazardous medications and pharmaceutical waste. Strategies for successful implementation of the recommended practices include promoting a basic understanding of the nurse's role in the medication use process and developing a medication management plan as well as policies and procedures that support medication safety and activities to measure compliance with safe practices. Published by Elsevier Inc.

Developing a Virtual Physics World

ERIC Educational Resources Information Center

Wegener, Margaret; McIntyre, Timothy J.; McGrath, Dominic; Savage, Craig M.; Williamson, Michael

2012-01-01

In this article, the successful implementation of a development cycle for a physics teaching package based on game-like virtual reality software is reported. The cycle involved several iterations of evaluating students' use of the package followed by instructional and software development. The evaluation used a variety of techniques, including…

Development of a Design Tool for Planning Aqueous Amendment Injection Systems

DTIC Science & Technology

2012-08-01

Chemical Oxidation with Permanganate (MnO4- ) ...................................... 2 1.4 IMPLEMENTATION ISSUES...17 6.4 SS DESIGN TOOL DEVELOPMENT AND EVALUATION ........................... 19 7.0 CHEMICAL OXIDATION WITH PERMANGANATE ...21 7.1 NUMERICAL MODELING OF PERMANGANATE DISTRIBUTION ........... 21 7.2 CDISCO DEVELOPMENT AND EVALUATION

Development and implementation of the Saskatchewan Leadership Program: Leading for healthcare transformation.

PubMed

Mutwiri, Betty; Witt, Christine; Denysek, Christina; Halferdahl, Susan; McLeod, Katherine M

2016-01-01

The Saskatchewan Leadership Program (SLP) was developed based on the LEADS framework and aligned with Lean management to build leadership renewal and sustainability conducive to transformational change in the Saskatchewan health system. This article describes the development, implementation, and evaluation of the SLP, including experiences and lessons learned. © 2015 The Canadian College of Health Leaders.

Evaluative Case Study of the Effectiveness of Professional Development Elements When Implementing a Learning Management System in Elementary Education

ERIC Educational Resources Information Center

Beams, Tara E.

2017-01-01

As school districts across the country attempt to comply with federal and state mandates to effectively integrate technology into today's teaching and learning, they must face the challenge of also developing professional development plans which will adequately and successfully prepare teachers for implementing these new resources and these new…

Development, evaluation and implementation of video-EEG telemetry at home.

PubMed

Brunnhuber, Franz; Amin, Devyani; Nguyen, Yan; Goyal, Sushma; Richardson, Mark P

2014-05-01

To describe the development and implementation of video EEG telemetry (VT) in the patient's home (home video telemetry, HVT) in a single centre. HVT met the UK Medical Research Council definition of a complex intervention, and we used its guidance to evaluate the process of piloting, evaluating, developing and implementing this new clinical service. The first phase was a feasibility study, comparing inpatient VT (IVT) with HVT in a test-retest design (n=5), to assess data quality and yield of clinically relevant events. The second phase was a pre-implementation study (n=8), to examine acceptability and satisfaction as well as the costs of IVT and HVT. Subsequently, we implemented the service, and reviewed the outcomes of the first 34 patients. The feasibility study found no difference in the quality of recording or clinical yield between IVT and HVT. The pre-implementation study showed excellent patient satisfaction. We also discuss the findings of the main stakeholder survey (consultants and technicians). Our economic modelling demonstrates a clear financial superiority of HVT over IVT. Our findings show that diagnostic HVT for seizure classification and polysomnographies can be carried out safely in the patients' home and poses no security risks for staff. HVT can be effectively integrated into an existing tertiary care service as a routine home or community-based procedure. We hope to encourage other clinical neurophysiology departments and epilepsy centres to take advantage of our experience and consider adopting and implementing HVT, with the aim of a nationwide coverage. Copyright © 2014 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

CDC Activities for Improving Implementation of Human Papillomavirus Vaccination, Cervical Cancer Screening, and Surveillance Worldwide.

PubMed

Senkomago, Virginia; Duran, Denise; Loharikar, Anagha; Hyde, Terri B; Markowitz, Lauri E; Unger, Elizabeth R; Saraiya, Mona

2017-12-01

Cervical cancer incidence and mortality rates are high, particularly in developing countries. Most cervical cancers can be prevented by human papillomavirus (HPV) vaccination, screening, and timely treatment. The US Centers for Disease Control and Prevention (CDC) provides global technical assistance for implementation and evaluation of HPV vaccination pilot projects and programs and laboratory-related HPV activities to assess HPV vaccines. CDC collaborates with global partners to develop global cervical cancer screening recommendations and manuals, implement screening, create standardized evaluation tools, and provide expertise to monitor outcomes. CDC also trains epidemiologists in cancer prevention through its Field Epidemiology Training Program and is working to improve cancer surveillance by supporting efforts of the World Health Organization in developing cancer registry hubs and assisting countries in estimating costs for developing population-based cancer registries. These activities contribute to the Global Health Security Agenda action packages to improve immunization, surveillance, and the public health workforce globally.

Practical implementation science: developing and piloting the quality implementation tool.

PubMed

Meyers, Duncan C; Katz, Jason; Chien, Victoria; Wandersman, Abraham; Scaccia, Jonathan P; Wright, Annie

2012-12-01

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.

Implementing Dementia Care Mapping to develop person-centred care: results of a process evaluation within the Leben-QD II trial.

PubMed

Quasdorf, Tina; Riesner, Christine; Dichter, Martin Nikolaus; Dortmann, Olga; Bartholomeyczik, Sabine; Halek, Margareta

2017-03-01

To evaluate Dementia Care Mapping implementation in nursing homes. Dementia Care Mapping, an internationally applied method for supporting and enhancing person-centred care for people with dementia, must be successfully implemented into care practice for its effective use. Various factors influence the implementation of complex interventions such as Dementia Care Mapping; few studies have examined the specific factors influencing Dementia Care Mapping implementation. A convergent parallel mixed-methods design embedded in a quasi-experimental trial was used to assess Dementia Care Mapping implementation success and influential factors. From 2011-2013, nine nursing units in nine different nursing homes implemented either Dementia Care Mapping (n = 6) or a periodic quality of life measurement using the dementia-specific instrument QUALIDEM (n = 3). Diverse data (interviews, n = 27; questionnaires, n = 112; resident records, n = 81; and process documents) were collected. Each data set was separately analysed and then merged to comprehensively portray the implementation process. Four nursing units implemented the particular intervention without deviating from the preplanned intervention. Translating Dementia Care Mapping results into practice was challenging. Necessary organisational preconditions for Dementia Care Mapping implementation included well-functioning networks, a dementia-friendly culture and flexible organisational structures. Involved individuals' positive attitudes towards Dementia Care Mapping also facilitated implementation. Precisely planning the intervention and its implementation, recruiting champions who supported Dementia Care Mapping implementation and having well-qualified, experienced project coordinators were essential to the implementation process. For successful Dementia Care Mapping implementation, it must be embedded in a systematic implementation strategy considering the specific setting. Organisational preconditions may need to be developed before Dementia Care Mapping implementation. Necessary steps may include team building, developing and realising a person-centred care-based mission statement or educating staff regarding general dementia care. The implementation strategy may include attracting and involving individuals on different hierarchical levels in Dementia Care Mapping implementation and supporting staff to translate Dementia Care Mapping results into practice. The identified facilitating factors can guide Dementia Care Mapping implementation strategy development. © 2016 John Wiley & Sons Ltd.

Understanding Implementation of Complex Interventions in Primary Care Teams.

PubMed

Luig, Thea; Asselin, Jodie; Sharma, Arya M; Campbell-Scherer, Denise L

2018-01-01

The implementation of interventions to support practice change in primary care settings is complex. Pragmatic strategies, grounded in empiric data, are needed to navigate real-world challenges and unanticipated interactions with context that can impact implementation and outcomes. This article uses the example of the "5As Team" randomized control trial to explore implementation strategies to promote knowledge transfer, capacity building, and practice integration, and their interaction within the context of an interdisciplinary primary care team. We performed a qualitative evaluation of the implementation process of the 5As Team intervention study, a randomized control trial of a complex intervention in primary care. We conducted thematic analysis of field notes of intervention sessions, log books of the practice facilitation team members, and semistructured interviews with 29 interdisciplinary clinician participants. We used and further developed the Interactive Systems Framework for dissemination and implementation to interpret and structure findings. Three themes emerged that illuminate interactions between implementation processes, context, and outcomes: (1) facilitating team communication supported collective and individual sense-making and adoption of the innovation, (2) iterative evaluation of the implementation process and real-time feedback-driven adaptions of the intervention proved crucial for sustainable, context-appropriate intervention impact, (3) stakeholder engagement led to both knowledge exchange that contributes to local problem solving and to shaping a clinical context that is supportive to practice change. Our findings contribute pragmatic strategies that can help practitioners and researchers to navigate interactions between context, intervention, and implementation factors to increase implementation success. We further developed an implementation framework that includes sustained engagement with stakeholders, facilitation of team sense-making, and dynamic evaluation and intervention design as integral parts of complex intervention implementation. NCT01967797. 18 October 2013. © Copyright 2018 by the American Board of Family Medicine.

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Handbook for Improving Superintendent Performance Evaluation.

ERIC Educational Resources Information Center

Candoli, Carl; And Others

This handbook for superintendent performance evaluation contains information for boards of education as they institute or improve their evaluation system. The handbook answers questions involved in operationalizing, implementing, and evaluating a superintendent-evaluation system. The information was developed from research on superintendent…

The University of North Carolina Medical Center pharmacy resident leadership certificate program.

PubMed

Lyons, Kayley; Griggs, Danielle; Lebovic, Rachel; Roth, Mary E; South, David A; Hatfield, Chad

2017-03-15

The development and implementation of a certificate program for pharmacy residents are described. University of North Carolina (UNC) Medical Center met the call for increased efforts in the area of pharmacy residency leadership training through the design, implementation, and evaluation of a leadership certificate program. The purpose of the UNC certificate program is to develop leaders who will serve others, improve their communities, and advance the profession. The program is designed to (1) foster self-awareness, social awareness, and altruism, (2) provide transferable and individualized leadership experiences, (3) enrich other residency components through integration of leadership development opportunities, and (4) create role models for departmental leadership. A team of preceptors and residents implemented the certificate program by integrating program components into the existing pharmacy residency infrastructure. The certificate program includes required and flexible components to allow residents to set and achieve their determined leadership development goals. Overall, residents are satisfied with the program and perceive it as worthwhile. During the first 3 years since implementation of the certification initiative, program facilitators improved the feasibility of, participant engagement in, and sustainability of the program. Future directions include an effectiveness evaluation and a "scale-up" to other institutions. The need for a pharmacy residency leadership certificate was met by designing, implementing, and evaluating such a program at UNC. Through its first 3 years, the program was feasible, sustainable, and valued by program participants. Copyright © 2017 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

GLOBE Mission Earth: The evaluation of the first year's implementation.

NASA Astrophysics Data System (ADS)

Adaktylou, N. E.; Hedley, M. L.; Darche, S.; Harris-Stefanakis, E.; Silberglitt, M. D.; Struble, J.; Bingham, P.; Czajkowski, K.

2017-12-01

Here we present the evaluation findings for the first year of implementation of the `Mission Earth' Program.`Mission Earth' proposes the systematic embedding of GLOBE (Global Learning and Observations to Benefit the Environment) resources and NASA assets into the curricula of schools along the K-12 continuum, leveraging existing partnerships and networks. The main goal of the program is to create developmentally appropriate, vertically-integrated K-12 materials and activities,, supported by high quality professional development and ongoing support, engaging teachers from all grades. Its team consists of 5 geographically distributed universities and research institutions that have developed a curriculum progression following research-based best practices, have conducted the year's trainings for selected cohorts of teachers. The evaluation is a continuous process over the program's five year duration to examine implementation and opportunities for improvement. A broad set of data collection tools include a diagnostic component (needs assessment for teachers, capacity assessment for the school environment) and an assessment of implementation component (surveys for teachers and trainers, pre- and post tests for students, classroom observations, teacher interviews, portfolios). The tools used are validated instruments or ones modified to serve the program needs. The patterns emerging from the data provided information on: i) the quality of the intervention as to its design and content, ii) the alignment with the needs of the participants, iii) the implementation phase, iii) changes in the content knowledge of the students and their attitudes toward science, iv) changes in the facility of teachers to teach science in their classrooms after the professional development and materials provided, v) challenges and facilitators of implementation. Based on findings the program evaluation identifies additions/adjustments to be adopted in the following year.

The Microcomputer in the Library: VI. Implementation and Future Development.

ERIC Educational Resources Information Center

Leggate, Peter; Dyer, Hilary

1986-01-01

This sixth article in a series discusses planning for the installation and implementation of automated systems in the library, workstation design and location, scheduling of software implementation, security, data input, staff and reader training, job design, impact of automation on library procedures, evaluation of system performance, and future…

Development, implementation, and process evaluation of a regional palliative care quality improvement project.

PubMed

Dudgeon, Deborah J; Knott, Christine; Chapman, Cheryl; Coulson, Kathy; Jeffery, Elizabeth; Preston, Sharon; Eichholz, Mary; Van Dijk, Janice P; Smith, Anne

2009-10-01

The delivery of optimal palliative care requires an integrated and coordinated approach of many health care providers across the continuum of care. In response to identified gaps in the region, the Palliative Care Integration Project (PCIP) was developed to improve continuity and decrease variability of care to palliative patients with cancer. The infrastructure for the project included multi-institutional and multisectoral representation on the Steering Committee and on the Development, Implementation and Evaluation Working Groups. After review of the literature, five Collaborative Care Plans and Symptom Management Guidelines were developed and integrated with validated assessment tools (Edmonton Symptom Assessment System and Palliative Performance Scale). These project resources were implemented in the community, the palliative care unit, and the cancer center. Surveys were completed by frontline health professionals (defined as health professionals providing direct care), and two independent focus groups were conducted to capture information regarding: 1) the development of the project and 2) the processes of implementation and usefulness of the different components of the project. Over 90 individuals from more than 30 organizations were involved in the development, implementation, and evaluation of the PCIP. Approximately 600 regulated health professionals and allied health professionals who provided direct care, and over 200 family physicians and medical residents, received education/training on the use of the PCIP resources. Despite unanticipated challenges, frontline health professionals reported that the PCIP added value to their practice, particularly in the community sector. The PCIP showed that a network in which each organization had ownership and where no organization lost its autonomy, was an effective way to improve integration and coordination of care delivery.

Typical School Personnel Developing and Implementing Basic Behavior Support Plans

ERIC Educational Resources Information Center

Strickland-Cohen, M. Kathleen; Horner, Robert H.

2015-01-01

We evaluated the ability of typical school personnel with basic behavioral training to develop and implement function-based supports for students with mild to moderate problem behaviors. Descriptive results indicated that following four 1-hr training sessions, 13 participants were able to (a) identify interventions that were and were not…

A Working Model for the Development, Implementation and Evaluation of an Art Program on the College Level.

ERIC Educational Resources Information Center

Demery, Marie; And Others

Components of an art program that was developed with federal funding are outlined. The model contains information on the grant proposal, including the rationale for funding, implementation strategies, activity timetable, qualifications of key personnel, activity objectives and performance measures, intitutional goals, activity milestones, and…

Development and Implementation of a Multisite Evaluation for the Women, Co-Occurring Disorders and Violence Study

ERIC Educational Resources Information Center

Giard, Julienne; Hennigan, Karen; Huntington, Nicholas; Vogel, Wendy; Rinehart, Debbie; Mazelis, Ruta; Nadlicki, Terri; Veysey, Bonita M.

2005-01-01

In this article we describe the development and implementation of the Substance Abuse and Mental Health Services Administration's (SAMHSA's) multisite Women, Co-Occurring Disorders and Violence Study (WCDVS), highlighting some of the challenges encountered, decisions made, and lessons learned. Four themes are discussed. First, the unique…

Student Response Systems for Formative Assessment: Literature-Based Strategies and Findings from a Middle School Implementation

ERIC Educational Resources Information Center

Fuller, Julia S.; Dawson, Kara M.

2017-01-01

In this article we share how a district-level technology integration specialist used literature on implementing student response systems (SRS) for formative assessment, based on Desimone's (2009) core features of professional development design, Guskey's Levels of Professional Development Evaluation (1998, 2000, 2002), and Danielson's Observation…

Using Multimedia to Enhance Knowledge of Service Attitude in the Hospitality Industry

ERIC Educational Resources Information Center

Kuo, Chun Min

2012-01-01

Having used a quasi-experimental research model and the ADDIE (Analyze, Design, Develop, Implement, and Evaluate) calibration method to gather and implement data, the researcher developed an interactive multimedia assisted learning (MAL) program promoting proper service attitudes in the hospitality industry. In order to gauge MAL program's…

Academic Standards for Developing, Implementing, Evaluating, and Improving Information Science and Technology Baccalaureate Degrees

ERIC Educational Resources Information Center

Shields-Bryant, Elayne

2006-01-01

The unprecedented growth, development and implementation of information technology (IT) driven by e-commerce and other technological advances have resulted in an increased demand of technology skilled workers (Reichgelt, Zhang, & Price, 2002; United States Department of Labor Bureau of Labor Statistics, 2005). In response to degree-dependent…

Developing Difficult Dialogues: An Evaluation of Classroom Implementation

ERIC Educational Resources Information Center

Placier, Peggy; Kroner, Crystal; Burgoyne, Suzanne; Worthington, Roger

2012-01-01

The University of Missouri (MU) participated in the Ford Foundation's Difficult Dialogues Initiative (DDI) supporting faculty development projects at over 40 institutions of higher education from 2006-2010. This paper reports findings from an evaluation conducted with instructors who not only engaged in faculty development workshops but also…

Conducting an Efficient Proactive Risk Assessment Prior to CPOE Implementation in an Intensive Care Unit

PubMed Central

Hundt, Ann Schoofs; Adams, Jean A.; Schmid, J. Andrew; Musser, Linda M.; Walker, James M.; Wetterneck, Tosha B; Douglas, Stephen V.; Paris, Bonnie L.; Carayon, Pascale

2012-01-01

Purpose To develop, conduct, and evaluate a proactive risk assessment (PRA) of the design and implementation of CPOE in an ICU. Methods We developed a PRA method based on issues identified from documented experience with conventional PRA methods and the constraints of an organization about to implement CPOE in an intensive care unit. The PRA method consists of three phases: planning (three months), team (one five-hour meeting), and evaluation (short- and long-term). Results Sixteen unique relevant vulnerabilities were identified as a result of the PRA team’s efforts. Negative consequences resulting from the vulnerabilities included potential patient safety and quality of care issues, non-compliance with regulatory requirements, increases in cognitive burden on CPOE users, and/or worker inconvenience or distress. Actions taken to address the vulnerabilities included redesign of the technology, process (workflow) redesign, user training, and/or ongoing monitoring. Verbal and written evaluation by the team members indicated that the PRA method was useful and that participants were willing to participate in future PRAs. Long-term evaluation was accomplished by monitoring an ongoing “issues list” of CPOE problems identified by or reported to IT staff. Vulnerabilities identified by the team were either resolved prior to CPOE implementation (n = 7) or shortly thereafter (n = 9). No other issues were identified beside those identified by the team. Conclusions Generally positive results from the various evaluations including a long-term evaluation demonstrate the value of developing an efficient PRA method that meets organizational and contextual requirements and constraints. PMID:22608242

Implementation of a lung cancer multidisciplinary team standardised template for reporting to general practitioners: a mixed-method study

PubMed Central

Collett, Gemma K; Brown, Clare M; Shaw, Tim J; White, Kahren M; Beale, Philip J; Anderiesz, Cleola; Barnes, David J

2017-01-01

Objectives Few interventions have been designed that provide standardised information to primary care clinicians about the diagnostic and treatment recommendations resulting from cancer multidisciplinary team (MDT) (tumour board) meetings. This study aimed to develop, implement and evaluate a standardised template for lung cancer MDTs to provide clinical information and treatment recommendations to general practitioners (GPs). Specific objectives were to (1) evaluate template feasibility (acceptability, appropriateness and timeliness) with GPs and (2) document processes of preimplementation, implementation and evaluation within the MDT setting. Design A mixed-method study design using structured interviews with GPs and qualitative documentation of project logs about implementation processes. Setting Two hospitals in Central Sydney, New South Wales, Australia. Participants: 61 GPs evaluated the template. Two lung cancer MDTs, consisting of 33 clinicians, and eight researchers participated in template development and implementation strategy. Results The MDT-reporting template appears to be a feasible way of providing clinical information to GPs following patient presentation at a lung cancer MDT meeting. Ninety-five per cent of GPs strongly agreed or agreed that the standardised template provided useful and relevant information, that it was received in a timely manner (90%) and that the information was easy to interpret and communicate to the patient (84%). Implementation process data show that the investment made in the preimplementation stage to integrate the template into standard work practices was a critical factor in successful implementation. Conclusions This study demonstrates that it is feasible to provide lung cancer MDT treatment recommendations to GPs through implementation of a standardised template. A simple intervention, such as a standardised template, can help to address quality gaps and ensure that timely information is communicated between tertiary and primary care healthcare providers. PMID:29288182

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 1995

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program was established more than nine years ago to encourage the development and implementation of innovative treatment technologies for hazardous waste site remediation. Development of this program was in direct response to ...

Workforce development and effective evaluation of projects.

PubMed

Dickerson, Claire; Green, Tess; Blass, Eddie

The success of a project or programme is typically determined in relation to outputs. However, there is a commitment among UK public services to spending public funds efficiently and on activities that provide the greatest benefit to society. Skills for Health recognised the need for a tool to manage the complex process of evaluating project benefits. An integrated evaluation framework was developed to help practitioners identify, describe, measure and evaluate the benefits of workforce development projects. Practitioners tested the framework on projects within three NHS trusts and provided valuable feedback to support its development. The prospective approach taken to identify benefits and collect baseline data to support evaluation was positively received and the clarity and completeness of the framework, as well as the relevance of the questions, were commended. Users reported that the framework was difficult to complete; an online version could be developed, which might help to improve usability. Effective implementation of this approach will depend on the quality and usability of the framework, the willingness of organisations to implement it, and the presence or establishment of an effective change management culture.

Implementation Evaluation Study: Flipped Classroom Professional Development with Faculty Members to Enhance Students' Engagement in Higher Education

ERIC Educational Resources Information Center

Alebrahim, Fatimah Hussain

2016-01-01

The purpose of this qualitative study was to explore student engagement in higher education by evaluating training provided by experienced faculty members for those faculty desiring to implement a flipped classroom. A case study was utilized; data were collected in the form of online observation, in-class observation, student focus group…

The Development and Implementation of a Peer-Led Intervention to Prevent Smoking among Secondary School Students Using Their Established Social Networks

ERIC Educational Resources Information Center

Audrey, Suzanne; Cordall, Kathleen; Moore, Laurence; Cohen, David; Campbell, Rona

2004-01-01

Objective: To design, implement and evaluate a peer-led intervention to reduce smoking amongst secondary school students. Design: A health promotion intervention combining peer education with diffusion of innovation theory, to be rigorously evaluated by means of a cluster randomised controlled trial with concurrent process and economic…

Evaluation of a TB infection control implementation initiative in out-patient HIV clinics in Zambia and Botswana.

PubMed

Emerson, C; Lipke, V; Kapata, N; Mwananyambe, N; Mwinga, A; Garekwe, M; Lanje, S; Moshe, Y; Pals, S L; Nakashima, A K; Miller, B

2016-07-01

Out-patient human immunodeficiency virus (HIV) care and treatment clinics in Zambia and Botswana, countries with a high burden of HIV and TB infection. To develop a tuberculosis infection control (TB IC) training and implementation package and evaluate the implementation of TB IC activities in facilities implementing the package. Prospective program evaluation of a TB IC training and implementation package using a standardized facility risk assessment tool, qualitative interviews with facility health care workers and measures of pre- and post-test performance. A composite measure of facility performance in TB IC improved from 32% at baseline to 50% at 1 year among eight facilities in Zambia, and from 27% to 80% at 6 months among 10 facilities in Botswana. Although there was marked improvement in indicators of managerial, administrative and environmental controls, key ongoing challenges remained in ensuring access to personal protective equipment and implementing TB screening in health care workers. TB IC activities at out-patient HIV clinics in Zambia and Botswana improved after training using the implementation package. Continued infrastructure support, as well as monitoring and evaluation, are needed to support the scale-up and sustainability of TB IC programs in facilities in low-resource countries.

A Framework for the Study of Complex mHealth Interventions in Diverse Cultural Settings.

PubMed

Maar, Marion A; Yeates, Karen; Perkins, Nancy; Boesch, Lisa; Hua-Stewart, Diane; Liu, Peter; Sleeth, Jessica; Tobe, Sheldon W

2017-04-20

To facilitate decision-making capacity between options of care under real-life service conditions, clinical trials must be pragmatic to evaluate mobile health (mHealth) interventions under the variable conditions of health care settings with a wide range of participants. The mHealth interventions require changes in the behavior of patients and providers, creating considerable complexity and ambiguity related to causal chains. Process evaluations of the implementation are necessary to shed light on the range of unanticipated effects an intervention may have, what the active ingredients in everyday practice are, how they exert their effect, and how these may vary among recipients or between sites. Building on the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth) statement and participatory evaluation theory, we present a framework for the process evaluations for mHealth interventions in multiple cultural settings. We also describe the application of this evaluation framework to the implementation of DREAM-GLOBAL (Diagnosing hypertension-Engaging Action and Management in Getting Lower BP in Indigenous and LMIC [low- and middle-income countries]), a pragmatic randomized controlled trial (RCT), and mHealth intervention designed to improve hypertension management in low-resource environments. We describe the evaluation questions and the data collection processes developed by us. Our literature review revealed that there is a significant knowledge gap related to the development of a process evaluation framework for mHealth interventions. We used community-based participatory research (CBPR) methods and formative research data to develop a process evaluation framework nested within a pragmatic RCT. Four human organizational levels of participants impacted by the mHealth intervention were identified that included patients, providers, community and organizations actors, and health systems and settings. These four levels represent evaluation domains and became the core focus of the evaluation. In addition, primary implementation themes to explore in each of the domains were identified as follows: (1) the major active components of the intervention, (2) technology of the intervention, (3) cultural congruence, (4) task shifting, and (5) unintended consequences. Using the four organizational domains and their interaction with primary implementation themes, we developed detailed evaluation research questions and identified the data or information sources to best answer our questions. Using DREAM-GLOBAL to illustrate our approach, we succeeded in developing an uncomplicated process evaluation framework for mHealth interventions that provide key information to stakeholders, which can optimize implementation of a pragmatic trial as well as inform scale up. The human organizational level domains used to focus the primary implementation themes in the DREAM-GLOBAL process evaluation framework are sufficiently supported in our research, and the literature and can serve as a valuable tool for other mHealth process evaluations. ClinicalTrials.gov NCT02111226; https://clinicaltrials.gov/ct2/show/NCT02111226 (Archived by WebCite at http://www.webcitation.org/6oxfHXege). ©Marion A Maar, Karen Yeates, Nancy Perkins, Lisa Boesch, Diane Hua-Stewart, Peter Liu, Jessica Sleeth, Sheldon W Tobe. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 20.04.2017.

The Design and Implementation of a Model Evaluation Capability. 1975-76 Final Report. Title III Project.

ERIC Educational Resources Information Center

Austin Independent School District, TX. Office of Research and Evaluation.

The Austin Independent School District received an Elementary and Secondary Education Act Title III grant in 1973 to develop an internal research and evaluation capability. Funding was provided the resulting Office of Research and Evaluation (ORE) for three years. The foci of the original grant were (1) to develop a district evaluation model, (2)…

Development and implementation of mass media campaigns to delay sexual initiation among African American and White youth.

PubMed

Noar, Seth M; Zimmerman, Rick S; Palmgreen, Philip; Cupp, Pamela K; Floyd, Brenikki R; Mehrotra, Purnima

2014-01-01

Reducing new HIV/STD infections among at-risk adolescents requires developing and evaluating evidence-based health communication approaches. Research overwhelmingly supports the conclusion that early sexual initiation is associated with STDs and other negative outcomes in later years (e.g., unintended pregnancy). The authors' research group secured funding from the National Institute of Mental Health to develop, implement, and rigorously evaluate televised mass media campaigns to delay initiation of sexual intercourse among African American and White adolescents in two cities in the Southeastern United States. The focus of the present study is on the development and implementation of the campaigns, including (a) rationale and theoretical underpinnings; (b) collection, screening, and assessment of existing public service announcements; (c) development of new public service announcements; (d) study design and campaign airing plan; and (e) message exposure achieved in the campaigns. Health communication campaigns hold much promise in reaching at-risk adolescent populations with targeted, timely, and relevant risk-reduction messages.

An evaluation of a real-time fault diagnosis expert system for aircraft applications

NASA Technical Reports Server (NTRS)

Schutte, Paul C.; Abbott, Kathy H.; Palmer, Michael T.; Ricks, Wendell R.

1987-01-01

A fault monitoring and diagnosis expert system called Faultfinder was conceived and developed to detect and diagnose in-flight failures in an aircraft. Faultfinder is an automated intelligent aid whose purpose is to assist the flight crew in fault monitoring, fault diagnosis, and recovery planning. The present implementation of this concept performs monitoring and diagnosis for a generic aircraft's propulsion and hydraulic subsystems. This implementation is capable of detecting and diagnosing failures of known and unknown (i.e., unforseeable) type in a real-time environment. Faultfinder uses both rule-based and model-based reasoning strategies which operate on causal, temporal, and qualitative information. A preliminary evaluation is made of the diagnostic concepts implemented in Faultfinder. The evaluation used actual aircraft accident and incident cases which were simulated to assess the effectiveness of Faultfinder in detecting and diagnosing failures. Results of this evaluation, together with the description of the current Faultfinder implementation, are presented.

A Best Practices Model for Implementing Successful Electronic Disease Surveillance Systems: Insights from Peru and Around the Globe

DTIC Science & Technology

2013-06-03

associated Program design: Kenya . and written project with improved I) Generic model should be adaptable documentation. diagnosis or treatment. to local...potential for and threats to development through an unsustainable and 3) Gaps in evaluation in area of building sustainable to performance -based...implementation in developing countries by building a framework that will identify key elements in this process and serve as guidance to implementers. This study

Method of evaluating the impact of ERP implementation critical success factors - a case study in oil and gas industries

NASA Astrophysics Data System (ADS)

Gajic, Gordana; Stankovski, Stevan; Ostojic, Gordana; Tesic, Zdravko; Miladinovic, Ljubomir

2014-01-01

The so far implemented enterprise resource planning (ERP) systems have in many cases failed to meet the requirements regarding the business process control, decrease of business costs and increase of company profit margin. Therefore, there is a real need for an evaluation of the influence of ERP on the company's performance indicators. Proposed in this article is an advanced model for the evaluation of the success of ERP implementation on organisational and operational performance indicators in oil-gas companies. The recommended method establishes a correlation between a process-based method, a scorecard model and ERP critical success factors. The method was verified and tested on two case studies in oil-gas companies using the following procedure: the model was developed, tested and implemented in a pilot gas-oil company, while the results were implemented and verified in another gas-oil company.

Evaluating Evidence-Based Practice Knowledge and Beliefs Through the e-Learning EBP Academy.

PubMed

Green, Angela; Jeffs, Debra A; Boateng, Beatrice A; Lowe, Gary R; Walden, Marlene

2017-07-01

This research examined evidence-based practice (EBP) knowledge and beliefs before and after a 3-month e-learning program was implemented to build EBP capacity at a large children's hospital. Ten clinicians completed the development, implementation, and evaluation of the e-learning education, comprising phase one. Revision and participation by 41 clinicians followed in phase two. Participants in both phases completed the EBP Beliefs and Implementation Scales preintervention, postintervention, and 6 months after postintervention. EBP beliefs and implementation increased immediately and 6 months after postintervention, with statistically significant increases in both phases. Participants in both phases applied knowledge by completing mentor-supported EBP projects. Although EBP beliefs and implementation scores increased and e-learning provided flexibility for clinician participation, challenges arose, resulting in lower-than-expected completion. Subsequent revisions resulted in hybrid education, integrating classroom and e-learning with project mentoring. This funded e-learning research contributes knowledge to the growing specialty of professional development. J Contin Educ Nurs. 2017;48(7):304-311. Copyright 2017, SLACK Incorporated.

Qualitative evaluation of the implementation of the Interdisciplinary Management Tool: a reflective tool to enhance interdisciplinary teamwork using Structured, Facilitated Action Research for Implementation.

PubMed

Nancarrow, Susan A; Smith, Tony; Ariss, Steven; Enderby, Pamela M

2015-07-01

Reflective practice is used increasingly to enhance team functioning and service effectiveness; however, there is little evidence of its use in interdisciplinary teams. This paper presents the qualitative evaluation of the Interdisciplinary Management Tool (IMT), an evidence-based change tool designed to enhance interdisciplinary teamwork through structured team reflection. The IMT incorporates three components: an evidence-based resource guide; a reflective implementation framework based on Structured, Facilitated Action Research for Implementation methodology; and formative and summative evaluation components. The IMT was implemented with intermediate care teams supported by independent facilitators in England. Each intervention lasted 6 months and was evaluated over a 12-month period. Data sources include interviews, a focus group with facilitators, questionnaires completed by team members and documentary feedback from structured team reports. Data were analysed qualitatively using the Framework approach. The IMT was implemented with 10 teams, including 253 staff from more than 10 different disciplines. Team challenges included lack of clear vision; communication issues; limited career progression opportunities; inefficient resource use; need for role clarity and service development. The IMT successfully engaged staff in the change process, and resulted in teams developing creative strategies to address the issues identified. Participants valued dedicated time to focus on the processes of team functioning; however, some were uncomfortable with a focus on teamwork at the expense of delivering direct patient care. The IMT is a relatively low-cost, structured, reflective way to enhance team function. It empowers individuals to understand and value their own, and others' roles and responsibilities within the team; identify barriers to effective teamwork, and develop and implement appropriate solutions to these. To be successful, teams need protected time to take for reflection, and executive support to be able to broker changes that are beyond the scope of the team. © 2014 John Wiley & Sons Ltd.

1999 commuter assistance program evaluation manual

DOT National Transportation Integrated Search

2001-01-01

This manual was developed to assist Florida's Commuter Assistance Programs (CAP) to measure and evaluate their performance. It provides information necessary for a CAP to create and implement its own evaluation program. It discusses performance measu...

The Superfund Innovative Technology Evaluation Program SUMMARY AND CLOSURE REPORT

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program promoted the development, commercialization, and implementation of innovative hazardous waste treatment technologies for 20 years. SITE offered a mechanism for conducting joint technology demonstration and evaluation ...

--No Title--

Science.gov Websites

Security Robots Lasers RSS Feed Prev Next Air Force scientists are developing an improved system for coating materials performance evaluations that will accelerate the implementation of new aircraft coatings . New Evaluation System Helps Air Force Better Understand Corrosion Air Force scientists are developing

The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) Program: Reach, Sustainability, Spread and Lessons Learned from an Implementation Funding Model.

PubMed

Moore, Julia E; Grouchy, Michelle; Graham, Ian D; Shandling, Maureen; Doyle, Winnie; Straus, Sharon E

2016-05-01

Despite evidence on what works in healthcare, there is a significant gap in the time it takes to bring research into practice. The Council of Academic Hospitals of Ontario's Adopting Research to Improve Care program addresses this research-to-practice gap by incorporating the following components into its funding program: strategic selection of evidence for implementation, education and training for implementation, implementation supports, executive champions and governance, and evaluation. Funded projects have been sustained (76% reported full sustainability) and spread to over 200 new sites. Lessons learned include the following: assess readiness, develop tailored implementation materials, consider characteristics of implementation supports, protect champion time and consider evaluation feasibility. Copyright © 2016 Longwoods Publishing.

The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) Program: Reach, Sustainability, Spread and Lessons Learned from an Implementation Funding Model

PubMed Central

Grouchy, Michelle; Graham, Ian D.; Shandling, Maureen; Doyle, Winnie; Straus, Sharon E.

2016-01-01

Despite evidence on what works in healthcare, there is a significant gap in the time it takes to bring research into practice. The Council of Academic Hospitals of Ontario's Adopting Research to Improve Care program addresses this research-to-practice gap by incorporating the following components into its funding program: strategic selection of evidence for implementation, education and training for implementation, implementation supports, executive champions and governance, and evaluation. Funded projects have been sustained (76% reported full sustainability) and spread to over 200 new sites. Lessons learned include the following: assess readiness, develop tailored implementation materials, consider characteristics of implementation supports, protect champion time and consider evaluation feasibility. PMID:27232234

Spacelab user implementation assessment study. (Software requirements analysis). Volume 2: Technical report

NASA Technical Reports Server (NTRS)

1976-01-01

The engineering analyses and evaluation studies conducted for the Software Requirements Analysis are discussed. Included are the development of the study data base, synthesis of implementation approaches for software required by both mandatory onboard computer services and command/control functions, and identification and implementation of software for ground processing activities.

Long Live Love. The Implementation of a School-Based Sex-Education Program in the Netherlands

ERIC Educational Resources Information Center

Schutte, Lisette; Meertens, Ree M.; Mevissen, Fraukje E. F.; Schaalma, Herman; Meijer, Suzanne; Kok, Gerjo

2014-01-01

Implementation of health education programs is often inadequately considered or not considered at all in planning, developing and evaluating interventions. With the focus being predominantly on the adoption stage, little is known about the factors influencing the implementation and continuation stages of the diffusion process. This study…

The School Implementation Scale: Measuring Implementation in Response to Intervention Models

ERIC Educational Resources Information Center

Erickson, Amy Gaumer; Noonan, Pattie M.; Jenson, Ronda

2012-01-01

Models of response to intervention (RTI) have been widely developed and implemented and have expanded to include integrated academic/behavior RTI models. Until recently, evaluation of model effectiveness has focused primarily on student-level data, but additional measures of treatment integrity within these multi-tiered models are emerging to…

78 FR 16679 - Center for Drug Evaluation and Research Medical Policy Council; Request for Comments

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-18

... Council to ensure better coordination of medical policy development and implementation within CDER and... and implementation. II. Range of Medical Policy Issues To Be Considered FDA envisions a variety of... to other products; or Strategies for implementation of a new policy. III. Establishment of a Docket...

Westinghouse corporate development of a decision software program for Radiological Evaluation Decision Input (REDI)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bush, T.S.

1995-03-01

In December 1992, the Department of Energy (DOE) implemented the DOE Radiological Control Manual (RCM). Westinghouse Idaho Nuclear Company, Inc. (WINCO) submitted an implementation plan showing how compliance with the manual would be achieved. This implementation plan was approved by DOE in November 1992. Although WINCO had already been working under a similar Westinghouse RCM, the DOE RCM brought some new and challenging requirements. One such requirement was that of having procedure writers and job planners create the radiological input in work control procedures. Until this time, that information was being provided by radiological engineering or a radiation safety representative.more » As a result of this requirement, Westinghouse developed the Radiological Evaluation Decision Input (REDI) program.« less

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

The role of advanced nursing in lung cancer: A framework based development.

PubMed

Serena, A; Castellani, P; Fucina, N; Griesser, A-C; Jeanmonod, J; Peters, S; Eicher, M

2015-12-01

Advanced Practice Lung Cancer Nurses (APLCN) are well-established in several countries but their role has yet to be established in Switzerland. Developing an innovative nursing role requires a structured approach to guide successful implementation and to meet the overarching goal of improved nursing sensitive patient outcomes. The "Participatory, Evidence-based, Patient-focused process, for guiding the development, implementation, and evaluation of advanced practice nursing" (PEPPA framework) is one approach that was developed in the context of the Canadian health system. The purpose of this article is to describe the development of an APLCN model at a Swiss Academic Medical Center as part of a specialized Thoracic Cancer Center and to evaluate the applicability of PEPPA framework in this process. In order to develop and implement the APLCN role, we applied the first seven phases of the PEPPA framework. This article spreads the applicability of the PEPPA framework for an APLCN development. This framework allowed us to i) identify key components of an APLCN model responsive to lung cancer patients' health needs, ii) identify role facilitators and barriers, iii) implement the APLCN role and iv) design a feasibility study of this new role. The PEPPA framework provides a structured process for implementing novel Advanced Practice Nursing roles in a local context, particularly where such roles are in their infancy. Two key points in the process include assessing patients' health needs and involving key stakeholders. Copyright © 2015 Elsevier Ltd. All rights reserved.

Paratransit Handbook : a Guide to Paratransit Implementation : Volume 1. Parts 1-3.

DOT National Transportation Integrated Search

1979-01-01

This Paratransit Handbook has been developed to aid public officials, planners and system operators in planning, designing, implementing, operating and evaluating integrated paratransit systems. The Handbook represents a compedium of techniques and e...

Modeling, implementation, and validation of arterial travel time reliability.

DOT National Transportation Integrated Search

2013-11-01

Previous research funded by Florida Department of Transportation (FDOT) developed a method for estimating : travel time reliability for arterials. This method was not initially implemented or validated using field data. This : project evaluated and r...

A 7-Step Strategy for the Implementation of Worksite Lifestyle Interventions: Helpful or Not?

PubMed

Wierenga, Debbie; Engbers, Luuk H; Van Empelen, Pepjin; van Mechelen, Willem

2016-05-01

The aim of this study was to evaluate the use of and adherence to a 7-step strategy for the development, implementation, and continuation of a comprehensive, multicomponent lifestyle program. Strategy use and adherence was assessed with 12 performance indicators. Data were collected by combining onsite monitoring with semi-structured interviews at baseline and follow-up (6, 12, and 18 months). Not all performance indicators were met so partial strategy adherence was obtained. The strategy could be improved on the following aspects: support among management, project structure, adaptation to needs of employees, planning, and maintenance. The results of this evaluation indicate that strategy adherence facilitated structured development and implementation. On the basis of the qualitative data, this study suggests that when improvements will be made on both the content and performance, the 7-step strategy could be an effective tool to successfully implement a multicomponent WHPP.

Teaching Assistant Professional Development in Biology: Designed for and Driven by Multidimensional Data

PubMed Central

Long, Tammy M.; Ebert-May, Diane

2014-01-01

Graduate teaching assistants (TAs) are increasingly responsible for instruction in undergraduate science, technology, engineering, and mathematics (STEM) courses. Various professional development (PD) programs have been developed and implemented to prepare TAs for this role, but data about effectiveness are lacking and are derived almost exclusively from self-reported surveys. In this study, we describe the design of a reformed PD (RPD) model and apply Kirkpatrick's Evaluation Framework to evaluate multiple outcomes of TA PD before, during, and after implementing RPD. This framework allows evaluation that includes both direct measures and self-reported data. In RPD, TAs created and aligned learning objectives and assessments and incorporated more learner-centered instructional practices in their teaching. However, these data are inconsistent with TAs’ self-reported perceptions about RPD and suggest that single measures are insufficient to evaluate TA PD programs. PMID:26086654

Process evaluation of the implementation of scorecard-based antenatal risk assessment, care pathways and interdisciplinary consultation: the Healthy Pregnancy 4 All study.

PubMed

Vos, A A; van Voorst, S F; Posthumus, A G; Waelput, A J M; Denktaş, S; Steegers, E A P

2017-09-01

To evaluate the implementation of a complex intervention in the antenatal healthcare field in 14 Dutch municipalities. The intervention consisted of the implementation of a systematic scorecard-based risk assessment in pregnancy, subsequent patient-tailored care pathways, and consultations of professionals from different medical and social disciplines. Saunders's seven-step method was used for the development of a programme implementation monitoring plan, with specific attention to the setting and context of the programme. Data were triangulated from multiple sources, and prespecified criteria were applied to examine the evidence for implementation. Six out of 11 municipalities (54%) met the implementation criteria for the entire risk assessment programme, whereas three municipalities (27%) met the criteria if the three components of implementation were analysed separately. A process evaluation of implementation of a complex intervention is possible. The results can be used to improve understanding of the associations between specific programme elements and programme outcomes on effectiveness of the intervention. Additionally, the results are important for formative purposes to assess how future implementation of antenatal risk assessment can be improved in comparable contexts. Copyright © 2017. Published by Elsevier Ltd.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems.

PubMed

Lyon, Aaron R; Lewis, Cara C; Melvin, Abigail; Boyd, Meredith; Nicodimos, Semret; Liu, Freda F; Jungbluth, Nathaniel

2016-09-22

Health information technologies (HIT) have become nearly ubiquitous in the contemporary healthcare landscape, but information about HIT development, functionality, and implementation readiness is frequently siloed. Theory-driven methods of compiling, evaluating, and integrating information from the academic and commercial sectors are necessary to guide stakeholder decision-making surrounding HIT adoption and to develop pragmatic HIT research agendas. This article presents the Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology, a structured, theory-driven method for compiling and evaluating information from multiple sectors. As an example demonstration of the methodology, we apply HIT-ACE to mental and behavioral health measurement feedback systems (MFS). MFS are a specific class of HIT that support the implementation of routine outcome monitoring, an evidence-based practice. HIT-ACE is guided by theories and frameworks related to user-centered design and implementation science. The methodology involves four phases: (1) coding academic and commercial materials, (2) developer/purveyor interviews, (3) linking putative implementation mechanisms to hit capabilities, and (4) experimental testing of capabilities and mechanisms. In the current demonstration, phase 1 included a systematic process to identify MFS in mental and behavioral health using academic literature and commercial websites. Using user-centered design, implementation science, and feedback frameworks, the HIT-ACE coding system was developed, piloted, and used to review each identified system for the presence of 38 capabilities and 18 additional characteristics via a consensus coding process. Bibliometic data were also collected to examine the representation of the systems in the scientific literature. As an example, results are presented for the application of HIT-ACE phase 1 to MFS wherein 49 separate MFS were identified, reflecting a diverse array of characteristics and capabilities. Preliminary findings demonstrate the utility of HIT-ACE to represent the scope and diversity of a given class of HIT beyond what can be identified in the academic literature. Phase 2 data collection is expected to confirm and expand the information presented and phases 3 and 4 will provide more nuanced information about the impact of specific HIT capabilities. In all, HIT-ACE is expected to support adoption decisions and additional HIT development and implementation research.

Using Multimedia Technology to Teach Modern Greek Language Online in China: Development, Implementation, and Evaluation

ERIC Educational Resources Information Center

Huang, Xiaoyin; Dedegikas, Costa; Walls, Jan

2011-01-01

This article reviews the process of design, development, and implementation of the Modern Greek online courses (Chinese version) in Hellenic Studies at Simon Fraser University (SFU), in collaboration with Chinese university partners. The purpose of this study is (a) to explore the effectiveness of the course design, and (b) to reveal the…

A suggested Ten-Year Phased Program for Developing, Evaluating and Implementing Instructional Technologies.

ERIC Educational Resources Information Center

Miller, James G.

A national program is necessary to discover and implement the best ways to utilize educational technology. Several university centers for research and development on instructional technology could provide a basis for national initiative in this field. These centers should carry out basic research on systems theory, with emphasis on such fields as…

What Are the Professional Development Needs of Principals as They Implement the New Educator Effectiveness System?

ERIC Educational Resources Information Center

Salvesen, Susan L.

2016-01-01

With the passing of Act 82, the state of Pennsylvania has provided school districts with Danielson's Framework as a tool for principals to evaluate teachers. The purpose of this study was to determine the perceived professional development needs of Pennsylvania principals as they implemented the new educator effectiveness system. Three hundred…

Evaluating and Celebrating PBIS Success: Development and Implementation of Ohio's PBIS Recognition System

ERIC Educational Resources Information Center

Noltemeyer, Amity; Petrasek, Michael; Stine, Karen; Palmer, Katelyn; Meehan, Cricket; Jordan, Emily

2018-01-01

With the increasing use of Positive Behavioral Interventions and Supports (PBIS) nationally, several states have developed systems to recognize exemplar schools that are implementing PBIS with fidelity. These systems serve the dual purpose of identifying model PBIS schools for other schools to emulate while also reinforcing schools' effective PBIS…

Implementing a wound care resource nurse program.

PubMed

Tully, Sandra; Ganson, Claudia; Savage, Pamela; Banez, Carol; Zarins, Baiba

2007-08-01

Nurses are leaders in implementing innovations that can create positive outcomes in the prevention and management of pressure ulcers in patients admitted to acute care hospitals. Believing that nurses knowledgeable in best practices could impact prevalence, incidence, and care of pressure ulcers, an educational program was developed in a Canadian healthcare system to inform and empower nurses providing skin and wound care. The program afforded participants the opportunity to acquire the knowledge and skill to recognize patients at risk for developing pressure ulcers and to independently treat Stage I and Stage II pressure ulcers and skin breakdown related to moisture, friction, and shear. The program includes evidence-based practice recommendations and highlights the Best Practice Guidelines developed by the Registered Nurses Association of Ontario, a provincial body taking an active role in the development, implementation, and evaluation of published guidelines derived from global research literature synthesis. Pre- and post participation assessment of 65 nurse participants from three hospitals deemed the program successful in terms of knowledge and fulfillment of their educational expectations. Organizational support to implement the skin and wound care resource nurse role was encouraging and medical directives for Stage I and Stage II pressure ulcers by nurses were implemented. Evaluation and monitoring of program outcomes, including pressure ulcer incidence rates, continue.

The process, logistics and challenges of implementing clinical supervision in a generalist tertiary referral hospital.

PubMed

Brunero, Scott; Lamont, Scott

2012-03-01

Clinical supervision (CS) has been identified within nursing as a process for improving clinical practice and reducing the emotional burden of nursing practice. Little is known about its implementation across large tertiary referral hospitals. The purpose of this study is to evaluate the implementation of clinical supervision across several different nursing specialities at a teaching hospital in Sydney, Australia. Using a model of nursing implementation science, a process was developed at the study site that facilitated the development, implementation and evaluation of the project. After a 6-month study period, the CS groups were postevaluated using a survey tool developed for the project. A total of nine CS groups were in operation over the 6-month study period. A predominant focus within the sessions was one of the collegial support and developing standards of practice. The process was able to achieve wide hospital-based support for the role of CS from the senior nurse executives to junior nurses. Whilst there was overall positive support for the CS groups, logistical and resource challenges remain, in the effective roll out of CS to large numbers of nurses. © 2011 The Authors. Scandinavian Journal of Caring Sciences © 2011 Nordic College of Caring Science.

The Collier Chautauqua program: A formative evaluation of the implementation of the Iowa Chautauqua model of professional development and its effectiveness in improving science teaching

NASA Astrophysics Data System (ADS)

Dass, Pradeep Maxwell

1997-11-01

A formative evaluation of the implementation of the Iowa Chautauqua model of professional development in Collier County, Florida, was conducted during 1995-97, focusing on implementation issues and teacher enhancement. Major findings are as follows: Implementation issues. (1) Development of a shared vision through collaborative interaction between teachers, school administrators, and district administrators is critical to successful program implementation. (2) When a new program is implemented on a district-wide basis, the success of implementation depends upon how well the program matches local goals and needs and how ready the district and teachers are to make changes necessary for implementing the tenets of the program. (3) Development of proper understanding of desired pedagogical approaches requires modeling of these approaches in program activities, with explicit attention drawn to the modeling. (4) Successful implementation of desired pedagogical approaches in the classroom is critically influenced by the support and continual feedback teachers receive from district administrators, building administrators, and their peers. (5) Unwavering commitment of district and school administrators is essential for encouraging more teachers to participate in the program, leading to district-wide implementation without making it mandatory. Teacher Enhancement. (1) Participants developed leadership skills in mentorship, teamwork, presenting at professional meetings, and assuming responsibility within the program. (2) Participants learned to focus more on student questions and concerns, value prior conceptions of students, and develop instructional activities accordingly. They grew in their understanding and use of the constructivist pedagogy. (3) Participants attitude toward teaching in general and science in particular improved markedly, leading to new excitement and enthusiasm toward their profession. (4) Participants became more confident about teaching science. Elementary teachers reported spending more time on science activities and integrating science topics more with other curricular areas. (5) Participants collaborated more with their peers, administrators, and local community resources in improving instructional activities, providing more meaningful learning experiences for their students. (6) Participants integrated more technological resources than they did formerly, helping students explore avenues otherwise inaccessible. This investigation reveals that teacher enhancement is closely related to changed practice, which is critically influenced by implementation issues at broader levels.

Interactive Graphics Simulator: Design, Development, and Effectiveness/Cost Evaluation. Final Report.

ERIC Educational Resources Information Center

Pieper, William J.; And Others

This study was initiated to design, develop, implement, and evaluate a videodisc-based simulator system, the Interactive Graphics Simulator (IGS) for 6883 Converter Flight Control Test Station training at Lowry Air Force Base, Colorado. The simulator provided a means for performing task analysis online, developing simulations from the task…

Developing Culturally Responsive Surveys: Lessons in Development, Implementation, and Analysis from Brazil's African Descent Communities

ERIC Educational Resources Information Center

Bowen, Merle L.; Tillman, Ayesha S.

2015-01-01

Considerable empirical research, along with a growing body of conceptual and theoretical literature, exists on the role of culture and context in evaluation. Less scholarship has examined culturally responsive surveys in the context of international evaluation. In this article, the authors present lessons learned from the development,…

New York State technical and economic MAGLEV evaluation. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-06-01

The study is the preliminary evaluation of magnetically levitated ground transportation systems (MAGLEV). The evaluation focuses on using the New York State Thruway right-of-way in combination with MAGLEV systems currently in development in Germany and Japan and those proposed for development in the United States. The Energy Authority's goal in cosponsoring the study was to determine if MAGLEV offered the potential to meet future New York State transportation demands cost-effectively, and to evaluate the benefits that the State might expect from supporting MAGLEV technology development and system implementation. According to the preliminary report, substantial economic benefits could accrue to themore » State through MAGLEV-related research, development, manufacturing and construction. Implementation would have a favorable impact on issues related to transportation, the environment and energy conservation. With the exception of the German Transrapid system, developing a domestic prototype MAGLEV vehicle would take seven to nine years; no insurmountable technical barriers are apparent. EMF shielding (electromagnetic fields) is, however, a concern. It will cost an estimated $1 billion to develop a new MAGLEV system design; however, innovative designs may reduce the price.« less

Development and implementation of an empirical frequency map for use in MD simulations of isotope-edited proteins, and, Development, implementation, and evaluation of an online student portal as a textbook replacement in an advanced general chemistry course

NASA Astrophysics Data System (ADS)

Shorb, Justin Matthew

The first portion of this thesis describes an extension of work done in the Skinner group to develop an empirical frequency map for N-methylacetamide (NMA) in water. NMA is a peptide bond capped on either side by a methyl group and is therefore a common prototypical molecule used when studying complicated polypeptides and proteins. This amide bond is present along the backbone of every protein as it connects individual component amino acids. This amide bond also has a strong observable frequency in the IR due to the Amide-I mode (predominantly carbon-oxygen stretching motion). This project describes the simplification of the prior model for mapping the frequency of the Amide-I mode from the electric field due to the environment and develops a parallel implementation of this algorithm for use in larger biological systems, such as the trans-membrane portion of the tetrameric polypeptide bundle protein CD3zeta. The second portion of this thesis describes the development, implementation and evaluation of an online textbook within the context of a cohesive theoretical framework. The project begins by describing what is meant when discussing a digital textbook, including a survey of various types of digital media being used to deliver textbook-like content. This leads into the development of a theoretical framework based on constructivist pedagogical theory, hypertext learning theory, and chemistry visualization and representation frameworks. The implementation and design of ChemPaths, the general chemistry online text developed within the Chemistry Education Digital Library (ChemEd DL) is then described. The effectiveness of ChemPaths being used as a textbook replacement in an advanced general chemistry course is evaluated within the developed theoretical framework both qualitatively and quantitatively.

Development, Implementation, and Evaluation of Active Lions: A Campaign to Promote Active Travel to a University Campus.

PubMed

Bopp, Melissa; Sims, Dangaia; Matthews, Stephen A; Rovniak, Liza S; Poole, Erika; Colgan, Joanna

2018-03-01

To outline the development, implementation, and evaluation of a multistrategy intervention to promote active transportation, on a large university campus. Single group pilot study. A large university in the Northeastern United States. University students (n = 563), faculty and staff (employees, n = 999) were included in the study. The Active Lions campaign aimed to increase active transportation to campus for all students and employees. The campaign targeted active transport participation through the development of a smartphone application and the implementation of supporting social marketing and social media components. Component-specific measures included app user statistics, social media engagement, and reach of social marketing strategies. Overall evaluation included cross-sectional online surveys preintervention and postintervention of student and employee travel patterns and campaign awareness. Number of active trips to campus were summed, and the percentage of trips as active was calculated. T tests compared the differences in outcomes from preintervention to postintervention. Students had a higher percentage of active trips postintervention (64.2%) than preintervention (49.2%; t = 3.32, P = .001), although there were no differences for employees (7.9% and 8.91%). Greater awareness of Active Lions was associated with greater active travel. This multistrategy approach to increase active transportation on a college campus provided insight on the process of developing and implementing a campaign with the potential for impacting health behaviors among campus members.

New York State technical economic MAGLEV evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-06-01

The Energy Authority, the New York State Departments of Transportation, Economic Development, Environmental Conservation and the New York State Thruway Authority sponsored an evaluation of high-speed surface transit options for New York State. This study is the preliminary evaluation of magnetically levitated ground transportation systems (MAGLEV). The evaluation focuses on using the New York State Thruway right-of-way in combination with MAGLEV systems currently in development in Germany and Japan and those proposed for development in the United States. The Energy Authority's goal in cosponsoring this study was to determine if MAGLEV offered the potential to meet future New York Statemore » transportation demands cost-effectively, and to evaluate the benefits that the State might expect from supporting MAGLEV technology development and system implementation. According to the preliminary report, substantial economic benefits could accrue to the State through MAGLEV-related research, development, manufacturing and construction. Implementation would have a favorable impact on issues related to transportation, the environment and energy conservation. With the exception of the German Transrapid system, developing a domestic prototype MAGLEV vehicle would take seven to nine years; no insurmountable technical barriers are apparent. EMF shielding (electromagnetic fields) is, however a concern. 39 refs., 71 figs., 26 tabs.« less

Implementing a strategy to promote lifelong learning in the primary care workforce: an evaluation of leadership roles, change management approaches, interim challenges and achievements.

PubMed

McLaren, Susan; Woods, Leslie; Boudioni, Markella; Lemma, Ferew; Tavabie, Abdol

2008-01-01

To identify and explore leadership roles and responsibilities for implementing the workforce development strategy; to identify approaches used to implement and disseminate the strategy; and to identify and explore challenges and achievements in the first 18 months following implementation. A formative evaluation with qualitative methods was used. Documentary analysis, interviews (n = 29) and two focus groups (n = 12) were conducted with a purposive sample of individuals responsible for strategy implementation. Data were transcribed and analysed thematically using framework analysis. Regional health area in Kent, Surrey and Sussex: 24 primary care trusts (PCTs) and 900 general practices. Primary care workforce tutors, lifelong learning advisors, GP tutors, patch associate GP deans and chairs of PCT education committees all had vital leadership roles, some existing and others newly developed. Approaches used to implement the strategy encompassed working within and across organisational boundaries, communication and dissemination of information. Challenges encountered by implementers were resistance to change - evident in some negative attitudes to uptake of training and development opportunities - and role diversity and influence. Achievements included successes in embedding appraisal and protected learning time, and changes in educational practices and services. The use of key leadership roles and change-management approaches had brought about early indications of positive transition in lifelong learning cultures.

Teacher Supervision and Evaluation Policies in Selected Alberta School Jurisdictions, 1983-1986; A Summary of Research, Opinion and Recent Experience Relative to Implementation.

ERIC Educational Resources Information Center

Townsend, David

This monograph focuses on the implementation process that has been a concern of school jurisdictions since the teacher evaluation policy became mandatory in Alberta, Canada, in 1985. Research has shown that school systems are adept at developing written policy but much less successful at putting that policy into effective operation. This overview…

Implementation of Effective Intervention: An Empirical Study to Evaluate the Efficacy of Fountas & Pinnell's Leveled Literacy Intervention System (LLI). 2009-2010

ERIC Educational Resources Information Center

Ransford-Kaldon, Carolyn R.; Flynt, E. Sutton; Ross, Cristin L.; Franceschini, Louis; Zoblotsky, Todd; Huang, Ying; Gallagher, Brenda

2010-01-01

This report summarizes evaluation results for an efficacy study of the Leveled Literacy Intervention system (LLI) implemented in Tift County Schools (TCS) in Georgia and the Enlarged City School District of Middletown (ECSDM) in New York during the 2009-2010 school year. Developed by Fountas & Pinnell (2009) and published by Heinemann, LLI is…

Creating Workforce Development Systems That Work: An Evaluation of the Initial One-Stop Implementation Experience. Final Report.

ERIC Educational Resources Information Center

Kogan, Deborah; Dickinson, Katherine P.; Fedrau, Ruth; Midling, Michael J.; Wolff, Kristin E.

This report analyzes progress states and local sites have made in implementing the One-Stop Career Center systems. An executive summary is followed by Section A, Introduction, which provides an overview of the One-Stop initiative and describes evaluation objectives and methods. The main portion of the report is organized into three major sections.…

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service.

PubMed

Misso, Marie L; Ilic, Dragan; Haines, Terry P; Hutchinson, Alison M; East, Christine E; Teede, Helena J

2016-01-14

Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education. The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up. It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Development, implementation and evaluation of a patient handoff tool to improve safety in orthopaedic surgery.

PubMed

Gagnier, Joel J; Derosier, Joseph M; Maratt, Joseph D; Hake, Mark E; Bagian, James P

2016-06-01

To develop, implement and test the effect of a handoff tool for orthopaedic trauma residents that reduces adverse events associated with the omission of critical information and the transfer of erroneous information. Components of this project included a literature review, resident surveys and observations, checklist development and refinement, implementation and evaluation of impact on adverse events through a chart review of a prospective cohort compared with a historical control group. Large teaching hospital. Findings of a literature review were presented to orthopaedic residents, epidemiologists, orthopaedic surgeons and patient safety experts in face-to-face meetings, during which we developed and refined the contents of a resident handoff tool. The tool was tested in an orthopaedic trauma service and its impact on adverse events was evaluated through a chart review. The handoff tool was developed and refined during the face-to-face meetings and a pilot implementation. Adverse event data were collected on 127 patients (n = 67 baseline period; n = 60 test period). A handoff tool for use by orthopaedic residents. Adverse events in patients handed off by orthopaedic trauma residents. After controlling for age, gender and comorbidities, testing resulted in fewer events per person (25-27% reduction; P < 0.10). Preliminary evidence suggests that our resident handoff tool may contribute to a decrease in adverse events in orthopaedic patients. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

An Integrated Knowledge Translation Experience

PubMed Central

Bagatto, Marlene P.; Miller, Linda T.; Kothari, Anita; Seewald, Richard; Scollie, Susan D.

2011-01-01

Pediatric audiologists lack evidence-based, age-appropriate outcome evaluation tools with well-developed normative data that could be used to evaluate the auditory development and performance of children aged birth to 6 years with permanent childhood hearing impairment. Bagatto and colleagues recommend a battery of outcome tools that may be used with this population. This article provides results of an evaluation of the individual components of the University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) version 1.0 by the audiologists associated with the Network of Pediatric Audiologists of Canada. It also provides information regarding barriers and facilitators to implementing outcome measures in clinical practice. Results indicate that when compared to the Parents’ Evaluation of Aural/Oral Performance of Children (PEACH) Diary, audiologists found the PEACH Rating Scale to be a more clinically feasible evaluation tool to implement in practice from a time, task, and consistency of use perspective. Results also indicate that the LittlEARS® Auditory Questionnaire could be used to evaluate the auditory development and performance of children aged birth to 6 years with permanent childhood hearing impairment (PCHI). The most cited barrier to implementation is time. The result of this social collaboration was the creation of a knowledge product, the UWO PedAMP v1.0, which has the potential to be useful to audiologists and the children and families they serve. PMID:22194315

In preparation of the nationwide dissemination of the school-based obesity prevention program DOiT: stepwise development applying the intervention mapping protocol.

PubMed

van Nassau, Femke; Singh, Amika S; van Mechelen, Willem; Brug, Johannes; Chin A Paw, Mai J M

2014-08-01

The school-based Dutch Obesity Intervention in Teenagers (DOiT) program is an evidence-based obesity prevention program. In preparation for dissemination throughout the Netherlands, this study aimed to adapt the initial program and to develop an implementation strategy and materials. We revisited the Intervention Mapping (IM) protocol, using results of the previous process evaluation and additional focus groups and interviews with students, parents, teachers, and professionals. The adapted 2-year DOiT program consists of a classroom, an environmental and a parental component. The year 1 lessons aim to increase awareness and knowledge of healthy behaviors. The lessons in year 2 focus on the influence of the (obesogenic) environment. The stepwise development of the implementation strategy resulted in objectives that support teachers' implementation. We developed a 7-step implementation strategy and supporting materials by translating the objectives into essential elements and practical strategies. This study illustrates how revisiting the IM protocol resulted in an adapted program and tailored implementation strategy based on previous evaluations as well as input from different stakeholders. The stepwise development of DOiT can serve as an example for other evidence-based programs in preparation for wider dissemination. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

A real-time simulation evaluation of an advanced detection. Isolation and accommodation algorithm for sensor failures in turbine engines

NASA Technical Reports Server (NTRS)

Merrill, W. C.; Delaat, J. C.

1986-01-01

An advanced sensor failure detection, isolation, and accommodation (ADIA) algorithm has been developed for use with an aircraft turbofan engine control system. In a previous paper the authors described the ADIA algorithm and its real-time implementation. Subsequent improvements made to the algorithm and implementation are discussed, and the results of an evaluation presented. The evaluation used a real-time, hybrid computer simulation of an F100 turbofan engine.

Electronic tools to support medication reconciliation: a systematic review.

PubMed

Marien, Sophie; Krug, Bruno; Spinewine, Anne

2017-01-01

Medication reconciliation (MedRec) is essential for reducing patient harm caused by medication discrepancies across care transitions. Electronic support has been described as a promising approach to moving MedRec forward. We systematically reviewed the evidence about electronic tools that support MedRec, by (a) identifying tools; (b) summarizing their characteristics with regard to context, tool, implementation, and evaluation; and (c) summarizing key messages for successful development and implementation. We searched PubMed, the Cumulative Index to Nursing and Allied Health Literature, Embase, PsycINFO, and the Cochrane Library, and identified additional reports from reference lists, reviews, and patent databases. Reports were included if the electronic tool supported medication history taking and the identification and resolution of medication discrepancies. Two researchers independently selected studies, evaluated the quality of reporting, and extracted data. Eighteen reports relative to 11 tools were included. There were eight quality improvement projects, five observational effectiveness studies, three randomized controlled trials (RCTs) or RCT protocols (ie, descriptions of RCTs in progress), and two patents. All tools were developed in academic environments in North America. Most used electronic data from multiple sources and partially implemented functionalities considered to be important. Relevant information on functionalities and implementation features was frequently missing. Evaluations mainly focused on usability, adherence, and user satisfaction. One RCT evaluated the effect on potential adverse drug events. Successful implementation of electronic tools to support MedRec requires favorable context, properly designed tools, and attention to implementation features. Future research is needed to evaluate the effect of these tools on the quality and safety of healthcare. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Evaluation of Federal Social Programs: An Uncertain Impact. Occasional Paper 1992-2.

ERIC Educational Resources Information Center

Levitan, Sar A.

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY2000

EPA Science Inventory

The Superfund Innovative Technology Evaluation Program promotes the development, commercialization, and implementation of innovative hazardous waste treatment technologies. SITE offers a mechanism for conducting joint demonstration and evaluation projects at hazardous waste site...

Evaluating Educational Programmes: The Need and the Response.

ERIC Educational Resources Information Center

Stake, Robert E.

This survey of recent developments in educational program evaluation is intended for persons who commission, implement, direct, or carry out evaluation studies. The attitudes of government officials, educators, and researchers toward assessment and their own evaluation needs are discussed. Various approaches to evaluation are briefly described;…

Modeling the dynamics of evaluation: a multilevel neural network implementation of the iterative reprocessing model.

PubMed

Ehret, Phillip J; Monroe, Brian M; Read, Stephen J

2015-05-01

We present a neural network implementation of central components of the iterative reprocessing (IR) model. The IR model argues that the evaluation of social stimuli (attitudes, stereotypes) is the result of the IR of stimuli in a hierarchy of neural systems: The evaluation of social stimuli develops and changes over processing. The network has a multilevel, bidirectional feedback evaluation system that integrates initial perceptual processing and later developing semantic processing. The network processes stimuli (e.g., an individual's appearance) over repeated iterations, with increasingly higher levels of semantic processing over time. As a result, the network's evaluations of stimuli evolve. We discuss the implications of the network for a number of different issues involved in attitudes and social evaluation. The success of the network supports the IR model framework and provides new insights into attitude theory. © 2014 by the Society for Personality and Social Psychology, Inc.

Implementing AORN recommended practices for product selection.

PubMed

Conrardy, Julie A

2012-06-01

This article focuses on the revised AORN "Recommended practices for product selection in perioperative practice settings." Hospitals and ambulatory surgery facilities should have protocols in place for product evaluation that includes a multidisciplinary team approach. The process for product evaluation and selection includes gathering information; establishing consistent requirements for product evaluation; performing a financial impact analysis; investigating a plan to standardize products; conducting an environmental impact analysis; determining whether to purchase single-use, reposable, or reusable products or reprocess single-use devices; developing an evaluation process based on objective criteria; and developing and implementing a comprehensive plan to introduce and use new products. Use of an evaluation tool that is based on objective criteria is one way to obtain valuable input during product evaluations. Because of varied roles and experiences, the perioperative RN is an integral member of the product selection committee. Published by Elsevier Inc.

Developing Community Health Worker Diabetes Training

ERIC Educational Resources Information Center

Ferguson, W. J.; Lemay, C. A.; Hargraves, J. L.; Gorodetsky, T.; Calista, J.

2012-01-01

We designed, implemented and evaluated a 48-hour training program for community health workers (CHWs) deployed to diabetes care teams in community health centers (CHCs). The curriculum included core knowledge/skills with diabetes content to assist CHWs in developing patient self-management goals. Our qualitative evaluation included…

Tools and Techniques for Evaluating the Effects of Maintenance Resource Management (MRM) in Air Safety

NASA Technical Reports Server (NTRS)

Taylor, James C.

2002-01-01

This research project was designed as part of a larger effort to help Human Factors (HF) implementers, and others in the aviation maintenance community, understand, evaluate, and validate the impact of Maintenance Resource Management (MRM) training programs, and other MRM interventions; on participant attitudes, opinions, behaviors, and ultimately on enhanced safety performance. It includes research and development of evaluation methodology as well as examination of psychological constructs and correlates of maintainer performance. In particular, during 2001, three issues were addressed. First a prototype process for measuring performance was developed and used. Second an automated calculator was developed to aid the HF implementer user in analyzing and evaluating local survey data. These results include being automatically compared with the experience from all MRM programs studied since 1991. Third the core survey (the Maintenance Resource Management Technical Operations Questionnaire, or 'MRM/TOQ') was further developed and tested to include topics of added relevance to the industry.

Best practice recommendations for the development, implementation, and evaluation of online knowledge translation resources in rehabilitation.

PubMed

Levac, Danielle; Glegg, Stephanie M N; Camden, Chantal; Rivard, Lisa M; Missiuna, Cheryl

2015-04-01

The knowledge-to-practice gap in rehabilitation has spurred knowledge translation (KT) initiatives aimed at promoting clinician behavior change and improving patient care. Online KT resources for physical therapists and other rehabilitation clinicians are appealing because of their potential to reach large numbers of individuals through self-paced, self-directed learning. This article proposes best practice recommendations for developing online KT resources that are designed to translate evidence into practice. Four recommendations are proposed with specific steps in the development, implementation, and evaluation process: (1) develop evidence-based, user-centered content; (2) tailor content to online format; (3) evaluate impact; and (4) share results and disseminate knowledge. Based on KT evidence and instructional design principles, concrete examples are provided along with insights gained from experiences in creating and evaluating online KT resources for physical therapists. In proposing these recommendations, the next steps for research are suggested, and others are invited to contribute to the discussion. © 2015 American Physical Therapy Association.

Development of a theory- and evidence-based intervention to enhance implementation of physical therapy guidelines for the management of low back pain

PubMed Central

2014-01-01

Background Systematic planning could improve the generally moderate effectiveness of interventions to enhance adherence to clinical practice guidelines. The aim of our study was to demonstrate how the process of Intervention Mapping was used to develop an intervention to address the lack of adherence to the national CPG for low back pain by Dutch physical therapists. Methods We systematically developed a program to improve adherence to the Dutch physical therapy guidelines for low back pain. Based on multi-method formative research, we formulated program and change objectives. Selected theory-based methods of change and practical applications were combined into an intervention program. Implementation and evaluation plans were developed. Results Formative research revealed influential determinants for physical therapists and practice quality managers. Self-regulation was appropriate because both the physical therapists and the practice managers needed to monitor current practice and make and implement plans for change. The program stimulated interaction between practice levels by emphasizing collective goal setting. It combined practical applications, such as knowledge transfer and discussion-and-feedback, based on theory-based methods, such as consciousness raising and active learning. The implementation plan incorporated the wider environment. The evaluation plan included an effect and process evaluation. Conclusions Intervention Mapping is a useful framework for formative data in program planning in the field of clinical guideline implementation. However, a decision aid to select determinants of guideline adherence identified in the formative research to analyse the problem may increase the efficiency of the application of the Intervention Mapping process. PMID:24428945

Development of a theory- and evidence-based intervention to enhance implementation of physical therapy guidelines for the management of low back pain.

PubMed

Rutten, Geert M; Harting, Janneke; Bartholomew, Leona K; Braspenning, Jozé C; van Dolder, Rob; Heijmans, Marcel Fgj; Hendriks, Erik Jm; Kremers, Stef Pj; van Peppen, Roland Ps; Rutten, Steven Tj; Schlief, Angelique; de Vries, Nanne K; Oostendorp, Rob Ab

2014-01-15

Systematic planning could improve the generally moderate effectiveness of interventions to enhance adherence to clinical practice guidelines. The aim of our study was to demonstrate how the process of Intervention Mapping was used to develop an intervention to address the lack of adherence to the national CPG for low back pain by Dutch physical therapists. We systematically developed a program to improve adherence to the Dutch physical therapy guidelines for low back pain. Based on multi-method formative research, we formulated program and change objectives. Selected theory-based methods of change and practical applications were combined into an intervention program. Implementation and evaluation plans were developed. Formative research revealed influential determinants for physical therapists and practice quality managers. Self-regulation was appropriate because both the physical therapists and the practice managers needed to monitor current practice and make and implement plans for change. The program stimulated interaction between practice levels by emphasizing collective goal setting. It combined practical applications, such as knowledge transfer and discussion-and-feedback, based on theory-based methods, such as consciousness raising and active learning. The implementation plan incorporated the wider environment. The evaluation plan included an effect and process evaluation. Intervention Mapping is a useful framework for formative data in program planning in the field of clinical guideline implementation. However, a decision aid to select determinants of guideline adherence identified in the formative research to analyse the problem may increase the efficiency of the application of the Intervention Mapping process.

Computer Administering of the Psychological Investigations: Set-Relational Representation

NASA Astrophysics Data System (ADS)

Yordzhev, Krasimir

Computer administering of a psychological investigation is the computer representation of the entire procedure of psychological assessments - test construction, test implementation, results evaluation, storage and maintenance of the developed database, its statistical processing, analysis and interpretation. A mathematical description of psychological assessment with the aid of personality tests is discussed in this article. The set theory and the relational algebra are used in this description. A relational model of data, needed to design a computer system for automation of certain psychological assessments is given. Some finite sets and relation on them, which are necessary for creating a personality psychological test, are described. The described model could be used to develop real software for computer administering of any psychological test and there is full automation of the whole process: test construction, test implementation, result evaluation, storage of the developed database, statistical implementation, analysis and interpretation. A software project for computer administering personality psychological tests is suggested.

Artificial neural networks in evaluation and optimization of modified release solid dosage forms.

PubMed

Ibrić, Svetlana; Djuriš, Jelena; Parojčić, Jelena; Djurić, Zorica

2012-10-18

Implementation of the Quality by Design (QbD) approach in pharmaceutical development has compelled researchers in the pharmaceutical industry to employ Design of Experiments (DoE) as a statistical tool, in product development. Among all DoE techniques, response surface methodology (RSM) is the one most frequently used. Progress of computer science has had an impact on pharmaceutical development as well. Simultaneous with the implementation of statistical methods, machine learning tools took an important place in drug formulation. Twenty years ago, the first papers describing application of artificial neural networks in optimization of modified release products appeared. Since then, a lot of work has been done towards implementation of new techniques, especially Artificial Neural Networks (ANN) in modeling of production, drug release and drug stability of modified release solid dosage forms. The aim of this paper is to review artificial neural networks in evaluation and optimization of modified release solid dosage forms.

Artificial Neural Networks in Evaluation and Optimization of Modified Release Solid Dosage Forms

PubMed Central

Ibrić, Svetlana; Djuriš, Jelena; Parojčić, Jelena; Djurić, Zorica

2012-01-01

Implementation of the Quality by Design (QbD) approach in pharmaceutical development has compelled researchers in the pharmaceutical industry to employ Design of Experiments (DoE) as a statistical tool, in product development. Among all DoE techniques, response surface methodology (RSM) is the one most frequently used. Progress of computer science has had an impact on pharmaceutical development as well. Simultaneous with the implementation of statistical methods, machine learning tools took an important place in drug formulation. Twenty years ago, the first papers describing application of artificial neural networks in optimization of modified release products appeared. Since then, a lot of work has been done towards implementation of new techniques, especially Artificial Neural Networks (ANN) in modeling of production, drug release and drug stability of modified release solid dosage forms. The aim of this paper is to review artificial neural networks in evaluation and optimization of modified release solid dosage forms. PMID:24300369

Using drama to prevent teen smoking: development, implementation, and evaluation of crossroads in Hawai'i.

PubMed

Mitschke, Diane B; Loebl, Karen; Tatafu, Elitei; Matsunaga, Doris Segal; Cassel, Kevin

2010-03-01

The use of drama as a preventive education measure has demonstrated success in various health promotion venues and offers promise in promoting positive youth attitudes and behavior change related to tobacco use. Especially important is a need to implement culturally relevant methods to reach youth. This article describes the development and implementation of a tobacco prevention drama for Asian and Pacific Islander youth. The resulting play, Crossroads, features a soap opera-style drama interspersed with humorous vignettes and multimedia effects and incorporates cultural cues, mannerisms, dress, and values consistent with Asian and Pacific Islander youth culture. Evaluation data indicate that the drama has an effect on audience knowledge, attitudes, and intended behavior, including a change in future intent to smoke cigarettes and the ability of audience members to develop connections with the characters in the play and apply concepts that are presented in the play to their own lives.

Implementation of genetic conservation practices in a muskellunge propagation and stocking program

USGS Publications Warehouse

Jennings, Martin J.; Sloss, Brian L.; Hatzenbeler, Gene R.; Kampa, Jeffrey M.; Simonson, Timothy D.; Avelallemant, Steven P.; Lindenberger, Gary A.; Underwood, Bruce D.

2010-01-01

Conservation of genetic resources is a challenging issue for agencies managing popular sport fishes. To address the ongoing potential for genetic risks, we developed a comprehensive set of recommendations to conserve genetic diversity of muskellunge (Esox masquinongy) in Wisconsin, and evaluated the extent to which the recommendations can be implemented. Although some details are specific to Wisconsin's muskellunge propagation program, many of the practical issues affecting implementation are applicable to other species and production systems. We developed guidelines to restrict future broodstock collection operations to lakes with natural reproduction and to develop a set of brood lakes to use on a rotational basis within regional stock boundaries, but implementation will require considering lakes with variable stocking histories. Maintaining an effective population size sufficient to minimize the risk of losing alleles requires limiting broodstock collection to large lakes. Recommendations to better approximate the temporal distribution of spawning in hatchery operations and randomize selection of brood fish are feasible. Guidelines to modify rearing and distribution procedures face some logistic constraints. An evaluation of genetic diversity of hatchery-produced fish during 2008 demonstrated variable success representing genetic variation of the source population. Continued evaluation of hatchery operations will optimize operational efficiency while moving toward genetic conservation goals.

Implementation of genetic conservation practices in a muskellunge propagation and stocking program

USGS Publications Warehouse

Jennings, Martin J.; Sloss, Brian L.; Hatzenbeler, Gene R.; Kampa, Jeffrey M.; Simonson, Timothy D.; Avelallemant, Steven P.; Lindenberger, Gary A.; Underwood, Bruce D.

2010-01-01

Conservation of genetic resources is a challenging issue for agencies managing popular sport fishes. To address the ongoing potential for genetic risks, we developed a comprehensive set of recommendations to conserve genetic diversity of muskellunge (Esox masquinongy) in Wisconsin, and evaluated the extent to which the recommendations can be implemented. Although some details are specific to Wisconsin's muskellunge propagation program, many of the practical issues affecting implementation are applicable to other species and production systems. We developed guidelines to restrict future brood stock collection operations to lakes with natural reproduction and to develop a set of brood lakes to use on a rotational basis within regional stock boundaries, but implementation will require considering lakes with variable stocking histories. Maintaining an effective population size sufficient to minimize the risk of losing alleles requires limiting brood stock collection to large lakes. Recommendations to better approximate the temporal distribution of spawning in hatchery operations and randomize selection of brood fish are feasible. Guidelines to modify rearing and distribution procedures face some logistic constraints. An evaluation of genetic diversity of hatchery-produced fish during 2008 demonstrated variable success representing genetic variation of the source population. Continued evaluation of hatchery operations will optimize operational efficiency while moving toward genetic conservation goals.

Implementing and evaluating a professional practice framework in child and family health nursing: a pilot project.

PubMed

Guest, Eileen M; Keatinge, Diana R; Reed, Jennifer; Johnson, Karen R; Higgins, Helen M; Greig, Jennifer

2013-09-01

This paper describes the implementation and evaluation of the NSW Child and Family Health Nursing Professional Practice Framework in one health district in New South Wales, Australia. Child and family health nurses provide specialised, community based primary health care to families with children 0-5 years. A state wide professional practice framework was recently developed to support child and family health nurses. Online learning, clinical practice consultancies and skill assessments related to routine infant and child health surveillance were developed and implemented. Child and family health nurse reviewers gained competency in the various education and assessment components. Reviewers replicated this process in partnership with 21 child and family health nurses from two rural and one regional cluster. Evaluation questionnaires and focus groups were held with stakeholder groups. Participation provided nurses with affirmation of clinical practice and competency. Education and assessment processes were user friendly and particularly helpful for rural and remote nurses. Managers reported greater confidence in staff competence following project participation. Detailed planning and consultation is recommended before implementation of the Framework. Online learning, skills assessments and model of clinical practice consultancies were identified as central to ongoing orientation, education and professional development. Copyright © 2012 Elsevier Ltd. All rights reserved.

Paratransit Handbook : a Guide to Paratransit System Implementation volume II - parts 4 and 5

DOT National Transportation Integrated Search

1979-02-01

This Paratransit Handbook has been developed to aid public officials, planners and system operators in planning, designing, implementing, operating and evaluating integrated paratransit systems. The Handbook represents a compedium of techniques and e...

Sustainability in Health care by Allocating Resources Effectively (SHARE) 7: supporting staff in evidence-based decision-making, implementation and evaluation in a local healthcare setting.

PubMed

Harris, Claire; Allen, Kelly; Waller, Cara; Dyer, Tim; Brooke, Vanessa; Garrubba, Marie; Melder, Angela; Voutier, Catherine; Gust, Anthony; Farjou, Dina

2017-06-21

This is the seventh in a series of papers reporting Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. The SHARE Program was a systematic, integrated, evidence-based program for resource allocation within a large Australian health service. It aimed to facilitate proactive use of evidence from research and local data; evidence-based decision-making for resource allocation including disinvestment; and development, implementation and evaluation of disinvestment projects. From the literature and responses of local stakeholders it was clear that provision of expertise and education, training and support of health service staff would be required to achieve these aims. Four support services were proposed. This paper is a detailed case report of the development, implementation and evaluation of a Data Service, Capacity Building Service and Project Support Service. An Evidence Service is reported separately. Literature reviews, surveys, interviews, consultation and workshops were used to capture and process the relevant information. Existing theoretical frameworks were adapted for evaluation and explication of processes and outcomes. Surveys and interviews identified current practice in use of evidence in decision-making, implementation and evaluation; staff needs for evidence-based practice; nature, type and availability of local health service data; and preferred formats for education and training. The Capacity Building and Project Support Services were successful in achieving short term objectives; but long term outcomes were not evaluated due to reduced funding. The Data Service was not implemented at all. Factors influencing the processes and outcomes are discussed. Health service staff need access to education, training, expertise and support to enable evidence-based decision-making and to implement and evaluate the changes arising from those decisions. Three support services were proposed based on research evidence and local findings. Local factors, some unanticipated and some unavoidable, were the main barriers to successful implementation. All three proposed support services hold promise as facilitators of EBP in the local healthcare setting. The findings from this study will inform further exploration.

Evaluation of FNS control systems: software development and sensor characterization.

PubMed

Riess, J; Abbas, J J

1997-01-01

Functional Neuromuscular Stimulation (FNS) systems activate paralyzed limbs by electrically stimulating motor neurons. These systems have been used to restore functions such as standing and stepping in people with thoracic level spinal cord injury. Research in our laboratory is directed at the design and evaluation of the control algorithms for generating posture and movement. This paper describes software developed for implementing FNS control systems and the characterization of a sensor system used to implement and evaluate controllers in the laboratory. In order to assess FNS control algorithms, we have developed a versatile software package using Lab VIEW (National Instruments, Corp). This package provides the ability to interface with sensor systems via serial port or A/D board, implement data processing and real-time control algorithms, and interface with neuromuscular stimulation devices. In our laboratory, we use the Flock of Birds (Ascension Technology Corp.) motion tracking sensor system to monitor limb segment position and orientation (6 degrees of freedom). Errors in the sensor system have been characterized and nonlinear polynomial models have been developed to account for these errors. With this compensation, the error in the distance measurement is reduced by 90 % so that the maximum error is less than 1 cm.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

Evaluation of competence-based teaching in higher education: From theory to practice.

PubMed

Bergsmann, Evelyn; Schultes, Marie-Therese; Winter, Petra; Schober, Barbara; Spiel, Christiane

2015-10-01

Competence-based teaching in higher education institutions and its evaluation have become a prevalent topic especially in the European Union. However, evaluation instruments are often limited, for example to single student competencies or specific elements of the teaching process. The present paper provides a more comprehensive evaluation concept that contributes to sustainable improvement of competence-based teaching in higher education institutions. The evaluation concept considers competence research developments as well as the participatory evaluation approach. The evaluation concept consists of three stages. The first stage evaluates whether the competencies students are supposed to acquire within the curriculum (ideal situation) are well defined. The second stage evaluates the teaching process and the competencies students have actually acquired (real situation). The third stage evaluates concrete aspects of the teaching process. Additionally, an implementation strategy is introduced to support the transfer from the theoretical evaluation concept to practice. The evaluation concept and its implementation strategy are designed for internal evaluations in higher education and primarily address higher education institutions that have already developed and conducted a competence-based curriculum. Copyright © 2015 Elsevier Ltd. All rights reserved.

Tools developed and disseminated by guideline producers to promote the uptake of their guidelines.

PubMed

Flodgren, Gerd; Hall, Amanda M; Goulding, Lucy; Eccles, Martin P; Grimshaw, Jeremy M; Leng, Gillian C; Shepperd, Sasha

2016-08-22

The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.

Participative management and shared leadership: implementing a model.

PubMed

Noonan, D

1995-01-01

The author identifies the development, implementation and outcomes of a task subgroup model of management that provides a mechanism for shared leadership, planning, decision making, implementation and evaluation by staff, patients and families on a program level. The conceptual model and its operationalization are outlined within the context of the rehabilitation program at the Providence Centre in Scarborough, Ontario.

The Implementation of Enrollment Management at Two Public Universities Experiencing Demographic and Funding Challenges

ERIC Educational Resources Information Center

Lee, Stephen

2010-01-01

The purpose of this study was to evaluate the implementation of enrollment management at two public universities. The theoretical framework was conceptual and centered on the effectiveness of the implementation process as a pivotal factor in the development of a comprehensive enrollment management operation. This multi-site case study included 14…

Development of Continuing Nursing Education Offerings for the World Wide Web.

ERIC Educational Resources Information Center

Billings, Diane M.; Rowles, Connie J.

2001-01-01

Describes steps for web-based continuing education courses in terms of planning (strategic plan, website development, resource team, marketing plan), implementing (course design, web-based tools, copyright and intellectual property), and evaluating (pilot test, formative/summative evaluation, continuous quality improvement). (Contains 16…

Development, implementation, and evaluation of a multi-addiction prevention program for primary school students in Hong Kong: the B.E.S.T. Teen Program.

PubMed

Shek, Daniel T L; Yu, Lu; Leung, Hildie; Wu, Florence K Y; Law, Moon Y M

Based on the evaluation findings of the B.E.S.T. Teen Program which aimed at promoting behavioral, emotional, social, and thinking competencies in primary school students, it is argued in this paper that promotion of psychosocial competence to prevent addiction in primary school students is a promising strategy. A total of 382 Primary 5 (Grade 5) and 297 Primary 6 (Grade 6) students from five primary schools in Hong Kong participated in the program. Different evaluation strategies were adopted to evaluate the program. First, objective outcome evaluation adopting a non-equivalent group pretest-posttest experimental-control group design was conducted to examine change in the students. Second, to gauge students' perceptions of the program, subjective outcome evaluation was conducted. The evaluation findings basically converged to tentatively suggest that young adolescents benefited from participating in the program. Implications on the development, implementation, and evaluation of addiction prevention programs for teenagers are discussed.

IS0 9000 Implementation and Assessment: A Guide to Developing and Evaluating Quality Management Systems

NASA Technical Reports Server (NTRS)

Navarro, Robert J.; Grimm, Barry

1996-01-01

The agency has developed this reference publication to aid NASA organizations and their suppliers in the transition to IS0 9000. This guide focuses on the standard s intent, clarifies its requirements, offers implementation examples and highlights interrelated areas. It can assist anyone developing or evaluating NASA or supplier quality management systems. The IS0 9000 standards contain the basic elements for managing those processes that affect an organization's ability to consistently meet customer requirements. IS0 9000 was developed through the International Organization for Standardization and has been adopted as the US. national standard. These standards define a flexible foundation for customer focused process measurement, management and improvement that is the hallmark of world class enterprises.

Development of biology student worksheets to facilitate science process skills of student

NASA Astrophysics Data System (ADS)

Rahayu, Y. S.; Pratiwi, R.; Indana, S.

2018-01-01

This research aims to describe development of Biology student worksheets to facilitate science process skills of student, at the same time to facilitate thinking skills of students in senior high school are equipped with Assesment Sheets. The worksheets development refers to cycle which includes phase analysis (analysis), planning (planning), design (design), development (development), implementation (implementation), evaluation and revision (evaluation and revision). Phase evaluation and revision is an ongoing activity conducted in each phase of the development cycle. That is, after the evaluation of the results of these activities and make revisions at any phase, then continue to the next phase. Based on the test results for grade X, XI, and XII in St. Agnes Surabaya high school, obtained some important findings. The findings are as follows. (1) Developed biology student worksheets could be used to facilitate thinking ability of students in particular skills integrated process that includes components to formulate the problem, formulate hypotheses, determine the study variables, formulate an operational definition of variables, determine the steps in the research, planning data tables, organizing Data in the form of tables/charts, drawing conclusions, (2) Developed biology student worksheets could also facilitate the development of social interaction of students such as working together, listening/respect the opinions of others, assembling equipment and materials, discuss and share information and facilitate the upgrading of skills hands-on student activity. (3) Developed biology worksheets basically could be implemented with the guidance of the teacher step by step, especially for students who have never used a similar worksheet. Guidance at the beginning of this need, especially for worksheets that require special skills or understanding of specific concepts as a prerequisite, such as using a microscope, determine the heart rate, understand the mechanism of specific indicators.

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

A Case Study on the Implementation of Reflective Development Model in Improving Intercultural Competence among Business Student in Stamford College

ERIC Educational Resources Information Center

Gowindasamy, Maniyarasi

2017-01-01

This study was conducted to evaluate the implementation of reflective development model in improving the intercultural competence among business student in Stamford College. This study will be focus on the local and international students in terms of their cultural competencies through the globalization subjects. An embedded design of mixed…

The Development of an Implementation Model for ICT in Education: An Example of the Interaction of Affordances and Multimodality

ERIC Educational Resources Information Center

Hadfield, Mark; Jopling, Michael

2014-01-01

This paper discusses the development of a model targeted at non-specialist practitioners implementing innovations that involve information and communication technology (ICT) in education. It is based on data from a national evaluation of ICT-based projects in initial teacher education, which included a large-scale questionnaire survey and six…

Using a Template to Facilitate External Peer Preview of Curriculum: A Variation on the PRoT Theme

ERIC Educational Resources Information Center

Sealey, Rebecca

2013-01-01

Peer reviewing of teaching and curriculum in Higher Education is a common practice aimed at both quality assurance and professional development. External review of curriculum prior to implementation appears less common. The aim of this project was to develop, implement and evaluate a user-friendly process for external peer preview of teaching…

Implementation of palliative care as a mandatory cross-disciplinary subject (QB13) at the Medical Faculty of the Heinrich-Heine-University Düsseldorf, Germany

PubMed Central

Schulz, Christian; Wenzel-Meyburg, Ursula; Karger, André; Scherg, Alexandra; in der Schmitten, Jürgen; Trapp, Thorsten; Paling, Andreas; Bakus, Simone; Schatte, Gesa; Rudolf, Eva; Decking, Ulrich; Ritz-Timme, Stephanie; Grünewald, Matthias; Schmitz, Andrea

2015-01-01

Background: By means of the revision of the Medical Licensure Act for Physicians (ÄAppO) in 2009, undergraduate palliative care education (UPCE) was incorporated as a mandatory cross sectional examination subject (QB13) in medical education in Germany. Its implementation still constitutes a major challenge for German medical faculties. There is a discrepancy between limited university resources and limited patient availabilities and high numbers of medical students. Apart from teaching theoretical knowledge and skills, palliative care education is faced with the particular challenge of imparting a professional and adequate attitude towards incurably ill and dying patients and their relatives. Project description: Against this background, an evidence-based longitudinal UPCE curriculum was systematically developed following Kern’s Cycle [1] and partly implemented and evaluated by the students participating in the pilot project. Innovative teaching methods (virtual standardised/simulated patient contacts, e-learning courses, interdisciplinary and interprofessional collaborative teaching, and group sessions for reflective self-development) aim at teaching palliative care-related core competencies within the clinical context and on an interdisciplinary and interprofessional basis. Results: After almost five years of development and evaluation, the UPCE curriculum comprises 60 teaching units and is being fully implemented and taught for the first time in the winter semester 2014/15. The previous pilot phases were successfully concluded. To date, the pilot phases (n=26), the subproject “E-learning in palliative care” (n=518) and the blended-learning elective course “Communication with dying patients” (n=12) have been successfully evaluated. Conclusion: All conducted development steps and all developed programmes are available for other palliative care educators (Open Access). The integrated teaching formats and methods (video, e-learning module, interprofessional education, group sessions for reflexive self-development) and their evaluations are intended to make a contribution to an evidence-based development of palliative care curricula in Germany. PMID:25699109

Evaluation of a District-wide Inservice Professional Development Program for Teaching Science: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

1999-01-01

Nationwide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. Discusses a formative evaluation of the implementation of the Collier Chautauqua Program (CCP) which focuses on teacher enhancement resulting from participation in…

Evaluation of a District-Wide Inservice Professional Development Program for Science Teachers: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

Nation-wide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. The Collier Chautauqua Program (CCP) implemented the Iowa Chautauqua model at the district level in Collier County, Florida. A formative evaluation of the…

The effectiveness of clinical supervision for a group of ward managers based in a district general hospital: an evaluative study.

PubMed

Davis, Cynthia; Burke, Linda

2012-09-01

To present an evaluative audit assessing the effectiveness of clinical supervision for ward managers. A year-long project to introduce clinical supervision to ward managers was implemented and evaluated. The objectives were to evaluate staff perceptions of implementing clinical supervision and determine its outcomes. An audit evaluation process was used. Findings are presented against perceptions, implementation and reported outcomes of clinical supervision. Insights were gained into its relevance and importance to nurses and the organisation. Findings show that clinical supervision was perceived to be effective and helped improve patient care, but some feared it becoming a form of managerial control. Ward managers perceived advantages for personal and professional development from adopting this process. There is a need for greater understanding of clinical supervision before Trusts implement it. The introduction of a resource pack for clinical areas would also be of value. Finally, there needs to be a named person who has a special knowledge of clinical supervision to act as a champion and change agent in effecting implementation at both the executive level and within each clinical area. © 2011 Blackwell Publishing Ltd.

The Active plus protocol: systematic development of two theory- and evidence-based tailored physical activity interventions for the over-fifties.

PubMed

van Stralen, Maartje M; Kok, Gerjo; de Vries, Hein; Mudde, Aart N; Bolman, Catherine; Lechner, Lilian

2008-12-04

Limited data are available on the development, implementation and evaluation processes of physical activity promotion programmes among older adults. More integrative insights into interventions describing the planned systematic development, implementation and evaluation are needed. The purpose of this study is to give an integrative insight into the development of the Active plus programme applying the six-step Intervention Mapping protocol. The Active plus programme consisted of two theory- and evidence-based tailored physical activity promotion interventions, both comprising three tailored letters delivered over four months and aimed at raising awareness of insufficient physical activity, and stimulating physical activity initiation and maintenance among the over-fifties. The first intervention, the basic tailored intervention, provided tailored letters that intervened on the psychosocial determinants of physical activity. The second intervention, the intervention plus, provided the same tailored information but additionally provided tailored information about physical activity opportunities in the specific environment in which the older adults lived. This environment-based component also provided access to a forum and e-buddy system on a website. A plan for implementation and evaluation is also described. The planned development of the Active plus programme resulted in two theory- and evidence-based tailored physical activity interventions targeted at the over-fifties. Dutch Trial Register NTR 920.

A four stage approach for ontology-based health information system design.

PubMed

Kuziemsky, Craig E; Lau, Francis

2010-11-01

To describe and illustrate a four stage methodological approach to capture user knowledge in a biomedical domain area, use that knowledge to design an ontology, and then implement and evaluate the ontology as a health information system (HIS). A hybrid participatory design-grounded theory (GT-PD) method was used to obtain data and code them for ontology development. Prototyping was used to implement the ontology as a computer-based tool. Usability testing evaluated the computer-based tool. An empirically derived domain ontology and set of three problem-solving approaches were developed as a formalized model of the concepts and categories from the GT coding. The ontology and problem-solving approaches were used to design and implement a HIS that tested favorably in usability testing. The four stage approach illustrated in this paper is useful for designing and implementing an ontology as the basis for a HIS. The approach extends existing ontology development methodologies by providing an empirical basis for theory incorporated into ontology design. Copyright © 2010 Elsevier B.V. All rights reserved.

Manipulatives Implementation For Supporting Learning Of Mathematics For Prospective Teachers

NASA Astrophysics Data System (ADS)

Sulistyaningsih, D.; Mawarsari, V. D.; Hidayah, I.; Dwijanto

2017-04-01

Manipulatives are needed by teachers to facilitate students understand of mathematics which is abstract. As a prospective mathematics teacher, the student must have good skills in making manipulatives. Aims of this study is to describe the implementation of learning courses of manipulative workshop in mathematics education courses by lecturer at Universitas Muhammadiyah Semarang which includes the preparation of learning, general professional ability, the professional capacity specifically, ability of self-development, development class managing, planning and implementation of learning, a way of delivering the material, and evaluation of learning outcomes. Data collection techniques used were questionnaires, interviews, and observation. The research instrument consisted of a questionnaire sheet, sheet observation and interview guides. Validity is determined using data triangulation and triangulation methods. Data were analyzed using an interactive model. The results showed that the average value of activities in preparation for learning, fosters capabilities of general professional, specialized professional, self-development, manage the classroom, implementing the learning, how to deliver the material, and how to evaluate learning outcomes are 79%, 73%, 67%, 75%, 83%, 72%, 64%, and 54%, respectively

Proposed Performance Measures and Strategies for Implementation of the Fatigue Risk Management Guidelines for Emergency Medical Services

DOT National Transportation Integrated Search

2018-01-11

Background: Performance measures are a key component of implementation, dissemination, and evaluation of evidence-based guidelines (EBGs). We developed performance measures for Emergency Medical Services (EMS) stakeholders to enable the implementatio...

Implementing Computer-Based Training for Library Staff.

ERIC Educational Resources Information Center

Bayne, Pauline S.; And Others

1994-01-01

Describes a computer-based training program for library staff developed at the University of Tennessee, Knoxville, that used HyperCard stacks on Macintosh computers. Highlights include staff involvement; evaluation of modules; trainee participation and feedback; staff recognition; administrative support; implementation plan; supervisory…

IEP: Developing Criteria for the Evaluation of Individualized Education Program Provisions. Exploring Issues in the Implementation of P.L. 94-142.

ERIC Educational Resources Information Center

LINC Resources, Inc., Columbus, OH.

Four papers address approaches to evaluate the implementation of the individualized education program (IEP) provisions of P.L. 94-142, The Education for All Handicapped Children Act. The papers are "Auditing the IEP System: A Self-Audit System for Use by Local Education Agencies" by Beth Stephens and Daniel Macy, which examines a 10-step…

Review: evaluating information systems in nursing.

PubMed

Oroviogoicoechea, Cristina; Elliott, Barbara; Watson, Roger

2008-03-01

To review existing nursing research on inpatient hospitals' information technology (IT) systems in order to explore new approaches for evaluation research on nursing informatics to guide further design and implementation of effective IT systems. There has been an increase in the use of IT and information systems in nursing in recent years. However, there has been little evaluation of these systems and little guidance on how they might be evaluated. A literature review was conducted between 1995 and 2005 inclusive using CINAHL and Medline and the search terms 'nursing information systems', 'clinical information systems', 'hospital information systems', 'documentation', 'nursing records', 'charting'. Research in nursing information systems was analysed and some deficiencies and contradictory results were identified which impede a comprehensive understanding of effective implementation. There is a need for IT systems to be understood from a wider perspective that includes aspects related to the context where they are implemented. Social and organizational aspects need to be considered in evaluation studies and realistic evaluation can provide a framework for the evaluation of information systems in nursing. The rapid introduction of IT systems for clinical practice urges evaluation of already implemented systems examining how and in what circumstances they work to guide effective further development and implementation of IT systems to enhance clinical practice. Evaluation involves more factors than just involving technologies such as changing attitudes, cultures and healthcare practices. Realistic evaluation could provide configurations of context-mechanism-outcomes that explain the underlying relationships to understand why and how a programme or intervention works.

Statistical innovations in diagnostic device evaluation.

PubMed

Yu, Tinghui; Li, Qin; Gray, Gerry; Yue, Lilly Q

2016-01-01

Due to rapid technological development, innovations in diagnostic devices are proceeding at an extremely fast pace. Accordingly, the needs for adopting innovative statistical methods have emerged in the evaluation of diagnostic devices. Statisticians in the Center for Devices and Radiological Health at the Food and Drug Administration have provided leadership in implementing statistical innovations. The innovations discussed in this article include: the adoption of bootstrap and Jackknife methods, the implementation of appropriate multiple reader multiple case study design, the application of robustness analyses for missing data, and the development of study designs and data analyses for companion diagnostics.

Development of a Maternal, Newborn and Child mHealth Intervention in Thai Nguyen Province, Vietnam: Protocol for the mMom Project

PubMed Central

McBride, Bronwyn; Nguyen, Liem Thanh; Wiljer, David; Vu, Nguyen C; Nguyen, Cuong K

2018-01-01

Background Ethnic minority women (EMW) living in mountainous areas of northern Vietnam have disproportionately high infant and maternal mortality rates as a result of low maternal health knowledge, poverty, and remoteness from low-capacity health centers. Objective The objective of this study was to describe the protocol for the development and evaluation of the mMom intervention, which is an integrated mobile health (mHealth) system designed to improve maternal and infant health knowledge, and behavior among women in remote areas of Thai Nguyen, Vietnam. Methods This project featured the following four phases: (1) development of an mHealth platform integrated into the existing health management information system in partnership with the provincial health department; (2) ethnographic fieldwork and intervention content development; (3) intervention piloting and implementation; and (4) evaluation of the intervention’s impact on participants’ maternal health knowledge, behavior, and interactions with the health system. Results The mMom project development process resulted in the following: (1) the successful development of the mMom system, including the mHealth platform hardware and integration, the intervention plan and content, and the monitoring and evaluation framework; (2) the piloting and implementation of the intervention as planned; and (3) the implementation of the monitoring and evaluation framework components. Conclusions This protocol outlines the development of the mMom intervention and describes critical next steps in understanding the impact of the intervention on participants and the wider health system in Thai Nguyen province, Vietnam. PMID:29326095

Designing and evaluating a balanced scorecard for a health information management department in a Canadian urban non-teaching hospital.

PubMed

Nippak, Pria Md; Veracion, Julius Isidro; Muia, Maria; Ikeda-Douglas, Candace J; Isaac, Winston W

2016-06-01

This report is a description of a balanced scorecard design and evaluation process conducted for the health information management department at an urban non-teaching hospital in Canada. The creation of the health information management balanced scorecard involved planning, development, implementation, and evaluation of the indicators within the balanced scorecard by the health information management department and required 6 months to complete. Following the evaluation, the majority of members of the health information management department agreed that the balanced scorecard is a useful tool in reporting key performance indicators. These findings support the success of the balanced scorecard development within this setting and will help the department to better align with the hospital's corporate strategy that is linked to the provision of efficient management through the evaluation of key performance indicators. Thus, it appears that the planning and selection process used to determine the key indicators within the study can aid in the development of a balanced scorecard for a health information management department. In addition, it is important to include the health information management department staff in all stages of the balanced scorecard development, implementation, and evaluation phases. © The Author(s) 2014.

Development and Implementation of Culturally Tailored Offline Mobile Health Surveys.

PubMed

McIntosh, Scott; Pérez-Ramos, José; Demment, Margaret M; Vélez Vega, Carmen; Avendaño, Esteban; Ossip, Deborah J; Dye, Timothy D

2016-06-02

In low and middle income countries (LMICs), and other areas with low resources and unreliable access to the Internet, understanding the emerging best practices for the implementation of new mobile health (mHealth) technologies is needed for efficient and secure data management and for informing public health researchers. Innovations in mHealth technology can improve on previous methods, and dissemination of project development details and lessons learned during implementation are needed to provide lessons learned to stakeholders in both the United States and LMIC settings. The aims of this paper are to share implementation strategies and lessons learned from the development and implementation stages of two survey research projects using offline mobile technology, and to inform and prepare public health researchers and practitioners to implement new mobile technologies in survey research projects in LMICs. In 2015, two survey research projects were developed and piloted in Puerto Rico and pre-tested in Costa Rica to collect face-to-face data, get formative evaluation feedback, and to test the feasibility of an offline mobile data collection process. Fieldwork in each setting involved survey development, back translation with cultural tailoring, ethical review and approvals, data collector training, and piloting survey implementation on mobile tablets. Critical processes and workflows for survey research projects in low resource settings were identified and implemented. This included developing a secure mobile data platform tailored to each survey, establishing user accessibility, and training and eliciting feedback from data collectors and on-site LMIC project partners. Formative and process evaluation strategies are necessary and useful for the development and implementation of survey research projects using emerging mHealth technologies in LMICs and other low resource settings. Lessons learned include: (1) plan institutional review board (IRB) approvals in multiple countries carefully to allow for development, implementation, and feedback, (2) in addition to testing the content of survey instruments, allow time and consideration for testing the use of novel mHealth technology (hardware and software), (3) incorporate training for and feedback from project staff, LMIC partner staff, and research participants, and (4) change methods accordingly, including content, as mHealth technology usage influences and is influenced by the content and structure of the survey instrument. Lessons learned from early phases of LMIC research projects using emerging mHealth technologies are critical for informing subsequent research methods and study designs.

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation

NASA Technical Reports Server (NTRS)

Haley, D. C.; Almand, B. J.; Thomas, M. M.; Krauze, L. D.; Gremban, K. D.; Sanborn, J. C.; Kelly, J. H.; Depkovich, T. M.

1984-01-01

A generic computer simulation for manipulator systems (ROBSIM) was implemented and the specific technologies necessary to increase the role of automation in various missions were developed. The specific items developed are: (1) capability for definition of a manipulator system consisting of multiple arms, load objects, and an environment; (2) capability for kinematic analysis, requirements analysis, and response simulation of manipulator motion; (3) postprocessing options such as graphic replay of simulated motion and manipulator parameter plotting; (4) investigation and simulation of various control methods including manual force/torque and active compliances control; (5) evaluation and implementation of three obstacle avoidance methods; (6) video simulation and edge detection; and (7) software simulation validation.

Development and use of the generic WHO/CDC logic model for vitamin and mineral interventions in public health programmes

PubMed Central

De-Regil, Luz Maria; Peña-Rosas, Juan Pablo; Flores-Ayala, Rafael; del Socorro Jefferds, Maria Elena

2015-01-01

Objective Nutrition interventions are critical to achieve the Millennium Development Goals; among them, micronutrient interventions are considered cost-effective and programmatically feasible to scale up, but there are limited tools to communicate the programme components and their relationships. The WHO/CDC (Centers for Disease Control and Prevention) logic model for micronutrient interventions in public health programmes is a useful resource for planning, implementation, monitoring and evaluation of these interventions, which depicts the programme theory and expected relationships between inputs and expected Millennium Development Goals. Design The model was developed by applying principles of programme evaluation, public health nutrition theory and programmatic expertise. The multifaceted and iterative structure validation included feedback from potential users and adaptation by national stakeholders involved in public health programmes' design and implementation. Results In addition to the inputs, main activity domains identified as essential for programme development, implementation and performance include: (i) policy; (ii) products and supply; (iii) delivery systems; (iv) quality control; and (v) behaviour change communication. Outputs encompass the access to and coverage of interventions. Outcomes include knowledge and appropriate use of the intervention, as well as effects on micronutrient intake, nutritional status and health of target populations, for ultimate achievement of the Millennium Development Goals. Conclusions The WHO/CDC logic model simplifies the process of developing a logic model by providing a tool that has identified high-priority areas and concepts that apply to virtually all public health micronutrient interventions. Countries can adapt it to their context in order to support programme design, implementation, monitoring and evaluation for the successful scale-up of nutrition interventions in public health. PMID:23507463

Evaluation Criteria for the Educational Web-Information System

ERIC Educational Resources Information Center

Seok, Soonhwa; Meyen, Edward; Poggio, John C.; Semon, Sarah; Tillberg-Webb, Heather

2008-01-01

This article addresses how evaluation criteria improve educational Web-information system design, and the tangible and intangible benefits of using evaluation criteria, when implemented in an educational Web-information system design. The evaluation criteria were developed by the authors through a content validation study applicable to…

Situated Research Design and Methodological Choices in Formative Program Evaluation

ERIC Educational Resources Information Center

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Comprehensive Framework for Evaluating e-Learning Systems: Using BSC Framework

ERIC Educational Resources Information Center

Momeni, Mansor; Jamporazmey, Mona; Mehrafrouz, Mohsen; Bahadori, Fatemeh

2013-01-01

The development of information and communication technology (ICT) is changing the way in which people work, communicate and learn. Recently developing and implementing e-learning solutions have increased dramatically. According to heavily investing in this area, it is essential to evaluate its different aspects and understand measures, which…

Women in Technical Education. Annual Report 1990-91.

ERIC Educational Resources Information Center

Texas State Technical Coll., Waco.

First-year activities of Women in Technical Education, a project to develop a model for women in that field, were evaluated. A formative evaluation showed that intense development and implementation activity enabled achievement of first-year goals and objectives during the 1990-91 year. Procedures to accomplish objectives were effective.…

Comprehensive Evaluation of the 1996 Interdisciplinary Teamed Instruction Summer Institute.

ERIC Educational Resources Information Center

Meehan, Merrill L.; Cowley, Kimberly S.

The Interdisciplinary Teamed Instruction (ITI) Project was a 2-year project aimed at determining the effects of ITI on teaching and learning and at validating the effectiveness of a professional development model to facilitate development, implementation, and evaluation of ITI. Through summer institutes and onsite workshops, project staff provided…

Evaluation of Participatory Research in Developing Community Leadership Skills.

ERIC Educational Resources Information Center

Karim, Wazir-Jahan B.

1982-01-01

This paper attempts to evaluate and explain the dynamic processes of decision-making and leadership development through participatory research, using the Malaysian experience as a case study. The focus is on the structural and situational constraints in the Malaysian rural society, the formal political machinery and the implementation of…

The Development and Validation of the Inquiry Science Observation Coding Sheet

ERIC Educational Resources Information Center

Brandon, P. R.; Taum, A. K. H.; Young, D. B.; Pottenger, F. M., III

2008-01-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this…

Evaluating the implementation and active living impacts of a state government planning policy designed to create walkable neighborhoods in Perth, Western Australia.

PubMed

Hooper, Paula; Giles-Corti, Billie; Knuiman, Matthew

2014-01-01

Evaluate the implementation of a government planning policy (Liveable Neighbourhoods Guidelines) and its impacts on residents' walking behaviors. Cross-sectional study of participants from the RESIDential Environments project (RESIDE). Nineteen "liveable" and 17 "conventionally designed" housing developments across Perth, Western Australia. Five hundred ninety-four participants from RESIDE who resided in 36 housing developments. Developed in geographic information systems to assess the on-ground implementation of 43 policy requirements. Policy compliance was defined as the degree to which construction of the developments adhered to the standards outlined. Walking behaviors were measured using the Neighborhood Physical Activity Questionnaire. K-means cluster analyses identified groups of homogeneous developments with respect to policy implementation. Logistic regression with generalized estimating equations estimated the odds ratios (ORs) and 95% confidence intervals (95% CIs) for the likelihood of undertaking any and ≥ 60 minutes of transport and recreational walking associated with (1) policy compliance and (2) different clusters of developments. There were few significant differences in on-ground outcomes between the two development types. Despite incomplete implementation, the odds of walking for transport increased with overall levels of policy compliance (OR = 1.53, 95% CI 1.13-2.08) and compliance with the community design (OR = 1.3, 95% CI 1.13-1.42), movement network (OR = 2.49, 95% CI 1.38-4.50), and lot layout elements (OR = 1.26, 95% CI 1.06-1.50). Consistent with the aims of the policy, residents in walkable (i.e., liveable) neighborhoods may be more physically active.

Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol.

PubMed

McHugh, S; Tracey, M L; Riordan, F; O'Neill, K; Mays, N; Kearney, P M

2016-07-28

Over the last three decades in response to the growing burden of diabetes, countries worldwide have developed national and regional multifaceted programmes to improve the monitoring and management of diabetes and to enhance the coordination of care within and across settings. In Ireland in 2010, against a backdrop of limited dedicated strategic planning and engrained variation in the type and level of diabetes care, a national programme was established to standardise and improve care for people with diabetes in Ireland, known as the National Diabetes Programme (NDP). The NDP comprises a range of organisational and service delivery changes to support evidence-based practices and policies. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended. This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. In stage 1, to identify the official programme theories, documentary analysis and qualitative interviews were conducted with national stakeholders involved in the design, development and management of the programme. In stage 2, as part of a multiple case study design with one case per administrative region in the health system, qualitative interviews are being conducted with frontline staff and service users to explore their responses to, and reasoning about, the programme's resources (mechanisms). Finally, administrative data will be used to examine intermediate implementation outcomes such as service uptake, acceptability, and fidelity to models of care. This evaluation is using the principles of realist evaluation to examine the implementation of a national programme to standardise and improve services for people with diabetes in Ireland. The concurrence of implementation and evaluation has enabled us to produce formative feedback for the NDP while also supporting the refinement and revision of initial theories about how the programme is being implemented in the dynamic and unstable context of the Irish healthcare system.

Practical experience from the Office of Adolescent Health's large scale implementation of an evidence-based Teen Pregnancy Prevention Program.

PubMed

Margolis, Amy Lynn; Roper, Allison Yvonne

2014-03-01

After 3 years of experience overseeing the implementation and evaluation of evidence-based teen pregnancy prevention programs in a diversity of populations and settings across the country, the Office of Adolescent Health (OAH) has learned numerous lessons through practical application and new experiences. These lessons and experiences are applicable to those working to implement evidence-based programs on a large scale. The lessons described in this paper focus on what it means for a program to be implementation ready, the role of the program developer in replicating evidence-based programs, the importance of a planning period to ensure quality implementation, the need to define and measure fidelity, and the conditions necessary to support rigorous grantee-level evaluation. Published by Elsevier Inc.

Development, Implementation, and Evaluation of a Curriculum to Prepare Volunteer Navigators to Support Older Persons Living With Serious Illness.

PubMed

Duggleby, Wendy; Pesut, Barbara; Cottrell, Laura; Friesen, Lynnelle; Sullivan, Kelli; Warner, Grace

2018-05-01

The purpose of this article is to report the development, implementation, and evaluation of a curriculum designed to prepare volunteer navigators to support community-dwelling older persons with serious chronic illness. The role of the volunteer navigator was to facilitate independence and quality of life through building social connections, improving access to resources, and fostering engagement. A curriculum was constructed from evidence-based competencies, piloted and revised, and then implemented in 7 subsequent workshops. Workshop participants were 51 volunteers and health-care providers recruited through local hospice societies and health regions. Curriculum was evaluated through satisfaction and self-efficacy questionnaires completed at workshop conclusion. Postworkshop evaluation indicated a high degree of satisfaction with the training. One workshop cohort of 7 participants was followed for 1 year to provide longitudinal evaluation data. Participants followed longitudinally reported improved self-efficacy over 12 months and some challenges with role transition. Future improvements will include further structured learning opportunities offered by telephone postworkshop, focusing on advocacy, communication, and conflict management. Overall, volunteers were satisfied with the curriculum and reported good self-perceived efficacy in their new role as navigators.

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

The Instrument for Measuring the Implementation Situation of Traditional Chinese Medicine Guideline: Evaluation and Application

PubMed Central

Wang, Yangyang; Chen, Yaolong; Wang, Xiaoyun; Deng, Jingwen

2017-01-01

Clinical practice guidelines play an important role in reducing the variations in clinical practices and improving the quality of care. To assess the real effect, measuring its implementation situation is needed. The implementation situation can be reflected by testing the consistency between the actual clinical practice and the guideline. We constructed an instrument to measure the implementation situation of Traditional Chinese Medicine (TCM) guideline through consistency testing. The main objectives of our study were to validate the instrument and evaluate the implementation situation of menopause syndrome guideline of TCM, using the data from the consistency test of comparing the medical records with the guideline. A total of 621 cases were included for data analysis. Cronbach's Alpha coefficient is 0.73. The model fit of 7 items in four dimensions was good (SRMR = 0.04; GFI = 0.97; NFI = 0.97; TLI = 0.96; CFI = 0.98; AGFI = 0.90). This instrument is of good reliability and validity. It can help the guideline developers to measure the implementation situation, find the reasons affecting the implementation, and revise the guideline. The method of using consistency test to measure the implementation situation may provide a sample for evaluating the guideline implementation in other fields. PMID:29234379

Problem-based learning in optical engineering studies

NASA Astrophysics Data System (ADS)

Voznesenskaya, Anna

2016-09-01

Nowadays, the Problem-Based Learning (PBL) is one of the most prospective educational technologies. PBL is based on evaluation of learning outcomes of a student, both professional and personal, instead of traditional evaluation of theoretical knowledge and selective practical skills. Such an approach requires changes in the curricula development. There should be introduced projects (cases) imitating real tasks from the professional life. These cases should include a problem summary with necessary theoretic description, charts, graphs, information sources etc, task to implement and evaluation indicators and criteria. Often these cases are evaluated with the assessment-center method. To motivate students for the given task they could be divided into groups and have a contest. Whilst it looks easy to implement in social, economic or teaching fields PBL is pretty complicated in engineering studies. Examples of cases in the first-cycle optical engineering studies are shown in this paper. Procedures of the PBL implementation and evaluation are described.

Direct Lending: How To Improve Implementation.

ERIC Educational Resources Information Center

Jepsen, Keith

This evaluation study developed 29 recommendations concerning the implementation of direct loans in providing financial assistance to postsecondary school students. The investigation included examination of a current Department of Education (ED) pilot program, a video teleconference to discuss direct lending with 23 individuals in education…

Improving Culturally Appropriate Care Using a Community-Based Participatory Research Approach: Evaluation of a Multicomponent Cultural Competency Training Program, Arkansas, 2015–2016

PubMed Central

Long, Christopher R.; Rowland, Brett; Moore, Sarah; Wilmoth, Ralph; Ayers, Britni

2017-01-01

Introduction The United States continues to become more racially and ethnically diverse, and racial/ethnic minority communities encounter sociocultural barriers to quality health care, including implicit racial/ethnic bias among health care providers. In response, health care organizations are developing and implementing cultural competency curricula. Using a community-based participatory research (CBPR) approach, we developed and evaluated a cultural competency training program to improve the delivery of culturally appropriate care in Marshallese and Hispanic communities. Methods We used a mixed-methods evaluation approach based on the Kirkpatrick model of training evaluation. We collected quantitative evaluation data immediately after each training session (March 19, 2015–November 30, 2016) and qualitative data about implementation at 2 points: immediately after each session and 6 months after training. Individuals and organizational units provided qualitative data. Results We delivered 1,250 units of in-person training at 25 organizations. Participants reported high levels of changes in knowledge (91.2%), competence (86.6%), and performance (87.2%) as a result of the cultural competency training. Organizations reported making policy and environmental changes. Conclusion Initial outcomes demonstrate the value of developing and implementing cultural competency training programs using a CBPR approach. Additional research is needed to determine the effect on long-term patient outcomes. PMID:28771402

Development of a Management Algorithm for Post-operative Pain (MAPP) after total knee and total hip replacement: study rationale and design.

PubMed

Botti, Mari; Kent, Bridie; Bucknall, Tracey; Duke, Maxine; Johnstone, Megan-Jane; Considine, Julie; Redley, Bernice; Hunter, Susan; de Steiger, Richard; Holcombe, Marlene; Cohen, Emma

2014-08-28

Evidence from clinical practice and the extant literature suggests that post-operative pain assessment and treatment is often suboptimal. Poor pain management is likely to persist until pain management practices become consistent with guidelines developed from the best available scientific evidence. This work will address the priority in healthcare of improving the quality of pain management by standardising evidence-based care processes through the incorporation of an algorithm derived from best evidence into clinical practice. In this paper, the methodology for the creation and implementation of such an algorithm that will focus, in the first instance, on patients who have undergone total hip or knee replacement is described. In partnership with clinicians, and based on best available evidence, the aim of the Management Algorithm for Post-operative Pain (MAPP) project is to develop, implement, and evaluate an algorithm designed to support pain management decision-making for patients after orthopaedic surgery. The algorithm will provide guidance for the prescription and administration of multimodal analgesics in the post-operative period, and the treatment of breakthrough pain. The MAPP project is a multisite study with one coordinating hospital and two supporting (rollout) hospitals. The design of this project is a pre-implementation-post-implementation evaluation and will be conducted over three phases. The Promoting Action on Research Implementation in Health Services (PARiHS) framework will be used to guide implementation. Outcome measurements will be taken 10 weeks post-implementation of the MAPP. The primary outcomes are: proportion of patients prescribed multimodal analgesics in accordance with the MAPP; and proportion of patients with moderate to severe pain intensity at rest. These data will be compared to the pre-implementation analgesic prescribing practices and pain outcome measures. A secondary outcome, the efficacy of the MAPP, will be measured by comparing pain intensity scores of patients where the MAPP guidelines were or were not followed. The outcomes of this study have relevance for nursing and medical professionals as well as informing health service evaluation. In establishing a framework for the sustainable implementation and evaluation of a standardised approach to post-operative pain management, the findings have implications for clinicians and patients within multiple surgical contexts.

[Implementation of a Clinical Practice Guidelines for the Management of Adults With Schizophrenia in Colombia].

PubMed

Sánchez Díaz, Natalia; Duarte Osorio, Andrés; Gómez Restrepo, Carlos; Bohórquez Peñaranda, Adriana Patricia

2016-01-01

To present overall strategies and activities for the implementation process of the recommendations contained in the clinical practice guideline for the management of adults with schizophrenia (GPC_E) published by the Colombian Ministry of Health and Welfare (MSPS). Prioritize the proposed recommendations, identify barriers and solving strategies to implement the GPC_E, and develop a monitoring and evaluation system for the key recommendations. The Guideline Developer Group (GDG) included professionals with primary dedication to implementation issues that accompanied the entire process. During the GDG meetings implementation topics were identified and discussed, and later complemented by literature reviews concerning the experience of mental health guidelines implementation at national and international level. Additionally, feedback from the discussions raised during the socialization meetings, and joint meetings with the MSPS and the Institute of Technology Assessment in Health (IETS) were included. The prioritization of recommendations was made in conjunction with the GDG, following the proposed steps in the methodological guide for the development of Clinical Practice Guidelines with Economic Evaluation in the General System of Social Security in Colombian Health (GMEGPC) using the tools 13 and 14. the conclusions and final adjustments were discussed with the GPC_E leaders. The implementation chapter includes a description of the potential barriers, solution strategies, facilitators and monitoring indicators. The identified barriers were categorized in the following 3 groups: Cultural context, health system and proposed interventions. The issues related to solving strategies and facilitating education programs include community mental health, mental health training for health workers in primary care, decentralization and integration of mental health services at the primary care level, use of technologies information and communication and telemedicine. To monitor and evaluate o the implementation process, five (5) indicators were designed one (1) structure, two (2) process and two (2)outcome indicators. The GPC_E implementation within the Colombian General health System of Social Security (SGSSSC) poses multiple challenges. Potential barriers, enabling strategies and indicators for monitoring and evaluation described in this article, can provide efficient support to ensure the success of this process in the institutions that will adopt the guideline. Copyright © 2014 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Changing the world: the design and implementation of comprehensive continuous integrated systems of care for individuals with co-occurring disorders.

PubMed

Minkoff, Kenneth; Cline, Christie A

2004-12-01

This article has described the CCISC model and the process of implementation of systemic implementation of co-occurring disorder services enhancements within the context of existing resources. Four projects were described as illustrations of current implementation activities. Clearly, there is need for improved services for these individuals, and increasing recognition of the need for systemic change models that are effective and efficient. The CCISC model has been recognized by SAMHSA as a consensus best practice for system design, and initial efforts at implementation appear to be promising. The existing toolkit may permit a more formal process of data-driven evaluation of system, program, clinician, and client outcomes, to better measure the effectiveness of this approach. Some projects have begun such formal evaluation processes, but more work is needed, not only with individual projects, but also to develop opportunities for multi-system evaluation, as more projects come on line.

Implementing drought early warning systems: policy lessons and future needs

NASA Astrophysics Data System (ADS)

Iglesias, Ana; Werner, Micha; Maia, Rodrigo; Garrote, Luis; Nyabeze, Washington

2014-05-01

Drought forecasting and Warning provides the potential of reducing impacts to society due to drought events. The implementation of effective drought forecasting and warning, however, requires not only science to support reliable forecasting, but also adequate policy and societal response. Here we propose a protocol to develop drought forecasting and early warning based in the international cooperation of African and European institutions in the DEWFORA project (EC, 7th Framework Programme). The protocol includes four major phases that address the scientific knowledge and the social capacity to use the knowledge: (a) What is the science available? Evaluating how signs of impending drought can be detected and predicted, defining risk levels, and analysing of the signs of drought in an integrated vulnerability approach. (b) What are the societal capacities? In this the institutional framework that enables policy development is evaluated. The protocol gathers information on vulnerability and pending hazard in advance so that early warnings can be declared at sufficient lead time and drought mitigation planning can be implemented at an early stage. (c) How can science be translated into policy? Linking science indicators into the actions/interventions that society needs to implement, and evaluating how policy is implemented. Key limitations to planning for drought are the social capacities to implement early warning systems. Vulnerability assessment contributes to identify these limitations and therefore provides crucial information to policy development. Based on the assessment of vulnerability we suggest thresholds for management actions to respond to drought forecasts and link predictive indicators to relevant potential mitigation strategies. Vulnerability assessment is crucial to identify relief, coping and management responses that contribute to a more resilient society. (d) How can society benefit from the forecast? Evaluating how information is provided to potentially affected groups, and how mitigation strategies can be taken in response. This paper presents an outline of the protocol that was developed in the DEWFORA project, outlining the complementary roles of science, policy and societal uptake in effective drought forecasting and warning. A consensus on the need to emphasise the social component of early warning was reached when testing the DEWFORA early warning system protocol among experts from 18 countries.

Evaluating Niger's experience in strengthening supervision, improving availability of child survival drugs through cost recovery, and initiating training for Integrated Management of Childhood Illness (IMCI)

PubMed Central

Tawfik, Youssef M; Legros, Stephane; Geslin, Colette

2001-01-01

Background WHO and UNICEF have recently developed the "Integrated Management of Childhood Illness" (IMCI) as an efficient strategy to assist developing countries reduce childhood mortality. Early experience with IMCI implementation suggests that clinical training is essential but not sufficient for the success of the strategy. Attention needs to be given to strengthening health systems, such as supervision and drug supply. Results This paper presents results of evaluating an innovative approach for implementing IMCI in Niger. It starts with strengthening district level supervision and improving the availability of child survival drugs through cost recovery well before the beginning of IMCI clinical training. The evaluation documented the effectiveness of the initial IMCI clinical training and referral. Conclusions Strengthening supervision and assuring the availability of essential drugs need to precede the initiation of IMCI Clinical training. Longer term follow up is necessary to confirm the impact of the approach on IMCI preparation and implementation. PMID:11504567

The impact of clinical nurse specialists on clinical pathways in the application of evidence-based practice.

PubMed

Gurzick, Martha; Kesten, Karen S

2010-01-01

The purpose of this article was to address the call for evidence-based practice through the development of clinical pathways and to assert the role of the clinical nurse specialist (CNS) as a champion in clinical pathway implementation. In the current health care system, providing quality of care while maintaining cost-effectiveness is an ever-growing battle that institutions face. The CNS's role is central to meeting these demands. An extensive literature review has been conducted to validate the use of clinical pathways as a means of improving patient outcomes. This literature also suggests that clinical pathways must be developed, implemented, and evaluated utilizing validated methods including the use of best practice standards. Execution of clinical pathways should include a clinical expert, who has the ability to look at the system as a whole and can facilitate learning and change by employing a multitude of competencies while maintaining a sphere of influence over patient and families, nurses, and the system. The CNS plays a pivotal role in influencing effective clinical pathway development, implementation, utilization, and ongoing evaluation to ensure improved patient outcomes and reduced costs. This article expands upon the call for evidence-based practice through the utilization of clinical pathways to improve patient outcomes and reduce costs and stresses the importance of the CNS as a primary figure for ensuring proper pathway development, implementation, and ongoing evaluation. Copyright 2010 Elsevier Inc. All rights reserved.

Identification of six Listeria species by real-time PCR assay.

PubMed

Hage, E; Mpamugo, O; Ohai, C; Sapkota, S; Swift, C; Wooldridge, D; Amar, C F L

2014-06-01

The Listeria genus comprises 10 recognized species. Listeria monocytogenes causes listeriosis in humans and other animals primarily via contaminated food or animal feed. Listeria ivanovii causes listeriosis in animals and on rare occasions in humans. The identification of nonpathogenic species of Listeria in foods indicates that conditions exist that support the growth of pathogenic strains and is used to facilitate the implementation of control and prevention measures. This study shows the development and evaluation of a 5'exonuclease real-time PCR assay for the rapid identification of Listeria seeligeri, Listeria welshimeri, L. monocytogenes, L. ivanovii, Listeria grayi and Listeria innocua. The assay consists of two triplexes that were evaluated using 53 cultures of Gram-positive bacteria, including 49 Listeria spp. from human, animal, food or food-processing environments. The assay was rapid, specific and reproducible and could identify each of the six species from a mixture of strains. The developed assay proved to be a powerful means of rapidly identifying Listeria species and could be usefully implemented in busy specialist reference laboratories. The identification of species of Listeria from foods is important to monitor pathogenic strains and facilitates the implementation of control measures. This study shows the development and evaluation of a 5'exonuclease real-time PCR assay for the rapid identification of L. seeligeri, L. welshimeri, L. monocytogenes and L. ivanovii, L. grayi, L. innocua. The developed assay proved to be specific, rapid and reproducible and therefore could be implemented in busy specialist reference laboratories. © 2014 The Society for Applied Microbiology.

[Health coaching as a part of integration into the job market--evaluation of a qualification concept].

PubMed

Heinmüller, M; Liel, K; Angerer, P; Gündel, H; Geldermann, B; Gottwald, M; Kimil, A; Limm, H

2014-03-01

The aim of this study is to develop, implement and evaluate an education programme enabling the pedagogic staff of employment promotion agencies to integrate health promotion approaches und activities in vocational training programmes. The evaluation of the education programme is based on Kirkpatrick's 4 levels training evaluation model. Besides the participants' verbal end of session feedback, a standardised questionnaire was used at the end of the education programme and after 3 months practical experience. Process evaluation included the implementation level of the methods learned. From a total of 71 participants, 56 completed the first and 31 the second questionnaire (return rate 79% and 44%, respectively). The participants' mean age was 42 years, 80% were female. Only 22% of them integrated health topics systematically into their daily work. A 3-day basic training followed by case conferences during practical work was developed to transfer knowledge and practical competence in person-to-person talks and group activities (so called FIT-counselling and FIT-group). For 96% of participants, their expectations regarding the education programme were met completely or predominantly. 91% indicated a rise in motivation to work as health coach. When rating the training material, 96% judged it helpful for implementation/transfer. Many participants marked the education programme as being too short and wished more time for the topic of "mental health" and exchange of experiences. The follow-up after 3 months on-the-job training revealed that 84 and 97%, respectively, found FIT-counselling and FIT-groups helpful for their daily work. In all employment promotion agencies FIT-counselling and FIT-groups were implemented. Our results affirm the need for and prove the acceptance of education programmes enabling the pedagogic staff of job-training programmes to deliver health coaching. Periodic case conferences take into account the participants' request for more exchange of experiences, facilitate implementation and contribute to quality and sustainability. Further development of the education programme is ongoing. © Georg Thieme Verlag KG Stuttgart · New York.

Development of indicators for measuring outcomes of water safety plans

PubMed Central

Lockhart, Gabriella; Oswald, William E.; Hubbard, Brian; Medlin, Elizabeth; Gelting, Richard J.

2015-01-01

Water safety plans (WSPs) are endorsed by the World Health Organization as the most effective method of protecting a water supply. With the increase in WSPs worldwide, several valuable resources have been developed to assist practitioners in the implementation of WSPs, yet there is still a need for a practical and standardized method of evaluating WSP effectiveness. In 2012, the Centers for Disease Control and Prevention (CDC) published a conceptual framework for the evaluation of WSPs, presenting four key outcomes of the WSP process: institutional, operational, financial and policy change. In this paper, we seek to operationalize this conceptual framework by providing a set of simple and practical indicators for assessing WSP outcomes. Using CDC’s WSP framework as a foundation and incorporating various existing performance monitoring indicators for water utilities, we developed a set of approximately 25 indicators of institutional, operational, financial and policy change within the WSP context. These outcome indicators hold great potential for the continued implementation and expansion of WSPs worldwide. Having a defined framework for evaluating a WSP’s effectiveness, along with a set of measurable indicators by which to carry out that evaluation, will help implementers assess key WSP outcomes internally, as well as benchmark their progress against other WSPs in their region and globally. PMID:26361540

Real-Time Evaluation: Exploring Effects on Instructional Quality and Learning Enhancement

ERIC Educational Resources Information Center

DeSimone, Charles P.

2016-01-01

Evaluation of instruction has typically occurred during development, before implementation, and after course completion. The problem is that evaluation is typically post delivery; courses are not traditionally updated in real time with feedback from students in the classroom. However the potential to evaluate and modify instruction during delivery…

Evaluation and Management: Continuous Professional Growth. [Federal Policy Platform Series. Brief 4

ERIC Educational Resources Information Center

New Leaders, 2014

2014-01-01

Despite the recent push to design and adopt educator evaluation systems, many states and local educational agencies (LEAs) have focused primarily on teacher evaluations and lack the appropriate attention to design and implementation of school leader evaluations and aligned professional development. And, since principals are responsible for…

ATAMM enhancement and multiprocessor performance evaluation

NASA Technical Reports Server (NTRS)

Stoughton, John W.; Mielke, Roland R.; Som, Sukhamoy; Obando, Rodrigo; Malekpour, Mahyar R.; Jones, Robert L., III; Mandala, Brij Mohan V.

1991-01-01

ATAMM (Algorithm To Architecture Mapping Model) enhancement and multiprocessor performance evaluation is discussed. The following topics are included: the ATAMM model; ATAMM enhancement; ADM (Advanced Development Model) implementation of ATAMM; and ATAMM support tools.

STUDY AND INVESTIGATION OF A TECHNIQUE FOR EVALUATING SURVEILLANCE SENSOR PERFORMANCE.

DTIC Science & Technology

noncoherent optical correlator is suggested as the most feasible implementation. Conclusions supporting the feasibility of the technique are given followed by recommendations for further development of the evaluation technique.

Operational research as implementation science: definitions, challenges and research priorities.

PubMed

Monks, Thomas

2016-06-06

Operational research (OR) is the discipline of using models, either quantitative or qualitative, to aid decision-making in complex implementation problems. The methods of OR have been used in healthcare since the 1950s in diverse areas such as emergency medicine and the interface between acute and community care; hospital performance; scheduling and management of patient home visits; scheduling of patient appointments; and many other complex implementation problems of an operational or logistical nature. To date, there has been limited debate about the role that operational research should take within implementation science. I detail three such roles for OR all grounded in upfront system thinking: structuring implementation problems, prospective evaluation of improvement interventions, and strategic reconfiguration. Case studies from mental health, emergency medicine, and stroke care are used to illustrate each role. I then describe the challenges for applied OR within implementation science at the organisational, interventional, and disciplinary levels. Two key challenges include the difficulty faced in achieving a position of mutual understanding between implementation scientists and research users and a stark lack of evaluation of OR interventions. To address these challenges, I propose a research agenda to evaluate applied OR through the lens of implementation science, the liberation of OR from the specialist research and consultancy environment, and co-design of models with service users. Operational research is a mature discipline that has developed a significant volume of methodology to improve health services. OR offers implementation scientists the opportunity to do more upfront system thinking before committing resources or taking risks. OR has three roles within implementation science: structuring an implementation problem, prospective evaluation of implementation problems, and a tool for strategic reconfiguration of health services. Challenges facing OR as implementation science include limited evidence and evaluation of impact, limited service user involvement, a lack of managerial awareness, effective communication between research users and OR modellers, and availability of healthcare data. To progress the science, a focus is needed in three key areas: evaluation of OR interventions, embedding the knowledge of OR in health services, and educating OR modellers about the aims and benefits of service user involvement.

Reflections on the Implementation of a Course Website Maintained by Multiple Faculty Members: Analysis, Development, Sustainability, and Evaluation

ERIC Educational Resources Information Center

Fried, Aaron P.

2007-01-01

Sustainability is a major issue when creating Websites that students use with courses. How will content change over time, how can faculty inexperienced with Web development add to and maintain content? This article will examine an implemented sustainable Website that can be managed by everyone associated with the course. (Contains 4 tables and 1…

A Problem Based Learning Project Analyzing Rubrics Used to Evaluate Elementary STEM Immersion Programs

NASA Astrophysics Data System (ADS)

Pearson, Roxanne N.

In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

PubMed

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Development and implementation of a smartphone application to promote physical activity and reduce screen-time in adolescent boys.

PubMed

Lubans, David R; Smith, Jordan J; Skinner, Geoff; Morgan, Philip J

2014-01-01

To describe the development and implementation of a smartphone application (app) designed to promote physical activity and reduce screen-time in adolescent boys considered "at-risk" of obesity. An app was developed to support the delivery of a face-to-face school-based obesity prevention program known as the "Active Teen Leaders Avoiding Screen-time" (ATLAS) program. ATLAS was guided by self-determination theory and social cognitive theory and evaluated using a cluster randomized controlled trial with 361 boys (12.7 ± 0.5 years) in 14 secondary schools. Following the completion of the study, participants in the intervention group completed a process evaluation questionnaire and focus groups were conducted with 42 students to explore their general perceptions of the ATLAS program and their experience with the smartphone app. Barriers and challenges encountered in the development, implementation, and evaluation of the app are also described. Participation in the study was not contingent on ownership of a smartphone, but 70% of participants in the intervention group reported having access to a smartphone or tablet device. Focus group participants reported an enjoyment of the program, and felt that it had provided them with new skills, techniques, and routines for the future. However, their engagement with the smartphone app was limited, due to a variety of reasons. Barriers to the implementation and evaluation of the app included limited access to smartphone devices, technical problems with the push notifications, lack of access to usage data, and the challenges of maintaining participants' interest in using the app. Although participants reported high levels of satisfaction with the ATLAS program in general, the smartphone app was not used extensively. Additional strategies and features may be needed to enhance engagement in adolescent boys.

Evaluation of a Web-Based Professional Development Program (Project ACE) for Teachers of Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Rakap, Salih; Jones, Hazel A.; Emery, Alice Kaye

2015-01-01

This article describes the development, implementation, and second-year evaluation of Project Autism Competencies for Endorsement (ACE), a web-based professional development (PD) program that is designed to train teachers currently working in the field to meet the unique and diverse needs of children with autism spectrum disorders (ASDs). A…

Teachers’ ability in using math learning media

NASA Astrophysics Data System (ADS)

Masniladevi; Prahmana, R. C. I.; Helsa, Y.; Dalais, M.

2017-12-01

The studies aim to enhance teachers’ knowledge and skill in making math instructional media, develop math instructional media, train and assist the use of instructional media in learning math in the classroom. The method used in the activities adopted the pattern of preventive implementation, planning stage, program implementation, observation and evaluation and reflection. The research results show that the evaluation of teachers’ ability is still in average category. The result required more intensive training.

NASA software specification and evaluation system: Software verification/validation techniques

NASA Technical Reports Server (NTRS)

1977-01-01

NASA software requirement specifications were used in the development of a system for validating and verifying computer programs. The software specification and evaluation system (SSES) provides for the effective and efficient specification, implementation, and testing of computer software programs. The system as implemented will produce structured FORTRAN or ANSI FORTRAN programs, but the principles upon which SSES is designed allow it to be easily adapted to other high order languages.

Health system context and implementation of evidence-based practices-development and validation of the Context Assessment for Community Health (COACH) tool for low- and middle-income settings.

PubMed

Bergström, Anna; Skeen, Sarah; Duc, Duong M; Blandon, Elmer Zelaya; Estabrooks, Carole; Gustavsson, Petter; Hoa, Dinh Thi Phuong; Källestål, Carina; Målqvist, Mats; Nga, Nguyen Thu; Persson, Lars-Åke; Pervin, Jesmin; Peterson, Stefan; Rahman, Anisur; Selling, Katarina; Squires, Janet E; Tomlinson, Mark; Waiswa, Peter; Wallin, Lars

2015-08-15

The gap between what is known and what is practiced results in health service users not benefitting from advances in healthcare, and in unnecessary costs. A supportive context is considered a key element for successful implementation of evidence-based practices (EBP). There were no tools available for the systematic mapping of aspects of organizational context influencing the implementation of EBPs in low- and middle-income countries (LMICs). Thus, this project aimed to develop and psychometrically validate a tool for this purpose. The development of the Context Assessment for Community Health (COACH) tool was premised on the context dimension in the Promoting Action on Research Implementation in Health Services framework, and is a derivative product of the Alberta Context Tool. Its development was undertaken in Bangladesh, Vietnam, Uganda, South Africa and Nicaragua in six phases: (1) defining dimensions and draft tool development, (2) content validity amongst in-country expert panels, (3) content validity amongst international experts, (4) response process validity, (5) translation and (6) evaluation of psychometric properties amongst 690 health workers in the five countries. The tool was validated for use amongst physicians, nurse/midwives and community health workers. The six phases of development resulted in a good fit between the theoretical dimensions of the COACH tool and its psychometric properties. The tool has 49 items measuring eight aspects of context: Resources, Community engagement, Commitment to work, Informal payment, Leadership, Work culture, Monitoring services for action and Sources of knowledge. Aspects of organizational context that were identified as influencing the implementation of EBPs in high-income settings were also found to be relevant in LMICs. However, there were additional aspects of context of relevance in LMICs specifically Resources, Community engagement, Commitment to work and Informal payment. Use of the COACH tool will allow for systematic description of the local healthcare context prior implementing healthcare interventions to allow for tailoring implementation strategies or as part of the evaluation of implementing healthcare interventions and thus allow for deeper insights into the process of implementing EBPs in LMICs.

Community, intervention and provider support influences on implementation: reflections from a South African illustration of safety, peace and health promotion.

PubMed

van Niekerk, Ashley; Seedat, Mohamed; Kramer, Sherianne; Suffla, Shahnaaz; Bulbulia, Samed; Ismail, Ghouwa

2014-01-01

The development, implementation and evaluation of community interventions are important for reducing child violence and injuries in low- to middle-income contexts, with successful implementation critical to effective intervention outcomes. The assessment of implementation processes is required to identify the factors that influence effective implementation. This article draws on a child safety, peace and health initiative to examine key factors that enabled or hindered its implementation, in a context characterised by limited resources. A case study approach was employed. The research team was made up of six researchers and intervention coordinators, who led the development and implementation of the Ukuphepha Child Study in South Africa, and who are also the authors of this article. The study used author observations, reflections and discussions of the factors perceived to influence the implementation of the intervention. The authors engaged in an in-depth and iterative dialogic process aimed at abstracting the experiences of the intervention, with a recursive cycle of reflection and dialogue. Data were analysed utilising inductive content analysis, and categorised using classification frameworks for understanding implementation. The study highlights key factors that enabled or hindered implementation. These included the community context and concomitant community engagement processes; intervention compatibility and adaptability issues; community service provider perceptions of intervention relevance and expectations; and the intervention support system, characterised by training and mentorship support. This evaluation illustrated the complexity of intervention implementation. The study approach sought to support intervention fidelity by fostering and maintaining community endorsement and support, a prerequisite for the unfolding implementation of the intervention.

Community, intervention and provider support influences on implementation: reflections from a South African illustration of safety, peace and health promotion

PubMed Central

2014-01-01

Background The development, implementation and evaluation of community interventions are important for reducing child violence and injuries in low- to middle-income contexts, with successful implementation critical to effective intervention outcomes. The assessment of implementation processes is required to identify the factors that influence effective implementation. This article draws on a child safety, peace and health initiative to examine key factors that enabled or hindered its implementation, in a context characterised by limited resources. Methods A case study approach was employed. The research team was made up of six researchers and intervention coordinators, who led the development and implementation of the Ukuphepha Child Study in South Africa, and who are also the authors of this article. The study used author observations, reflections and discussions of the factors perceived to influence the implementation of the intervention. The authors engaged in an in-depth and iterative dialogic process aimed at abstracting the experiences of the intervention, with a recursive cycle of reflection and dialogue. Data were analysed utilising inductive content analysis, and categorised using classification frameworks for understanding implementation. Results The study highlights key factors that enabled or hindered implementation. These included the community context and concomitant community engagement processes; intervention compatibility and adaptability issues; community service provider perceptions of intervention relevance and expectations; and the intervention support system, characterised by training and mentorship support. Conclusions This evaluation illustrated the complexity of intervention implementation. The study approach sought to support intervention fidelity by fostering and maintaining community endorsement and support, a prerequisite for the unfolding implementation of the intervention. PMID:25081088

24 CFR 598.420 - Periodic progress determinations.

Code of Federal Regulations, 2011 CFR

2011-04-01

... Development (Continued) OFFICE OF ASSISTANT SECRETARY FOR COMMUNITY PLANNING AND DEVELOPMENT, DEPARTMENT OF... evaluate the progress of implementation of the strategic plan in each designated Empowerment Zone on the...

Developing Effective TMDLs: An Evaluation of the TMDL Process

EPA Pesticide Factsheets

The report explores whether various characteristics of data availability, funding resources, guidance materials, stakeholder involvement, scale of TMDLs and implementation planning positively influence development of effective TMDLs.

Implementing Basic Education: An African Experience.

ERIC Educational Resources Information Center

Banya, Kingsley; Elu, Juliet

1999-01-01

Analyses some of the difficulties involved in implementing the recently approved Basic Education Program for primary and secondary education in Sierra Leone. Discusses issues such as funding, training, and retention of teachers, curriculum reform, language development, equipment and supplies, and evaluation. Concludes that political stability is…

75 FR 45124 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-02

... to obtain a copy of the information collection plans, call the SAMHSA Reports Clearance Officer on... clinicians and supervisors, implementation calls and monthly progress reports, and topical workgroups that... evaluate the implementation, expansion, and sustainability of adolescent substance use services developed...

Problems and Prospects in Foreign Language Computing.

ERIC Educational Resources Information Center

Pusack, James P.

The problems and prospects of the field of foreign language computing are profiled through a survey of typical implementation, development, and research projects that language teachers may undertake. Basic concepts in instructional design, hardware, and software are first clarified. Implementation projects involving courseware evaluation, textbook…

Implementation and evaluation of PM2.5 source contribution analysis in a photochemical model

EPA Science Inventory

Source culpability assessments are useful for developing effective emissions control programs. The Integrated Source Apportionment Method (ISAM) has been implemented in the Community Multiscale Air Quality (CMAQ) model to track contributions from source groups and regions to ambi...

Systems antecedents for dissemination and implementation: a review and analysis of measures.

PubMed

Emmons, Karen M; Weiner, Bryan; Fernandez, Maria Eulalia; Tu, Shin-Ping

2012-02-01

There is a growing emphasis on the role of organizations as settings for dissemination and implementation. Only recently has the field begun to consider features of organizations that affect dissemination and implementation of evidence-based interventions. This manuscript identifies and evaluates available measures for five key organizational-level constructs: (a) leadership, (b) vision, (c) managerial relations, (d) climate, and (e) absorptive capacity. Overall the picture was the same across the five constructs--no measure was used in more than one study, many studies did not report the psychometric properties of the measures, some assessments were based on a single response per unit, and the level of the instrument and analysis did not always match. One must seriously consider the development and evaluation of a robust set of measures that will serve as the basis of building the field, allow for comparisons across organizational types and intervention topics, and allow a robust area of dissemination and implementation research to develop.

VHA mental health information system: applying health information technology to monitor and facilitate implementation of VHA Uniform Mental Health Services Handbook requirements.

PubMed

Trafton, Jodie A; Greenberg, Greg; Harris, Alex H S; Tavakoli, Sara; Kearney, Lisa; McCarthy, John; Blow, Fredric; Hoff, Rani; Schohn, Mary

2013-03-01

To describe the design and deployment of health information technology to support implementation of mental health services policy requirements in the Veterans Health Administration (VHA). Using administrative and self-report survey data, we developed and fielded metrics regarding implementation of the requirements delineated in the VHA Uniform Mental Health Services Handbook. Finalized metrics were incorporated into 2 external facilitation-based quality improvement programs led by the VHA Mental Health Operations. To support these programs, tailored site-specific reports were generated. Metric development required close collaboration between program evaluators, policy makers and clinical leadership, and consideration of policy language and intent. Electronic reports supporting different purposes required distinct formatting and presentation features, despite their having similar general goals and using the same metrics. Health information technology can facilitate mental health policy implementation but must be integrated into a process of consensus building and close collaboration with policy makers, evaluators, and practitioners.

Systems Antecedents for Dissemination and Implementation: A Review and Analysis of Measures

PubMed Central

Emmons, Karen M.; Weiner, Bryan; Fernandez, Maria; Tu, Shin-Ping

2011-01-01

There is a growing emphasis on the role of organizations as settings for dissemination and implementation. Only recently has the field begun to consider features of organizations that impact on dissemination and implementation of evidence-based interventions. This manuscript identifies and evaluates available measures for 5 key organizational-level constructs: (1) leadership; (2) vision; (3) managerial relations; (4) climate; and (5) absorptive capacity. Overall the picture was the same across the five constructs—no measure was used in more than one study, many studies did not report the psychometric properties of the measures, some assessments were based on a single response per unit, and the level of the instrument and analysis did not always match. We must seriously consider the development and evaluation of a robust set of measures that will serve as the basis of building the field, allow for comparisons across organizational types and intervention topics, and allow a robust area of dissemination and implementation research to develop. PMID:21724933

Developing, implementing, and evaluating a handbook for parents of pediatric hematology/oncology patients.

PubMed

Heiney, S P; Wells, L M

1995-07-01

This article details the development of a parent handbook for pediatric hematology and oncology patients. The planning and content development are discussed. Adult learning principles were incorporated throughout the handbook. Use of the handbook in a pediatric cancer center is described. Both subjective and objective methods were used to evaluate the handbook. Results from the evaluation verify the value of the handbook to parents and give direction for future revisions of the handbook.

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

PubMed

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Process evaluation of discharge planning implementation in healthcare using normalization process theory.

PubMed

Nordmark, Sofi; Zingmark, Karin; Lindberg, Inger

2016-04-27

Discharge planning is a care process that aims to secure the transfer of care for the patient at transition from home to the hospital and back home. Information exchange and collaboration between care providers are essential, but deficits are common. A wide range of initiatives to improve the discharge planning process have been developed and implemented for the past three decades. However, there are still high rates of reported medical errors and adverse events related to failures in the discharge planning. Using theoretical frameworks such as Normalization Process Theory (NPT) can support evaluations of complex interventions and processes in healthcare. The aim of this study was to explore the embedding and integration of the DPP from the perspective of registered nurses, district nurses and homecare organizers. The study design was explorative, using the NPT as a framework to explore the embedding and integration of the DPP. Data consisted of written documentation from; workshops with staff, registered adverse events and system failures, web based survey and individual interviews with staff. Using the NPT as a framework to explore the embedding and integration of discharge planning after 10 years in use showed that the staff had reached a consensus of opinion of what the process was (coherence) and how they evaluated the process (reflexive monitoring). However, they had not reached a consensus of opinion of who performed the process (cognitive participation) and how it was performed (collective action). This could be interpreted as the process had not become normalized in daily practice. The result shows necessity to observe the implementation of old practices to better understand the needs of new ones before developing and implementing new practices or supportive tools within healthcare to reach the aim of development and to accomplish sustainable implementation. The NPT offers a generalizable framework for analysis, which can explain and shape the implementation process of old practices, before further development of new practices or supportive tools.

Development, Testing, and Implementation of a Training Curriculum for Nonphysician Health Workers to Reduce Cardiovascular Disease.

PubMed

Khan, Maheer; Lamelas, Pablo; Musa, Hadi; Paty, Jared; McCready, Tara; Nieuwlaat, Robby; Ng, Eleonor; Lopez-Jaramillo, Patricio; Lopez-Lopez, Jose; Yusoff, Khalid; Majid, Fadhlina A; Ng, Kien Keat; Garis, Len; Onuma, Oyere; Yusuf, Salim; Schwalm, Jon-David

2018-01-10

Cardiovascular disease (CVD) is the leading cause of death worldwide. The need to address CVD is greatest in low- and middle-income countries where there is a shortage of trained health workers in CVD detection, prevention, and control. Based on the growing evidence that many elements of chronic disease management can be shifted to nonphysician health care workers (NPHW), the HOPE-4 (Heart Outcomes Prevention and Evaluation Program) aimed to develop, test, and implement a training curriculum on CVD prevention and control in Colombia, Malaysia, and low-resource settings in Canada. Curriculum development followed an iterative and phased approach where evidence-based guidelines, revised blood pressure treatment algorithms, and culturally relevant risk factor counseling were incorporated. Through a pilot-training process with high school students in Canada, the curriculum was further refined. Implementation of the curriculum in Colombia, Malaysia, and Canada occurred through partner organizations as the HOPE-4 team coordinated the program from Hamilton, Ontario, Canada. In addition to content on the burden of disease, cardiovascular system pathophysiology, and CVD risk factors, the curriculum also included evaluations such as module tests, in-class exercises, and observed structured clinical examinations, which were administered by the local partner organizations. These evaluations served as indicators of adequate uptake of curriculum content as well as readiness to work as an NPHW in the field. Overall, 51 NPHW successfully completed the training curriculum with an average score of 93.19% on module tests and 84.76% on the observed structured clinical examinations. Since implementation, the curriculum has also been adapted to the World Health Organization's HEARTS Technical Package, which was launched in 2016 to improve management of CVD in primary health care. The robust curriculum development, testing, and implementation process described affirm that NPHW in diverse settings can be trained in implementing measures for CVD prevention and control. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

PubMed Central

Berendonk, Christoph; Schirlo, Christian; Balestra, Gianmarco; Bonvin, Raphael; Feller, Sabine; Huber, Philippe; Jünger, Ernst; Monti, Matteo; Schnabel, Kai; Beyeler, Christine; Guttormsen, Sissel; Huwendiek, Sören

2015-01-01

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking. PMID:26483853

Criteria for implementing interventions to reduce health inequalities in primary care settings in European regions.

PubMed

Daponte, Antonio; Bernal, Mariola; Bolívar, Julia; Mateo, Inmaculada; Salmi, Louis-Rachid; Barsanti, Sara; Berghmans, Luc; Piznal, Ewelina; Bourgueil, Yann; Marquez, Soledad; González, Ingrid; Carriazo, Ana; Maros-Szabo, Zsuzsanna; Ménival, Solange

2014-12-01

The current social and political context is generating socio-economic inequalities between and within countries, causing and widening health inequalities. The development and implementation of interventions in primary health care (PHC) settings seem unavoidable. Attempts have been made to draw up adequate criteria to guide and evaluate interventions but none for the specific case of PHC. This methodological article aims to contribute to this field by developing and testing a set of criteria for guiding and evaluating real-life interventions to reduce health inequalities in PHC settings in European regions. A literature review, nominal group technique, survey and evaluation template were used to design and test a set of criteria. The questionnaire was answered by professionals in charge of 46 interventions carried out in 12 European countries, and collected detailed information about each intervention. Third-party experts scored the interventions using the set of evaluation criteria proposed. Nine criteria to guide and evaluate interventions were proposed: relevance, appropriateness, applicability, innovation, quality assurance, adequacy of resources, effectiveness in the process, effectiveness in results and mainstreaming. A working definition was drawn up for each one. These criteria were then used to evaluate the interventions identified. The set of criteria drawn up to guide the design, implementation and evaluation of interventions to reduce health inequalities in PHC will be a useful instrument to be applied to interventions under development for culturally, politically and socio-economically diverse PHC contexts throughout Europe. © The Author 2014. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

Peer Tutoring: A Guide to Program Design. Research and Development Series No. 260.

ERIC Educational Resources Information Center

Ashley, William L.; And Others

This publication presents guidelines for planning, implementing, and evaluating a peer tutoring program within a vocational setting. Chapter 1 discusses benefits of peer tutoring and presents a compilation of guidelines, suggestions, and examples for planning, developing, and evaluating a peer tutoring program. Tasks in each area--program…

The Multiple Challenges of Multimedia: Development, Implementation, and Evaluation.

ERIC Educational Resources Information Center

Kassen, Margaret Ann

1998-01-01

This article presents an overview of an ongoing initiative to develop, integrate, and evaluate multimedia lessons to enhance listening comprehension in Spanish language classes at the Catholic University of America (District of Columbia). Focusing on the process involved, the two phases of the project that have been completed are examined,…

Standards & Criteria for the Development and Evaluation of a Comprehensive Employee Assistance Program.

ERIC Educational Resources Information Center

Health Resources and Services Administration, Rockville, MD. Bureau of Health Care Delivery and Assistance.

This document was designed for use by persons or agencies interested in both establishing and evaluating employee assistance programs (EAP) for federal employees. It contains essential elements, standards, and assessment criteria which have been developed to assist in the planning and implementation of services, and to provide a framework for…

Evaluating Interactive Policy Making on Biotechnology: The Case of the Dutch Ministry of Health, Welfare and Sport

ERIC Educational Resources Information Center

Broerse, Jacqueline E. W.; de Cock Buning, Tjard; Roelofsen, Anneloes; Bunders, Joske F. G.

2009-01-01

Public engagement is increasingly advocated and applied in the development and implementation of technological innovations. However, initiatives so far are rarely considered effective. There is a need for more methodological rigor and insight into conducive conditions. The authors developed an evaluative framework and assessed accordingly the…

The Evaluation of Vocational Programming in Secondary School Settings: A Suggested Protocol

ERIC Educational Resources Information Center

George, Jennifer C.; Seruya, Francine M.

2018-01-01

The primary purpose of this project was to determine if a therapist-created protocol to develop a prevocational program provided sufficient information for a practitioner to implement a vocational program within another high school setting. The developed protocol was evaluated on feasibility and efficacy for replication within another setting by…

An Evaluation Model for Competency Based Teacher Preparatory Programs.

ERIC Educational Resources Information Center

Denton, Jon J.

This discussion describes an evaluation model designed to complement a curriculum development project, the primary goal of which is to structure a performance based program for preservice teachers. Data collected from the implementation of this four-phase model can be used to make decisions for developing and changing performance objectives and…

Development of a multilayer interference simulation program for MSS systems

NASA Technical Reports Server (NTRS)

Izadian, Jamal S.

1993-01-01

This paper discusses the development of a multilayer interference analysis and simulation program which is used to evaluate interference between non-geostationary and geostationary satellites. In addition to evaluating interference, this program can be used in the development of sharing criteria and coordination among various Mobile Satellite Services (MSS) systems. A C++/Windows implementation of this program, called Globalstar Interference Simulation Program (GISP), has been developed.

Overview of CEV Thermal Protection System Seal Development

NASA Technical Reports Server (NTRS)

DeMange, Jeff; Taylor, Shawn; Dunlap, Patrick; Steinetz, Bruce; Delgado, Irebert; Finkbeiner, Josh; Mayer, John

2009-01-01

NASA GRC supporting design, development, and implementation of numerous seal systems for the Orion CEV: a) HS-to-BS interface. b) Compression pad. HS-to-BS Interface Seal System: a) design has evolved as a result of changes with the CEV TPS. b) Seal system is currently under development/evaluation. Coupon level tests, Arc jet tests, and Validation test development. Compression Pad: a) Finalizing design options. b) Evaluating material candidates.

Number and type of guideline implementation tools varies by guideline, clinical condition, country of origin, and type of developer organization: content analysis of guidelines.

PubMed

Liang, Laurel; Abi Safi, Jhoni; Gagliardi, Anna R

2017-11-15

Guideline implementation tools (GI tools) can improve clinician behavior and patient outcomes. Analyses of guidelines published before 2010 found that many did not offer GI tools. Since 2010 standards, frameworks and instructions for GI tools have emerged. This study analyzed the number and types of GI tools offered by guidelines published in 2010 or later. Content analysis and a published GI tool framework were used to categorize GI tools by condition, country, and type of organization. English-language guidelines on arthritis, asthma, colorectal cancer, depression, diabetes, heart failure, and stroke management were identified in the National Guideline Clearinghouse. Screening and data extraction were in triplicate. Findings were reported with summary statistics. Eighty-five (67.5%) of 126 eligible guidelines published between 2010 and 2017 offered one or more of a total of 464 GI tools. The mean number of GI tools per guideline was 5.5 (median 4.0, range 1 to 28) and increased over time. The majority of GI tools were for clinicians (239, 51.5%), few were for patients (113, 24.4%), and fewer still were to support implementation (66, 14.3%) or evaluation (46, 9.9%). Most clinician GI tools were guideline summaries (116, 48.5%), and most patient GI tools were condition-specific information (92, 81.4%). Government agencies (patient 23.5%, clinician 28.9%, implementation 24.1%, evaluation 23.5%) and developers in the UK (patient 18.5%, clinician 25.2%, implementation 27.2%, evaluation 29.1%) were more likely to generate guidelines that offered all four types of GI tools. Professional societies were more likely to generate guidelines that included clinician GI tools. Many guidelines do not include any GI tools, or a variety of GI tools for different stakeholders that may be more likely to prompt guideline uptake (point-of-care forms or checklists for clinicians, decision-making or self-management tools for patients, implementation and evaluation tools for managers and policy-makers). While this may vary by country and type of organization, and suggests that developers could improve the range of GI tools they develop, further research is needed to identify determinants and potential solutions. Research is also needed to examine the cost-effectiveness of various types of GI tools so that developers know where to direct their efforts and scarce resources.

Classroom modules for nanotechnology undergraduate education: development, implementation and evaluation

NASA Astrophysics Data System (ADS)

Shabani, R.; Massi, L.; Zhai, L.; Seal, S.; Cho, H. J.

2011-05-01

In order to address the challenges and restrictions given by a traditional classroom lecture environment, the top-down and bottom-up nanotechnology teaching modules were developed, implemented and evaluated. Then based on the hypothesis that instructors could further develop students' interest in this emerging area through the introduction of the teaching modules and a career module, an early stage evaluation of the effectiveness of the modules in selected engineering courses was conducted. The data suggested that adoption of modular lectures in regular engineering courses influenced attitude towards nanotechnology - overall, the teaching modules did a better job of piquing student's interest (albeit in the short term) in the subject, but there were also positive gains in interest in nanotechnology as a career. There was some evidence that the hands-on demonstration teaching modules with visual elements and the career module were more effective than traditional lecture presentations in the classroom.

Scale development of safety management system evaluation for the airline industry.

PubMed

Chen, Ching-Fu; Chen, Shu-Chuan

2012-07-01

The airline industry relies on the implementation of Safety Management System (SMS) to integrate safety policies and augment safety performance at both organizational and individual levels. Although there are various degrees of SMS implementation in practice, a comprehensive scale measuring the essential dimensions of SMS is still lacking. This paper thus aims to develop an SMS measurement scale from the perspective of aviation experts and airline managers to evaluate the performance of company's safety management system, by adopting Schwab's (1980) three-stage scale development procedure. The results reveal a five-factor structure consisting of 23 items. The five factors include documentation and commands, safety promotion and training, executive management commitment, emergency preparedness and response plan and safety management policy. The implications of this SMS evaluation scale for practitioners and future research are discussed. Copyright © 2012 Elsevier Ltd. All rights reserved.

A management system for evaluating trailer.

DOT National Transportation Integrated Search

1979-01-01

In 1974, at the request of the Department of State Police, the Research Council developed a system for management evaluation of inspection approval receipts issued under the state's periodic motor vehicle inspection program (PMVI). Implementation of ...

Pervious Pavement System Evaluation

EPA Science Inventory

Porous pavement is a low impact development stormwater control. The Urban Watershed Management Branch is evaluating interlocking concrete pavers as a popular implementation. The pavers themselves are impermeable, but the spaces between the pavers are backfilled with washed, grade...

OA38 From service delivery to community enablement: a public health approach to palliative care.

PubMed

McLoughlin, Kathleen; Rhatigan, Jim; Richardson, Marie; Lloyd, Rebecca

2015-04-01

: Milford Care Centre is the only hospice in Ireland to make a strategic decision to embrace a public health approach to palliative care, through the development, implementation and evaluation of the Compassionate Communities Project. This presentation seeks to examine why Milford made the decision to move toward a community enablement model, describes the development and implementation of the Compassionate Communities Project to date, presents key findings from recent evaluations and highlights our plans for the future. The presentation uses a reflective, story telling approach to meet it's aims, coupled with data and statistics gathered from the evaluations, and includes a new short film 'Tell Me' developed by recent Computer Science graduates for the Project to use to engage with communities during Café Conversations. The presentation will highlight the relevance of Health Promoting Palliative Care theory to the development of a three-tier model of programme activity, examine the challenges in implementing such an approach and will discuss the impact of upstream intervention to downstream service provision using case studies. © 2015, Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

[Team Development in Medical Rehabilitation: Concept and Evaluation of a Team Intervention].

PubMed

Körner, M; Luzay, L; Becker, S; Rundel, M; Müller, C; Zimmermann, L

2016-04-01

Interprofessional collaboration is a main precondition of successful treatment in rehabilitation. In order to improve interprofessional collaboration, a clinic-specific, goal- and solution-oriented and systemic team development approach was designed. The aim of the study is the evaluation of this approach. A multi-centre cluster-randomized controlled study with staff questionnaires. The team development could be implemented successfully in 4 of 5 clinics and led to significant improvements in team organisation, willingness to accept responsibility and knowledge integration. The effects are small and are caused by the opposed development of intervention and control group. The team development approach can be recommended for rehabilitation practice. A train-the-trainer approach will be developed and further studies are planned in order to disseminate the approach and to investigate the conditions of implementation. © Georg Thieme Verlag KG Stuttgart · New York.

Development of a Learning-Oriented Computer Assisted Instruction Designed to Improve Skills in the Clinical Assessment of the Nutritional Status: A Pilot Evaluation

PubMed Central

García de Diego, Laura; Cuervo, Marta; Martínez, J. Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient’s nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient’s needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum. PMID:25978456

Development of a learning-oriented computer assisted instruction designed to improve skills in the clinical assessment of the nutritional status: a pilot evaluation.

PubMed

García de Diego, Laura; Cuervo, Marta; Martínez, J Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient's nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient's needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum.

Implementation and Evaluation of Linked Parenting Models in a Large Urban Child Welfare System

PubMed Central

Feldman, Sara Wolf; Wulczyn, Fred; Saldana, Lisa; Forgatch, Marion

2015-01-01

During the past decade, there have been increased efforts to implement evidence-based practices into child welfare systems to improve outcomes for children in foster care and their families. In this paper, the implementation and evaluation of a policy-driven large system-initiated reform is described. Over 250 caseworkers and supervisors were trained and supported to implement two evidence-based parent focused interventions in five private agencies serving over 2,000 children and families. At the request of child welfare system leaders, a third intervention was developed and implemented to train the social work workforce to use evidence-based principles in everyday interactions with caregivers (including foster, relative, adoptive, and biological parents). In this paper, we describe the policy context and the targeted outcomes of the reform. We discuss the theory of the interventions and the logistics of how they were linked to create consistency and synergy. Training and ongoing consultation strategies used are described as are some of the barriers and opportunities that arose during the implementation. The strategy for creating a path to sustainability is also discussed. The reform effort was evaluated using both qualitative and quantitative methods; the evaluation design, research questions and preliminary results are provided. PMID:26602831

Implementation and evaluation of linked parenting models in a large urban child welfare system.

PubMed

Chamberlain, Patricia; Feldman, Sara Wolf; Wulczyn, Fred; Saldana, Lisa; Forgatch, Marion

2016-03-01

During the past decade, there have been increased efforts to implement evidence-based practices into child welfare systems to improve outcomes for children in foster care and their families. In this paper, the implementation and evaluation of a policy-driven large system-initiated reform is described. Over 250 caseworkers and supervisors were trained and supported to implement two evidence-based parent focused interventions in five private agencies serving over 2,000 children and families. At the request of child welfare system leaders, a third intervention was developed and implemented to train the social work workforce to use evidence-based principles in everyday interactions with caregivers (including foster, relative, adoptive, and biological parents). In this paper, we describe the policy context and the targeted outcomes of the reform. We discuss the theory of the interventions and the logistics of how they were linked to create consistency and synergy. Training and ongoing consultation strategies used are described as are some of the barriers and opportunities that arose during the implementation. The strategy for creating a path to sustainability is also discussed. The reform effort was evaluated using both qualitative and quantitative methods; the evaluation design, research questions and preliminary results are provided. Copyright © 2015 Elsevier Ltd. All rights reserved.

Improving handoff communication from hospital to home: the development, implementation and evaluation of a personalized patient discharge letter.

PubMed

Buurman, Bianca M; Verhaegh, Kim J; Smeulers, Marian; Vermeulen, Hester; Geerlings, Suzanne E; Smorenburg, Susanne; de Rooij, Sophia E

2016-06-01

To develop, implement and evaluate a personalized patient discharge letter (PPDL) to improve the quality of handoff communication from hospital to home. From the end of 2006-09 we conducted a quality improvement project; consisting of a before-after evaluation design, and a process evaluation. Four general internal medicine wards, in a 1024-bed teaching hospital in Amsterdam, the Netherlands. All consecutive patients of 18 years and older, admitted for at least 48 h. A PPDL, a plain language handoff communication tool provided to the patient at hospital discharge. Verbal and written information provision at discharge, feasibility of integrating the PPDL into daily practice, pass rates of PPDLs provided at discharge. A total of 141 patients participated in the before-after evaluation study. The results from the first phase of quality improvement showed that providing patient with a PPDL increased the number of patients receiving verbal and written information at discharge. Patient satisfaction with the PPDL was 7.3. The level of implementation was low (30%). In the second phase, the level of implementation improved because of incorporating the PPDL into the electronic patient record (EPR) and professional education. An average of 57% of the discharged patients received the PPDL upon discharge. The number of discharge conversations also increased. Patients and professionals rated the PPDL positively. Key success factors for implementation were: education of interns, residents and staff, standardization of the content of the PPDL, integrating the PPDL into the electronic medical record and hospital-wide policy. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Strategies for implementing Health-Promoting Schools in a province in China.

PubMed

Aldinger, Carmen; Zhang, Xin-Wei; Liu, Li-Qun; Guo, Jun-Xiang; Yu Sen Hai; Jones, Jack

2008-01-01

After successful pilot projects in 10 schools (four schools with tobacco control and six schools with nutrition interventions, plus 10 control schools), Health and Education officials in Zhejiang Province, China, decided to scale up Health-Promoting Schools (HPS) systematically over the entire province, starting with an initial cohort of 51 additional schools, reaching from primary to vocational schools. Interviews with school personnel during the first phase of scaling up illuminated the key pre-implementation, implementation, and monitoring and evaluation activities. Pre-implementation activities included choosing an entry point, setting up a special HPS committee, and establishing a work plan. Implementation activities included conducting mobilization meetings, prioritizing health, popularizing the HPS concept, ensuring community cooperation and participation, acting as role models, offering training, and using new teaching and learning methods. Monitoring and evaluation activities included process, baseline, and final evaluations and changing standards of evaluation to a more holistic evaluation that schools go through to become Health-Promoting Schools. Schools also reported that they faced - and overcame - a number of challenges including understanding and integrating the HPS concept and lack of professional development and support. Results revealed that schools transitioned from a passive model of education to interactive pedagogy put priority on health and viewed it as a co-responsibility, reshaped assessment to a more holistic approach and called for more training and technical support. Participants mentioned that they gained knowledge and skills and developed a deeper understanding about health. Health impact was also demonstrated, for instance in reduced injuries and reduced smoking, and educational impact was demonstrated, for instance in improved relationships of children to parents and teachers, improved social qualities, and improved teacher satisfaction.

Use of the Theoretical Domains Framework to evaluate factors driving successful implementation of the Accelerated Chest pain Risk Evaluation (ACRE) project.

PubMed

Skoien, Wade; Page, Katie; Parsonage, William; Ashover, Sarah; Milburn, Tanya; Cullen, Louise

2016-10-12

The translation of healthcare research into practice is typically challenging and limited in effectiveness. The Theoretical Domains Framework (TDF) identifies 12 domains of behaviour determinants which can be used to understand the principles of behavioural change, a key factor influencing implementation. The Accelerated Chest pain Risk Evaluation (ACRE) project has successfully translated research into practice, by implementing an intervention to improve the assessment of low to intermediate risk patients presenting to emergency departments (EDs) with chest pain. The aims of this paper are to describe use of the TDF to determine which factors successfully influenced implementation and to describe use of the TDF as a tool to evaluate implementation efforts and which domains are most relevant to successful implementation. A 30-item questionnaire targeting clinicians was developed using the TDF as a guide. Questions encompassed ten of the domains of the TDF: Knowledge; Skills; Social/professional role and identity; Beliefs about capabilities; Optimism; Beliefs about consequences; Intentions; Memory, attention and decision processes; Environmental context and resources; and Social influences. Sixty-three of 176 stakeholders (36 %) responded to the questionnaire. Responses for all scales showed that respondents were highly favourable to all aspects of the implementation. Scales with the highest mean responses were Intentions, Knowledge, and Optimism, suggesting that initial education and awareness strategies around the ACRE project were effective. Scales with the lowest mean responses were Environmental context and resources, and Social influences, perhaps highlighting that implementation planning could have benefitted from further consideration of the factors underlying these scales. The ACRE project was successful, and therefore, a perfect case study for understanding factors which drive implementation success. The overwhelmingly positive response suggests that it was a successful programme and likely that each of these domains was important for the implementation. However, a lack of variance in the responses hampered us from concluding which factors were most influential in driving the success of the implementation. The TDF offers a useful framework to conceptualise and evaluate factors impacting on implementation success. However, its broad scope makes it necessary to tailor the framework to allow evaluation of specific projects.

Methods for design and evaluation of integrated hardware-software systems for concurrent computation

NASA Technical Reports Server (NTRS)

Pratt, T. W.

1985-01-01

Research activities and publications are briefly summarized. The major tasks reviewed are: (1) VAX implementation of the PISCES parallel programming environment; (2) Apollo workstation network implementation of the PISCES environment; (3) FLEX implementation of the PISCES environment; (4) sparse matrix iterative solver in PSICES Fortran; (5) image processing application of PISCES; and (6) a formal model of concurrent computation being developed.

Walkthrough screening evaluation field guide. Natural phenomena hazards at Department of Energy facilities: Revision 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Eder, S.J.; Eli, M.W.; Salmon, M.W.

1993-11-01

The US Department of Energy (DOE) has a large inventory of existing facilities. Many of these facilities were not designed and constructed to current natural phenomena hazard (NPH) criteria. The NPH events include earthquakes, extreme winds and tornadoes, and floods. DOE Order 5480.28 establishes policy and requirements for NPH mitigation for DOE facilities. DOE is conducting a multiyear project to develop evaluation guidelines for assessing the condition and determining the need for upgrades at DOE facilities. One element of the NPH evaluation guidelines` development involves the existing systems and components at DOE facilities. This effort is described in detail inmore » a cited reference. In the interim period prior to availability of the final guidelines, DOE facilities are encouraged to implement an NPH walk through screening evaluation process by which systems and components that need attention can be rapidly identified. Guidelines for conducting the walk through screening evaluations are contained herein. The result of the NPH walk through screening evaluation should be a prioritized list of systems and components that need further action. Simple and inexpensive fixes for items identified in the walk through as marginal or inadequate should be implemented without further study. By implementing an NPH walk through screening evaluation, DOE facilities may realize significant reduction in risk from NPH in the short term.« less

Implementation and adoption of nationwide electronic health records in secondary care in England: final qualitative results from prospective national evaluation in “early adopter” hospitals

PubMed Central

Cornford, Tony; Barber, Nicholas; Avery, Anthony; Takian, Amirhossein; Lichtner, Valentina; Petrakaki, Dimitra; Crowe, Sarah; Marsden, Kate; Robertson, Ann; Morrison, Zoe; Klecun, Ela; Prescott, Robin; Quinn, Casey; Jani, Yogini; Ficociello, Maryam; Voutsina, Katerina; Paton, James; Fernando, Bernard; Jacklin, Ann; Cresswell, Kathrin

2011-01-01

Objectives To evaluate the implementation and adoption of the NHS detailed care records service in “early adopter” hospitals in England. Design Theoretically informed, longitudinal qualitative evaluation based on case studies. Setting 12 “early adopter” NHS acute hospitals and specialist care settings studied over two and a half years. Data sources Data were collected through in depth interviews, observations, and relevant documents relating directly to case study sites and to wider national developments that were perceived to impact on the implementation strategy. Data were thematically analysed, initially within and then across cases. The dataset consisted of 431 semistructured interviews with key stakeholders, including hospital staff, developers, and governmental stakeholders; 590 hours of observations of strategic meetings and use of the software in context; 334 sets of notes from observations, researchers’ field notes, and notes from national conferences; 809 NHS documents; and 58 regional and national documents. Results Implementation has proceeded more slowly, with a narrower scope and substantially less clinical functionality than was originally planned. The national strategy had considerable local consequences (summarised under five key themes), and wider national developments impacted heavily on implementation and adoption. More specifically, delays related to unrealistic expectations about the capabilities of systems; the time needed to build, configure, and customise the software; the work needed to ensure that systems were supporting provision of care; and the needs of end users for training and support. Other factors hampering progress included the changing milieu of NHS policy and priorities; repeatedly renegotiated national contracts; different stages of development of diverse NHS care records service systems; and a complex communication process between different stakeholders, along with contractual arrangements that largely excluded NHS providers. There was early evidence that deploying systems resulted in important learning within and between organisations and the development of relevant competencies within NHS hospitals. Conclusions Implementation of the NHS Care Records Service in “early adopter” sites proved time consuming and challenging, with as yet limited discernible benefits for clinicians and no clear advantages for patients. Although our results might not be directly transferable to later adopting sites because the functionalities we evaluated were new and untried in the English context, they shed light on the processes involved in implementing major new systems. The move to increased local decision making that we advocated based on our interim analysis has been pursued and welcomed by the NHS, but it is important that policymakers do not lose sight of the overall goal of an integrated interoperable solution. PMID:22006942

In the wake of suicide: Developing guidelines for suicide postvention in fire service

PubMed Central

Gulliver, Suzy Bird; Pennington, Michelle L.; Leto, Frank; Cammarata, Claire; Ostiguy, William; Zavodny, Cynthia; Flynn, Elisa J.; Kimbrel, Nathan A.

2016-01-01

ABSTRACT This project aimed to develop a standard operating procedure (SOP) for suicide postvention in Fire Service. First, an existing SOP was refined through expert review. Next, focus groups were conducted with fire departments lacking a peer suicide postvention SOP; feedback obtained guided revisions. The current article describes the iterative process used to evaluate and revise a Suicide Postvention SOP into a Postvention guideline that is available for implementation and evaluation. Postventions assist survivors in grief and bereavement and attempt to prevent additional negative outcomes. The implementation of suicide postvention guidelines will increase behavioral wellness within Fire Service. PMID:26332212

[A development and evaluation of nursing KMS using QFD in outpatient departments].

PubMed

Lee, Han Na; Yun, Eun Kyoung

2014-02-01

This study was done to develop and implement the Nursing KMS (knowledge management system) in order to improve knowledge sharing and creation among clinical nurses in outpatient departments. This study was a methodological research using the 'System Development Life Cycle': consisting of planning, analyzing, design, implementation, and evaluation. Quality Function Deployment (QFD) was applied to establish nurse requirements and to identify important design requirements. Participants were 32 nurses and for evaluation data were collected pre and post intervention at K Hospital in Seoul, a tertiary hospital with over 1,000 beds. The Nursing KMS was built using a Linux-based operating system, Oracle DBMS, and Java 1.6 web programming tools. The system was implemented as a sub-system of the hospital information system. There was statistically significant differences in the sharing of knowledge but creating of knowledge was no statistically meaningful difference observed. In terms of satisfaction with the system, system efficiency ranked first followed by system convenience, information suitability and information usefulness. The results indicate that the use of Nursing KMS increases nurses' knowledge sharing and can contribute to increased quality of nursing knowledge and provide more opportunities for nurses to gain expertise from knowledge shared among nurses.

Evaluating the Implementation of an Olympic Education Program in Greece

NASA Astrophysics Data System (ADS)

Grammatikopoulos, Vasilios; Tsigilis, Nikolaos; Koustelios, Athanasios; Theodorakis, Yannis

2005-11-01

The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following six factors: `facilities', `administration', `educational material', `student-teacher relationships', `educational procedures', and `training'. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with advanced statistical methods.

Introducing a New Learning and Teaching Evaluation Planning Framework for Small Internally Funded Projects in Higher Education

ERIC Educational Resources Information Center

Huber, Elaine

2017-01-01

Scholarly evaluation practices in learning and teaching projects are under-reported in the literature. In order for robust evaluative measures to be implemented, a project requires a well-designed evaluation plan. This research study describes the development of a practical evaluation planning framework through an action research approach, using…

Development and implementation of a science training course for breast cancer activists: Project LEAD (leadership, education and advocacy development).

PubMed

Dickersin, K; Braun, L; Mead, M; Millikan, R; Wu, A M; Pietenpol, J; Troyan, S; Anderson, B; Visco, F

2001-12-01

To develop and implement Project LEAD (leadership, education, and advocacy development), a science course for breast cancer activists. Students were breast cancer activists and other consumers, mainly affiliated with advocacy organizations in the United States of America. Project LEAD is offered by the National Breast Cancer Coalition; the course takes place over 5 days and is offered 4 times a year, in various cities in the United States of America. The Project LEAD curriculum has developed over 5 years to include lectures, problem-based study groups, case studies, interactive critical appraisal sessions, a seminar by an 'expert' scientist, role play, and homework components. A core faculty has been valuable for evaluating and revising the course and has proved necessary to provide consistent high quality teaching. Course evaluations indicated that students gained critical appraisal skills, enhanced their knowledge and developed confidence in selected areas of basic science and epidemiology. Project LEAD comprises a unique curriculum for training breast cancer activists in science and critical appraisal. Course evaluations indicate that students gain confidence and skills from the course.

Ontario's daily physical activity policy for elementary schools: is everything in place for success?

PubMed

Robertson-Wilson, Jennifer E; Lévesque, Lucie

2009-01-01

The development, implementation, and evaluation of policies may play an important role in promoting health behaviours such as physical activity. The Ontario Ministry of Education (OME) recently mandated Memorandum No. 138 requiring daily physical activity (DPA) for Ontario elementary students in grades one through eight. The purpose of this paper is to examine implementation strategies. Hogwood and Gunn's 10 preconditions for "perfect implementation" are used to examine publicly available Ministry DPA policy documents to assess whether these implementation strategies have been considered in the policy documents. Several preconditions (e.g., allocation of resources, task specification) appear to have been considered, however a number of preconditions (e.g., the sustainability of resources, extent to which the policy is valued, and evaluation plans) thought to be important require additional attention to ensure optimal DPA implementation. Additional reflection upon Hogwood and Gunn's implementation preconditions would, in our opinion, assist in facilitating optimal DPA implementation as per Memorandum No. 138.

Dissemination and implementation of evidence based, mental health interventions in post conflict, low resource settings

PubMed Central

Tol, Wietse; Jordans, Mark; Zangana, Goran Sabir; Amin, Ahmed Mohammed; Bolton, Paul; Bass, Judith; Bonilla-Escobar, Fransisco Javier; Thornicroft, Graham

2014-01-01

The burden of mental health problems in (post)conflict low- and middle-income countries (LMIC) is substantial. Despite growing evidence for the effectiveness of selected mental health programs in conflict-affected LMIC and growing policy support, actual uptake and implementation have been slow. A key direction for future research, and a new frontier within science and practice, is Dissemination and Implementation (DI) which directly addresses the movement of evidence-based, effective health care approaches from experimental settings into routine use. This paper outlines some key implementation challenges, and strategies to address these, while implementing evidence-based treatments in conflict-affected LMIC based on the authors’ collective experiences. Dissemination and implementation evaluation and research in conflict settings is an essential new research direction. Future DI work in LMIC should include: 1) defining concepts and developing measurement tools, 2) the measurement of DI outcomes for all programming, and 3) the systematic evaluation of specific implementation strategies. PMID:28316559

Technology Supported Learning and Teaching: A Staff Perspective

ERIC Educational Resources Information Center

O'Donoghue, John, Ed.

2006-01-01

"Technology Supported Learning and Teaching: A Staff Perspective" presents accounts and case studies of first-hand experience in developing, implementing, or evaluating learning technologies. This book highlights the many areas in which practitioners are attempting to implement learning technologies and reflects themes of current topical interest.…

Original Courseware for Introductory Psychology: Implementation and Evaluation.

ERIC Educational Resources Information Center

Slotnick, Robert S.

1988-01-01

Describes the implementation and field testing of PsychWare, a courseware package for introductory psychology developed and field tested at New York Institute of Technology. Highlights include the courseware package (10 software programs, a faculty manual, and a student workbook), and instructional design features (simulations, real-time…

Teaching Paraprofessionals to Implement Function-Based Interventions

ERIC Educational Resources Information Center

Walker, Virginia L.; Snell, Martha E.

2017-01-01

The purpose of this study was to evaluate the effects of workshops and coaching on paraprofessional implementation of function-based interventions. The results of indirect and direct functional behavior assessment guided the development of intervention strategies for three students with autism and intellectual disability. Following intervention,…

Development and Two-Year Follow-Up Evaluation of a Training Workshop for the Large Preventive Positive Psychology Happy Family Kitchen Project in Hong Kong

PubMed Central

Lai, Agnes Y.; Mui, Moses W.; Wan, Alice; Stewart, Sunita M.; Yew, Carol; Lam, Tai-hing; Chan, Sophia S.

2016-01-01

Evidence-based practice and capacity-building approaches are essential for large-scale health promotion interventions. However, there are few models in the literature to guide and evaluate training of social service workers in community settings. This paper presents the development and evaluation of the “train-the-trainer” workshop (TTT) for the first large scale, community-based, family intervention projects, entitled “Happy Family Kitchen Project” (HFK) under the FAMILY project, a Hong Kong Jockey Club Initiative for a Harmonious Society. The workshop aimed to enhance social workers’ competence and performance in applying positive psychology constructs in their family interventions under HFK to improve family well-being of the community they served. The two-day TTT was developed and implemented by a multidisciplinary team in partnership with community agencies to 50 social workers (64% women). It focused on the enhancement of knowledge, attitude, and practice of five specific positive psychology themes, which were the basis for the subsequent development of the 23 family interventions for 1419 participants. Acceptability and applicability were enhanced by completing a needs assessment prior to the training. The TTT was evaluated by trainees’ reactions to the training content and design, changes in learners (trainees) and benefits to the service organizations. Focus group interviews to evaluate the workshop at three months after the training, and questionnaire survey at pre-training, immediately after, six months, one year and two years after training were conducted. There were statistically significant increases with large to moderate effect size in perceived knowledge, self-efficacy and practice after training, which sustained to 2-year follow-up. Furthermore, there were statistically significant improvements in family communication and well-being of the participants in the HFK interventions they implemented after training. This paper offers a practical example of development, implementation and model-based evaluation of training programs, which may be helpful to others seeking to develop such programs in diverse communities. PMID:26808541

Development and Two-Year Follow-Up Evaluation of a Training Workshop for the Large Preventive Positive Psychology Happy Family Kitchen Project in Hong Kong.

PubMed

Lai, Agnes Y; Mui, Moses W; Wan, Alice; Stewart, Sunita M; Yew, Carol; Lam, Tai-Hing; Chan, Sophia S

2016-01-01

Evidence-based practice and capacity-building approaches are essential for large-scale health promotion interventions. However, there are few models in the literature to guide and evaluate training of social service workers in community settings. This paper presents the development and evaluation of the "train-the-trainer" workshop (TTT) for the first large scale, community-based, family intervention projects, entitled "Happy Family Kitchen Project" (HFK) under the FAMILY project, a Hong Kong Jockey Club Initiative for a Harmonious Society. The workshop aimed to enhance social workers' competence and performance in applying positive psychology constructs in their family interventions under HFK to improve family well-being of the community they served. The two-day TTT was developed and implemented by a multidisciplinary team in partnership with community agencies to 50 social workers (64% women). It focused on the enhancement of knowledge, attitude, and practice of five specific positive psychology themes, which were the basis for the subsequent development of the 23 family interventions for 1419 participants. Acceptability and applicability were enhanced by completing a needs assessment prior to the training. The TTT was evaluated by trainees' reactions to the training content and design, changes in learners (trainees) and benefits to the service organizations. Focus group interviews to evaluate the workshop at three months after the training, and questionnaire survey at pre-training, immediately after, six months, one year and two years after training were conducted. There were statistically significant increases with large to moderate effect size in perceived knowledge, self-efficacy and practice after training, which sustained to 2-year follow-up. Furthermore, there were statistically significant improvements in family communication and well-being of the participants in the HFK interventions they implemented after training. This paper offers a practical example of development, implementation and model-based evaluation of training programs, which may be helpful to others seeking to develop such programs in diverse communities.

Knowledge translation and implementation in spinal cord injury: a systematic review.

PubMed

Noonan, V K; Wolfe, D L; Thorogood, N P; Park, S E; Hsieh, J T; Eng, J J

2014-08-01

To conduct a systematic review examining the effectiveness of knowledge translation (KT) interventions in changing clinical practice and patient outcomes. MEDLINE/PubMed, CINAHL, EMBASE and PsycINFO were searched for studies published from January 1980 to July 2012 that reported and evaluated an implemented KT intervention in spinal cord injury (SCI) care. We reviewed and summarized results from studies that documented the implemented KT intervention, its impact on changing clinician behavior and patient outcomes as well as the facilitators and barriers encountered during the implementation. A total of 13 articles featuring 10 studies were selected and abstracted from 4650 identified articles. KT interventions included developing and implementing patient care protocols, providing clinician education and incorporating outcome measures into clinical practice. The methods (or drivers) to facilitate the implementation included organizing training sessions for clinical staff, introducing computerized reminders and involving organizational leaders. The methodological quality of studies was mostly poor. Only 3 out of 10 studies evaluated the success of the implementation using statistical analyses, and all 3 reported significant behavior change. Out of the 10 studies, 6 evaluated the effect of the implementation on patient outcomes using statistical analyses, with 4 reporting significant improvements. The commonly cited facilitators and barriers were communication and resources, respectively. The field of KT in SCI is in its infancy with only a few relevant publications. However, there is some evidence that KT interventions may change clinician behavior and improve patient outcomes. Future studies should ensure rigorous study methods are used to evaluate KT interventions.

EHR implementation in South Africa: how do we get it right?

PubMed

Yogeswaran, Parimalaranie; Wright, Graham

2010-01-01

In an environment of expanding demand on the health care system to provide equitable, accessible and safe health care, usage of information communication technology is one of the strategies identified to fulfil such expectations. Electronic Health Record (EHR) is an important tool towards achieving better health care using such technology, although, across the world EHR implementation has experienced a high failure rate. Nevertheless South Africa has made a strategic decision to implement EHR system in the public health sector. An evaluation toolkit was developed, to measure the state of readiness of health institutions in South Africa in implementing EHR based on Kaplan and Norton's work on Balanced Score Card (BSC), and the subsequent variant model developed by Protti. A Critical Success Factor (CSF) scorecard to assess the state of readiness and a Balanced Score Card matrix to be used as a strategic framework was developed. These tools were validated using critiques by a panel of experts. The toolkit developed has the potential to assist the organization towards a better EHR implementation path.

Scaling and Sustaining Effective Early Childhood Programs Through School-Family-University Collaboration.

PubMed

Reynolds, Arthur J; Hayakawa, Momoko; Ou, Suh-Ruu; Mondi, Christina F; Englund, Michelle M; Candee, Allyson J; Smerillo, Nicole E

2017-09-01

We describe the development, implementation, and evaluation of a comprehensive preschool to third grade prevention program for the goals of sustaining services at a large scale. The Midwest Child-Parent Center (CPC) Expansion is a multilevel collaborative school reform model designed to improve school achievement and parental involvement from ages 3 to 9. By increasing the dosage, coordination, and comprehensiveness of services, the program is expected to enhance the transition to school and promote more enduring effects on well-being in multiple domains. We review and evaluate evidence from two longitudinal studies (Midwest CPC, 2012 to present; Chicago Longitudinal Study, 1983 to present) and four implementation examples of how the guiding principles of shared ownership, committed resources, and progress monitoring for improvement can promote effectiveness. The implementation system of partners and further expansion using "Pay for Success" financing shows the feasibility of scaling the program while continuing to improve effectiveness. © 2017 The Authors. Child Development published by Wiley Periodicals, Inc. on behalf of Society for Research in Child Development.

Developing Effective Nonpoint Source TMDLs: An Evaluation of the TMDL Process

EPA Pesticide Factsheets

The report explores whether various characteristics of data availability, funding resources, guidance materials, stakeholder involvement, scale of TMDLs and implementation planning positively influence development of effective TMDLs.

Development of an intervention program to increase effective behaviours by patients and clinicians in psychiatric services: Intervention Mapping study.

PubMed

Koekkoek, Bauke; van Meijel, Berno; Schene, Aart; Hutschemaekers, Giel

2010-10-25

Health clinicians perceive certain patients as 'difficult' across all settings, including mental health care. In this area, patients with non-psychotic disorders that become long-term care users may be perceived as obstructing their own recovery or seeking secondary gain. This negative perception of patients results in ineffective responses and low-quality care by health clinicians. Using the concept of illness behaviour, this paper describes the development, implementation, and planned evaluation of a structured intervention aimed at prevention and management of ineffective behaviours by long-term non-psychotic patients and their treating clinicians. The principles of Intervention Mapping were applied to guide the development, implementation, and planned evaluation of the intervention. Qualitative (individual and group interviews), quantitative (survey), and mixed methods (Delphi-procedure) research was used to gain a broad perspective of the problem. Empirical findings, theoretical models, and existing evidence were combined to construct a program tailored to the needs of the target groups. A structured program to increase effective illness behaviour in long-term non-psychotic patients and effective professional behaviour in their treating clinicians was developed, consisting of three subsequent stages and four substantial components, that is described in detail. Implementation took place and evaluation of the intervention is being carried out. Intervention Mapping proved to be a suitable method to develop a structured intervention for a multi-faceted problem in mental health care.

Peer Evaluation of Teaching in an Online Information Literacy Course

ERIC Educational Resources Information Center

Vega García, Susan A.; Stacy-Bates, Kristine K.; Alger, Jeff; Marupova, Rano

2017-01-01

This paper reports on the development and implementation of a process of peer evaluation of teaching to assess librarian instruction in a high-enrollment online information literacy course for undergraduates. This paper also traces a shift within libraries from peer coaching to peer evaluation models. One common model for peer evaluation, using…

The Ecology of Sustainable Implementation: Reflection on a 10-Year Case History Illustration.

PubMed

Rimehaug, Tormod

2014-01-01

The primary aim of this paper is to illustrate the strategic and ecological nature of implementation. The ultimate aim of implementation is not dissemination but sustainability beyond the implementation effort. A case study is utilized to illustrate these broad and long-term perspectives of sustainable implementation based on qualitative analyses of a 10-year implementation effort. The purveyors aimed to develop selective community prevention services for children in families burdened by parental psychiatric or addictive problems. Services were gradually disseminated to 23 sites serving 40 municipalities by 2013. Up to 2013, only one site terminated services after initial implementation. Although many sites suspended services for shorter periods, services are still offered at 22 sites. This case analysis is based on project reports, user evaluations, practitioner interviews, and service statistics. The paper focuses on the analyses and strategies utilized to cope with quality decay and setbacks as well as progress and success in disseminating and sustaining the services and their quality. Low-cost multilevel strategies to implement services at the community level were organized by a prevention unit in child psychiatry, supervised by a university department (purveyors). The purveyors were also involved in national and international collaboration and development. Multilevel strategies included manualized intervention, in-practice training methods, organizational responsibility, media strategies, service evaluation, staff motivation maintenance, quality assurance, and proposals for new law regulations. These case history aspects will be discussed in relation to the implementation literature, focusing on possible applicability across settings.

Implementation and Evaluation of a Ward-Based eLearning Program for Trauma Patient Management.

PubMed

Curtis, Kate; Wiseman, Taneal; Kennedy, Belinda; Kourouche, Sarah; Goldsmith, Helen

2016-01-01

The majority of trauma nursing education is focused on the emergency phases of care. We describe the development and evaluation of a trauma eLearning module for the ward environment. The module was developed using adult learning principles and implemented in 2 surgical wards. There were 3 phases of evaluation: (1) self-efficacy of nurses; (2) relevance and usability of the module and; (3) application of knowledge learnt. The majority indicated they had applied new knowledge, particularly when performing a physical assessment (85.7%), communicating (91.4%), and identifying risk of serious illness (90.4%). Self-efficacy relating to confidence in caring for patients, communication, and escalating clinical deterioration improved (p = .023). An eLearning trauma patient assessment module for ward nursing staff improves nursing knowledge and self-efficacy.

Human Factors Evaluation of Advanced Electric Power Grid Visualization Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.; Dauenhauer, Peter M.; Wierks, Tamara G.

This report describes initial human factors evaluation of four visualization tools (Graphical Contingency Analysis, Force Directed Graphs, Phasor State Estimator and Mode Meter/ Mode Shapes) developed by PNNL, and proposed test plans that may be implemented to evaluate their utility in scenario-based experiments.

Evaluation and implementation of a machine vision system to categorize extraneous matter in cotton

USDA-ARS?s Scientific Manuscript database

The Cotton Trash Identification System (CTIS) developed at the Southwestern Cotton Ginning Research Laboratory was evaluated for identification and categorization of extraneous matter (EM) in cotton. The system’s categorization of trash objects in cotton images was evaluated against Agricultural Mar...

Community-based oral health promotion practices targeted at children and adolescents in Finland--developing an assessment tool.

PubMed

Blomqvist, Pia; Ojala, Ellinoora; Kettunen, Tarja; Poskiparta, Marita; Kasila, Kirsti

2014-06-01

To develop an assessment tool for evaluating oral health promotion practices and to evaluate community-based oral health promotion practices targeted at children and adolescents with this tool. A theoretical framework about health promotion planning, implementation and evaluation was made on the basis of a literature review. Then, information about Finnish community-based oral health promotion practices (n=12) targeted at children and adolescents was collected using semi-structured interviews. Also, related documents, for example action plans and reports, were collected when available. Next, an assessment tool based on the theoretical framework was developed, and the recorded and transcribed interview data and other documents were evaluated with this tool. The assessment tool proved to be practical: it pointed out the strengths and weaknesses of the practices. The tool revealed strengths in the implementation and deficiencies in the planning and evaluation of oral health promotion practices. One-quarter of the 12 practices assessed could be considered 'good practices'. There is a need to improve the planning and evaluation of oral health promotion practices. The assessment tool developed in this study might be useful for practitioners both in the field of oral health promotion and general health promotion. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

The participatory design of a performance oriented monitoring and evaluation system in an international development environment.

PubMed

Guerra-López, Ingrid; Hicks, Karen

2015-02-01

This article illustrates the application of the impact monitoring and evaluation process for the design and development of a performance monitoring and evaluation framework in the context of human and institutional capacity development. This participative process facilitated stakeholder ownership in several areas including the design, development, and use of a new monitoring and evaluation system, as well their targeted results and accomplishments through the use of timely performance data gathered through ongoing monitoring and evaluation. The process produced a performance indicator map, a comprehensive monitoring and evaluation framework, and data collection templates to promote the development, implementation, and sustainability of the monitoring and evaluation system of a farmer's trade union in an African country. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development, implementation and evaluation of satellite-aided agricultural monitoring systems

NASA Technical Reports Server (NTRS)

Cicone, R. C.; Crist, E. P.; Metzler, M.; Nuesch, D.

1982-01-01

Research activities in support of AgRISTARS Inventory Technology Development Project in the use of aerospace remote sensing for agricultural inventory described include: (1) corn and soybean crop spectral temporal signature characterization; (2) efficient area estimation techniques development; and (3) advanced satellite and sensor system definition. Studies include a statistical evaluation of the impact of cultural and environmental factors on crop spectral profiles, the development and evaluation of an automatic crop area estimation procedure, and the joint use of SEASAT-SAR and LANDSAT MSS for crop inventory.

Developing care pathways--lessons from the Steele Review implementation in England.

PubMed

Rooney, Eric

2014-02-01

This paper sets out to discuss the concept of care pathways, review their definition, features and implementation and using an example from the NHS dental system in England guide the development of an elder care pathway. Care pathways have developed from quality management approaches in industry and focus on a number of steps which are intended to lead to expected outcomes. The existing definition and descriptors of care pathways serve well, but miss the complex process underlying the development of pathways, their structure, implementation and evaluation. The literature identifies key features of clinical pathways and from the developing field of implementation science, the factors likely to support pathway implementation. Pathways must be generic enough to enable them to be applicable broadly, but specific enough for them to be locally relevant and population specific. The development of care pathways in the National Health Service (NHS) Dental Service in England is described and when compared with the implementation science literature exhibits features identified as positive factors for implementation. As a result a contribution to the pathway definition literature is offered. Learning from the literature and the practical experience described from England, the process for developing dental care pathways for dependent elders should begin with the creation of a high level pathway, which is cognisant of the clinical and implementation science evidence base. © 2014 John Wiley & Sons A/S and The Gerodontology Society. Published by John Wiley & Sons Ltd.

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION (SITE) PROGRAM ANNUAL REPORT TO CONGRESS 2003

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program has successfully promoted the development, commercialization and implementation of innovative hazardous waste treatment technologies for 17 years. SITE offers a mechanism for conducting joint technology demonstration a...

Pervious Pavement System Evaluation

EPA Science Inventory

Pervious pavement is a low impact development stormwater control. The Urban Watershed Management Branch of the U.S. Environmental Protection Agency in Edison, NJ, is evaluating concrete pavers as a popular implementation. The pollutant removal of a bench-scale permeable interlo...

The Superfund Innovative Technology Evaluation Program Annual Report to Congress FY2004

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program has successfully promoted the development, commercialization, and implementation of innovative hazardous waste treatment technologies for 18 years. SITE offers a mechanism for conducting joint technology demonstration ...

Pervious Pavement System Evaluation- Abstract

EPA Science Inventory

Porous pavement is a low impact development stormwater control. The Urban Watershed Management Branch is evaluating interlocking concrete pavers as a popular implementation. The pavers themselves are impermeable, but the spaces between the pavers are backfilled with washed, gra...

Pervious Pavement System Evaluation- Abstract 1

EPA Science Inventory

Porous pavement is a low impact development stormwater control. The Urban Watershed Management Branch is evaluating interlocking concrete pavers as a popular implementation. The pavers themselves are impermeable, but the spaces between the pavers are backfilled with washed, gra...

F100 Multivariable Control Synthesis Program. Computer Implementation of the F100 Multivariable Control Algorithm

NASA Technical Reports Server (NTRS)

Soeder, J. F.

1983-01-01

As turbofan engines become more complex, the development of controls necessitate the use of multivariable control techniques. A control developed for the F100-PW-100(3) turbofan engine by using linear quadratic regulator theory and other modern multivariable control synthesis techniques is described. The assembly language implementation of this control on an SEL 810B minicomputer is described. This implementation was then evaluated by using a real-time hybrid simulation of the engine. The control software was modified to run with a real engine. These modifications, in the form of sensor and actuator failure checks and control executive sequencing, are discussed. Finally recommendations for control software implementations are presented.

The role of theory in research to develop and evaluate the implementation of patient safety practices.

PubMed

Foy, Robbie; Ovretveit, John; Shekelle, Paul G; Pronovost, Peter J; Taylor, Stephanie L; Dy, Sydney; Hempel, Susanne; McDonald, Kathryn M; Rubenstein, Lisa V; Wachter, Robert M

2011-05-01

Theories provide a way of understanding and predicting the effects of patient safety practices (PSPs), interventions intended to prevent or mitigate harm caused by healthcare or risks of such harm. Yet most published evaluations make little or no explicit reference to theory, thereby hindering efforts to generalise findings from one context to another. Theories from a wide range of disciplines are potentially relevant to research on PSPs. Theory can be used in research to explain clinical and organisational behaviour, to guide the development and selection of PSPs, and in evaluating their implementation and mechanisms of action. One key recommendation from an expert consensus process is that researchers should describe the theoretical basis for chosen intervention components or provide an explicit logic model for 'why this PSP should work.' Future theory-driven evaluations would enhance generalisability and help build a cumulative understanding of the nature of change.

Development of a Short Line Railroad Safety Institute : phase I - job analysis.

DOT National Transportation Integrated Search

2014-04-01

The Federal Railroad Administrations (FRA) : Office of Research and Development (R&D) is : supporting the American Short Line and : Regional Railroad Association (ASLRRA) in the : development, implementation, and evaluation of : a proposed Short L...

State experiences implementing youth sports concussion laws: challenges, successes, and lessons for evaluating impact.

PubMed

Lowrey, Kerri McGowan; Morain, Stephanie R

2014-01-01

While provisions of youth sports concussion laws are very similar, little is known as to how they are being implemented, factors that promote or impede implementation, or the level of compliance in each jurisdiction. We aimed to describe state experiences with implementation in order to inform ongoing efforts to reduce the harm of sports-related traumatic brain injury and to guide future evaluations of the laws' impacts and the development of future public health laws. We conducted key-informant interviews in 35 states with recently enacted concussion legislation. States varied considerably in their readiness and capacity for implementation. Factors facilitating implementation included existing partnerships, procedures, and resources; centralized implementation authority; prior related efforts; and involvement in the policymaking process by those now charged with implementation. Inhibitors included ambiguous statutory language, unclear delegation of authority, and compliance difficulties. Ongoing challenges persist, including primary prevention; determining which providers are qualified to make return-to-play assessments and contents of those assessments; compliance difficulties in rural and under-served areas; and unclear responsibility for enforcement. Despite the similarity of youth sports concussion laws, early evidence suggests there is considerable variation in their implementation. These findings are critical for ongoing empirical investigations to accurately evaluate the laws' provisions and to identify successful legal approaches to protecting young athletes. © 2014 American Society of Law, Medicine & Ethics, Inc.

A common evaluation framework for the African Health Initiative.

PubMed

Bryce, Jennifer; Requejo, Jennifer Harris; Moulton, Lawrence H; Ram, Malathi; Black, Robert E

2013-01-01

The African Health Initiative includes highly diverse partnerships in five countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia), each of which is working to improve population health by strengthening health systems and to evaluate the results. One aim of the Initiative is to generate cross-site learning that can inform implementation in the five partnerships during the project period and identify lessons that may be generalizable to other countries in the region. Collaborators in the Initiative developed a common evaluation framework as a basis for this cross-site learning. This paper describes the components of the framework; this includes the conceptual model, core metrics to be measured in all sites, and standard guidelines for reporting on the implementation of partnership activities and contextual factors that may affect implementation, or the results it produces. We also describe the systems that have been put in place for data management, data quality assessments, and cross-site analysis of results. The conceptual model for the Initiative highlights points in the causal chain between health system strengthening activities and health impact where evidence produced by the partnerships can contribute to learning. This model represents an important advance over its predecessors by including contextual factors and implementation strength as potential determinants, and explicitly including equity as a component of both outcomes and impact. Specific measurement challenges include the prospective documentation of program implementation and contextual factors. Methodological issues addressed in the development of the framework include the aggregation of data collected using different methods and the challenge of evaluating a complex set of interventions being improved over time based on continuous monitoring and intermediate results.

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

NASA Astrophysics Data System (ADS)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

A framework for evaluating the formation, implementation, and performance of accountable care organizations.

PubMed

Fisher, Elliott S; Shortell, Stephen M; Kreindler, Sara A; Van Citters, Aricca D; Larson, Bridget K

2012-11-01

The implementation of accountable care organizations (ACOs), a new health care payment and delivery model designed to improve care and lower costs, is proceeding rapidly. We build on our experience tracking early ACOs to identify the major factors-such as contract characteristics; structure, capabilities, and activities; and local context-that would be likely to influence ACO formation, implementation, and performance. We then propose how an ACO evaluation program could be structured to guide policy makers and payers in improving the design of ACO contracts, while providing insights for providers on approaches to care transformation that are most likely to be successful in different contexts. We also propose key activities to support evaluation of ACOs in the near term, including tracking their formation, developing a set of performance measures across all ACOs and payers, aggregating those performance data, conducting qualitative and quantitative research, and coordinating different evaluation activities.

Revised catalog of types of CODES applications implemented using linked state data : crash outcome data evaluation system (CODES)

DOT National Transportation Integrated Search

2000-06-01

The purpose of the Revised Catalog of Types of CODES Applications Implemented Using Linked : State Data (CODES) is to inspire the development of new applications for linked data that support : efforts to reduce death, disability, severity, and health...

Task-Based Language Learning and Teaching: An Action-Research Study

ERIC Educational Resources Information Center

Calvert, Megan; Sheen, Younghee

2015-01-01

The creation, implementation, and evaluation of language learning tasks remain a challenge for many teachers, especially those with limited experience with using tasks in their teaching. This action-research study reports on one teacher's experience of developing, implementing, critically reflecting on, and modifying a language learning task…

Handbook for Educational Buildings Planning. Educational Building and Equipment 9.

ERIC Educational Resources Information Center

Almeida, Rodolfo

Stages in the educational facility planning process are presented in this handbook, with a second focus on implementation. Four chapters provide information on the four cycles of the planning process, which include analysis and diagnosis, research and development, planning and programming, and implementation and evaluation. Characteristics of an…

Helping Students Adapt to Computer-Based Encrypted Examinations

ERIC Educational Resources Information Center

Baker-Eveleth, Lori; Eveleth, Daniel M.; O'Neill, Michele; Stone, Robert W.

2006-01-01

The College of Business and Economics at the University of Idaho conducted a pilot study that used commercially available encryption software called Securexam to deliver computer-based examinations. A multi-step implementation procedure was developed, implemented, and then evaluated on the basis of what students viewed as valuable. Two key aspects…

Treatment Acceptability of Interventions Published in Six School Psychology Journals

ERIC Educational Resources Information Center

Villarreal, Victor; Ponce, Christopher; Gutierrez, Heveli

2015-01-01

Treatment acceptability (TA) is critical when selecting and implementing an intervention, as TA is associated with treatment outcomes. The significance of TA is reflected in school psychology models for services that state that school psychologists should address TA during development, implementation, and evaluation of interventions. However, the…

Now for the Science Bit: Implementing Community-Based Learning in Chemistry

ERIC Educational Resources Information Center

McDonnell, Claire; Ennis, Patricia; Shoemaker, Leslie

2011-01-01

Purpose: The purpose of this paper is to contribute to the understanding of student learning from community engagement by critically assessing the implementation of this pedagogical approach in the context of teaching and learning chemistry and also evaluating the role of personal development in student-community engagement.…

Examining the Quality of Technology Implementation in STEM Classrooms: Demonstration of an Evaluative Framework

ERIC Educational Resources Information Center

Parker, Caroline E.; Stylinski, Cathlyn D.; Bonney, Christina R.; Schillaci, Rebecca; McAuliffe, Carla

2015-01-01

Technology applications aligned with science, technology, engineering, and math (STEM) workplace practices can engage students in real-world pursuits but also present dramatic challenges for classroom implementation. We examined the impact of teacher professional development focused on incorporating these workplace technologies in the classroom.…

Developing weighted criteria to evaluate lean reverse logistics through analytical network process

NASA Astrophysics Data System (ADS)

Zagloel, Teuku Yuri M.; Hakim, Inaki Maulida; Krisnawardhani, Rike Adyartie

2017-11-01

Reverse logistics is a part of supply chain that bring materials from consumers back to manufacturer in order to gain added value or do a proper disposal. Nowadays, most companies are still facing several problems on reverse logistics implementation which leads to high waste along reverse logistics processes. In order to overcome this problem, Madsen [Framework for Reverse Lean Logistics to Enable Green Manufacturing, Eco Design 2009: 6th International Symposium on Environmentally Conscious Design and Inverse Manufacturing, Sapporo, 2009] has developed a lean reverse logistics framework as a step to eliminate waste by implementing lean on reverse logistics. However, the resulted framework sets aside criteria used to evaluate its performance. This research aims to determine weighted criteria that can be used as a base on reverse logistics evaluation by considering lean principles. The resulted criteria will ensure reverse logistics are kept off from waste, thus implemented efficiently. Analytical Network Process (ANP) is used in this research to determine the weighted criteria. The result shows that criteria used for evaluation lean reverse logistics are Innovation and Learning (35%), Economic (30%), Process Flow Management (14%), Customer Relationship Management (13%), Environment (6%), and Social (2%).

Evaluation metrics for bone segmentation in ultrasound

NASA Astrophysics Data System (ADS)

Lougheed, Matthew; Fichtinger, Gabor; Ungi, Tamas

2015-03-01

Tracked ultrasound is a safe alternative to X-ray for imaging bones. The interpretation of bony structures is challenging as ultrasound has no specific intensity characteristic of bones. Several image segmentation algorithms have been devised to identify bony structures. We propose an open-source framework that would aid in the development and comparison of such algorithms by quantitatively measuring segmentation performance in the ultrasound images. True-positive and false-negative metrics used in the framework quantify algorithm performance based on correctly segmented bone and correctly segmented boneless regions. Ground-truth for these metrics are defined manually and along with the corresponding automatically segmented image are used for the performance analysis. Manually created ground truth tests were generated to verify the accuracy of the analysis. Further evaluation metrics for determining average performance per slide and standard deviation are considered. The metrics provide a means of evaluating accuracy of frames along the length of a volume. This would aid in assessing the accuracy of the volume itself and the approach to image acquisition (positioning and frequency of frame). The framework was implemented as an open-source module of the 3D Slicer platform. The ground truth tests verified that the framework correctly calculates the implemented metrics. The developed framework provides a convenient way to evaluate bone segmentation algorithms. The implementation fits in a widely used application for segmentation algorithm prototyping. Future algorithm development will benefit by monitoring the effects of adjustments to an algorithm in a standard evaluation framework.

People's Need for Additional Job Training: Development and Evaluation of an Assessment Procedure.

ERIC Educational Resources Information Center

Copa, George H.; Maurice, Clyde F.

A procedure was developed and evaluated for assessing the self-perceived educational needs of people as one input to the process of planning, approving, and implementing relevant educational programs. The method of data collection involved selecting samples of people by randomly selecting households in a given geographic area, and then contacting…

Driving and Dementia in Older Adults: Implementation and Evaluation of a Continuing Education Project

ERIC Educational Resources Information Center

Meuser, Thomas M.; Carr, David B.; Berg-Weger, Marla; Niewoehner, Pat; Morris, John C.

2006-01-01

Purpose: We aimed to develop and evaluate a multimedia workshop curriculum to educate physicians and other health professionals about (a) driving-related assessment in older adults with dementia, and (b) strategies to encourage driving retirement for impaired individuals. Design and Methods: A curriculum developed by the Older Drivers Project of…

The Development and Evaluation of a Chemistry Curriculum for Nursing Schools in Israel.

ERIC Educational Resources Information Center

Dori, Yehudit; And Others

A very diverse population of students choose nursing as a profession in Israel. Although chemistry is basic for studying nursing, most of these students have not studied chemistry in school for longer than a single year--usually in grade 10. A chemistry curriculum for nursing schools was developed, implemented, and evaluated. This curriculum was…

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

Learning about the Effects of Development Education Programmes: Strengthening Planning, Monitoring, and Evaluation (PME) through Reflective Practice

ERIC Educational Resources Information Center

Van Ongevalle, Jan; Huyse, Huib; Van Petegem, Peter

2013-01-01

This article reports on the results of an action research project (2010-13) in which ten Belgian organizations who implement development education programmes explored different planning, monitoring, and evaluation (PME) approaches with the aim of learning more effectively about their results. PME approaches piloted included outcome mapping, most…

Methodology for Evaluating a Novel Education Technology: A Case Study of Handheld Video Games in Chile

ERIC Educational Resources Information Center

Margolis, Jesse L.; Nussbaum, Miguel; Rodriguez, Patricio; Rosas, Ricardo

2006-01-01

Many school systems, in both the developed and developing world, are implementing educational technology to assist in student learning. However, there is no clear consensus on how to evaluate these new technologies. This paper proposes a comprehensive methodology for estimating the value of a new educational technology in three steps: benefit…

Netlist Oriented Sensitivity Evaluation (NOSE)

DTIC Science & Technology

2017-03-01

developing methodologies to assess sensitivities of alternative chip design netlist implementations. The research is somewhat foundational in that such...Netlist-Oriented Sensitivity Evaluation (NOSE) project was to develop methodologies to assess sensitivities of alternative chip design netlist...analysis to devise a methodology for scoring the sensitivity of circuit nodes in a netlist and thus providing the raw data for any meaningful

Monitoring and Evaluation of an Early Childhood Development Programme: Implications for Leadership and Management

ERIC Educational Resources Information Center

Hodgson, Sarah; Papatheodorou, Theodora; James, Mary

2014-01-01

The article aims to discuss preliminary findings from a participatory monitoring and evaluation (M&E) framework, used in a community-based early childhood development (ECD) programme in KwaZulu-Natal South Africa, and their implications for leadership and management. The purposes of the M&E were for LETCEE, the implementing organization,…

A Flexible e-Learning Resource Promoting the Critical Reading of Scientific Papers for Science Undergraduates

ERIC Educational Resources Information Center

Letchford, Julie; Corradi, Hazel; Day, Trevor

2017-01-01

An important aim of undergraduate science education is to develop student skills in reading and evaluating research papers. We have designed, developed, and implemented an on-line interactive resource entitled "Evaluating Scientific Research literature" (ESRL) aimed at students from the first 2 years of the undergraduate program. In this…

Methodological Considerations in Evaluating Long-Term Systems Change: A Case Study From Eastern Nepal

ERIC Educational Resources Information Center

Koleros, Andrew; Jupp, Dee; Kirwan, Sean; Pradhan, Meeta S.; Pradhan, Pushkar K.; Seddon, David; Tumbahangfe, Ansu

2016-01-01

This article presents discussion and recommendations on approaches to retrospectively evaluating development interventions in the long term through a systems lens. It is based on experiences from the implementation of an 18-month study to investigate the impact of development interventions on economic and social change over a 40-year period in the…

Foundational Elements of Applied Simulation Theory: Development and Implementation of a Longitudinal Simulation Educator Curriculum

PubMed Central

Posner, Glenn; Humphrey-Murto, Susan

2017-01-01

Simulation-based education has gained popularity, yet many faculty members feel inadequately prepared to teach using this technique. Fellowship training in medical education exists, but there is little information regarding simulation or formal educational programs therein. In our institution, simulation fellowships were offered by individual clinical departments. We recognized the need for a formal curriculum in educational theory. Kern’s approach to curriculum development was used to develop, implement, and evaluate the Foundational Elements of Applied Simulation Theory (FEAST) curriculum. Needs assessments resulted in a 26-topic curriculum; each biweekly session built upon the previous. Components essential to success included setting goals and objectives for each interactive session and having dedicated faculty, collaborative leadership and administrative support for the curriculum. Evaluation data was collated and analyzed annually via anonymous feedback surveys, focus groups, and retrospective pre-post self-assessment questionnaires. Data collected from 32 fellows over five years of implementation showed that the curriculum improved knowledge, challenged thinking, and was excellent preparation for a career in simulation-based medical education. Themes arising from focus groups demonstrated that participants valued faculty expertise and the structure, practicality, and content of the curriculum. We present a longitudinal simulation educator curriculum that adheres to a well-described framework of curriculum development. Program evaluation shows that FEAST has increased participant knowledge in key areas relevant to simulation-based education and that the curriculum has been successful in meeting the needs of novice simulation educators. Insights and practice points are offered for educators wishing to implement a similar curriculum in their institution. PMID:28280655

Foundational Elements of Applied Simulation Theory: Development and Implementation of a Longitudinal Simulation Educator Curriculum.

PubMed

Chiu, Michelle; Posner, Glenn; Humphrey-Murto, Susan

2017-01-27

Simulation-based education has gained popularity, yet many faculty members feel inadequately prepared to teach using this technique. Fellowship training in medical education exists, but there is little information regarding simulation or formal educational programs therein. In our institution, simulation fellowships were offered by individual clinical departments. We recognized the need for a formal curriculum in educational theory. Kern's approach to curriculum development was used to develop, implement, and evaluate the Foundational Elements of Applied Simulation Theory (FEAST) curriculum. Needs assessments resulted in a 26-topic curriculum; each biweekly session built upon the previous. Components essential to success included setting goals and objectives for each interactive session and having dedicated faculty, collaborative leadership and administrative support for the curriculum. Evaluation data was collated and analyzed annually via anonymous feedback surveys, focus groups, and retrospective pre-post self-assessment questionnaires. Data collected from 32 fellows over five years of implementation showed that the curriculum improved knowledge, challenged thinking, and was excellent preparation for a career in simulation-based medical education. Themes arising from focus groups demonstrated that participants valued faculty expertise and the structure, practicality, and content of the curriculum. We present a longitudinal simulation educator curriculum that adheres to a well-described framework of curriculum development. Program evaluation shows that FEAST has increased participant knowledge in key areas relevant to simulation-based education and that the curriculum has been successful in meeting the needs of novice simulation educators. Insights and practice points are offered for educators wishing to implement a similar curriculum in their institution.

Implementing and Evaluating a Multicomponent Inpatient Diabetes Management Program: Putting Research into Practice

PubMed Central

Munoz, Miguel; Pronovost, Peter; Dintzis, Joanne; Kemmerer, Theresa; Wang, Nae-Yuh; Chang, Yi-Ting; Efird, Leigh; Berenholtz, Sean M.; Golden, Sherita Hill

2013-01-01

Background Strategies for successful implementation of hospitalwide glucose control efforts were addressed in a conceptual model for the development and implementation of an institutional inpatient glucose management program. Conceptual Model Components The Glucose Steering Committee incrementally developed and implemented hospitalwide glucose policies, coupled with targeted education and clinical decision support to facilitate policy acceptance and uptake by staff while incorporating process and outcome measures to objectively assess the effectiveness of quality improvement efforts. The model includes four components: (1) engaging staff and hospital executives in the importance of inpatient glycemic management, (2) educating staff involved in the care of patients with diabetes through structured knowledge dissemination, (3) executing evidence-based inpatient glucose management through development of policies and clinical decision aids, and (4) evaluating intervention effectiveness through assessing process measures, intermediary glucometric outcomes, and clinical and economic outcomes. An educational curriculum for nursing, provider, and pharmacist diabetes education programs and current glucometrics were also developed. Outcomes Overall the average patient-day–weighted mean blood glucose (PDWMBG) was below the currently recommended maximum of 180 mg/dL in patients with diabetes and hyperglycemia, with a significant decrease in PDWMBG of 7.8 mg/dL in patients with hyperglycemia. The program resulted in an 18.8% reduction in hypoglycemia event rates, which was sustained. Conclusion Inpatient glucose management remains an important area for patient safety, quality improvement, and clinical research, and the implementation model should guide other hospitals in their glucose management initiatives. PMID:22649859

Implementing and evaluating a multicomponent inpatient diabetes management program: putting research into practice.

PubMed

Munoz, Miguel; Pronovost, Peter; Dintzis, Joanne; Kemmerer, Theresa; Wang, Nae-Yuh; Chang, Yi-Ting; Efird, Leigh; Berenholtz, Sean M; Golden, Sherita Hill

2012-05-01

Strategies for successful implementation of hospitalwide glucose control efforts were addressed in a conceptual model for the development and implementation of an institutional inpatient glucose management program. CONCEPTUAL MODEL COMPONENTS: The Glucose Steering Committee incrementally developed and implemented hospitalwide glucose policies, coupled with targeted education and clinical decision support to facilitate policy acceptance and uptake by staffwhile incorporating process and outcome measures to objectively assess the effectiveness of quality improvement efforts. The model includes four components: (1) engaging staff and hospital executives in the importance of inpatient glycemic management, (2) educating staff involved in the care of patients with diabetes through structured knowledge dissemination, (3) executing evidence-based inpatient glucose management through development of policies and clinical decision aids, and (4) evaluating intervention effectiveness through assessing process measures, intermediary glucometric outcomes, and clinical and economic outcomes. An educational curriculum for nursing, provider, and pharmacist diabetes education programs and current glucometrics were also developed. Overall the average patient-day-weighted mean blood glucose (PDWMBG) was below the currently recommended maximum of 180 mg/dL in patients with diabetes and hyperglycemia, with a significant decrease in PDWMBG of 7.8 mg/dL in patients with hyperglycemia. The program resulted in an 18.8% reduction in hypoglycemia event rates, which was sustained. Inpatient glucose management remains an important area for patient safety, quality improvement, and clinical research, and the implementation model should guide other hospitals in their glucose management initiatives.

Developing a Promotional Campaign for a Statewide Continuing Education System.

ERIC Educational Resources Information Center

Munger, Paul; And Others

1981-01-01

Describes activities developed in promoting a statewide continuing education system. They included television and radio advertisements, a user's manual, and a logo. Program evaluation and implementation are also discussed. (CT)

An Integrated Data-Driven Strategy for Safe-by-Design Nanoparticles: The FP7 MODERN Project.

PubMed

Brehm, Martin; Kafka, Alexander; Bamler, Markus; Kühne, Ralph; Schüürmann, Gerrit; Sikk, Lauri; Burk, Jaanus; Burk, Peeter; Tamm, Tarmo; Tämm, Kaido; Pokhrel, Suman; Mädler, Lutz; Kahru, Anne; Aruoja, Villem; Sihtmäe, Mariliis; Scott-Fordsmand, Janeck; Sorensen, Peter B; Escorihuela, Laura; Roca, Carlos P; Fernández, Alberto; Giralt, Francesc; Rallo, Robert

2017-01-01

The development and implementation of safe-by-design strategies is key for the safe development of future generations of nanotechnology enabled products. The safety testing of the huge variety of nanomaterials that can be synthetized is unfeasible due to time and cost constraints. Computational modeling facilitates the implementation of alternative testing strategies in a time and cost effective way. The development of predictive nanotoxicology models requires the use of high quality experimental data on the structure, physicochemical properties and bioactivity of nanomaterials. The FP7 Project MODERN has developed and evaluated the main components of a computational framework for the evaluation of the environmental and health impacts of nanoparticles. This chapter describes each of the elements of the framework including aspects related to data generation, management and integration; development of nanodescriptors; establishment of nanostructure-activity relationships; identification of nanoparticle categories; hazard ranking and risk assessment.

Developing, Implementing, and Evaluating the Educational Module Students Active Learning via Internet Observations (SALIO) in Undergraduate Nursing Education.

PubMed

Salzmann-Erikson, Martin; Bjuhr, Marie; Mårtensson, Gunilla

2017-04-01

This study aimed not only to describe the development and implementation of the module but also to evaluate the nursing students' perceptions. A cross-sectional design including 101 students who were asked to participate and answer a survey. We describe the development of the pedagogic module Students Active Learning via Internet Observations based on situated learning. The findings show that learning about service users' own lived experiences via web-based platforms was instructive according to the students: 81% agreed to a high or very high degree. Another important finding was that 96% of students responded that the module had clinical relevance for nursing work. We argue that learning that engages students with data that are contextually and culturally situated is important for developing competence in caregiving. © 2015 Wiley Periodicals, Inc.

Development and implementation of a peer mentoring program for early career gerontological faculty.

PubMed

Bryant, Ashley Leak; Aizer Brody, Abraham; Perez, Adriana; Shillam, Casey; Edelman, Linda S; Bond, Stewart M; Foster, Victoria; Siegel, Elena O

2015-05-01

The Hartford Gerontological Nursing Leaders (HGNL) formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), in conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), developed and executed a peer mentoring program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of HGNL members. The purpose of this article is to describe key strategies used to develop and execute the peer mentoring program and to present formative program evaluation. The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. © 2015 Sigma Theta Tau International.

Shortridge academy: positive youth development in action within a therapeutic community.

PubMed

Baber, Kristine M; Rainer, Adam

2011-01-01

This chapter presents a case example of the implementation of Positive Youth Development (PYD) at a therapeutic boarding school including the theoretical, conceptual, and empirical information about PYD, adolescent brain development, authoritative communities, and youth-adult partnerships that guided this work. Specific examples demonstrate how key concepts and underlying principles of PYD were put into practice. The chapter provides information about parents' perceptions of the school's effectiveness and explains a theory of change approach used to develop the program evaluation. The chapter concludes with a discussion of challenges and opportunities experienced in the development and implementation of the program.

Developing the Capacity to Implement Tier 2 and Tier 3 Supports: How Do We Support Our Faculty and Staff in Preparing for Sustainability?

ERIC Educational Resources Information Center

Oakes, Wendy Peia; Lane, Kathleen Lynne; Germer, Kathryn A.

2014-01-01

School-site and district-level leadership teams rely on the existing knowledge base to select, implement, and evaluate evidence-based practices meeting students' multiple needs within the context of multitiered systems of support. The authors focus on the stages of implementation science as applied to Tier 2 and Tier 3 supports; the…

Explicit robust schemes for implementation of a class of principal value-based constitutive models: Symbolic and numeric implementation

NASA Technical Reports Server (NTRS)

Arnold, S. M.; Saleeb, A. F.; Tan, H. Q.; Zhang, Y.

1993-01-01

The issue of developing effective and robust schemes to implement a class of the Ogden-type hyperelastic constitutive models is addressed. To this end, special purpose functions (running under MACSYMA) are developed for the symbolic derivation, evaluation, and automatic FORTRAN code generation of explicit expressions for the corresponding stress function and material tangent stiffness tensors. These explicit forms are valid over the entire deformation range, since the singularities resulting from repeated principal-stretch values have been theoretically removed. The required computational algorithms are outlined, and the resulting FORTRAN computer code is presented.

Participatory Evaluation with Youth Leads to Community Action Project

ERIC Educational Resources Information Center

Ashton, Carolyn; Arnold, Mary E.; Wells, Elissa E.

2010-01-01

4-H has long emphasized the importance of civic engagement and community service for positive youth development. One pathway to this ideal is youth action research and evaluation. This article demonstrates how participatory youth research and evaluation can lead to the successful implementation of community action projects. It describes the…

A Process for the Evaluation of Training.

ERIC Educational Resources Information Center

Civil Service Commission, Washington, DC. Training Leadership Div.

The process of evaluating the training of federal civil service employees is summarized in three phases: (1) the focus--establishing the scope and objectives of the evaluation effort, (2) the plan--developing a blueprint for conducting the project, and (3) the implementation--obtaining necessary data, interpreting them, and providing conclusions…

A Model for Evaluating Development Programs. Miscellaneous Report.

ERIC Educational Resources Information Center

Burton, John E., Jr.; Rogers, David L.

Taking the position that the Classical Experimental Evaluation (CEE) Model does not do justice to the process of acquiring information necessary for decision making re planning, programming, implementing, and recycling program activities, this paper presents the Inductive, System-Process (ISP) evaluation model as an alternative to be used in…

Evidence implementation: Development of an online methodology from the knowledge-to-action model of knowledge translation.

PubMed

Lockwood, Craig; Stephenson, Matthew; Lizarondo, Lucylynn; van Den Hoek, Joan; Harrison, Margaret

2016-08-01

This paper describes an online facilitation for operationalizing the knowledge-to-action (KTA) model. The KTA model incorporates implementation planning that is optimally suited to the information needs of clinicians. The can-implement(©) is an evidence implementation process informed by the KTA model. An online counterpart, the can-implement.pro(©) , was developed to enable greater dissemination and utilization of the can-implement(©) process. The driver for this work was health professionals' need for facilitation that is iterative, informed by context and localized to the specific needs of users. The literature supporting this paper includes evaluation studies and theoretical concepts relevant to KTA model, evidence implementation and facilitation. Nursing and other health disciplines require a skill set and resources to successfully navigate the complexity of organizational requirements, inter-professional leadership and day-to-day practical management to implement evidence into clinical practice. The can-implement.pro(©) provides an accessible, inclusive system for evidence implementation projects. There is empirical support for evidence implementation informed by the KTA model, which in this phase of work has been developed for online uptake. Nurses and other clinicians seeking to implement evidence could benefit from the directed actions, planning advice and information embedded in the phases and steps of can-implement.pro(©) . © 2016 John Wiley & Sons Australia, Ltd.

Considering health equity when moving from evidence-based guideline recommendations to implementation: a case study from an upper-middle income country on the GRADE approach

PubMed Central

Mosquera, Paola; Alzate, Juan Pablo; Pottie, Kevin; Welch, Vivian; Akl, Elie A; Jull, Janet; Lang, Eddy; Katikireddi, Srinivasa Vittal; Morton, Rachel; Thabane, Lehana; Shea, Bev; Stein, Airton T; Singh, Jasvinder; Florez, Ivan D; Guyatt, Gordon; Schünemann, Holger; Tugwell, Peter

2017-01-01

Abstract The availability of evidence-based guidelines does not ensure their implementation and use in clinical practice or policy making. Inequities in health have been defined as those inequalities within or between populations that are avoidable, unnecessary and also unjust and unfair. Evidence-based clinical practice and public health guidelines (‘guidelines’) can be used to target health inequities experienced by disadvantaged populations, although guidelines may unintentionally increase health inequities. For this reason, there is a need for evidence-based clinical practice and public health guidelines to intentionally target health inequities experienced by disadvantaged populations. Current guideline development processes do not include steps for planned implementation of equity-focused guidelines. This article describes nine steps that provide guidance for consideration of equity during guideline implementation. A critical appraisal of the literature followed by a process to build expert consensus was undertaken to define how to include consideration of equity issues during the specific GRADE guideline development process. Using a case study from Colombia we describe nine steps that were used to implement equity-focused GRADE recommendations: (1) identification of disadvantaged groups, (2) quantification of current health inequities, (3) development of equity-sensitive recommendations, (4) identification of key actors for implementation of equity-focused recommendations, (5) identification of barriers and facilitators to the implementation of equity-focused recommendations, (6) development of an equity strategy to be included in the implementation plan, (7) assessment of resources and incentives, (8) development of a communication strategy to support an equity focus and (9) development of monitoring and evaluation strategies. This case study can be used as model for implementing clinical practice guidelines, taking into account equity issues during guideline development and implementation. PMID:29029068

A process evaluation of implementing a vocational enablement protocol for employees with hearing difficulties in clinical practice.

PubMed

Gussenhoven, Arjenne H M; Singh, Amika S; Goverts, S Theo; van Til, Marten; Anema, Johannes R; Kramer, Sophia E

2015-08-01

A multidisciplinary vocational rehabilitation programme, the Vocational Enablement Protocol (VEP) was developed to address the specific needs of employees with hearing difficulties. In the current study we evaluated the process of implementing the VEP in audiologic care among employees with hearing impairment. In conjunction with a randomized controlled trial, we collected and analysed data on seven process parameters: recruitment, reach, fidelity, dose delivered, dose received and implemented, satisfaction, and perceived benefit. Sixty-six employees with hearing impairment participated in the VEP. The multidisciplinary team providing the VEP comprised six professionals. The professionals performed the VEP according to the protocol. Of the recommendations delivered by the professionals, 31% were perceived as implemented by the employees. Compliance rate was highest for hearing-aid uptake (51%). Both employees and professionals were highly satisfied with the VEP. Participants rated good perceived benefit from it. Our results indicate that the VEP could be a useful treatment for employees with hearing difficulties from a process evaluation perspective. Implementation research in the audiological setting should be encouraged in order to further provide insight into parameters facilitating or hindering successful implementation of an intervention and to improve its quality and efficacy.

Implementation and evaluation of critical thinking strategies to enhance critical thinking skills in Middle Eastern nurses.

PubMed

Simpson, Elaine; Courtney, Mary

2008-12-01

The purpose of this study was to develop, implement and evaluate critical thinking strategies to enhance critical thinking skills in Middle Eastern nurses. Critical thinking strategies such as questioning, debate, role play and small group activity were developed and used in a professional development programme, which was trialled on a sample of Middle Eastern nurses (n = 20), to promote critical thinking skills, encourage problem solving, development of clinical judgment making and care prioritization in order to improve patient care and outcomes. Classroom learning was transformed from memorization to interaction and active participation. The intervention programme was successful in developing critical thinking skills in both the nurse educators and student nurses in this programme. This programme successfully integrated critical thinking strategies into a Middle Eastern nursing curriculum. Recommendations are as follows: (1) utilize evidence-based practice and stem questions to encourage the formulation of critical thinking questions; (2) support the needs of nurse educators for them to effectively implement teaching strategies to foster critical thinking skills; and (3) adopt creative approaches to (i) transform students into interactive participants and (ii) open students' minds and stimulate higher-level thinking and problem-solving abilities.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

PubMed

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic sensitivities, classroom management challenges, and fitting new programs into already busy school schedules. Overall, the program content and individual lessons were well received by the teachers and students. The lessons learned from the development, implementation and evaluation of this program can provide health professionals with key pedagogical strategies for designing culturally responsive educational programs. Culturally responsive programs are critical for ensuring interventions are effective for their specific context.

Agile Implementation: A Blueprint for Implementing Evidence-Based Healthcare Solutions.

PubMed

Boustani, Malaz; Alder, Catherine A; Solid, Craig A

2018-03-07

To describe the essential components of an Agile Implementation (AI) process, which rapidly and effectively implements evidence-based healthcare solutions, and present a case study demonstrating its utility. Case demonstration study. Integrated, safety net healthcare delivery system in Indianapolis. Interdisciplinary team of clinicians and administrators. Reduction in dementia symptoms and caregiver burden; inpatient and outpatient care expenditures. Implementation scientists were able to implement a collaborative care model for dementia care and sustain it for more than 9 years. The model was implemented and sustained by using the elements of the AI process: proactive surveillance and confirmation of clinical opportunities, selection of the right evidence-based healthcare solution, localization (i.e., tailoring to the local environment) of the selected solution, development of an evaluation plan and performance feedback loop, development of a minimally standardized operation manual, and updating such manual annually. The AI process provides an effective model to implement and sustain evidence-based healthcare solutions. © 2018, Copyright the Authors Journal compilation © 2018, The American Geriatrics Society.

Research and Application of an Air Quality Early Warning System Based on a Modified Least Squares Support Vector Machine and a Cloud Model.

PubMed

Wang, Jianzhou; Niu, Tong; Wang, Rui

2017-03-02

The worsening atmospheric pollution increases the necessity of air quality early warning systems (EWSs). Despite the fact that a massive amount of investigation about EWS in theory and practicality has been conducted by numerous researchers, studies concerning the quantification of uncertain information and comprehensive evaluation are still lacking, which impedes further development in the area. In this paper, firstly a comprehensive warning system is proposed, which consists of two vital indispensable modules, namely effective forecasting and scientific evaluation, respectively. For the forecasting module, a novel hybrid model combining the theory of data preprocessing and numerical optimization is first developed to implement effective forecasting for air pollutant concentration. Especially, in order to further enhance the accuracy and robustness of the warning system, interval forecasting is implemented to quantify the uncertainties generated by forecasts, which can provide significant risk signals by using point forecasting for decision-makers. For the evaluation module, a cloud model, based on probability and fuzzy set theory, is developed to perform comprehensive evaluations of air quality, which can realize the transformation between qualitative concept and quantitative data. To verify the effectiveness and efficiency of the warning system, extensive simulations based on air pollutants data from Dalian in China were effectively implemented, which illustrate that the warning system is not only remarkably high-performance, but also widely applicable.

Research and Application of an Air Quality Early Warning System Based on a Modified Least Squares Support Vector Machine and a Cloud Model

PubMed Central

Wang, Jianzhou; Niu, Tong; Wang, Rui

2017-01-01

The worsening atmospheric pollution increases the necessity of air quality early warning systems (EWSs). Despite the fact that a massive amount of investigation about EWS in theory and practicality has been conducted by numerous researchers, studies concerning the quantification of uncertain information and comprehensive evaluation are still lacking, which impedes further development in the area. In this paper, firstly a comprehensive warning system is proposed, which consists of two vital indispensable modules, namely effective forecasting and scientific evaluation, respectively. For the forecasting module, a novel hybrid model combining the theory of data preprocessing and numerical optimization is first developed to implement effective forecasting for air pollutant concentration. Especially, in order to further enhance the accuracy and robustness of the warning system, interval forecasting is implemented to quantify the uncertainties generated by forecasts, which can provide significant risk signals by using point forecasting for decision-makers. For the evaluation module, a cloud model, based on probability and fuzzy set theory, is developed to perform comprehensive evaluations of air quality, which can realize the transformation between qualitative concept and quantitative data. To verify the effectiveness and efficiency of the warning system, extensive simulations based on air pollutants data from Dalian in China were effectively implemented, which illustrate that the warning system is not only remarkably high-performance, but also widely applicable. PMID:28257122

[Implementation of the National Expert Standard Prophylaxis of Pressure Ulcers in nurse practise - a cost-benefit analysis].

PubMed

Wolke, R; Hennings, D; Scheu, P

2007-06-01

By developing evidence-based, national Expert Standards, agreed-upon by an association of nursing professionals, the German Care Science participates in the international discussion. Up to now, five National Expert Standards on relevant care-related topics have been developed and have been widely implemented in Care Practice. However, sufficient evaluations of these Expert Standards are still required, especially from an economic perspective. The following paper addresses this topic by performing a cost-benefit analysis for the National Expert Standard Prophylaxis of Pressure Ulcers. The authors demonstrate which costs are caused by the implementation of this National Expert Standard for a residential care agency providing services. The benefit of the implementation of the Expert Standard is then being compared to its cost for a period of three years. The evaluation concludes that, in consideration of opportunity costs, the introduction of the National Expert Standard Prophylaxis of Pressure Ulcers appears economically viable for the residential care agency only if the rate of pressure ulcers in the reference agency can be lowered at least by 26.48%. In this case, when exclusively considering direct benefits and direct costs, a positive impact of the implementation will be achieved.