Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

PubMed

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Evaluation readiness: improved evaluation planning using a data inventory framework.

PubMed

Cohen, A B; Hall, K C; Cohodes, D R

1985-01-01

Factors intrinsic to many programs, such as ambiguously stated objectives, inadequately defined performance measures, and incomplete or unreliable databases, often conspire to limit the evaluability of these programs. Current evaluation planning approaches are somewhat constrained in their ability to overcome these obstacles and to achieve full preparedness for evaluation. In this paper, the concept of evaluation readiness is introduced as a complement to other evaluation planning approaches, most notably that of evaluability assessment. The basic products of evaluation readiness--the formal program definition and the data inventory framework--are described, along with a guide for assuring more timely and appropriate evaluation response capability to support the decision making needs of program managers. The utility of evaluation readiness for program planning, as well as for effective management, is also discussed.

Evaluating Comprehensive State Tobacco Prevention and Control Programs Using an Outcome Indicator Framework.

PubMed

Fulmer, Erika; Rogers, Todd; Glasgow, LaShawn; Brown, Susan; Kuiper, Nicole

2018-03-01

The outcome indicator framework helps tobacco prevention and control programs (TCPs) plan and implement theory-driven evaluations of their efforts to reduce and prevent tobacco use. Tobacco use is the single-most preventable cause of morbidity and mortality in the United States. The implementation of public health best practices by comprehensive state TCPs has been shown to prevent the initiation of tobacco use, reduce tobacco use prevalence, and decrease tobacco-related health care expenditures. Achieving and sustaining program goals require TCPs to evaluate the effectiveness and impact of their programs. To guide evaluation efforts by TCPs, the Centers for Disease Control and Prevention's Office on Smoking and Health developed an outcome indicator framework that includes a high-level logic model and evidence-based outcome indicators for each tobacco prevention and control goal area. In this article, we describe how TCPs and other community organizations can use the outcome indicator framework in their evaluation efforts. We also discuss how the framework is used at the national level to unify tobacco prevention and control efforts across varying state contexts, identify promising practices, and expand the public health evidence base.

Evaluating a Blended Degree Program through the Use of the NSSE Framework

ERIC Educational Resources Information Center

Vaughan, Norman; Cloutier, David

2017-01-01

The purpose of this student-faculty partnership research study was to evaluate the effectiveness of a blended four-year Bachelor of Education Elementary Program at a Canadian university using the National Survey of Student Engagement (NSSE) framework. Data was collected from the first graduating cohort of students from the B.Ed. program in…

Promoting Excellence in Nursing Education (PENE): Pross evaluation model.

PubMed

Pross, Elizabeth A

2010-08-01

The purpose of this article is to examine the Promoting Excellence in Nursing Education (PENE) Pross evaluation model. A conceptual evaluation model, such as the one described here, may be useful to nurse academicians in the ongoing evaluation of educational programs, especially those with goals of excellence. Frameworks for evaluating nursing programs are necessary because they offer a way to systematically assess the educational effectiveness of complex nursing programs. This article describes the conceptual framework and its tenets of excellence. Copyright 2009 Elsevier Ltd. All rights reserved.

Using developmental evaluation as a system of organizational learning: An example from San Francisco.

PubMed

Shea, Jennifer; Taylor, Tory

2017-12-01

In the last 20 years, developmental evaluation has emerged as a promising approach to support organizational learning in emergent social programs. Through a continuous system of inquiry, reflection, and application of knowledge, developmental evaluation serves as a system of tools, methods, and guiding principles intended to support constructive organizational learning. However, missing from the developmental evaluation literature is a nuanced framework to guide evaluators in how to elevate the organizational practices and concepts most relevant for emergent programs. In this article, we describe and reflect on work we did to develop, pilot, and refine an integrated pilot framework. Drawing on established developmental evaluation inquiry frameworks and incorporating lessons learned from applying the pilot framework, we put forward the Evaluation-led Learning framework to help fill that gap and encourage others to implement and refine it. We posit that without explicitly incorporating the assessments at the foundation of the Evaluation-led Learning framework, developmental evaluation's ability to affect organizational learning in productive ways will likely be haphazard and limited. Copyright © 2017 Elsevier Ltd. All rights reserved.

Educational Evaluation: Key Characteristics. ACER Research Series No. 102.

ERIC Educational Resources Information Center

Maling-Keepes, Jillian

A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…

Steps towards incorporating heterogeneities into program theory: A case study of a data-driven approach.

PubMed

Sridharan, Sanjeev; Jones, Bobby; Caudill, Barry; Nakaima, April

2016-10-01

This paper describes a framework that can help refine program theory through data explorations and stakeholder dialogue. The framework incorporates the following steps: a recognition that program implementation might need to be multi-phased for a number of interventions, the need to take stock of program theory, the application of pattern recognition methods to help identify heterogeneous program mechanisms, and stakeholder dialogue to refine the program. As part of the data exploration, a method known as developmental trajectories is implemented to learn about heterogeneous trajectories of outcomes in longitudinal evaluations. This method identifies trajectory clusters and also can estimate different treatment impacts for the various groups. The framework is highlighted with data collected in an evaluation of an alcohol risk-reduction program delivered in a college fraternity setting. The framework discussed in the paper is informed by a realist focus on "what works for whom under what contexts." The utility of the framework in contributing to a dialogue on heterogeneous mechanism and subsequent implementation is described. The connection of the ideas in paper to a 'learning through principled discovery' approach is also described. Copyright © 2016. Published by Elsevier Ltd.

Public health program capacity for sustainability: a new framework.

PubMed

Schell, Sarah F; Luke, Douglas A; Schooley, Michael W; Elliott, Michael B; Herbers, Stephanie H; Mueller, Nancy B; Bunger, Alicia C

2013-02-01

Public health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health. This developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention). The literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program's capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity-89% of the individual items composing the framework had specific support in the sustainability literature. The sustainability framework presented here suggests that a number of selected factors may be related to a program's ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing and implementing prevention and intervention programs. The sustainability framework will be useful for public health decision makers, program managers, program evaluators, and dissemination and implementation researchers.

Collaborative Evaluation within a Framework of Stakeholder-Oriented Evaluation Approaches

ERIC Educational Resources Information Center

O'Sullivan, Rita G.

2012-01-01

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

An Overview of the National Nutrition Education and Training Program Evaluation.

ERIC Educational Resources Information Center

St. Pierre, Robert G.; Rezmovic, Victor

1982-01-01

Presents the organizing framework used in evaluating the National Nutrition Education and Training Program (NET) and summarizes the descriptive, evaluative, and meta-evaluative findings. Concludes that positive effects on children's nutrition-related knowledge have resulted from different nutrition education programs. (DC)

Introducing an accountability framework for polio eradication in Ethiopia: results from the first year of implementation 2014-2015

PubMed Central

Kassahun, Aron; Braka, Fiona; Gallagher, Kathleen; Gebriel, Aregai Wolde; Nsubuga, Peter; M’pele-Kilebou, Pierre

2017-01-01

Introduction the World Health Organization (WHO), Ethiopia country office, introduced an accountability framework into its Polio Eradication Program in 2014 with the aim of improving the program's performance. Our study aims to evaluate staff performance and key program indicators following the introduction of the accountability framework. Methods the impact of the WHO accountability framework was reviewed after its first year of implementation from June 2014 to June 2015. We analyzed selected program and staff performance indicators associated with acute flaccid paralysis (AFP) surveillance from a database available at WHO. Data on managerial actions taken were also reviewed. Performance of a total of 38 staff was evaluated during our review. Results our review of results for the first four quarters of implementation of the polio eradication accountability framework showed improvement both at the program and individual level when compared with the previous year. Managerial actions taken during the study period based on the results from the monitoring tool included eleven written acknowledgments, six discussions regarding performance improvement, six rotations of staff, four written first-warning letters and nine non-renewal of contracts. Conclusion the introduction of the accountability framework resulted in improvement in staff performance and overall program indicators for AFP surveillance. PMID:28890753

A Framework of Operating Models for Interdisciplinary Research Programs in Clinical Service Organizations

ERIC Educational Resources Information Center

King, Gillian; Currie, Melissa; Smith, Linda; Servais, Michelle; McDougall, Janette

2008-01-01

A framework of operating models for interdisciplinary research programs in clinical service organizations is presented, consisting of a "clinician-researcher" skill development model, a program evaluation model, a researcher-led knowledge generation model, and a knowledge conduit model. Together, these models comprise a tailored, collaborative…

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Public health program capacity for sustainability: a new framework

PubMed Central

2013-01-01

Background Public health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health. Methods This developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention). Results The literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program’s capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity—89% of the individual items composing the framework had specific support in the sustainability literature. Conclusions The sustainability framework presented here suggests that a number of selected factors may be related to a program’s ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing and implementing prevention and intervention programs. The sustainability framework will be useful for public health decision makers, program managers, program evaluators, and dissemination and implementation researchers. PMID:23375082

Lights, Camera, Action: Advancing Learning, Research, and Program Evaluation through Video Production in Educational Leadership Preparation

ERIC Educational Resources Information Center

Friend, Jennifer; Militello, Matthew

2015-01-01

This article analyzes specific uses of digital video production in the field of educational leadership preparation, advancing a three-part framework that includes the use of video in (a) teaching and learning, (b) research methods, and (c) program evaluation and service to the profession. The first category within the framework examines videos…

Monitoring and evaluation framework for hypertension programs. A collaboration between the Pan American Health Organization and World Hypertension League.

PubMed

Campbell, Norm R C; Ordunez, Pedro; DiPette, Donald J; Giraldo, Gloria P; Angell, Sonia Y; Jaffe, Marc G; Lackland, Dan; Martinez, Ramón; Valdez, Yamilé; Maldonado Figueredo, Javier I; Paccot, Melanie; Santana, Maria J; Whelton, Paul K

2018-06-01

The Pan American Health Organization (PAHO)-World Hypertension League (WHL) Hypertension Monitoring and Evaluation Framework is summarized. Standardized indicators are provided for monitoring and evaluating national or subnational hypertension control programs. Five core indicators from the World Health Organization hearts initiative and a single PAHO-WHL core indicator are recommended to be used in all hypertension control programs. In addition, hypertension control programs are encouraged to select from 14 optional qualitative and 33 quantitative indicators to facilitate progress towards enhanced hypertension control. The intention is for hypertension programs to select quantitative indicators based on the current surveillance mechanisms that are available and what is feasible and to use the framework process indicators as a guide to program management. Programs may wish to increase or refine the number of indicators they use over time. With adaption the indicators can also be implemented at a community or clinic level. The standardized indicators are being pilot tested in Cuba, Colombia, Chile, and Barbados. ©2018 Wiley Periodicals, Inc.

Developing a curriculum framework for global health in family medicine: emerging principles, competencies, and educational approaches.

PubMed

Redwood-Campbell, Lynda; Pakes, Barry; Rouleau, Katherine; MacDonald, Colla J; Arya, Neil; Purkey, Eva; Schultz, Karen; Dhatt, Reena; Wilson, Briana; Hadi, Abdullahel; Pottie, Kevin

2011-07-22

Recognizing the growing demand from medical students and residents for more comprehensive global health training, and the paucity of explicit curricula on such issues, global health and curriculum experts from the six Ontario Family Medicine Residency Programs worked together to design a framework for global health curricula in family medicine training programs. A working group comprised of global health educators from Ontario's six medical schools conducted a scoping review of global health curricula, competencies, and pedagogical approaches. The working group then hosted a full day meeting, inviting experts in education, clinical care, family medicine and public health, and developed a consensus process and draft framework to design global health curricula. Through a series of weekly teleconferences over the next six months, the framework was revised and used to guide the identification of enabling global health competencies (behaviours, skills and attitudes) for Canadian Family Medicine training. The main outcome was an evidence-informed interactive framework http://globalhealth.ennovativesolution.com/ to provide a shared foundation to guide the design, delivery and evaluation of global health education programs for Ontario's family medicine residency programs. The curriculum framework blended a definition and mission for global health training, core values and principles, global health competencies aligning with the Canadian Medical Education Directives for Specialists (CanMEDS) competencies, and key learning approaches. The framework guided the development of subsequent enabling competencies. The shared curriculum framework can support the design, delivery and evaluation of global health curriculum in Canada and around the world, lay the foundation for research and development, provide consistency across programmes, and support the creation of learning and evaluation tools to align with the framework. The process used to develop this framework can be applied to other aspects of residency curriculum development.

Developing a curriculum framework for global health in family medicine: emerging principles, competencies, and educational approaches

PubMed Central

2011-01-01

Background Recognizing the growing demand from medical students and residents for more comprehensive global health training, and the paucity of explicit curricula on such issues, global health and curriculum experts from the six Ontario Family Medicine Residency Programs worked together to design a framework for global health curricula in family medicine training programs. Methods A working group comprised of global health educators from Ontario's six medical schools conducted a scoping review of global health curricula, competencies, and pedagogical approaches. The working group then hosted a full day meeting, inviting experts in education, clinical care, family medicine and public health, and developed a consensus process and draft framework to design global health curricula. Through a series of weekly teleconferences over the next six months, the framework was revised and used to guide the identification of enabling global health competencies (behaviours, skills and attitudes) for Canadian Family Medicine training. Results The main outcome was an evidence-informed interactive framework http://globalhealth.ennovativesolution.com/ to provide a shared foundation to guide the design, delivery and evaluation of global health education programs for Ontario's family medicine residency programs. The curriculum framework blended a definition and mission for global health training, core values and principles, global health competencies aligning with the Canadian Medical Education Directives for Specialists (CanMEDS) competencies, and key learning approaches. The framework guided the development of subsequent enabling competencies. Conclusions The shared curriculum framework can support the design, delivery and evaluation of global health curriculum in Canada and around the world, lay the foundation for research and development, provide consistency across programmes, and support the creation of learning and evaluation tools to align with the framework. The process used to develop this framework can be applied to other aspects of residency curriculum development. PMID:21781319

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

NASA Astrophysics Data System (ADS)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

Evaluating Intervention Programs Targeting Parents to Manage Childhood Overweight and Obesity: A Systematic Review Using the RE-AIM Framework.

PubMed

Jang, Myoungock; Chao, Ariana; Whittemore, Robin

2015-01-01

Intervention programs targeting parents to manage childhood overweight and obesity have emerged based on parents influence on the health behaviors of their children. The purpose of this review was to systematically evaluate intervention programs targeting parents to manage childhood overweight and obesity using the Reach, Efficacy, Adopt, Implementation, and Maintenance (RE-AIM) framework. There was a moderate risk of bias across all studies. The overall proportion of studies (n=7) reporting on each dimension of the RE-AIM framework ranged from 78.6% (reach) to 23.8% (maintenance). The majority of intervention programs demonstrated improvement in child BMI. However intervention programs did not reach families of diverse race/ethnicity, were provided by highly trained professionals, and demonstrated high attrition, thus limiting generalizability. Copyright © 2015 Elsevier Inc. All rights reserved.

SEE Action Guide for States: Evaluation, Measurement, and Verification Frameworks$-$Guidance for Energy Efficiency Portfolios Funded by Utility Customers

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Michael; Dietsch, Niko

2018-01-01

This guide describes frameworks for evaluation, measurement, and verification (EM&V) of utility customer–funded energy efficiency programs. The authors reviewed multiple frameworks across the United States and gathered input from experts to prepare this guide. This guide provides the reader with both the contents of an EM&V framework, along with the processes used to develop and update these frameworks.

First Destination Transportation Study

DTIC Science & Technology

1978-03-03

avoidance potentials on a daily procurement basis. A "total" sys- tematic cost evaluation program, including specific de - cision rules needed on an...implementation priority :x needed. The rec- ommended priority is as follows: [ (1) Develop improved system management concepts that will "form the framework ...priority as it provides the overall framework for better system management. Cost evaluation and CCSS Enhancement Programs deserve next consideration, as

Urban Partnership Agreement and Congestion Reduction Demonstration : National Evaluation Framework

DOT National Transportation Integrated Search

2008-11-21

This report provides an analytical framework for evaluating six deployments under the United States Department of Transportation (U.S. DOT) Urban Partnership Agreement (UPA) and Congestion Reduction Demonstration (CRD) Programs. The six UPA/CRD sites...

The Use of the Data-to-Action Framework in the Evaluation of CDC's DELTA FOCUS Program.

PubMed

Armstead, Theresa L; Kearns, Megan; Rambo, Kirsten; Estefan, Lianne Fuino; Dills, Jenny; Rivera, Moira S; El-Beshti, Rasha

The Centers for Disease Control and Prevention's (CDC's) Domestic Violence Prevention Enhancements and Leadership Through Alliances, Focusing on Outcomes for Communities United with States (DELTA FOCUS) program is a 5-year cooperative agreement (2013-2018) funding 10 state domestic violence coalitions and local coordinated community response teams to engage in primary prevention of intimate partner violence. Grantees' prevention strategies were often developmental and emergent; therefore, CDC's approach to program oversight, administration, and support to grantees required a flexible approach. CDC staff adopted a Data-to-Action Framework for the DELTA FOCUS program evaluation that supported a culture of learning to meet dynamic and unexpected information needs. Briefly, a Data-to-Action Framework involves the collection and use of information in real time for program improvement. Utilizing this framework, the DELTA FOCUS data-to-action process yielded important insights into CDC's ongoing technical assistance, improved program accountability by providing useful materials, and information for internal agency leadership, and helped build a learning community among grantees. CDC and other funders, as decision makers, can promote program improvements that are data-informed by incorporating internal processes supportive of ongoing data collection and review.

Using RUFDATA to guide a logic model for a quality assurance process in an undergraduate university program.

PubMed

Sherman, Paul David

2016-04-01

This article presents a framework to identify key mechanisms for developing a logic model blueprint that can be used for an impending comprehensive evaluation of an undergraduate degree program in a Canadian university. The evaluation is a requirement of a comprehensive quality assurance process mandated by the university. A modified RUFDATA (Saunders, 2000) evaluation model is applied as an initiating framework to assist in decision making to provide a guide for conceptualizing a logic model for the quality assurance process. This article will show how an educational evaluation is strengthened by employing a RUFDATA reflective process in exploring key elements of the evaluation process, and then translating this information into a logic model format that could serve to offer a more focussed pathway for the quality assurance activities. Using preliminary program evaluation data from two key stakeholders of the undergraduate program as well as an audit of the curriculum's course syllabi, a case is made for, (1) the importance of inclusivity of key stakeholders participation in the design of the evaluation process to enrich the authenticity and accuracy of program participants' feedback, and (2) the diversification of data collection methods to ensure that stakeholders' narrative feedback is given ample exposure. It is suggested that the modified RUFDATA/logic model framework be applied to all academic programs at the university undergoing the quality assurance process at the same time so that economies of scale may be realized. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Contextual Factors Framework to Inform Implementation and Evaluation of Public Health Initiatives

ERIC Educational Resources Information Center

Vanderkruik, Rachel; McPherson, Marianne E.

2017-01-01

Evaluating initiatives implemented across multiple settings can elucidate how various contextual factors may influence both implementation and outcomes. Understanding context is especially critical when the same program has varying levels of success across settings. We present a framework for evaluating contextual factors affecting an initiative…

Formative Evaluation of the No-Fee Teacher Education Program from the Students' Standpoint

ERIC Educational Resources Information Center

Han, Yumei; Hu, Meizhong; Li, Ling

2013-01-01

This exploratory case study applied a formative evaluation framework to evaluate the no-fee teacher education program at Southwest University. The study focused on the students' perspective and their perceptions of the program, both intrinsic and extrinsic. A self-evaluation checklist and a questionnaire were the instruments used to collect data.…

Science-based Framework for Environmental Benefits Assessment

DTIC Science & Technology

2013-03-01

ER D C/ EL T R -1 3 -4 Environmental Benefits Analysis Program Science-based Framework for Environmental Benefits Assessment E nv ir...acwc.sdp.sirsi.net/client/default. Environmental Benefits Analysis Program ERDC/EL TR-13-4 March 2013 Science-based Framework for Environmental Benefits ...evaluating ecosystem restoration benefits within the context of USACE Civil Works planning process. An emphasis is placed on knowledge gained from

Logic Modeling as a Tool to Prepare to Evaluate Disaster and Emergency Preparedness, Response, and Recovery in Schools

ERIC Educational Resources Information Center

Zantal-Wiener, Kathy; Horwood, Thomas J.

2010-01-01

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

Evaluation Framework for NASA's Educational Outreach Programs

NASA Technical Reports Server (NTRS)

Berg, Rick; Booker, Angela; Linde, Charlotte; Preston, Connie

1999-01-01

The objective of the proposed work is to develop an evaluation framework for NASA's educational outreach efforts. We focus on public (rather than technical or scientific) dissemination efforts, specifically on Internet-based outreach sites for children.The outcome of this work is to propose both methods and criteria for evaluation, which would enable NASA to do a more analytic evaluation of its outreach efforts. The proposed framework is based on IRL's ethnographic and video-based observational methods, which allow us to analyze how these sites are actually used.

Healing by Creating: Patient Evaluations of Art-Making Program

ERIC Educational Resources Information Center

Heiney, Sue P.; Darr-Hope, Heidi; Meriwether, Marian P.; Adams, Swann Arp

2017-01-01

The benefits of using art in health care, especially with cancer patients, have been described anecdotally. However, few manuscripts include a conceptual framework to describe the evaluation of patient programs. This paper describes patients' evaluation of a healing arts program developed within a hospital for cancer patients that used art-making,…

Evaluation Capacity in K-12 School Counseling Programs.

ERIC Educational Resources Information Center

Trevisan, Michael S.

2002-01-01

Presents results of a literature review, organized the Milstein and Cotton evaluation capacity (B. Milstein and D. Cotton, 2000) framework, detailing and analyzing the contextual factors and system features that impact the evaluation capacity of school counseling programs. Discusses implications for evaluation in other settings. (SLD)

High Impact Anti-Crime Program: A Framework for Assessing Project-Level Evaluation Plans.

ERIC Educational Resources Information Center

Kupersmith, Gerrie

The pamphlet describes an evaluation model for crime reduction projects developed by National Institute of Law Enforcement and Criminal Justice sponsored research. It is meant to assist justice agency and project managers in determining completeness of evaluation planning by providing a framework against which to measure their evaluation…

Rigorous Measures of Implementation: A Methodological Framework for Evaluating Innovative STEM Programs

ERIC Educational Resources Information Center

Cassata-Widera, Amy; Century, Jeanne; Kim, Dae Y.

2011-01-01

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

Doctor coach: a deliberate practice approach to teaching and learning clinical skills.

PubMed

Gifford, Kimberly A; Fall, Leslie H

2014-02-01

The rapidly evolving medical education landscape requires restructuring the approach to teaching and learning across the continuum of medical education. The deliberate practice strategies used to coach learners in disciplines beyond medicine can also be used to train medical learners. However, these deliberate practice strategies are not explicitly taught in most medical schools or residencies. The authors designed the Doctor Coach framework and competencies in 2007-2008 to serve as the foundation for new faculty development and resident-as-teacher programs. In addition to teaching deliberate practice strategies, the programs model a deliberate practice approach that promotes the continuous integration of newly developed coaching competencies by participants into their daily teaching practice. Early evaluation demonstrated the feasibility and efficacy of implementing the Doctor Coach framework across the continuum of medical education. Additionally, the Doctor Coach framework has been disseminated through national workshops, which have resulted in additional institutions applying the framework and competencies to develop their own coaching programs. Design of a multisource evaluation tool based on the coaching competencies will enable more rigorous study of the Doctor Coach framework and training programs and provide a richer feedback mechanism for participants. The framework will also facilitate the faculty development needed to implement the milestones and entrustable professional activities in medical education.

Using the RE-AIM framework to evaluate physical activity public health programs in México.

PubMed

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

Using a Mixed-Methods RE-AIM Framework to Evaluate Community Health Programs for Older Latinas.

PubMed

Schwingel, Andiara; Gálvez, Patricia; Linares, Deborah; Sebastião, Emerson

2017-06-01

This study used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate a promotora-led community health program designed for Latinas ages 50 and older that sought to improve physical activity, nutrition, and stress management. A mixed-methods evaluation approach was administered at participant and organizational levels with a focus on the efficacy, adoption, implementation, and maintenance components of the RE-AIM theoretical model. The program was shown to be effective at improving participants' eating behaviors, increasing their physical activity levels, and lowering their depressive symptoms. Promotoras felt motivated and sufficiently prepared to deliver the program. Some implementation challenges were reported. More child care opportunities and an increased focus on mental well-being were suggested. The promotora delivery model has promise for program sustainability with both promotoras and participants alike expressing interest in leading future programs.

Evaluating International Research Ethics Capacity Development: An Empirical Approach

PubMed Central

Ali, Joseph; Kass, Nancy E.; Sewankambo, Nelson K.; White, Tara D.; Hyder, Adnan A.

2014-01-01

The US National Institutes of health, Fogarty International Center (NIH-FIC) has, for the past 13 years, been a leading funder of international research ethics education for resource-limited settings. Nearly half of the NIH-FIC funding in this area has gone to training programs that train individuals from sub-Saharan Africa. Identifying the impact of training investments, as well as the potential predictors of post-training success, can support curricular decision-making, help establish funding priorities, and recognize the ultimate outcomes of trainees and training programs. Comprehensive evaluation frameworks and targeted evaluation tools for bioethics training programs generally, and for international research ethics programs in particular, are largely absent from published literature. This paper shares an original conceptual framework, data collection tool, and detailed methods for evaluating the inputs, processes, outputs, and outcomes of research ethics training programs serving individuals in resource-limited settings. This paper is part of a collection of papers analyzing the Fogarty International Center’s International Research Ethics Education and Curriculum Development program. PMID:24782071

Introduction of new technologies and decision making processes: a framework to adapt a Local Health Technology Decision Support Program for other local settings.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Poulin, Michelle; Gall, Nadine; Seidel, Judy; Lafrenière, René

2013-01-01

Introducing new health technologies, including medical devices, into a local setting in a safe, effective, and transparent manner is a complex process, involving many disciplines and players within an organization. Decision making should be systematic, consistent, and transparent. It should involve translating and integrating scientific evidence, such as health technology assessment (HTA) reports, with context-sensitive evidence to develop recommendations on whether and under what conditions a new technology will be introduced. However, the development of a program to support such decision making can require considerable time and resources. An alternative is to adapt a preexisting program to the new setting. We describe a framework for adapting the Local HTA Decision Support Program, originally developed by the Department of Surgery and Surgical Services (Calgary, AB, Canada), for use by other departments. The framework consists of six steps: 1) development of a program review and adaptation manual, 2) education and readiness assessment of interested departments, 3) evaluation of the program by individual departments, 4) joint evaluation via retreats, 5) synthesis of feedback and program revision, and 6) evaluation of the adaptation process. Nine departments revised the Local HTA Decision Support Program and expressed strong satisfaction with the adaptation process. Key elements for success were identified. Adaptation of a preexisting program may reduce duplication of effort, save resources, raise the health care providers' awareness of HTA, and foster constructive stakeholder engagement, which enhances the legitimacy of evidence-informed recommendations for introducing new health technologies. We encourage others to use this framework for program adaptation and to report their experiences.

Along the way to developing a theory of the program: a re-examination of the conceptual framework as an organizing strategy.

PubMed

Helitzer, Deborah L; Sussman, Andrew L; Hoffman, Richard M; Getrich, Christina M; Warner, Teddy D; Rhyne, Robert L

2014-08-01

Conceptual frameworks (CF) have historically been used to develop program theory. We re-examine the literature about the role of CF in this context, specifically how they can be used to create descriptive and prescriptive theories, as building blocks for a program theory. Using a case example of colorectal cancer screening intervention development, we describe the process of developing our initial CF, the methods used to explore the constructs in the framework and revise the framework for intervention development. We present seven steps that guided the development of our CF: (1) assemble the "right" research team, (2) incorporate existing literature into the emerging CF, (3) construct the conceptual framework, (4) diagram the framework, (5) operationalize the framework: develop the research design and measures, (6) conduct the research, and (7) revise the framework. A revised conceptual framework depicted more complicated inter-relationships of the different predisposing, enabling, reinforcing, and system-based factors. The updated framework led us to generate program theory and serves as the basis for designing future intervention studies and outcome evaluations. A CF can build a foundation for program theory. We provide a set of concrete steps and lessons learned to assist practitioners in developing a CF. Copyright © 2014 Elsevier Ltd. All rights reserved.

An innovative strategy in evaluation: using a student engagement framework to evaluate a role-based simulation.

PubMed

Smith, Morgan; Warland, Jane; Smith, Colleen

2012-03-01

Online role-play has the potential to actively engage students in authentic learning experiences and help develop their clinical reasoning skills. However, evaluation of student learning for this kind of simulation focuses mainly on the content and outcome of learning, rather than on the process of learning through student engagement. This article reports on the use of a student engagement framework to evaluate an online role-play offered as part of a course in Bachelor of Nursing and Bachelor of Midwifery programs. Instruments that measure student engagement to date have targeted large numbers of students at program and institutional levels, rather than at the level of a specific learning activity. Although the framework produced some useful findings for evaluation purposes, further refinement of the questions is required to be certain that deep learning results from the engagement that occurs with course-level learning initiatives. Copyright 2012, SLACK Incorporated.

Diversity training for the community aged care workers: A conceptual framework for evaluation.

PubMed

Appannah, Arti; Meyer, Claudia; Ogrin, Rajna; McMillan, Sally; Barrett, Elizabeth; Browning, Colette

2017-08-01

Older Australians are an increasingly diverse population, with variable characteristics such as culture, sexual orientation, socioeconomic status, and physical capabilities potentially influencing their participation in healthcare. In response, community aged care workers may need to increase skills and uptake of knowledge into practice regarding diversity through appropriate training interventions. Diversity training (DT) programs have traditionally existed in the realm of business, with little research attention devoted to scientifically evaluating the outcomes of training directed at community aged care workers. A DT workshop has been developed for community aged care workers, and this paper focuses on the construction of a formative evaluative framework for the workshop. Key evaluation concepts and measures relating to DT have been identified in the literature and integrated into the framework, focusing on five categories: Training needs analysis; Reactions; Learning outcomes, Behavioural outcomes and Results The use of a mixed methods approach in the framework provides an additional strength, by evaluating long-term behavioural change and improvements in service delivery. As little is known about the effectiveness of DT programs for community aged care workers, the proposed framework will provide an empirical and consistent method of evaluation, to assess their impact on enhancing older people's experience of healthcare. Copyright © 2017 Elsevier Ltd. All rights reserved.

ATR evaluation through the synthesis of multiple performance measures

NASA Astrophysics Data System (ADS)

Bassham, Christopher B.; Klimack, William K.; Bauer, Kenneth W., Jr.

2002-07-01

This research demonstrates the application of decision analysis (DA) techniques to decisions made within Automatic Target Recognition (ATR) technology development. This work is accomplished to improve the means by which ATR technologies are evaluated. The first step in this research was to create a flexible decision analysis framework that could be applied to several decisions across different ATR programs evaluated by the Comprehensive ATR Scientific Evaluation (COMPASE) Center of the Air Force Research Laboratory (AFRL). For the purposes of this research, a single COMPASE Center representative provided the value, utility, and preference functions for the DA framework. The DA framework employs performance measures collected during ATR classification system (CS) testing to calculate value and utility scores. The authors gathered data from the Moving and Stationary Target Acquisition and Recognition (MSTAR) program to demonstrate how the decision framework could be used to evaluate three different ATR CSs. A decision-maker may use the resultant scores to gain insight into any of the decisions that occur throughout the lifecycle of ATR technologies. Additionally, a means of evaluating ATR CS self-assessment ability is presented. This represents a new criterion that emerged from this study, and no present evaluation metric is known.

Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

PubMed

Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

2015-02-01

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

POLE.VAULT: A Semantic Framework for Health Policy Evaluation and Logical Testing.

PubMed

Shaban-Nejad, Arash; Okhmatovskaia, Anya; Shin, Eun Kyong; Davis, Robert L; Buckeridge, David L

2017-01-01

The major goal of our study is to provide an automatic evaluation framework that aligns the results generated through semantic reasoning with the best available evidence regarding effective interventions to support the logical evaluation of public health policies. To this end, we have designed the POLicy EVAlUation & Logical Testing (POLE.VAULT) Framework to assist different stakeholders and decision-makers in making informed decisions about different health-related interventions, programs and ultimately policies, based on the contextual knowledge and the best available evidence at both individual and aggregate levels.

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

Evaluation of Children's After-School Programs in Taiwan: FAHP Approach

ERIC Educational Resources Information Center

Lee, Amy H. I.; Yang, Chih-Neng; Lin, Chun-Yu

2012-01-01

The need of after-school programs has become urgent for school-age children in many industrialized countries due to social structure changes. This research develops a hierarchical framework to evaluate after-school programs from two distinct aspects--service quality from parents' perspectives and marketing strategy from operators'…

From bricks to buildings: adapting the Medical Research Council framework to develop programs of research in simulation education and training for the health professions.

PubMed

Haji, Faizal A; Da Silva, Celina; Daigle, Delton T; Dubrowski, Adam

2014-08-01

Presently, health care simulation research is largely conducted on a study-by-study basis. Although such "project-based" research generates a plethora of evidence, it can be chaotic and contradictory. A move toward sustained, thematic, theory-based programs of research is necessary to advance knowledge in the field. Recognizing that simulation is a complex intervention, we present a framework for developing research programs in simulation-based education adapted from the Medical Research Council (MRC) guidance. This framework calls for an iterative approach to developing, refining, evaluating, and implementing simulation interventions. The adapted framework guidance emphasizes: (1) identification of theory and existing evidence; (2) modeling and piloting interventions to clarify active ingredients and identify mechanisms linking the context, intervention, and outcomes; and (3) evaluation of intervention processes and outcomes in both the laboratory and real-world setting. The proposed framework will aid simulation researchers in developing more robust interventions that optimize simulation-based education and advance our understanding of simulation pedagogy.

Automated Discovery of Simulation Between Programs

DTIC Science & Technology

2014-10-18

relation. These relations enable the refinement-step of SimAbs. We have implemented SimAbs using UFO framework and Z3 SMT-solver and applied it to...step of SimAbs. We implemented SimAbs and AE-VAL on the top of the UFO framework [1, 15] and an SMT-solver Z3 [8], respectively. We have evaluated SimAbs...ut 6 Evaluation We have implemented SimAbs in the UFO framework, and evaluated it on the Software Verification Competition (SVCOMP’14) benchmarks and

New model framework and structure and the commonality evaluation model. [concerning unmanned spacecraft projects

NASA Technical Reports Server (NTRS)

1977-01-01

The development of a framework and structure for shuttle era unmanned spacecraft projects and the development of a commonality evaluation model is documented. The methodology developed for model utilization in performing cost trades and comparative evaluations for commonality studies is discussed. The model framework consists of categories of activities associated with the spacecraft system's development process. The model structure describes the physical elements to be treated as separate identifiable entities. Cost estimating relationships for subsystem and program-level components were calculated.

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

PubMed

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and evaluation in MHPSS programs in humanitarian settings within low- and middle-income countries. This scoping review of the terminology commonly used to describe monitoring and evaluation practices and their focus within MHPSS programming highlights areas of importance for the development of a more standardized approach to monitoring and evaluation.

Use of Bennett's Hierarchical Model in the Evaluation of the Extension Education Program for Cacao Farmers in the Northeast Region of the Dominican Republic. Summary of Research 54.

ERIC Educational Resources Information Center

De los Santos, Saturnino; Norland, Emmalou Van Tilburg

A study evaluated the cacao farmer training program in the Dominican Republic by testing hypothesized relationships among reactions, knowledge and skills, attitudes, aspirations, and some selected demographic characteristics of farmers who attended programs. Bennett's hierarchical model of program evaluation was used as the framework of the study.…

Process evaluation of a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus.

PubMed

Odgers-Jewell, Kate; Isenring, Elisabeth; Thomas, Rae; Reidlinger, Dianne P

2017-07-01

The present study developed and evaluated a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus. Two frameworks, the Medical Research Council (MRC) framework for developing and evaluating complex interventions and the RE-AIM framework were followed. Data to develop the intervention were sourced from scoping of the literature and formative evaluation. Program evaluation comprised analysis of primary recruitment of participants through general practitioners, baseline and end-point measures of anthropometry, four validated questionnaires, contemporaneous facilitator notes and telephone interviews with participants. A total of 16 participants enrolled in the intervention. Post-intervention results were obtained from 13 participants, with an estimated mean change from baseline in weight of -0.72 kg (95%CI -1.44 to -0.01), body mass index of -0.25 kg/m 2 (95%CI -0.49 to -0.01) and waist circumference of -1.04 cm (95%CI -4.52 to 2.44). The group education program was acceptable to participants. The results suggest that recruitment through general practitioners is ineffective, and alternative recruitment strategies are required. This patient-centred, patient-directed, group-based intervention for the management of type 2 diabetes mellitus was both feasible and acceptable to patients. Health professionals should consider the combined use of the MRC and RE-AIM frameworks in the development of interventions to ensure a rigorous design process and to enable the evaluation of all phases of the intervention, which will facilitate translation to other settings. Further research with a larger sample trialling additional recruitment strategies, evaluating further measures of effectiveness and utilising lengthier follow-up periods is required. © 2016 Dietitians Association of Australia.

CONSORT to community: translation of an RCT to a large-scale community intervention and learnings from evaluation of the upscaled program.

PubMed

Moores, Carly Jane; Miller, Jacqueline; Perry, Rebecca Anne; Chan, Lily Lai Hang; Daniels, Lynne Allison; Vidgen, Helen Anna; Magarey, Anthea Margaret

2017-11-29

Translation encompasses the continuum from clinical efficacy to widespread adoption within the healthcare service and ultimately routine clinical practice. The Parenting, Eating and Activity for Child Health (PEACH™) program has previously demonstrated clinical effectiveness in the management of child obesity, and has been recently implemented as a large-scale community intervention in Queensland, Australia. This paper aims to describe the translation of the evaluation framework from a randomised controlled trial (RCT) to large-scale community intervention (PEACH™ QLD). Tensions between RCT paradigm and implementation research will be discussed along with lived evaluation challenges, responses to overcome these, and key learnings for future evaluation conducted at scale. The translation of evaluation from PEACH™ RCT to the large-scale community intervention PEACH™ QLD is described. While the CONSORT Statement was used to report findings from two previous RCTs, the REAIM framework was more suitable for the evaluation of upscaled delivery of the PEACH™ program. Evaluation of PEACH™ QLD was undertaken during the project delivery period from 2013 to 2016. Experiential learnings from conducting the evaluation of PEACH™ QLD to the described evaluation framework are presented for the purposes of informing the future evaluation of upscaled programs. Evaluation changes in response to real-time changes in the delivery of the PEACH™ QLD Project were necessary at stages during the project term. Key evaluation challenges encountered included the collection of complete evaluation data from a diverse and geographically dispersed workforce and the systematic collection of process evaluation data in real time to support program changes during the project. Evaluation of large-scale community interventions in the real world is challenging and divergent from RCTs which are rigourously evaluated within a more tightly-controlled clinical research setting. Constructs explored in an RCT are inadequate in describing the enablers and barriers of upscaled community program implementation. Methods for data collection, analysis and reporting also require consideration. We present a number of experiential reflections and suggestions for the successful evaluation of future upscaled community programs which are scarcely reported in the literature. PEACH™ QLD was retrospectively registered with the Australian New Zealand Clinical Trials Registry on 28 February 2017 (ACTRN12617000315314).

Building Evaluation Capacity in Local Programs for Multisite Nutrition Education Interventions

ERIC Educational Resources Information Center

Fourney, Andrew; Gregson, Jennifer; Sugerman, Sharon; Bellow, Andrew

2011-01-01

From 2004-2008, capacity to conduct program evaluation was built among the "Network for a Healthy California's" 48 largest local partners. Capacity building was done within a framework of Empowerment Evaluation and Utility-Focused evaluation. Tools included: a Scope of Work template, a handbook, a compendium of surveys, an evaluation…

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

ERIC Educational Resources Information Center

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Arts Integration and Students' Reading Achievement: A Formative Evaluation Study

ERIC Educational Resources Information Center

Hosfelt, Patricia D.

2017-01-01

The purpose of this dissertation was to evaluate essential components of an arts-integration program that may contribute to improved student achievement in elementary reading at the school of study through a formative evaluation. Stufflebeam's CIPP model of program evaluation served as the conceptual framework for the study's findings. Creative…

The Data-to-Action Framework: A Rapid Program Improvement Process.

PubMed

Zakocs, Ronda; Hill, Jessica A; Brown, Pamela; Wheaton, Jocelyn; Freire, Kimberley E

2015-08-01

Although health education programs may benefit from quality improvement methods, scant resources exist to help practitioners apply these methods for program improvement. The purpose of this article is to describe the Data-to-Action framework, a process that guides practitioners through rapid-feedback cycles in order to generate actionable data to improve implementation of ongoing programs. The framework was designed while implementing DELTA PREP, a 3-year project aimed at building the primary prevention capacities of statewide domestic violence coalitions. The authors describe the framework's main steps and provide a case example of a rapid-feedback cycle and several examples of rapid-feedback memos produced during the project period. The authors also discuss implications for health education evaluation and practice. © 2015 Society for Public Health Education.

ORD Human Health Risk Assessment (HHRA) Research Program Mid-Cycle Progress Report and Review - 2010

EPA Pesticide Factsheets

The principal charge to the BOSC reviewers was to evaluate ORD’s HHRA Program from a program assessment framework relative to program relevance, structure, performance, quality, leadership, communication, and outcomes.

Multidimensional Implementation Evaluation of a Residential Treatment Program for Adolescent Substance Abuse

ERIC Educational Resources Information Center

Faw, Leyla; Hogue, Aaron; Liddle, Howard A.

2005-01-01

The authors applied contemporary methods from the evaluation literature to measure implementation in a residential treatment program for adolescent substance abuse. A logic model containing two main components was measured. Program structure (adherence to the intended framework of service delivery) was measured using data from daily activity logs…

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

An Evaluation of the ELNP e-Learning Quality Assurance Program: Perspectives of Gap Analysis and Innovation Diffusion

ERIC Educational Resources Information Center

Chen, Ming-Puu

2009-01-01

The purpose of this study was to examine the appropriateness of a nationwide quality assurance framework for e-learning from participants' perspectives. Two types of quality evaluation programs were examined in this study, including the e-Learning Service Certification program (eLSC) and the e-Learning Courseware Certification program (eLCC). Gap…

Translation Training in the Jordanian Context: Curriculum Evaluation in Translator Education

ERIC Educational Resources Information Center

Mahasneh, Anjad

2013-01-01

This study aims at drawing a clear picture of translator training in Jordan through the evaluation of translation programs at the Master's level. The framework of the Context, Input, Process, and Product components of the CIPP evaluation model developed by Daniel Stufflebeam in 1971 was used to evaluate the three translation Master's programs at…

Evaluating a Web-Based Educational Module on Oral Cancer Examination Based on a Behavioral Framework.

PubMed

Wee, Alvin G; Zimmerman, Lani M; Pullen, Carol H; Allen, Carl M; Lambert, Paul M; Paskett, Electra D

2016-03-01

Patients at risk of developing oral and/or oropharyngeal cancer (OPC) are more likely to see primary care providers (PCPs) than a dentist. Many PCPs do not regularly perform oral cancer examination (OCE). The purpose of this study was to design a web-based educational program based on a behavioral framework to encourage PCPs to conduct OCE. PCPs were solicited to provide feedback on the program and to evaluate their short-term knowledge. The integrated behavioral model was used to design the program. Fifteen PCPs (five in each group: physicians, physician assistants, and nurse practitioners) reviewed the program and took a posttest: (1) index of knowledge of risk factors for oral cancer (RiskOC) and (2) index of knowledge of diagnostic procedures for oral cancer (DiagOC). Findings from the process evaluation were mainly positive, with comments on the length of the program comprising the ten negative comments. No significant difference among groups of PCPs (physicians, physician assistants, and nurse practitioners) was detected for DiagOC (p = 0.43) or RiskOC (p = 0.201). A program on OPC for PCPs should be less than 40 min. Postviewing knowledge outcomes were similar for all PCPs. The web-based program on OPC based on a behavioral framework could have similar short-term knowledge outcomes for all PCPs and may increase the number of PCPs performing OCEs.

Lessons learned about collaborative evaluation using the Capacity for Applying Project Evaluation (CAPE) framework with school and district leaders.

PubMed

Corn, Jenifer O; Byrom, Elizabeth; Knestis, Kirk; Matzen, Nita; Thrift, Beth

2012-11-01

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In as much, education leaders need specific guidance and training on how to plan, implement, and use evaluation to critically examine district and school-level initiatives. One specific effort intended to address this need is through the Capacity for Applying Project Evaluation (CAPE) framework. The CAPE framework is composed of three crucial components: a collection of evaluation resources; a professional development model; and a conceptual framework that guides the work to support evaluation planning and implementation in schools and districts. School and district teams serve as active participants in the professional development and ultimately as formative evaluators of their own school or district-level programs by working collaboratively with evaluation experts. The CAPE framework involves the school and district staff in planning and implementing their evaluation. They are the ones deciding what evaluation questions to ask, which instruments to use, what data to collect, and how and to whom results should be reported. Initially this work is done through careful scaffolding by evaluation experts, where supports are slowly pulled away as the educators gain experience and confidence in their knowledge and skills as evaluators. Since CAPE engages all stakeholders in all stages of the evaluation, the philosophical intentions of these efforts to build capacity for formative evaluation strictly aligns with the collaborative evaluation approach. Copyright © 2012 Elsevier Ltd. All rights reserved.

Evaluating Community Engagement in an Academic Medical Center

PubMed Central

Shone, Laura P.; Dozier, Ann M.; Newton, Gail L.; Green, Theresa; Bennett, Nancy M.

2014-01-01

From the perspective of academic medical centers (AMCs), community engagement is a collaborative process of working toward mutually defined goals to improve the community’s health, and involves partnerships between AMCs, individuals, and entities representing the surrounding community. AMCs increasingly recognize the importance of community engagement, and recent programs such as Prevention Research Centers and Clinical and Translational Science Awards have highlighted community engagement activities. However, there is no standard or accepted metric for evaluating AMCs’ performance and impact of community engagement activities. In this article, the authors present a framework for evaluating AMCs’ community engagement activities. The framework includes broad goals and specific activities within each goal, wherein goals and activities are evaluated using a health services research framework consisting of structure, process, and outcome criteria. To illustrate how to use this community engagement evaluation framework, the authors present specific community engagement goals and activities of the University of Rochester Medical Center to (1) improve the health of the community served by the AMC; (2) increase the AMC’s capacity for community engagement; and (3) increase generalizable knowledge and practices in community engagement and public health. Using a structure-process-outcomes framework, a multidisciplinary team should regularly evaluate an AMC’s community engagement program with the purpose of measurably improving the performance of the AMC and the health of its surrounding community. PMID:24556768

Do less effective teachers choose professional development does it matter?

PubMed

Barrett, Nathan; Butler, J S; Toma, Eugenia F

2012-10-01

In an ongoing effort to improve teacher quality, most states require continuing education or professional development for their in-service teachers. Studies evaluating the effectiveness of various professional development programs have assumed a normal distribution of quality of teachers participating in the programs. Because participation in many professional development programs is either targeted or voluntary, this article suggests past evaluations of the effectiveness of professional development may be subject to selection bias and policy recommendations may be premature. This article presents an empirical framework for evaluating professional development programs where treatment is potentially nonrandom, and explicitly accounts for the teacher's prior effectiveness in the classroom as a factor that may influence participation in professional development. This article controls for the influence of selection bias on professional development outcomes by generating a matched sample based on propensity scores and then estimating the program's effect. In applying this framework to the professional development program examined in this article, less effective teachers are found to be more likely to participate in the program, and correcting for this selection leads to different conclusions regarding the program's effectiveness than when ignoring teacher selection patterns.

Health Information Technology Evaluation Framework (HITREF) Comprehensiveness as Assessed in Electronic Point-of-Care Documentation Systems Evaluations.

PubMed

Sockolow, Paulina S; Bowles, Kathryn H; Rogers, Michelle

2015-01-01

We assessed the Health Information Technology (HIT) Reference-based Evaluation Framework (HITREF) comprehensiveness in two HIT evaluations in settings different from that in which the HITREF was developed. Clinician satisfaction themes that emerged from clinician interviews in the home care and the hospital studies were compared to the framework components. Across both studies, respondents commented on 12 of the 20 HITREF components within 5 of the 6 HITREF concepts. No new components emerged that were missing from the HITREF providing evidence that the HITREF is a comprehensive framework. HITREF use in a range of HIT evaluations by researchers new to the HITREF demonstrates that it can be used as intended. Therefore, we continue to recommend the HITREF as a comprehensive, research-based HIT evaluation framework to increase the capacity of informatics evaluators' use of best practice and evidence-based practice to support the credibility of their findings for fulfilling the purpose of program evaluation.

Perceived Utility of the RE-AIM Framework for Health Promotion/Disease Prevention Initiatives for Older Adults: A Case Study from the U.S. Evidence-Based Disease Prevention Initiative.

PubMed

Ory, Marcia G; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee

2014-01-01

Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance.

Systems theory as a framework for examining a college campus-based support program for the former foster youth.

PubMed

Schelbe, Lisa; Randolph, Karen A; Yelick, Anna; Cheatham, Leah P; Groton, Danielle B

2018-01-01

Increased attention to former foster youth pursuing post-secondary education has resulted in the creation of college campus based support programs to address their need. However, limited empirical evidence and theoretical knowledge exist about these programs. This study seeks to describe the application of systems theory as a framework for examining a college campus based support program for former foster youth. In-depth semi-structured interviews were conducted with 32 program stakeholders including students, mentors, collaborative members, and independent living program staff. Using qualitative data analysis software, holistic coding techniques were employed to analyze interview transcripts. Then applying principles of extended case method using systems theory, data were analyzed. Findings suggest systems theory serves as a framework for understanding the functioning of a college campus based support program. The theory's concepts help delineate program components and roles of stakeholders; outline boundaries between and interactions among stakeholders; and identify program strengths and weakness. Systems theory plays an important role in identifying intervention components and providing a structure through which to identify and understand program elements as a part of the planning process. This study highlights the utility of systems theory as a framework for program planning and evaluation.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

An Evaluation of the Antibullying Program at a Public Suburban High School

ERIC Educational Resources Information Center

Drury, Brian

2014-01-01

This project study addressed the problem of harassment, intimidation, and bullying (HIB) at a public suburban high school in the Northeast United States. The study school implemented the Anti-bullying Program in September 2011, yet no evaluation had been conducted on whether the program was meeting its goals. Two conceptual frameworks that drove…

Evaluation of a national quality use of medicines service in Australia: an evolving model.

PubMed

Beilby, Justin; Wutzke, Sonia E; Bowman, Jenny; Mackson, Judith M; Weekes, Lynn M

2006-04-01

To describe the first phase of a global evaluation framework for the National Prescribing Service (NPS), with a focus on services for health professionals, and in particular highlight the lessons learnt from evaluation around the establishment and implementation of this national program. The agreed evaluation framework used mixed methods focused around a series of evaluation questions, aimed at measuring the overall effect of this new organization as well as the individual programs within it. The evaluation questions were determined a priori and were based on the objectives established by the organization in its first year of operation. A detailed analyses has been completed of: the process, scope and reach of program delivery using both quantitative and qualitative measures; changes in attitudes and knowledge measured through key informant interviews and surveys of professional groups and consumers; and changes in prescribing behaviour and savings to the Pharmaceutical Benefits Scheme (PBS) through analysis of prescription data. The evaluation period for this report was mid-1998 to mid-2004. The NPS has successfully implemented a complex, multi-faceted program across Australia. From 1998 to 2004, in addition to print material provided to all general practitioners (GPs) and pharmacists, 90% of all GPs have been actively involved in one or more educational activity; 116 of 120 divisions of general practice have coordinated local NPS programs; and 9% of pharmacists have actively participated in at least one educational activity. Sixty per cent of GPs and pharmacists rated the printed educational materials as good or very good. In the last three years, the NPS activities have generated savings in the range of $121-163 million to the PBS, owing to changes in prescribing practices. The national evaluation framework has informed program delivery and ongoing design and development. Continued refinement of existing evaluation methods and further exploration of new techniques will remain a priority for the organization.

A Decision Support Framework for Feasibility Analysis of International Space Station (ISS) Research Capability Enhancing Options

NASA Technical Reports Server (NTRS)

Ortiz, James N.; Scott,Kelly; Smith, Harold

2004-01-01

The assembly and operation of the ISS has generated significant challenges that have ultimately impacted resources available to the program's primary mission: research. To address this, program personnel routinely perform trade-off studies on alternative options to enhance research. The approach, content level of analysis and resulting outputs of these studies vary due to many factors, however, complicating the Program Manager's job of selecting the best option. To address this, the program requested a framework be developed to evaluate multiple research-enhancing options in a thorough, disciplined and repeatable manner, and to identify the best option on the basis of cost, benefit and risk. The resulting framework consisted of a systematic methodology and a decision-support toolset. The framework provides quantifiable and repeatable means for ranking research-enhancing options for the complex and multiple-constraint domain of the space research laboratory. This paper describes the development, verification and validation of this framework and provides observations on its operational use.

The use of concept mapping for scale development and validation in evaluation.

PubMed

Rosas, Scott R; Camphausen, Lauren C

2007-05-01

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a fully integrated part of scale development. As part of a multi-site evaluation of family support programs, we integrated concept mapping with traditional scale-development processes to strengthen the creation of a scale for inclusion in an evaluation instrument. Using concept mapping, we engaged staff and managers in the development of a framework of intended benefits of program participation and used the information to systematically select the scale's content. The psychometric characteristics of the scale were then formally assessed using a sample of program participants. The implications of the approach for supporting construct validity, inclusion of staff and managers, and theory-driven evaluation are discussed.

Electromechanical Technology. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This vocational program guide is intended to assist in the organization, operation, and evaluation of a program in electromechanical technology in school districts, area vocational centers, and community colleges. The following topics are covered: job duties of electromechanical technicians; program content (curriculum framework and student…

Paramedic. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of a paramedic program. An occupational description and program content are presented. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content, laboratory activities, special notes, major…

Workplace Literacy: From Survival to Empowerment and Human Development.

ERIC Educational Resources Information Center

Rhoder, Carol A.; French, Joyce N.

1994-01-01

Describes an effective literacy program in two hospitals, which benefited both the employer and employee by empowering participants to solve problems, think critically and creatively, and make decisions. Discusses criteria for effective workplace literacy programs, the program's framework, and program evaluation. (RS)

Marketing and Distribution. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of a marketing education program. An occupational description and program content are presented. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content, laboratory activities, special…

Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

PubMed

Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

2015-01-01

Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

The Ergonomic Program Implementation Continuum (EPIC): integration of health and safety--a process evaluation in the healthcare sector.

PubMed

Baumann, Andrea; Holness, D Linn; Norman, Patrica; Idriss-Wheeler, Dina; Boucher, Patricia

2012-07-01

This article presents a health and safety intervention model and the use of process evaluation to assess a participatory ergonomic intervention. The effectiveness of the Ergonomic Program Implementation Continuum (EPIC) was assessed at six healthcare pilot sites in Ontario, Canada. The model provided a framework to demonstrate evaluation findings. Participants reported that EPIC was thorough and identified improvements related to its use. Participants believed the program contributed to advancing an organizational culture of safety (COS). Main barriers to program uptake included resistance to change and need for adequate funding and resources. The dedication of organizational leaders and consultant coaches was identified as essential to the program's success. In terms of impact on industry, findings contribute to the evidence-based knowledge of health and safety interventions and support use of the framework for creating a robust infrastructure to advance organizational COS and link staff safety and wellness with patient safety in healthcare. Copyright © 2012 National Safety Council and Elsevier Ltd. All rights reserved.

Conceptualizing Youth Empowerment within Tobacco Control

ERIC Educational Resources Information Center

Holden, Debra J.; Messeri, Peter; Evans, W. Douglas; Crankshaw, Erik; Ben-Davies, Maureen

2004-01-01

This article presents a conceptual framework that was developed to guide a national evaluation of the American Legacy Foundation's (Legacy) Statewide Youth Movement Against Tobacco Use (SYMATU) program. This program was designed to develop youth-led, youth-directed initiatives within local communities. Two evaluation studies were designed and…

Framework for the Development of OER-Based Learning Materials in ODL Environment

ERIC Educational Resources Information Center

Teng, Khor Ean; Hung, Chung Sheng

2013-01-01

This paper describes the framework for the development of OER-based learning materials "TCC121/05 Programming Fundamentals with Java" for ODL learners in Wawasan Open University (WOU) using three main development phases mainly: creation, evaluation and production phases. The proposed framework has further been tested on ODL learners to…

Educational Outcomes Associated With School Behavioral Health Interventions: A Review of the Literature.

PubMed

Kase, Courtney; Hoover, Sharon; Boyd, Gina; West, Kristina D; Dubenitz, Joel; Trivedi, Pamala A; Peterson, Hilary J; Stein, Bradley D

2017-07-01

There is an unmet need for behavioral health support and services among children and adolescents, which school behavioral health has the potential to address. Existing reviews and meta-analyses document the behavioral health benefits of school behavioral health programs and frameworks, but few summaries of the academic benefits of such programs exist. We provide exemplars of the academic benefits of school behavioral health programs and frameworks. A literature review identified school behavioral health-related articles and reports. Articles for inclusion were restricted to those that were school-based programs and frameworks in the United States that included an empirical evaluation of intervention academic-related outcomes. Findings from 36 primary research, review, and meta-analysis articles from the past 17 years show the benefits of school behavioral health clinical interventions and targeted interventions on a range of academic outcomes for adolescents. Our findings are consistent with reports documenting health benefits of school behavioral health frameworks and programs and can facilitate further efforts to support school behavioral health for a range of stakeholders interested in the benefits of school behavioral health programs and frameworks on academic outcomes. © 2017, American School Health Association.

Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

PubMed

Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

2016-04-01

Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

Taking Stock of Parent Education in the Family Courts: Envisioning a Public Health Model

PubMed Central

Salem, Peter; Sandler, Irwin; Wolchik, Sharlene

2012-01-01

The paper reviewed the development and current status of the parent education movement in the Family Courts. Parent education programs are now being implemented in courts throughout the United States and have a high level of public acceptance; however, a stronger research methodology to evaluate the effects and continued work to align the goals with the content and teaching strategies of these programs are needed. A new conceptual framework is proposed for parent education, which views divorce as a public health problem for children as well as a legal issue. The three-level framework uses concepts from public health to align the goals, content and format of parent education programs and to enable rigorous evaluations of the outcomes achieved by these programs. PMID:23641191

A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review

PubMed Central

Callahan, Ryan; Darzi, Ara; Mayer, Erik

2016-01-01

Background Digital maturity is the extent to which digital technologies are used as enablers to deliver a high-quality health service. Extensive literature exists about how to assess the components of digital maturity, but it has not been used to design a comprehensive framework for evaluation. Consequently, the measurement systems that do exist are limited to evaluating digital programs within one service or care setting, meaning that digital maturity evaluation is not accounting for the needs of patients across their care pathways. Objective The objective of our study was to identify the best methods and metrics for evaluating digital maturity and to create a novel, evidence-based tool for evaluating digital maturity across patient care pathways. Methods We systematically reviewed the literature to find the best methods and metrics for evaluating digital maturity. We searched the PubMed database for all papers relevant to digital maturity evaluation. Papers were selected if they provided insight into how to appraise digital systems within the health service and if they indicated the factors that constitute or facilitate digital maturity. Papers were analyzed to identify methodology for evaluating digital maturity and indicators of digitally mature systems. We then used the resulting information about methodology to design an evaluation framework. Following that, the indicators of digital maturity were extracted and grouped into increasing levels of maturity and operationalized as metrics within the evaluation framework. Results We identified 28 papers as relevant to evaluating digital maturity, from which we derived 5 themes. The first theme concerned general evaluation methodology for constructing the framework (7 papers). The following 4 themes were the increasing levels of digital maturity: resources and ability (6 papers), usage (7 papers), interoperability (3 papers), and impact (5 papers). The framework includes metrics for each of these levels at each stage of the typical patient care pathway. Conclusions The framework uses a patient-centric model that departs from traditional service-specific measurements and allows for novel insights into how digital programs benefit patients across the health system. Trial Registration N/A PMID:27080852

A novel framework for analyzing conservation impacts: evaluation, theory, and marine protected areas.

PubMed

Mascia, Michael B; Fox, Helen E; Glew, Louise; Ahmadia, Gabby N; Agrawal, Arun; Barnes, Megan; Basurto, Xavier; Craigie, Ian; Darling, Emily; Geldmann, Jonas; Gill, David; Holst Rice, Susie; Jensen, Olaf P; Lester, Sarah E; McConney, Patrick; Mumby, Peter J; Nenadovic, Mateja; Parks, John E; Pomeroy, Robert S; White, Alan T

2017-07-01

Environmental conservation initiatives, including marine protected areas (MPAs), have proliferated in recent decades. Designed to conserve marine biodiversity, many MPAs also seek to foster sustainable development. As is the case for many other environmental policies and programs, the impacts of MPAs are poorly understood. Social-ecological systems, impact evaluation, and common-pool resource governance are three complementary scientific frameworks for documenting and explaining the ecological and social impacts of conservation interventions. We review key components of these three frameworks and their implications for the study of conservation policy, program, and project outcomes. Using MPAs as an illustrative example, we then draw upon these three frameworks to describe an integrated approach for rigorous empirical documentation and causal explanation of conservation impacts. This integrated three-framework approach for impact evaluation of governance in social-ecological systems (3FIGS) accounts for alternative explanations, builds upon and advances social theory, and provides novel policy insights in ways that no single approach affords. Despite the inherent complexity of social-ecological systems and the difficulty of causal inference, the 3FIGS approach can dramatically advance our understanding of, and the evidentiary basis for, effective MPAs and other conservation initiatives. © 2017 New York Academy of Sciences.

Patient Care Assistant. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of a patient care assistant program. An occupational description and program content are presented. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content, laboratory activities, special…

Developing Your Evaluation Plans: A Critical Component of Public Health Program Infrastructure.

PubMed

Lavinghouze, S Rene; Snyder, Kimberly

A program's infrastructure is often cited as critical to public health success. The Component Model of Infrastructure (CMI) identifies evaluation as essential under the core component of engaged data. An evaluation plan is a written document that describes how to monitor and evaluate a program, as well as how to use evaluation results for program improvement and decision making. The evaluation plan clarifies how to describe what the program did, how it worked, and why outcomes matter. We use the Centers for Disease Control and Prevention's (CDC) "Framework for Program Evaluation in Public Health" as a guide for developing an evaluation plan. Just as using a roadmap facilitates progress on a long journey, a well-written evaluation plan can clarify the direction your evaluation takes and facilitate achievement of the evaluation's objectives.

Progress and Accountability in Family Literacy: Lessons from a Collaborative Approach.

ERIC Educational Resources Information Center

Ryan, Katherine E.; And Others

1996-01-01

The implementation of a collaborative approach to evaluating family literacy programs was studied using a conceptual framework and applied to 36 family literacy programs from a midwestern state. Evaluation participants learned how results could be used to develop curriculum in addition to reporting to funding agencies. (SLD)

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program.

PubMed

Davis, LaShara A; Morgan, Susan E; Mobley, Amy R

2016-06-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported as memorable and the characteristics of those memorable messages. A convenience sample of low-income, primarily African American adults (N = 58) who previously completed a series of community nutrition education lessons within an urban area of Indiana participated in a focus group (N = 8 focus groups). A lead moderator using a semistructured script conducted the focus groups to determine what information about fruits and vegetables was most memorable from the participants' nutrition lessons and why this information was memorable. All focus group audiotapes were transcribed verbatim and ATLAS.ti software was used to code and identify themes within the data. Participants cited quantity, variety, and the positive nutritional impact of eating fruits and vegetables as most memorable. Information given in the form of recipes was also cited as most memorable. For example, participants referred to the recipe demonstrations as not only fun but also key components of the program that helped with message retention and memorability. Key characteristics of memorable messages included personal relevance and message vividness. These findings indicated that the Memorable Messages Framework may serve as an intermediary program evaluation tool to identify what information and messages are most influential to participants in community nutrition education programs. © 2015 Society for Public Health Education.

Ensuring youth's right to participation and promotion of youth leadership in the development of sexual and reproductive health policies and programs.

PubMed

Villa-Torres, Laura; Svanemyr, Joar

2015-01-01

The purpose of this article was to reflect on the concepts of adolescence and youth, summarize models and frameworks developed to conceptualize youth participation, and assess research that has attempted to evaluate the implementation and impact of youth participation in the field of sexual and reproductive health and rights (SRHR). We searched and critically reviewed relevant published reports and "gray literature" from the period 2000-2013. "Young people" are commonly defined as those between the ages of 10 and 24 years, but what it means to be a young person varies largely across cultures and depends on a range of socioeconomic factors. Several conceptual frameworks have been developed to better understand youth participation, and some frameworks are designed to monitor youth development programs that have youth participation as a key component. Although none of them are SRHR specific, they have the potential to be adapted and applied also for adolescents' SRHR programs. The most monitored and evaluated intervention type is peer education programs, but the effectiveness of the approach is questioned. There are few attempts to systematically evaluate youth participation, and clear indicators and better methodologies still need to be developed. More research and documentation as well as the adoption of innovative practices for involving youth in sexual and reproductive health programs are needed. Participation is a right and should not only be evaluated in terms of effectiveness and impact. Youth participation in program and policy development should still be a priority. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

An Evaluation of DOE-EM Public Participation Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bradbury, Judith A.; Branch, Kristi M.; Malone, Elizabeth L.

This report evaluates the scope and effectiveness of the public participation pr ograms, including Site-Specific Advisory Boards (SSABs), at seven U.S. Departmen t of Energy (DOE) sites: Fernald, Hanford, Los Alamos, Nevada, Oak Ridge, Paduc ah, and Savannah River. The primary purpose of the study is to assist both DOE Field and Headquarters managers in reviewing and understanding lessons learned o ver the past decade concerning public participation programs administered by the DOE Office of Environmental Management (EM). The evaluation provides a snapsh ot of selected EM public participation programs at a particular point of time. It is based onmore » interviews and site visits conducted between January and June 200 2- a time of change within the program. The study focuses on public participati on programs that incorporate a variety of activities and address a wide range of individual site activities and decisions. It uses the Acceptability Diamond as an evaluative framework to answer questions about stakeholders' experiences wit h, and assessment of, DOE-EM's public participation programs. The Acceptability Diamond, which was developed by researchers from the Pacific Northwest National Laboratory in previous research, identifies four program dimensions - substanti ve issues, decision-making process, relationships, and accountability - that det ermine the effectiveness of an agency's interactions with local communities. Es sentially, a public participation program may be deemed effective to the extent that it provides for open disclosure and addresses all four acceptability dimens ions in ways that are appropriate and effective for a particular community and s ituation. This framework provides a guide for agencies to 1) set objectives, 2) design public participation and oversight programs, and 3) set criteria for eva luating program effectiveness. In the current study, where the framework is use d as a means of assessing program effectiveness, the focus is on stakeholders' p erspectives of public participation: on the nature of DOE-EM's public disclosure and the four interrelated dimensions of DOE-EM's interactions with its neighbor ing communities« less

Respiratory Therapy and Respiratory Therapy Technician. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of respiratory therapy and respiratory therapy technician programs. An occupational description and program content are presented. The curriculum framework specifies the exact course title, course number, levels of instruction, major course content,…

Gasoline Engine Mechanics. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This vocational program guide is intended to assist in the organization, operation, and evaluation of a program in gasoline engine mechanics in school districts, area vocational centers, and community colleges. The following topics are covered: job duties of small-engine mechanics; program content (curriculum framework and student performance…

Laser Electro-Optic Engineering Technology. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This program guide identifies particular considerations in the organization, operation, and evaluation of laser electro-optic engineering technology programs. Contents include an occupational description and information on the following: program content, including a curriculum framework that details major concepts and intended outcomes and a list…

Laser Electro-Optic Technology. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This program guide identifies primary considerations in the organization, operation, and evaluation of a laser electro-optic technology program. An occupational description and program content are presented. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content, laboratory activities,…

Natural Resources and Forest Ecology. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of a natural resources and forest ecology program. Program content is presented first. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content, laboratory activities, special notes, major…

Fashion Marketing. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This vocational program guide is intended to assist in the organization, operation, and evaluation of a program in fashion marketing in school districts, area vocational centers, and community colleges. The following topics are covered: program content (job duties of wholesale and retail clothing salespersons and curriculum framework and student…

Receptionist and Communication Systems Operation. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Center for Instructional Development and Services.

This program guide identifies primary considerations in the organization, operation, and evaluation of a receptionist and communication systems operation program. An occupational description and program content are presented. A curriculum framework specifies the exact course title, course number, levels of instruction, major course content,…

Suicide Risk Assessment Training for Psychology Doctoral Programs: Core Competencies and a Framework for Training

PubMed Central

Cramer, Robert J.; Johnson, Shara M.; McLaughlin, Jennifer; Rausch, Emilie M.; Conroy, Mary Alice

2014-01-01

Clinical and counseling psychology programs currently lack adequate evidence-based competency goals and training in suicide risk assessment. To begin to address this problem, this article proposes core competencies and an integrated training framework that can form the basis for training and research in this area. First, we evaluate the extent to which current training is effective in preparing trainees for suicide risk assessment. Within this discussion, sample and methodological issues are reviewed. Second, as an extension of these methodological training issues, we integrate empirically- and expert-derived suicide risk assessment competencies from several sources with the goal of streamlining core competencies for training purposes. Finally, a framework for suicide risk assessment training is outlined. The approach employs Objective Structured Clinical Examination (OSCE) methodology, an approach commonly utilized in medical competency training. The training modality also proposes the Suicide Competency Assessment Form (SCAF), a training tool evaluating self- and observer-ratings of trainee core competencies. The training framework and SCAF are ripe for empirical evaluation and potential training implementation. PMID:24672588

Suicide Risk Assessment Training for Psychology Doctoral Programs: Core Competencies and a Framework for Training.

PubMed

Cramer, Robert J; Johnson, Shara M; McLaughlin, Jennifer; Rausch, Emilie M; Conroy, Mary Alice

2013-02-01

Clinical and counseling psychology programs currently lack adequate evidence-based competency goals and training in suicide risk assessment. To begin to address this problem, this article proposes core competencies and an integrated training framework that can form the basis for training and research in this area. First, we evaluate the extent to which current training is effective in preparing trainees for suicide risk assessment. Within this discussion, sample and methodological issues are reviewed. Second, as an extension of these methodological training issues, we integrate empirically- and expert-derived suicide risk assessment competencies from several sources with the goal of streamlining core competencies for training purposes. Finally, a framework for suicide risk assessment training is outlined. The approach employs Objective Structured Clinical Examination (OSCE) methodology, an approach commonly utilized in medical competency training. The training modality also proposes the Suicide Competency Assessment Form (SCAF), a training tool evaluating self- and observer-ratings of trainee core competencies. The training framework and SCAF are ripe for empirical evaluation and potential training implementation.

Breaking barriers: a competency-based framework for promoting the integration of the pediatrician's education.

PubMed

Naghettini, Alessandra V; Bollela, Valdes R; Costa, Nilce M S C; Salgado, Luciana M R

2011-01-01

To describe the process of integration and revision of a pediatric program curriculum which resulted in the creation of a competency-based framework recommended in the Brazilian National Curricular Guidelines. Quali-quantitative analysis of an intervention evaluating the students and professors' perception of the pediatric program curriculum (focus groups and semi-structured interviews). Results were discussed during teaching development workshops. A competency-based framework was suggested for the pediatric program from the 3rd to the 6th year. The new curriculum was approved, implemented, and reevaluated six months later. Twelve students (12%) from the 3rd to the 6th year participated in the focus groups, and 11 professors (78.5%) answered the questionnaire. Most participants reported lack of integration among the courses, lack of knowledge about the learning goals of the internships, few opportunities of practice, and predominance of theoretical evaluation. In the training workshops, a competency-based curriculum was created after pediatrics and collective health professors reached an agreement. The new curriculum was focused on general competency, learning goals, opportunities available to learn these goals, and evaluation system. After six months, 93% (104/112) of students and 79% (11/14) of professors reported greater integration of the program and highlighted the inclusion of the clinical performance evaluation. The collective creation of a competency-based curriculum promoted higher satisfaction of students and professors. After being implemented, the new curriculum was considered to integrate the teaching practices and contents, improving the quality of the clinical performance evaluation.

A 3-Month Jump-Landing Training Program: A Feasibility Study Using the RE-AIM Framework

PubMed Central

Aerts, Inne; Cumps, Elke; Verhagen, Evert; Mathieu, Niels; Van Schuerbeeck, Sander; Meeusen, Romain

2013-01-01

Context: Evaluating the translatability and feasibility of an intervention program has become as important as determining the effectiveness of the intervention. Objective: To evaluate the applicability of a 3-month jump-landing training program in basketball players, using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. Design: Randomized controlled trial. Setting: National and regional basketball teams. Patients or Other Participants: Twenty-four teams of the second highest national division and regional basketball divisions in Flanders, Belgium, were randomly assigned (1:1) to a control group and intervention group. A total of 243 athletes (control group = 129, intervention group = 114), ages 15 to 41 years, volunteered. Intervention(s): All exercises in the intervention program followed a progressive development, emphasizing lower extremity alignment during jump-landing activities. Main Outcome Measure(s): The results of the process evaluation of the intervention program were based on the 5 dimensions of the RE-AIM framework. The injury incidence density, hazard ratios, and 95% confidence intervals were determined. Results: The participation rate of the total sample was 100% (reach). The hazard ratio was different between the intervention group and the control group (0.40 [95% confidence interval = 0.16, 0.99]; effectiveness). Of the 12 teams in the intervention group, 8 teams (66.7%) agreed to participate in the study (adoption). Eight of the participating coaches (66.7%) felt positively about the intervention program and stated that they had implemented the training sessions of the program as intended (implementation). All coaches except 1 (87.5%) intended to continue the intervention program the next season (maintenance). Conclusions: Compliance of the coaches in this coach-supervised jump-landing training program was high. In addition, the program was effective in preventing lower extremity injuries. PMID:23675788

A 3-month jump-landing training program: a feasibility study using the RE-AIM framework.

PubMed

Aerts, Inne; Cumps, Elke; Verhagen, Evert; Mathieu, Niels; Van Schuerbeeck, Sander; Meeusen, Romain

2013-01-01

Evaluating the translatability and feasibility of an intervention program has become as important as determining the effectiveness of the intervention. To evaluate the applicability of a 3-month jump-landing training program in basketball players, using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. Randomized controlled trial. National and regional basketball teams. Twenty-four teams of the second highest national division and regional basketball divisions in Flanders, Belgium, were randomly assigned (1:1) to a control group and intervention group. A total of 243 athletes (control group = 129, intervention group = 114), ages 15 to 41 years, volunteered. All exercises in the intervention program followed a progressive development, emphasizing lower extremity alignment during jump-landing activities. The results of the process evaluation of the intervention program were based on the 5 dimensions of the RE-AIM framework. The injury incidence density, hazard ratios, and 95% confidence intervals were determined. The participation rate of the total sample was 100% (reach). The hazard ratio was different between the intervention group and the control group (0.40 [95% confidence interval = 0.16, 0.99]; effectiveness). Of the 12 teams in the intervention group, 8 teams (66.7%) agreed to participate in the study (adoption). Eight of the participating coaches (66.7%) felt positively about the intervention program and stated that they had implemented the training sessions of the program as intended (implementation). All coaches except 1 (87.5%) intended to continue the intervention program the next season (maintenance). Compliance of the coaches in this coach-supervised jump-landing training program was high. In addition, the program was effective in preventing lower extremity injuries.

Evaluating the Impact of Educational Interventions on Patients and Communities: A Conceptual Framework.

PubMed

Bzowyckyj, Andrew S; Dow, Alan; Knab, Mary S

2017-11-01

Health professions education programs can have direct effects on patients and communities as well as on learners. However, few studies have examined the patient and community outcomes of educational interventions. To better integrate education and health care delivery, educators and researchers would benefit from a unifying framework to guide the planning of educational interventions and evaluation of their impact on patients.The authors of this Perspective mirrored approaches from Miller's pyramid of educational assessment and Moore and colleagues' framework for evaluating continuing professional development to propose a conceptual framework for evaluating the impact of educational interventions on patients and communities. This proposed framework, which complements these existing frameworks for evaluating the impact of educational interventions on learners, includes four levels: (1) interaction; (2) acceptability; (3) individual outcomes (i.e., knowledge, skills, activation, behaviors, and individual health indicators); and (4) population outcomes (i.e., community health indicators, capacity, and disparities). The authors describe measures and outcomes at each level and provide an example of the application of their new conceptual framework.The authors encourage educators and researchers to use this conceptual framework to evaluate the impact of educational interventions on patients and to more clearly identify and define which educational interventions strengthen communities and enhance overall health outcomes.

The Faculty Learning Outcome Assessment Framework

ERIC Educational Resources Information Center

Hurney, Carol A.; Brantmeier, Edward J.; Good, Megan R.; Harrison, Douglas; Meixner, Cara

2016-01-01

Assessment is a cyclical process within which educators construct outcomes, implement programs, assess constructs such as learning, evaluate results, and utilize results to craft stronger programs and services. Within educational and faculty development, assessment measures program impact on faculty, students, and/or institutional culture.…

A framework for monitoring social process and outcomes in environmental programs.

PubMed

Chapman, Sarah

2014-12-01

When environmental programs frame their activities as being in the service of human wellbeing, social variables need to be integrated into monitoring and evaluation (M&E) frameworks. This article draws upon ecosystem services theory to develop a framework to guide the M&E of collaborative environmental programs with anticipated social benefits. The framework has six components: program need, program activities, pathway process variables, moderating process variables, outcomes, and program value. Needs are defined in terms of ecosystem services, as well as other human needs that must be addressed to achieve outcomes. The pathway variable relates to the development of natural resource governance capacity in the target community. Moderating processes can be externalities such as the inherent capacity of the natural system to service ecosystem needs, local demand for natural resources, policy or socio-economic drivers. Internal program-specific processes relate to program service delivery, targeting and participant responsiveness. Ecological outcomes are expressed in terms of changes in landscape structure and function, which in turn influence ecosystem service provision. Social benefits derived from the program are expressed in terms of the value of the eco-social service to user-specified goals. The article provides suggestions from the literature for identifying indicators and measures for components and component variables, and concludes with an example of how the framework was used to inform the M&E of an adaptive co-management program in western Kenya. Copyright © 2014 Elsevier Ltd. All rights reserved.

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Teaching Decision Making to Adolescents: A Critical Review.

ERIC Educational Resources Information Center

Beyth-Marom, Ruth; And Others

A conceptual framework derived from formal and behavioral theories was used to describe and evaluate a sample of the best developed programs for teaching decision making to adolescents. The internal validity of the programs was evaluated in terms of the adequacy of their coverage of the normatively prescribed steps to good decision making. The…

Standards & Criteria for the Development and Evaluation of a Comprehensive Employee Assistance Program.

ERIC Educational Resources Information Center

Health Resources and Services Administration, Rockville, MD. Bureau of Health Care Delivery and Assistance.

This document was designed for use by persons or agencies interested in both establishing and evaluating employee assistance programs (EAP) for federal employees. It contains essential elements, standards, and assessment criteria which have been developed to assist in the planning and implementation of services, and to provide a framework for…

Evaluation of a Psychological Skill Training Program on Mental Toughness and Psychological Wellbeing for Professional Soccer Players

ERIC Educational Resources Information Center

Miçoogullari, Bülent Okan; Ekmekçi, Ridvan

2017-01-01

The purpose of this study was to evaluate the effectiveness of psychological skills training (PST) in enhancing mental toughness among Turkish professional soccer team. Sixteen weeks of cognitive-behavioral conceptual framework-based PST program designed according to factors (confidence-constancy-control) of Sport Mental Toughness Questionnaire…

Deductive Evaluation: Implicit Code Verification With Low User Burden

NASA Technical Reports Server (NTRS)

Di Vito, Ben L.

2016-01-01

We describe a framework for symbolically evaluating C code using a deductive approach that discovers and proves program properties. The framework applies Floyd-Hoare verification principles in its treatment of loops, with a library of iteration schemes serving to derive loop invariants. During evaluation, theorem proving is performed on-the-fly, obviating the generation of verification conditions normally needed to establish loop properties. A PVS-based prototype is presented along with results for sample C functions.

Developing an evaluation framework for clinical redesign programs: lessons learnt.

PubMed

Samaranayake, Premaratne; Dadich, Ann; Fitzgerald, Anneke; Zeitz, Kathryn

2016-09-19

Purpose The purpose of this paper is to present lessons learnt through the development of an evaluation framework for a clinical redesign programme - the aim of which was to improve the patient journey through improved discharge practices within an Australian public hospital. Design/methodology/approach The development of the evaluation framework involved three stages - namely, the analysis of secondary data relating to the discharge planning pathway; the analysis of primary data including field-notes and interview transcripts on hospital processes; and the triangulation of these data sets to devise the framework. The evaluation framework ensured that resource use, process management, patient satisfaction, and staff well-being and productivity were each connected with measures, targets, and the aim of clinical redesign programme. Findings The application of business process management and a balanced scorecard enabled a different way of framing the evaluation, ensuring measurable outcomes were connected to inputs and outputs. Lessons learnt include: first, the importance of mixed-methods research to devise the framework and evaluate the redesigned processes; second, the need for appropriate tools and resources to adequately capture change across the different domains of the redesign programme; and third, the value of developing and applying an evaluative framework progressively. Research limitations/implications The evaluation framework is limited by its retrospective application to a clinical process redesign programme. Originality/value This research supports benchmarking with national and international practices in relation to best practice healthcare redesign processes. Additionally, it provides a theoretical contribution on evaluating health services improvement and redesign initiatives.

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

PubMed

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Perceived Utility of the RE-AIM Framework for Health Promotion/Disease Prevention Initiatives for Older Adults: A Case Study from the U.S. Evidence-Based Disease Prevention Initiative

PubMed Central

Ory, Marcia G.; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee

2015-01-01

Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance. PMID:25964897

The Web-based CanMEDS Resident Learning Portfolio Project (WEBCAM): how we got started.

PubMed

Glen, Peter; Balaa, Fady; Momoli, Franco; Martin, Louise; Found, Dorothy; Arnaout, Angel

2016-12-01

The CanMEDS framework is ubiquitous in Canadian postgraduate medical education; however, training programs do not have a universal method of assessing competence. We set out to develop a novel portfolio that allowed trainees to generate a longitudinal record of their training and development within the framework. The portfolio provided an objective means for the residency program director to document and evaluate resident progress within the CanMEDS roles.

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

A framework for evaluating and designing citizen science programs for natural resources monitoring.

PubMed

Chase, Sarah K; Levine, Arielle

2016-06-01

We present a framework of resource characteristics critical to the design and assessment of citizen science programs that monitor natural resources. To develop the framework we reviewed 52 citizen science programs that monitored a wide range of resources and provided insights into what resource characteristics are most conducive to developing citizen science programs and how resource characteristics may constrain the use or growth of these programs. We focused on 4 types of resource characteristics: biophysical and geographical, management and monitoring, public awareness and knowledge, and social and cultural characteristics. We applied the framework to 2 programs, the Tucson (U.S.A.) Bird Count and the Maui (U.S.A.) Great Whale Count. We found that resource characteristics such as accessibility, diverse institutional involvement in resource management, and social or cultural importance of the resource affected program endurance and success. However, the relative influence of each characteristic was in turn affected by goals of the citizen science programs. Although the goals of public engagement and education sometimes complimented the goal of collecting reliable data, in many cases trade-offs must be made between these 2 goals. Program goals and priorities ultimately dictate the design of citizen science programs, but for a program to endure and successfully meet its goals, program managers must consider the diverse ways that the nature of the resource being monitored influences public participation in monitoring. © 2016 Society for Conservation Biology.

Establishing a public-private partnership program : a primer.

DOT National Transportation Integrated Search

2012-11-01

Establishing a Public-Private Partnership (P3) program within a public agency involves issues from enabling legislation through identification, evaluation, negotiation and management of P3 projects. Public agencies will need: A legal framework to...

Teaching Money Literacy in a Positive Youth Development Program: The Project P.A.T.H.S. in Hong Kong

PubMed Central

Lee, Tak Yan; Law, Ben M. F.

2011-01-01

In view of the high impact of materialistic orientation among children and adolescents, financial educational programs are provided as preventive measures. Without a clear framework, it is impossible to evaluate these programs. The goals of this paper are threefold. Firstly, the phenomena related to adolescent materialistic orientation and its associated problems in Hong Kong are examined. Secondly, the concept of financial education as a preventive measure is reviewed. Both board and narrow definitions of money literacy are examined. A framework on money literacy for children and adolescents as a founding stone for financial education is proposed. The framework finds its support from a typology proposed by the authors and results from an integration of research findings on dimensions of the concepts of money and success. Finally, curriculum units for Grades 7 to 9 students in a positive youth development program (the Project P.A.T.H.S.) are developed using the framework. PMID:22194664

[The development of European Union common research and development policy and programs with special regard to life sciences].

PubMed

Pörzse, Gábor

2009-08-09

Research and development (R&D) has been playing a leading role in the European Community's history since the very beginning of European integration. Its importance has grown in recent years, after the launch of the Lisbon strategy. Framework programs have always played a considerable part in community research. The aim of their introduction was to fine tune national R&D activities, and to successfully divide research tasks between the Community and the member states. The Community, from the very outset, has acknowledged the importance of life sciences. It is no coincidence that life sciences have become the second biggest priority in the last two framework programs. This study provides a historical, and at the same time analytical and evaluative review of community R&D policy and activity from the starting point of its development until the present day. It examines in detail how the changes in structure, conditional system, regulations and priorities of the framework programs have followed the formation of social and economic needs. The paper puts special emphasis on the analysis of the development of life science research, presenting how they have met the challenges of the age, and how they have been built into the framework programs. Another research area of the present study is to elaborate how successfully Hungarian researchers have been joining the community research, especially the framework programs in the field of life sciences. To answer these questions, it was essential to survey, process and analyze the data available in the national and European public and closed databases. Contrary to the previous documents, this analysis doesn't concentrate on the political and scientific background. It outlines which role community research has played in sustainable social and economic development and competitiveness, how it has supported common policies and how the processes of integration have been deepening. Besides, the present paper offers a complete review of the given field, from its foundation up until the present day, by elaborating the newest initiatives and ideas for the future. This work is also novel from the point of view of the given professional field, the life sciences in the framework programs, and processing and evaluating of data of Hungarian participation in the 5th and 6th framework programs in the field of life sciences.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research

PubMed Central

Reeves, Todd D.; Marbach-Ad, Gili; Miller, Kristen R.; Ridgway, Judith; Gardner, Grant E.; Schussler, Elisabeth E.; Wischusen, E. William

2016-01-01

Biology graduate teaching assistants (GTAs) are significant contributors to the educational mission of universities, particularly in introductory courses, yet there is a lack of empirical data on how to best prepare them for their teaching roles. This essay proposes a conceptual framework for biology GTA teaching professional development (TPD) program evaluation and research with three overarching variable categories for consideration: outcome variables, contextual variables, and moderating variables. The framework’s outcome variables go beyond GTA satisfaction and instead position GTA cognition, GTA teaching practice, and undergraduate learning outcomes as the foci of GTA TPD evaluation and research. For each GTA TPD outcome variable, key evaluation questions and example assessment instruments are introduced to demonstrate how the framework can be used to guide GTA TPD evaluation and research plans. A common conceptual framework is also essential to coordinating the collection and synthesis of empirical data on GTA TPD nationally. Thus, the proposed conceptual framework serves as both a guide for conducting GTA TPD evaluation at single institutions and as a means to coordinate research across institutions at a national level. PMID:27193291

Participatory Evaluation as Seen in a Vygotskian Framework

ERIC Educational Resources Information Center

Higa, Terry Ann F.; Brandon, Paul R.

2008-01-01

In participatory evaluations of K-12 programs, evaluators develop school faculty's and administrators' evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We…

Faculty Descriptions of Simulation Debriefing in Traditional Baccalaureate Nursing Programs.

PubMed

Waznonis, Annette R

A study was conducted to describe simulation debriefing practices of faculty in accredited, traditional, baccalaureate nursing programs in the United States. Best debriefing practices include debriefing by a competent facilitator in a safe environment using a structured framework. Yet, structured frameworks and evaluation of debriefing are lacking in nursing education. This article reports the interview findings from the qualitative component of a large-scale mixed-methods study. Twenty-three full-time faculty members with an average of 6 years of simulation debriefing experience participated in interviews. Three themes emerged with subthemes: a) having the student's best interest at heart, b) getting over the emotional hurdle, and c) intentional debriefing evolves into learning. Gaps were found in faculty development, use of a structured framework, and evaluation. Research is warranted on use of video, postdebriefing assignments, cofacilitation, and debriefing effectiveness.

San Francisco urban partnership agreement : national evaluation plan.

DOT National Transportation Integrated Search

2009-12-22

This report provides an analytic framework for evaluating the San Francisco Urban Partnership Agreement (UPA) under the United States Department of Transportation (U.S. DOT) UPA Program. The San Francisco UPA projects to be evaluated focus on those r...

Advanced Public Transportation Systems. Technical Assistance Brief 2

DOT National Transportation Integrated Search

1993-01-01

The Advanced Public Transportation Systems (APTS) Program requires evaluation : of pilot projects. This technical assistance brief discusses the guidelines set : for developing evaluation framework and methodology for local projects. 4p.

Evaluating the Quality of Competency Assessment in Pharmacy: A Framework for Workplace Learning.

PubMed

Shah, Shailly; McLaughlin, Jacqueline E; Eckel, Stephen F; Mangun, Jesica; Hawes, Emily

2016-01-19

Demonstration of achieved competencies is critical in the pharmacy workplace. The purpose of this study was to evaluate the quality of the competency assessment program for pharmacy residents at an academic medical center. The competency assessment program (CAP) survey is a validated, 48-item instrument that evaluates the quality of an assessment program based on 12 criteria, each measured by four questions on a scale of 0 to 100. The CAP was completed by residents ( n = 23) and preceptors ( n = 28) from the pharmacy residency program between 2010 and 2013. Results were analyzed using descriptive statistics, Cronbach's alpha, and non-parametric tests. Educational Consequences was the only quality criteria falling below the standard for "good quality." Participants that completed residency training elsewhere rated the Comparability (0.04) and Meaningfulness (0.01) of the assessment program higher than those that completed residency at the academic medical center. There were no significant differences between resident and preceptor scores. Overall, the quality of the assessment program was rated highly by residents and preceptors. The process described here provides a useful framework for understanding the quality of workplace learning assessments in pharmacy practice.

Framework for a National Testing and Evaluation Program Based Upon the National Stormwater Testing and Evaluation for Products and Practices (STEPP) Initiative (WERF Report INFR2R14)

EPA Science Inventory

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective S...

An Approach for Selecting a Theoretical Framework for the Evaluation of Training Programs

ERIC Educational Resources Information Center

Tasca, Jorge Eduardo; Ensslin, Leonardo; Ensslin, Sandra Rolim; Alves, Maria Bernardete Martins

2010-01-01

Purpose: This research paper proposes a method for selecting references related to a research topic, and seeks to exemplify it for the case of a study evaluating training programs. The method is designed to identify references with high academic relevance in databases accessed via the internet, using a bibliometric analysis to sift the selected…

An Evaluation of the McRel Thinking Skills Program.

ERIC Educational Resources Information Center

Marzano, Robert J.

This report summarizes the results of an evaluation of the thinking skills model/program developed at the Mid-continent Regional Educational Laboratory (McREL). Participating were 19 primary, 32 upper elementary, 10 junior high, and 16 senior high school teachers at four sites varying in size and locale. Providing a framework for teaching a wide…

Toward a Capacity Framework for Useful Student Learning Outcomes Assessment in College Foreign Language Programs

ERIC Educational Resources Information Center

Davis, John McEwan

2016-01-01

The educational impacts of mandated assessment in U.S. colleges is part of a growing research agenda focused on how methodologies of program evaluation best enable educators to improve teaching and learning. Accordingly, research has tried to identify the key aspects of evaluation/assessment "capacity" in college language departments…

The Use of Workforce Assessment as a Component of Career and Technical Education Program Evaluation

ERIC Educational Resources Information Center

Bartlett, Kenneth R.; Schleif, Nicole L.; Bowen, Mauvalyn M.

2011-01-01

This research project examined the extent to which Career and Technical Education (CTE)-related programs use workforce needs assessment as a component of their evaluation activities. An employer perspective was used to develop a conceptual framework drawing on strategic human resource management theory. The extent and methods utilized for…

Evaluating Technology Transfer and Diffusion.

ERIC Educational Resources Information Center

Bozeman, Barry; And Others

1988-01-01

Four articles discuss the evaluation of technology transfer and diffusion: (1) "Technology Transfer at the U.S. National Laboratories: A Framework for Evaluation"; (2) "Application of Social Psychological and Evaluation Research: Lessons from Energy Information Programs"; (3) "Technology and Knowledge Transfer in Energy R and D Laboratories: An…

Monitoring and Evaluating the Transition of Large-Scale Programs in Global Health

PubMed Central

Bao, James; Rodriguez, Daniela C; Paina, Ligia; Ozawa, Sachiko; Bennett, Sara

2015-01-01

Purpose: Donors are increasingly interested in the transition and sustainability of global health programs as priorities shift and external funding declines. Systematic and high-quality monitoring and evaluation (M&E) of such processes is rare. We propose a framework and related guiding questions to systematize the M&E of global health program transitions. Methods: We conducted stakeholder interviews, searched the peer-reviewed and gray literature, gathered feedback from key informants, and reflected on author experiences to build a framework on M&E of transition and to develop guiding questions. Findings: The conceptual framework models transition as a process spanning pre-transition and transition itself and extending into sustained services and outcomes. Key transition domains include leadership, financing, programming, and service delivery, and relevant activities that drive the transition in these domains forward include sustaining a supportive policy environment, creating financial sustainability, developing local stakeholder capacity, communicating to all stakeholders, and aligning programs. Ideally transition monitoring would begin prior to transition processes being implemented and continue for some time after transition has been completed. As no set of indicators will be applicable across all types of health program transitions, we instead propose guiding questions and illustrative quantitative and qualitative indicators to be considered and adapted based on the transition domains identified as most important to the particular health program transition. The M&E of transition faces new and unique challenges, requiring measuring constructs to which evaluators may not be accustomed. Many domains hinge on measuring “intangibles” such as the management of relationships. Monitoring these constructs may require a compromise between rigorous data collection and the involvement of key stakeholders. Conclusion: Monitoring and evaluating transitions in global health programs can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Further investment and stronger methodological work are needed. PMID:26681706

The Rocky Road to Change: Implications for Substance Abuse Programs on College Campuses.

ERIC Educational Resources Information Center

Scott, Cynthia G.; Ambroson, DeAnn L.

1994-01-01

Examines college substance abuse prevention and intervention programs in the framework of the elaboration likelihood model. Discusses the role of persuasion and recommends careful analysis of the relevance, construction, and delivery of messages about substance use and subsequent program evaluation. Recommendations for increasing program…

Web-Based Engine for Program Curriculum Designers

ERIC Educational Resources Information Center

Hamam, H.; Loucif, S.

2009-01-01

Educational institutions pay careful attention to the design of program curricula, which represent a framework to meet institutional goals and missions. Of course, the success of any institution depends highly on the quality of its program curriculum. The development of such a curriculum and, more importantly, the evaluation of its quality are…

Engagement Theory in Action: An Investigation of Athletic Training Program Directors

ERIC Educational Resources Information Center

Peer, Kimberly S.

2007-01-01

Objective: To examine the use of good practice indicators by athletic training program directors and to provide a theoretical framework using engagement theory, a learner-centered process focusing on program improvement through continuous planning and evaluation, as a foundation for implementing good practices in athletic training education…

Evaluating School-Based Programming for Pregnant and Parenting Adolescents.

ERIC Educational Resources Information Center

Fenyk, Julie; Maruyama, Geoffrey; Seiden, Katherine; Pain, Lorna; Hoxie, Ann

The Children and Adolescent Support and Self-Sufficiency (CAPSS) program serves pregnant and parenting adolescents eligible to attend an urban school district in the Midwest. It employs a Youth Development Framework promoting connections with caring adults. While pregnancy prevention has become a major initiative for schools, programming to help…

Attributes of innovations and approaches to scalability - lessons from a national program to extend the scope of practice of health professionals.

PubMed

Masso, Malcolm; Thompson, Cristina

2016-01-01

The context for the paper was the evaluation of a national program in Australia to investigate extended scopes of practice for health professionals (paramedics, physiotherapists, and nurses). The design of the evaluation involved a mixed-methods approach with multiple data sources. Four multidisciplinary models of extended scope of practice were tested over an 18-month period, involving 26 organizations, 224 health professionals, and 36 implementation sites. The evaluation focused on what could be learned to inform scaling up the extended scopes of practice on a national scale. The evaluation findings were used to develop a conceptual framework for use by clinicians, managers, and policy makers to determine appropriate strategies for scaling up effective innovations. Development of the framework was informed by the literature on the diffusion of innovations, particularly an understanding that certain attributes of innovations influence adoption. The framework recognizes the role played by three groups of stakeholders: evidence producers, evidence influencers, and evidence adopters. The use of the framework is illustrated with four case studies from the evaluation. The findings demonstrate how the scaling up of innovations can be influenced by three quite distinct approaches - letting adoption take place in an uncontrolled, unplanned, way; actively helping the process of adoption; or taking deliberate steps to ensure that adoption takes place. Development of the conceptual framework resulted in two sets of questions to guide decisions about scalability, one for those considering whether to adopt the innovation (evidence adopters), and the other for those trying to decide on the optimal strategy for dissemination (evidence influencers).

Faculty Development for Continuing Interprofessional Education and Collaborative Practice

ERIC Educational Resources Information Center

Silver, Ivan L.; Leslie, Karen

2009-01-01

This article proposes a framework for faculty development in continuing interprofessional education (CIPE) and collaborative practice. The framework is built on best practices in faculty development and CIPE. It was informed by local experience in the development, delivery, and evaluation of a faculty development program to promote capacity for…

Evaluation of the Implementation of Operations and Maintenance Programs in New Jersey Schools.

ERIC Educational Resources Information Center

Kominsky, John R.; Freyberg, Ronald W.; Gerber, Donald R.; Centifonti, Gary J.

All schools are required to develop and implement an asbestos management plan (AMP). The key component of this plan is each school's operations and maintenance (O&M) program. This report outlines the importance of such programs. It describes an O&M program as an administrative framework that prescribes specific activities and work…

Atlanta congestion reduction demonstration national evaluation plan.

DOT National Transportation Integrated Search

2011-04-01

This report provides an analytic framework for evaluating the Atlanta Congestion Reduction Demonstration (CRD) under the United States Department of Transportation (U.S. DOT) Urban Partnership Agreement (UPA) and CRD Programs. The Atlanta CRD project...

Developing an Assessment, Monitoring, and Evaluation Framework for U.S. Department of Defense Security Cooperation

DTIC Science & Technology

2016-09-01

be conducted midstream, at the end of an activity program or LOE, or ex post facto . Not all security cooperation endeavors require evaluation...noncommercial use only. Unauthorized posting of this publication online is prohibited. Permission is given to duplicate this document for personal use only...iv Developing an AME Framework for DoD Security Cooperation approach, the study team analyzed documents, interviewed subject- matter experts

Evaluation du programme d'etudes de francais langue seconde en immersion a la 6e annee. La comprehension orale et la production orale, 1990. Rapport Final. (Evaluation of French as a Second Language Study Program for Grade Six Immersion. Oral Comprehension and Speaking Skills, 1990. Final Report).

ERIC Educational Resources Information Center

Theberge, Raymond

An evaluation of Manitoba's French immersion programs at the levels of grades 3, 6, and 9 focused on program effectiveness in teaching listening comprehension and speech skills. The results for grade 6 are presented here. The first section describes the framework of the immersion curriculum and the listening and oral skills targeted in it. The…

The Partners in Prevention Program: The Evaluation and Evolution of the Task-Centered Case Management Model

ERIC Educational Resources Information Center

Colvin, Julanne; Lee, Mingun; Magnano, Julienne; Smith, Valerie

2008-01-01

This article reports on the further development of the task-centered model for difficulties in school performance. We used Bailey-Dempsey and Reid's (1996) application of Rothman and Thomas's (1994) design and development framework and annual evaluations of the Partners in Prevention (PIP) Program to refine the task-centered case management model.…

Legal framework for food fortification: examples from Vietnam and Indonesia.

PubMed

Dijkhuizen, Marjoleine Amma; Wieringa, Frank Tammo; Soekarjo, Damayanti; Van, Khan Tran; Laillou, Arnaud

2013-06-01

Food fortification is a cost-effective, powerful, and sustainable strategy to combat micronutrient deficiency, with the potential to reach large sections of the population with minimal cost and effort. However, the implementation of food fortification on a systematic and large scale, for instance in national programs, has often been challenging. This paper takes a closer look at food fortification efforts and legislation mechanisms in Vietnam and Indonesia in order to determine specific factors and components in the legal framework that are crucial to the success of fortification programs. Fortification efforts in Indonesia and Vietnam are evaluated using published data as well as unpublished data from detailed evaluation reports, and compared with respect to the specific circumstances, constraints, objectives and results in each country. The legal framework is a crucial factor for the success of food fortification programs, as it shapes to a large extent the implementation of food fortification. The legal framework is instrumental to ensure the quality, safety, availability, cost-effectiveness, and sustainability of food fortification. In the first place, the legal framework should specify the fortificants and fortification levels, as well as the food vehicles and the fortification procedures. In addition, it should ensure the commitment of policy makers and producers to fortification, regulate the costing, describe and ensure information and communication such as product labeling integrate social marketing into the implementation, and provide the means to monitor and enforce fortification. A clear public health objective, together with careful consideration of the choices and restrictions dictated by the specific national environments, will help to develop legal frameworks that optimize the potential success of food fortification strategies. The lessons from these experiences show that a mandatory approach to fortification, with costing, monitoring and enforcement, and social marketing clearly defined and well embedded in the legal framework and in the implementation structures, is the best foundation for an effective, sustainable, and feasible food fortification program.

Formative Evaluation of ETV Programmes.

ERIC Educational Resources Information Center

Duby, Aliza

A process of formative evaluation which considers moral, scientific, and social values as its criteria and which is conducted by project staff is proposed for the evaluation of educational television (ETV) programs produced by the South African Broadcasting Corporation. The theoretical framework of ETV evaluation is outlined in the first section,…

Culture Writes the Script: On the Centrality of Context in Indigenous Evaluation

ERIC Educational Resources Information Center

LaFrance, Joan; Nichols, Richard; Kirkhart, Karen E.

2012-01-01

Context grounds all aspects of indigenous evaluation. From an indigenous evaluation framework (IEF), programs are understood within their relationship to place, setting, and community, and evaluations are planned, undertaken, and validated in relation to cultural context. This chapter describes and explains fundamental elements of IEF epistemology…

Growing a National Learning Environments and Resources Network for Science, Mathematics, Engineering, and Technology Education: Current Issues and Opportunities for the NSDL Program; Open Linking in the Scholarly Information Environment Using the OpenURL Framework; The HeadLine Personal Information Environment: Evaluation Phase One.

ERIC Educational Resources Information Center

Zia, Lee L.; Van de Sompel, Herbert; Beit-Arie, Oren; Gambles, Anne

2001-01-01

Includes three articles that discuss the National Science Foundation's National Science, Mathematics, Engineering, and Technology Education Digital Library (NSDL) program; the OpenURL framework for open reference linking in the Web-based scholarly information environment; and HeadLine (Hybrid Electronic Access and Delivery in the Library Networked…

Are we measuring what matters in health technology assessment of disease management? Systematic literature review.

PubMed

Steuten, Lotte; Vrijhoef, Bert; Severens, Hans; van Merode, Frits; Spreeuwenberg, Cor

2006-01-01

An overview was produced of indicators currently used to assess disease management programs and, based on these findings, provide a framework regarding sets of indicators that should be used when taking the aims and types of disease management programs into account. A systematic literature review was performed. Thirty-six studies met the inclusion criteria. It appeared that a link between aims of disease management and evaluated structure, process, as well as outcome indicators does not exist in a substantial part of published studies on disease management of diabetes and asthma/chronic obstructive pulmonary disease, especially when efficiency of care is concerned. Furthermore, structure indicators are largely missing from the evaluations, although these are of major importance for the interpretation of outcomes for purposes of decision-making. Efficiency of disease management is mainly evaluated by means of process indicators; the use of outcome indicators is less common. Within a framework, structure, process, and outcome indicators for effectiveness and efficiency are recommended for each type of disease management program. The link between aims of disease management and evaluated structure, process, and outcome indicators does not exist in a substantial part of published studies on disease management. The added value of this study mainly lies in the development of a framework to guide the choice of indicators for health technology assessment of disease management.

Creating a Culture of Safety Around Bar-Code Medication Administration: An Evidence-Based Evaluation Framework.

PubMed

Kelly, Kandace; Harrington, Linda; Matos, Pat; Turner, Barbara; Johnson, Constance

2016-01-01

Bar-code medication administration (BCMA) effectiveness is contingent upon compliance with best-practice protocols. We developed a 4-phased BCMA evaluation program to evaluate the degree of integration of current evidence into BCMA policies, procedures, and practices; identify barriers to best-practice BCMA use; and modify BCMA practice in concert with changes to the practice environment. This program provides an infrastructure for frontline nurses to partner with hospital leaders to continually evaluate and improve BCMA using a systematic process.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

A 3D Human-Machine Integrated Design and Analysis Framework for Squat Exercises with a Smith Machine.

PubMed

Lee, Haerin; Jung, Moonki; Lee, Ki-Kwang; Lee, Sang Hun

2017-02-06

In this paper, we propose a three-dimensional design and evaluation framework and process based on a probabilistic-based motion synthesis algorithm and biomechanical analysis system for the design of the Smith machine and squat training programs. Moreover, we implemented a prototype system to validate the proposed framework. The framework consists of an integrated human-machine-environment model as well as a squat motion synthesis system and biomechanical analysis system. In the design and evaluation process, we created an integrated model in which interactions between a human body and machine or the ground are modeled as joints with constraints at contact points. Next, we generated Smith squat motion using the motion synthesis program based on a Gaussian process regression algorithm with a set of given values for independent variables. Then, using the biomechanical analysis system, we simulated joint moments and muscle activities from the input of the integrated model and squat motion. We validated the model and algorithm through physical experiments measuring the electromyography (EMG) signals, ground forces, and squat motions as well as through a biomechanical simulation of muscle forces. The proposed approach enables the incorporation of biomechanics in the design process and reduces the need for physical experiments and prototypes in the development of training programs and new Smith machines.

A 3D Human-Machine Integrated Design and Analysis Framework for Squat Exercises with a Smith Machine

PubMed Central

Lee, Haerin; Jung, Moonki; Lee, Ki-Kwang; Lee, Sang Hun

2017-01-01

In this paper, we propose a three-dimensional design and evaluation framework and process based on a probabilistic-based motion synthesis algorithm and biomechanical analysis system for the design of the Smith machine and squat training programs. Moreover, we implemented a prototype system to validate the proposed framework. The framework consists of an integrated human–machine–environment model as well as a squat motion synthesis system and biomechanical analysis system. In the design and evaluation process, we created an integrated model in which interactions between a human body and machine or the ground are modeled as joints with constraints at contact points. Next, we generated Smith squat motion using the motion synthesis program based on a Gaussian process regression algorithm with a set of given values for independent variables. Then, using the biomechanical analysis system, we simulated joint moments and muscle activities from the input of the integrated model and squat motion. We validated the model and algorithm through physical experiments measuring the electromyography (EMG) signals, ground forces, and squat motions as well as through a biomechanical simulation of muscle forces. The proposed approach enables the incorporation of biomechanics in the design process and reduces the need for physical experiments and prototypes in the development of training programs and new Smith machines. PMID:28178184

Teaching Assistant Professional Development in Biology: Designed for and Driven by Multidimensional Data

PubMed Central

Long, Tammy M.; Ebert-May, Diane

2014-01-01

Graduate teaching assistants (TAs) are increasingly responsible for instruction in undergraduate science, technology, engineering, and mathematics (STEM) courses. Various professional development (PD) programs have been developed and implemented to prepare TAs for this role, but data about effectiveness are lacking and are derived almost exclusively from self-reported surveys. In this study, we describe the design of a reformed PD (RPD) model and apply Kirkpatrick's Evaluation Framework to evaluate multiple outcomes of TA PD before, during, and after implementing RPD. This framework allows evaluation that includes both direct measures and self-reported data. In RPD, TAs created and aligned learning objectives and assessments and incorporated more learner-centered instructional practices in their teaching. However, these data are inconsistent with TAs’ self-reported perceptions about RPD and suggest that single measures are insufficient to evaluate TA PD programs. PMID:26086654

[Assessing program sustainability in public health organizations: a tool-kit application in Haiti].

PubMed

Ridde, V; Pluye, P; Queuille, L

2006-10-01

Public health stakeholders are concerned about program sustainability. However, they usually conceive sustainability in accordance with financial criteria for at least one reason. No simple frameworks are operationally and theoretically sound enough to globally evaluate program sustainability. The present paper aims to describe an application of one framework assessment tool used to evaluate the sustainability level and process of a Nutritional Care Unit managed by a Swiss humanitarian agency to fight against severe child malnutrition in a Haitian area. The managing agency is committed to put this Unit back into the structure of a local public hospital. The evaluation was performed within the sustainability framework proposed in a former article. Data were collected with a combination of tools, semi-structured interviews (n=33, medical and support staff from the agency and the hospital), participatory observation and document review. Data concerned the four characteristics of organizational routines (memory, adaptation, values and rules) enabling assess to the level of sustainability. In addition, data were related to three types of events distinguishing routinization processes from implementation processes: specific events of routinization, routinization-implementation joint events, and specific events of implementation. Data analysis was thematic and results were validated by actors through a feed-back session and written comments. The current level of sustainability of the Nutritional Care Unit within the Hospital is weak: weak memory, high adaptation, weak sharing of values and rules. This may be explained by the sustainability process, and the absence of specific routinization events. The relevance of such processes is reasonable, while it has been strongly challenged in the troublesome Haitian context. Riots have been widespread over the last years, creating difficulties for the Hospital. This experience suggests the proposed framework and sustainability assessment tools are useful when the context permits scrutinization of program sustainability.

The Maine Savvy Caregiver Project: translating an evidence-based dementia family caregiver program within the RE-AIM Framework.

PubMed

Samia, Linda W; Aboueissa, AbouEl-Makarim; Halloran, Jan; Hepburn, Kenneth

2014-01-01

This article presents findings of a 3-year Savvy Caregiver Program translational study designed with the RE-AIM framework to create a statewide sustainable infrastructure and improve dementia family caregiver outcomes in one rural state. The RE-AIM dimensions--reach, effectiveness, adoption, implementation and maintenance--were evaluated using mixed methods. The program reached 770 caregivers and 87.7% (n = 676) participated in the study with 60.5% (n = 409) residing in rural locations. Participants demonstrated improved confidence, fewer depressive symptoms, and better managed their situation. Trainer resources, partnerships, and adequate planning were essential for program adoption and sustainability. Implications for replication are discussed.

Assessment of Evaluation Frameworks for Design of a Sexual Risk Prevention Game for Black Adolescent Girls.

PubMed

Sockolow, Paulina; Joppa, Meredith; Zhu, Jichen

2018-01-01

Adolescent sexual risk behavior (SRB), a major public health problem affects urban Black adolescent girls increasing their health disparities and risks for sexually transmitted infections. Collaborating with these adolescents, we designed a game for smartphones that incorporates elements of trauma-informed care and social cognitive theory to reduce SRB. Game researchers promote use of a comprehensive, multipurpose framework for development and evaluation of games for health applications. Our first game development step was framework selection and measurable health outcomes identification. Literature search identified two health game frameworks, both incorporating pedagogical theory, learning theory, and gaming requirements. Arnab used the IM + LM-GM framework to develop and implement a game in a school intervention program. Yusoff's framework was developed for use during game design. We investigated concordance and discordance between our SRB game design characteristics and each framework's components. Findings indicated Arnab's framework was sufficiently comprehensive to guide development of our game and outcome measure selection.

A Digital Program Informs Low-Income Caregivers of Preschool-Age Children about Family Meals

ERIC Educational Resources Information Center

Lohse, Barbara; Rifkin, Robin; Arnold, Kristen; Least, Christine

2012-01-01

Objective: To evaluate the digital program, "Mealtime is Family Time", as a means of educating caregivers of preschoolers on the importance of family meals within the division of feeding responsibility framework. Methods: Descriptive design using 2 approaches: focus group program review and discussion or self-report survey after independent…

Selecting forest residue treatment alternatives using goal programming.

Treesearch

Bruce B. Bare; Brian F. Anholt

1976-01-01

The use of goal programing for selecting forest residue treatment alternatives within a multiple goal framework is described. The basic features of goal programing are reviewed and illustrated with a hypothetical problem involving the selection of residue treatments for 10 cutting units. Twelve residue-regeneration treatment combinations are evaluated by using physical...

Application of Adverse Outcome Pathways to U.S. EPA’s Endocrine Disruptor Screening Program

PubMed Central

Noyes, Pamela D.; Casey, Warren M.; Dix, David J.

2017-01-01

Background: The U.S. EPA’s Endocrine Disruptor Screening Program (EDSP) screens and tests environmental chemicals for potential effects in estrogen, androgen, and thyroid hormone pathways, and it is one of the only regulatory programs designed around chemical mode of action. Objectives: This review describes the EDSP’s use of adverse outcome pathway (AOP) and toxicity pathway frameworks to organize and integrate diverse biological data for evaluating the endocrine activity of chemicals. Using these frameworks helps to establish biologically plausible links between endocrine mechanisms and apical responses when those end points are not measured in the same assay. Results: Pathway frameworks can facilitate a weight of evidence determination of a chemical’s potential endocrine activity, identify data gaps, aid study design, direct assay development, and guide testing strategies. Pathway frameworks also can be used to evaluate the performance of computational approaches as alternatives for low-throughput and animal-based assays and predict downstream key events. In cases where computational methods can be validated based on performance, they may be considered as alternatives to specific assays or end points. Conclusions: A variety of biological systems affect apical end points used in regulatory risk assessments, and without mechanistic data, an endocrine mode of action cannot be determined. Because the EDSP was designed to consider mode of action, toxicity pathway and AOP concepts are a natural fit. Pathway frameworks have diverse applications to endocrine screening and testing. An estrogen pathway example is presented, and similar approaches are being used to evaluate alternative methods and develop predictive models for androgen and thyroid pathways. https://doi.org/10.1289/EHP1304 PMID:28934726

The West African Health Organization's experience in improving the health research environment in the ECOWAS region.

PubMed

Aidam, Jude; Sombié, Issiaka

2016-04-20

The West African Health Organization (WAHO) implemented a research development program in West Africa during 2009-2013 using the Knowledge for Better Health Research Capacity Development Framework, developed by Pang et al. (Bull World Health Organ 81(11):815-820, 2003), on strategies used to improve the research environment. The framework has the following components: stewardship, financing, sustainable resourcing and research utilization. This paper describes how WAHO implemented this research development program in the West African region to help improve the research environment and lessons learnt. This is a retrospective review of the regional research development program using a triangulation of activity reports, an independent evaluation and the authors' experiences with stakeholders. This program was designed to address gaps along the components of the framework and to improve partnership. The activities, results and challenges are summarised for each component of the framework. The independent evaluation was conducted using over 180 semi-structured interviews of key stakeholders in the West African region and activity reports. WAHO and major stakeholders validated these findings during a regional meeting. All 15 ECOWAS countries benefited from this regional research development program. WAHO provided technical and financial support to eight countries to develop their policies, priorities and plans for research development to improve their research governance. WAHO, along with other technical and financial partners, organised many capacity-strengthening trainings in health systems research methodology, resource mobilization, ethical oversight and on HRWeb, a research information management platform. WAHO helped launch a regional network of health research institutions to improve collaboration between regional participating institutions. Further, WAHO developed strategic research partnerships and mobilised additional funding to support the program. The program supported 24 health research projects. High staff turnover, weak institutional capacities and ineffective collaboration were some of the challenges encountered during program activity implementation. The regional collaborative approach to health research development using this framework was effective given the challenges in the West African region. The achievements particularly with improved research partnerships and funding helped strengthen local health research environments. This highlights WAHO's role and the common experiences in the West African region in improving health research.

Evaluation of Capacity-Building Program of District Health Managers in India: A Contextualized Theoretical Framework

PubMed Central

Prashanth, N. S.; Marchal, Bruno; Kegels, Guy; Criel, Bart

2014-01-01

Performance of local health services managers at district level is crucial to ensure that health services are of good quality and cater to the health needs of the population in the area. In many low- and middle-income countries, health services managers are poorly equipped with public health management capacities needed for planning and managing their local health system. In the south Indian Tumkur district, a consortium of five non-governmental organizations partnered with the state government to organize a capacity-building program for health managers. The program consisted of a mix of periodic contact classes, mentoring and assignments and was spread over 30 months. In this paper, we develop a theoretical framework in the form of a refined program theory to understand how such a capacity-building program could bring about organizational change. A well-formulated program theory enables an understanding of how interventions could bring about improvements and an evaluation of the intervention. In the refined program theory of the intervention, we identified various factors at individual, institutional, and environmental levels that could interact with the hypothesized mechanisms of organizational change, such as staff’s perceived self-efficacy and commitment to their organizations. Based on this program theory, we formulated context–mechanism–outcome configurations that can be used to evaluate the intervention and, more specifically, to understand what worked, for whom and under what conditions. We discuss the application of program theory development in conducting a realist evaluation. Realist evaluation embraces principles of systems thinking by providing a method for understanding how elements of the system interact with one another in producing a given outcome. PMID:25121081

Evaluation of capacity-building program of district health managers in India: a contextualized theoretical framework.

PubMed

Prashanth, N S; Marchal, Bruno; Kegels, Guy; Criel, Bart

2014-01-01

Performance of local health services managers at district level is crucial to ensure that health services are of good quality and cater to the health needs of the population in the area. In many low- and middle-income countries, health services managers are poorly equipped with public health management capacities needed for planning and managing their local health system. In the south Indian Tumkur district, a consortium of five non-governmental organizations partnered with the state government to organize a capacity-building program for health managers. The program consisted of a mix of periodic contact classes, mentoring and assignments and was spread over 30 months. In this paper, we develop a theoretical framework in the form of a refined program theory to understand how such a capacity-building program could bring about organizational change. A well-formulated program theory enables an understanding of how interventions could bring about improvements and an evaluation of the intervention. In the refined program theory of the intervention, we identified various factors at individual, institutional, and environmental levels that could interact with the hypothesized mechanisms of organizational change, such as staff's perceived self-efficacy and commitment to their organizations. Based on this program theory, we formulated context-mechanism-outcome configurations that can be used to evaluate the intervention and, more specifically, to understand what worked, for whom and under what conditions. We discuss the application of program theory development in conducting a realist evaluation. Realist evaluation embraces principles of systems thinking by providing a method for understanding how elements of the system interact with one another in producing a given outcome.

Software Engineering Support of the Third Round of Scientific Grand Challenge Investigations: Earth System Modeling Software Framework Survey

NASA Technical Reports Server (NTRS)

Talbot, Bryan; Zhou, Shu-Jia; Higgins, Glenn; Zukor, Dorothy (Technical Monitor)

2002-01-01

One of the most significant challenges in large-scale climate modeling, as well as in high-performance computing in other scientific fields, is that of effectively integrating many software models from multiple contributors. A software framework facilitates the integration task, both in the development and runtime stages of the simulation. Effective software frameworks reduce the programming burden for the investigators, freeing them to focus more on the science and less on the parallel communication implementation. while maintaining high performance across numerous supercomputer and workstation architectures. This document surveys numerous software frameworks for potential use in Earth science modeling. Several frameworks are evaluated in depth, including Parallel Object-Oriented Methods and Applications (POOMA), Cactus (from (he relativistic physics community), Overture, Goddard Earth Modeling System (GEMS), the National Center for Atmospheric Research Flux Coupler, and UCLA/UCB Distributed Data Broker (DDB). Frameworks evaluated in less detail include ROOT, Parallel Application Workspace (PAWS), and Advanced Large-Scale Integrated Computational Environment (ALICE). A host of other frameworks and related tools are referenced in this context. The frameworks are evaluated individually and also compared with each other.

Adapting the Community of Inquiry Survey for an Online Graduate Program: Implications for Online Programs

ERIC Educational Resources Information Center

Kumar, Swapna; Ritzhaupt, Albert D.

2014-01-01

A cohort-based online professional doctorate program that consisted of both online coursework and research activities was designed using Garrison et al's community of inquiry (CoI) framework. The evaluation of the program proved a challenge because all existing CoI assessment methods in the past have dealt with online courses, not with online…

Implementation of a Systematic Accountability Framework in 2014 to Improve the Performance of the Nigerian Polio Program

PubMed Central

Tegegne, Sisay G.; MKanda, Pascal; Yehualashet, Yared G.; Erbeto, Tesfaye B.; Touray, Kebba; Nsubuga, Peter; Banda, Richard; Vaz, Rui G.

2016-01-01

Background. An accountability framework is a central feature of managing human and financial resources. One of its primary goals is to improve program performance through close monitoring of selected priority activities. The principal objective of this study was to determine the contribution of a systematic accountability framework to improving the performance of the World Health Organization (WHO)–Nigeria polio program staff, as well as the program itself. Methods. The effect of implementation of the accountability framework was evaluated using data on administrative actions and select process indicators associated with acute flaccid paralysis (AFP) surveillance, routine immunization, and polio supplemental immunization activities. Data were collected in 2014 during supportive supervision, using Magpi software (a company that provides service to collect data using mobile phones). A total of 2500 staff were studied. Results. Data on administrative actions and process indicators from quarters 2–4 in 2014 were compared. With respect to administrative actions, 1631 personnel (74%) received positive feedback (written or verbal commendation) in quarter 4 through the accountability framework, compared with 1569 (73%) and 1152 (61%) during quarters 3 and 2, respectively. These findings accorded with data on process indicators associated with AFP surveillance and routine immunization, showing statistically significant improvements in staff performance at the end of quarter 4, compared with other quarters. Conclusions. Improvements in staff performance and process indicators were observed for the WHO-Nigeria polio program after implementation of a systematic accountability framework. PMID:26823334

Use of program logic models in the Southern Rural Access Program evaluation.

PubMed

Pathman, Donald; Thaker, Samruddhi; Ricketts, Thomas C; Albright, Jennifer B

2003-01-01

The Southern Rural Access Program (SRAP) evaluation team used program logic models to clarify grantees' activities, objectives, and timelines. This information was used to benchmark data from grantees' progress reports to assess the program's successes. This article presents a brief background on the use of program logic models--essentially charts or diagrams specifying a program's planned activities, objectives, and goals--for evaluating and managing a program. It discusses the structure of the logic models chosen for the SRAP and how the model concept was introduced to the grantees to promote acceptance and use of the models. The article describes how the models helped clarify the program's objectives and helped lead agencies plan and manage the many program initiatives and subcontractors in their states. Models also provided a framework for grantees to report their progress to the National Program Office and evaluators and promoted the evaluators' visibility and acceptance by the grantees. Program logics, however, increased grantees' reporting requirements and demanded substantial time of the evaluators. Program logic models, on balance, proved their merit in the SRAP through their contributions to its management and evaluation and by providing a better understanding of the program's initiatives, successes, and potential impact.

Education for All in South Africa: Developing a National System for Quality Assurance.

ERIC Educational Resources Information Center

Smith, William J.; Ngoma-Maema, Wendy Yolisa

2003-01-01

Draws on international research, policy, and practice relevant to quality assurance systems to analyze the development of a national framework for educational quality assurance in South Africa. Describes an emerging framework for quality assurance that encompasses evaluation of student achievement, quality audits and reviews, program and service…

Evaluating Educative Temporary Systems

ERIC Educational Resources Information Center

Dickinson, Gary; Lamoureux, Marvin E.

1975-01-01

The framework of temporary systems theory was the basis for forming theoretical units and propositions pertaining to the outcomes of intensive adult education programs. Empirical indicators and research hypotheses were then developed and applied in the 1972 residential program of the Labour College of Canada. (Author)

Measuring Security Effectiveness and Efficiency at U.S. Commercial Airports

DTIC Science & Technology

2013-03-01

formative program evaluation and policy analysis to investigate current airport security programs. It identifies innovative public administration and...policy-analysis tools that could provide potential benefits to airport security . These tools will complement the System Based Risk Management framework if

Manual for research, development and technology program and project evaluations : final report.

DOT National Transportation Integrated Search

2016-04-01

This manual provides the Federal Railroad Administrations (FRA) Office of Research, Development and Technology (RD&T) a : framework, standards, and procedures for planning, conducting, reporting, and using sound evaluations of RD&Ts projects fo...

CRITICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide guidance fo...

Framework for selection and evaluation of bicycle and pedestrian safety projects in Virginia.

DOT National Transportation Integrated Search

2008-01-01

The Virginia Department of Transportation's (VDOT) Bicycle and Pedestrian Safety (BPS) Program provides funds for implementing short-term, low-cost bicycle and pedestrian safety projects in Virginia. This initiative is administered by evaluating each...

Risk-based evaluation of commercial motor vehicle roadside violations : process and results

DOT National Transportation Integrated Search

2010-09-01

This report provides an analytic framework for evaluating the Atlanta Congestion Reduction Demonstration (CRD) under the United States Department of Transportation (U.S. DOT) Urban Partnership Agreement (UPA) and CRD Programs. The Atlanta CRD project...

Evaluating health inequity interventions: applying a contextual (external) validity framework to programs funded by the Canadian Health Services Research Foundation.

PubMed

Phillips, Kaye; Müller-Clemm, Werner; Ysselstein, Margaretha; Sachs, Jonathan

2013-02-01

Including context in the measurement and evaluation of health in equity interventions is critical to understanding how events that occur in an intervention's environment might contribute to or impede its success. This study adapted and piloted a contextual validity assessment framework on a selection of health inequity-related programs funded by the Canadian Health Services Research Foundation (CHSRF) between 1998 and 2006. The two overarching objectives of this study were (1) to determine the relative amount and quality of attention given to conceptualizing, measuring and validating context within CHSRF funded research final reports related to health-inequity; and (2) to contribute evaluative evidence towards the incorporation of context into the assessment and measurement of health inequity interventions. The study found that of the 42/146 CHSRF programs and projects, judged to be related to health inequity 20 adequately reported on the conceptualization, measurement and validation of context. Amongst these health-inequity related project reports, greatest emphasis was placed on describing the socio-political and economical context over actually measuring and validating contextual evidence. Applying a contextual validity assessment framework was useful for distinguishing between the descriptive (conceptual) versus empirical (measurement and validation) inclusion of documented contextual evidence. Although contextual validity measurement frameworks needs further development, this study contributes insight into identifying funded research related to health inequities and preliminary criteria for assessing interventions targeted at specific populations and jurisdictions. This study also feeds a larger critical dialogue (albeit beyond the scope of this study) regarding the relevance and utility of using evaluative techniques for understanding how specific external conditions support or impede the successful implementation of health inequity interventions. Copyright © 2012 Elsevier Ltd. All rights reserved.

Attributes of innovations and approaches to scalability – lessons from a national program to extend the scope of practice of health professionals

PubMed Central

Masso, Malcolm; Thompson, Cristina

2016-01-01

The context for the paper was the evaluation of a national program in Australia to investigate extended scopes of practice for health professionals (paramedics, physiotherapists, and nurses). The design of the evaluation involved a mixed-methods approach with multiple data sources. Four multidisciplinary models of extended scope of practice were tested over an 18-month period, involving 26 organizations, 224 health professionals, and 36 implementation sites. The evaluation focused on what could be learned to inform scaling up the extended scopes of practice on a national scale. The evaluation findings were used to develop a conceptual framework for use by clinicians, managers, and policy makers to determine appropriate strategies for scaling up effective innovations. Development of the framework was informed by the literature on the diffusion of innovations, particularly an understanding that certain attributes of innovations influence adoption. The framework recognizes the role played by three groups of stakeholders: evidence producers, evidence influencers, and evidence adopters. The use of the framework is illustrated with four case studies from the evaluation. The findings demonstrate how the scaling up of innovations can be influenced by three quite distinct approaches – letting adoption take place in an uncontrolled, unplanned, way; actively helping the process of adoption; or taking deliberate steps to ensure that adoption takes place. Development of the conceptual framework resulted in two sets of questions to guide decisions about scalability, one for those considering whether to adopt the innovation (evidence adopters), and the other for those trying to decide on the optimal strategy for dissemination (evidence influencers). PMID:27616889

A Survey and Analysis of Frameworks and Framework Issues for Information Fusion Applications

NASA Astrophysics Data System (ADS)

Llinas, James

This paper was stimulated by the proposed project for the Santander Bank-sponsored "Chairs of Excellence" program in Spain, of which the author is a recipient. That project involves research on characterizing a robust, problem-domain-agnostic framework in which Information Fusion (IF) processes of all description, to include artificial intelligence processes and techniques could be developed. The paper describes the IF process and its requirements, a literature survey on IF frameworks, and a new proposed framework that will be implemented and evaluated at Universidad Carlos III de Madrid, Colmenarejo Campus.

Learning Theory Foundations of Simulation-Based Mastery Learning.

PubMed

McGaghie, William C; Harris, Ilene B

2018-06-01

Simulation-based mastery learning (SBML), like all education interventions, has learning theory foundations. Recognition and comprehension of SBML learning theory foundations are essential for thoughtful education program development, research, and scholarship. We begin with a description of SBML followed by a section on the importance of learning theory foundations to shape and direct SBML education and research. We then discuss three principal learning theory conceptual frameworks that are associated with SBML-behavioral, constructivist, social cognitive-and their contributions to SBML thought and practice. We then discuss how the three learning theory frameworks converge in the course of planning, conducting, and evaluating SBML education programs in the health professions. Convergence of these learning theory frameworks is illustrated by a description of an SBML education and research program in advanced cardiac life support. We conclude with a brief coda.

Evaluating the Impact of Instructional Multimedia: Workable Techniques.

ERIC Educational Resources Information Center

Rathbun, Gail A.; Goodrum, David A.

A framework is proposed for the formative evaluation of multimedia. It describes techniques that have worked well in the evaluation of software development and gives examples of the use of evaluation results. The focus is primarily on the degree to which the instructional multimedia program supports the user's activities and tasks in the user's…

Why Aren't Evaluations Working and What to Do About It: A Framework for Negotiating Meaningful Evaluation in Nonprofits

ERIC Educational Resources Information Center

Liket, Kellie C.; Rey-Garcia, Marta; Maas, Karen E. H.

2014-01-01

Nonprofit organizations are under great pressure to use evaluations to show that their programs "work" and that they are "effective." However, empirical evidence indicates that nonprofits struggle to perform useful evaluations, especially when conducted under accountability pressures. An increasing body of evidence highlights…

Deductive Evaluation: Formal Code Analysis With Low User Burden

NASA Technical Reports Server (NTRS)

Di Vito, Ben. L

2016-01-01

We describe a framework for symbolically evaluating iterative C code using a deductive approach that automatically discovers and proves program properties. Although verification is not performed, the method can infer detailed program behavior. Software engineering work flows could be enhanced by this type of analysis. Floyd-Hoare verification principles are applied to synthesize loop invariants, using a library of iteration-specific deductive knowledge. When needed, theorem proving is interleaved with evaluation and performed on the fly. Evaluation results take the form of inferred expressions and type constraints for values of program variables. An implementation using PVS (Prototype Verification System) is presented along with results for sample C functions.

Designing the framework for competency-based master of public health programs in India.

PubMed

Sharma, Kavya; Zodpey, Sanjay; Morgan, Alison; Gaidhane, Abhay; Syed, Zahiruddin Quazi; Kumar, Rajeev

2013-01-01

Competency in the practice of public health is the implicit goal of education institutions that offer master of public health (MPH) programs. With the expanding number of institutions offering courses in public health in India, it is timely to develop a common framework to ensure that graduates are proficient in critical public health. Steps such as situation assessment, survey of public health care professionals in India, and national consultation were undertaken to develop a proposed competency-based framework for MPH programs in India. The existing curricula of all 23 Indian MPH courses vary significantly in content with regard to core, concentration, and crosscutting discipline areas and course durations. The competency or learning outcome is not well defined. The findings of the survey suggest that MPH graduates in India should have competencies ranging from monitoring of health problems and epidemics in the community, applying biostatistics in public health, conducting action research, understanding social and community influence on public health developing indicators and instruments to monitor and evaluate community health programs, developing proposals, and involving community in planning, delivery, and monitoring of health programs. Competency statements were framed and mapped with domains including epidemiology, biostatistics, social and behavioral sciences, health care system, policy, planning, and financing, and environmental health sciences and a crosscutting domain that include health communication and informatics, health management and leadership, professionalism, systems thinking, and public health biology. The proposed competency-based framework for Indian MPH programs can be adapted to meet the needs of diverse, unique programs. The framework ensures the uniqueness and diversity of individual MPH programs in India while contributing to measures of overall program success.

Advantages of the net benefit regression framework for economic evaluations of interventions in the workplace: a case study of the cost-effectiveness of a collaborative mental health care program for people receiving short-term disability benefits for psychiatric disorders.

PubMed

Hoch, Jeffrey S; Dewa, Carolyn S

2014-04-01

Economic evaluations commonly accompany trials of new treatments or interventions; however, regression methods and their corresponding advantages for the analysis of cost-effectiveness data are not well known. To illustrate regression-based economic evaluation, we present a case study investigating the cost-effectiveness of a collaborative mental health care program for people receiving short-term disability benefits for psychiatric disorders. We implement net benefit regression to illustrate its strengths and limitations. Net benefit regression offers a simple option for cost-effectiveness analyses of person-level data. By placing economic evaluation in a regression framework, regression-based techniques can facilitate the analysis and provide simple solutions to commonly encountered challenges. Economic evaluations of person-level data (eg, from a clinical trial) should use net benefit regression to facilitate analysis and enhance results.

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program.

PubMed

Britten, Nicole; Wallar, Lauren E; McEwen, Scott A; Papadopoulos, Andrew

2014-07-31

Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students' learning experiences. The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system.

Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use

ERIC Educational Resources Information Center

Patton, Michael Quinn

2010-01-01

Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He…

Parallelizing Compiler Framework and API for Power Reduction and Software Productivity of Real-Time Heterogeneous Multicores

NASA Astrophysics Data System (ADS)

Hayashi, Akihiro; Wada, Yasutaka; Watanabe, Takeshi; Sekiguchi, Takeshi; Mase, Masayoshi; Shirako, Jun; Kimura, Keiji; Kasahara, Hironori

Heterogeneous multicores have been attracting much attention to attain high performance keeping power consumption low in wide spread of areas. However, heterogeneous multicores force programmers very difficult programming. The long application program development period lowers product competitiveness. In order to overcome such a situation, this paper proposes a compilation framework which bridges a gap between programmers and heterogeneous multicores. In particular, this paper describes the compilation framework based on OSCAR compiler. It realizes coarse grain task parallel processing, data transfer using a DMA controller, power reduction control from user programs with DVFS and clock gating on various heterogeneous multicores from different vendors. This paper also evaluates processing performance and the power reduction by the proposed framework on a newly developed 15 core heterogeneous multicore chip named RP-X integrating 8 general purpose processor cores and 3 types of accelerator cores which was developed by Renesas Electronics, Hitachi, Tokyo Institute of Technology and Waseda University. The framework attains speedups up to 32x for an optical flow program with eight general purpose processor cores and four DRP(Dynamically Reconfigurable Processor) accelerator cores against sequential execution by a single processor core and 80% of power reduction for the real-time AAC encoding.

Real-Time Data Capture and Management Evaluation and Performance Measures : Evaluation Framework

DOT National Transportation Integrated Search

2011-09-01

Through connected vehicle research, the U.S. DOT Intelligent Transportation Systems Joint Program Office (ITS JPO) is leading an effort to assess the potential for systematic and dynamic data capture from vehicles, travelers and the transportation sy...

Assessing Capacity for Sustainability of Effective Programs and Policies in Local Health Departments.

PubMed

Tabak, Rachel G; Duggan, Katie; Smith, Carson; Aisaka, Kristelle; Moreland-Russell, Sarah; Brownson, Ross C

2016-01-01

Sustainability has been defined as the existence of structures and processes that allow a program to leverage resources to effectively implement and maintain evidence-based public health and is important in local health departments (LHDs) to retain the benefits of effective programs. Explore the applicability of the Program Sustainability Framework in high- and low-capacity LHDs as defined by national performance standards. Case study interviews from June to July 2013. Standard qualitative methodology was used to code transcripts; codes were developed inductively and deductively. Six geographically diverse LHD's (selected from 3 of high and 3 of low capacity) : 35 LHD practitioners. Thematic reports explored the 8 domains (Organizational Capacity, Program Adaptation, Program Evaluation, Communications, Strategic Planning, Funding Stability, Environmental Support, and Partnerships) of the Program Sustainability Framework. High-capacity LHDs described having environmental support, while low-capacity LHDs reported this was lacking. Both high- and low-capacity LHDs described limited funding; however, high-capacity LHDs reported greater funding flexibility. Partnerships were important to high- and low-capacity LHDs, and both described building partnerships to sustain programming. Regarding organizational capacity, high-capacity LHDs reported better access to and support for adequate staff and staff training when compared with low-capacity LHDs. While high-capacity LHDs described integration of program evaluation into implementation and sustainability, low-capacity LHDs reported limited capacity for measurement specifically and evaluation generally. When high-capacity LHDs described program adoption, they discussed an opportunity to adapt and evaluate. Low-capacity LHDs struggled with programs requiring adaptation. High-capacity LHDs described higher quality communication than low-capacity LHDs. High- and low-capacity LHDs described strategic planning, but high-capacity LHDs reported efforts to integrate evidence-based public health. Investments in leadership support for improving organizational capacity, improvements in communication from the top of the organization, integrating program evaluation into implementation, and greater funding flexibility may enhance sustainability of evidence-based public health in LHDs.

Health promotion in schools: a multi-method evaluation of an Australian School Youth Health Nurse Program.

PubMed

Banfield, Michelle; McGorm, Kelly; Sargent, Ginny

2015-01-01

Health promotion provides a key opportunity to empower young people to make informed choices regarding key health-related behaviours such as tobacco and alcohol use, sexual practices, dietary choices and physical activity. This paper describes the evaluation of a pilot School Youth Health Nurse (SYHN) Program, which aims to integrate a Registered Nurse into school communities to deliver health promotion through group education and individual sessions. The evaluation was guided by the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework. The objectives were to explore: 1) whether the Program was accessible to the high school students; 2) the impacts of the Program on key stakeholders; 3) which factors affected adoption of the Program; 4) whether implementation was consistent with the Program intent; and 5) the long-term sustainability of the Program. Research included retrospective analysis of Program records, administration of a survey of student experiences and interviews with 38 stakeholders. This evaluation provided evidence that the SYHN Program is reaching students in need, is effective, has been adopted successfully in schools, is being implemented as intended and could be maintained with sustained funding. The nurses deliver an accessible and acceptable primary health care service, focused on health promotion, prevention and early intervention. After some initial uncertainty about the scope and nature of the role, the nurses are a respected source of health information in the schools, consulted on curriculum development and contributing to whole-of-school health activities. Findings demonstrate that the SYHN model is feasible and acceptable to the students and schools involved in the pilot. The Program provides health promotion and accessible primary health care in the school setting, consistent with the Health Promoting Schools framework.

An assessment of patient navigator activities in breast cancer patient navigation programs using a nine-principle framework.

PubMed

Gunn, Christine M; Clark, Jack A; Battaglia, Tracy A; Freund, Karen M; Parker, Victoria A

2014-10-01

To determine how closely a published model of navigation reflects the practice of navigation in breast cancer patient navigation programs. Observational field notes describing patient navigator activities collected from 10 purposefully sampled, foundation-funded breast cancer navigation programs in 2008-2009. An exploratory study evaluated a model framework for patient navigation published by Harold Freeman by using an a priori coding scheme based on model domains. Field notes were compiled and coded. Inductive codes were added during analysis to characterize activities not included in the original model. Programs were consistent with individual-level principles representing tasks focused on individual patients. There was variation with respect to program-level principles that related to program organization and structure. Program characteristics such as the use of volunteer or clinical navigators were identified as contributors to patterns of model concordance. This research provides a framework for defining the navigator role as focused on eliminating barriers through the provision of individual-level interventions. The diversity observed at the program level in these programs was a reflection of implementation according to target population. Further guidance may be required to assist patient navigation programs to define and tailor goals and measurement to community needs. © Health Research and Educational Trust.

An Assessment of Patient Navigator Activities in Breast Cancer Patient Navigation Programs Using a Nine-Principle Framework

PubMed Central

Gunn, Christine M; Clark, Jack A; Battaglia, Tracy A; Freund, Karen M; Parker, Victoria A

2014-01-01

Objective To determine how closely a published model of navigation reflects the practice of navigation in breast cancer patient navigation programs. Data Source Observational field notes describing patient navigator activities collected from 10 purposefully sampled, foundation-funded breast cancer navigation programs in 2008–2009. Study Design An exploratory study evaluated a model framework for patient navigation published by Harold Freeman by using an a priori coding scheme based on model domains. Data Collection Field notes were compiled and coded. Inductive codes were added during analysis to characterize activities not included in the original model. Principal Findings Programs were consistent with individual-level principles representing tasks focused on individual patients. There was variation with respect to program-level principles that related to program organization and structure. Program characteristics such as the use of volunteer or clinical navigators were identified as contributors to patterns of model concordance. Conclusions This research provides a framework for defining the navigator role as focused on eliminating barriers through the provision of individual-level interventions. The diversity observed at the program level in these programs was a reflection of implementation according to target population. Further guidance may be required to assist patient navigation programs to define and tailor goals and measurement to community needs. PMID:24820445

A framework for evaluating national space activity

NASA Astrophysics Data System (ADS)

Wood, Danielle; Weigel, Annalisa

2012-04-01

Space technology and resources are used around the world to address societal challenges. Space provides valuable satellite services, unique scientific discoveries, surprising technology applications and new economic opportunities. Many developing countries formally recognize the advantages of space resources and pursue national level activity to harness them. There is limited data or documentation on the space activities of developing countries. Meanwhile, traditional approaches to summarize national space activity do not necessarily capture the types of activity that developing countries pursue in space. This is especially true if they do not have a formal national space program or office. Developing countries pursue national space activity through activities of many types—from national satellite programs to commercial use of satellite services to involvement with international space institutions. This research aims to understand and analyze these trends. This paper introduces two analytical frameworks for evaluating space activity at the national level. The frameworks are specifically designed to capture the activity of countries that have traditionally been less involved in space. They take a broad view of space related activity across multiple societal sectors and disciplines. The discussion explains the approach for using the frameworks as well as illustrative examples of how they can be applied as part of a research process. The first framework is called the Mission and Management Ladders. This framework considers specific space projects within countries and ranks them on "Ladders" that measure technical challenge and managerial autonomy. This first method is at a micro level of analysis. The second framework is called the Space Participation Metric (SPM). The SPM can be used to assign a Space Participation score to countries based on their involvement in various space related activities. This second method uses a macro level of analysis. The authors developed both frameworks as part of a long term research program about the space activities of developing countries. This aspect of the research focuses on harnessing multiple techniques to summarize complex, multi-disciplinary information about global space activity.

Framework for Quality Professional Development for Practitioners Working with Adult English Language Learners. Revised

ERIC Educational Resources Information Center

Center for Adult English Language Acquisition, 2010

2010-01-01

The Center for Adult English Language Acquisition (CAELA) Network, under contract with the Office of Vocational and Adult Education (OVAE), has created a framework that can be used to plan, implement, and evaluate professional development for practitioners working with adult English language learners at the state, regional, and program levels. The…

Developmental Stages and Work Capacities of Community Coalitions: How Extension Educators Address and Evaluate Changing Coalition Needs

ERIC Educational Resources Information Center

Nichols, Allison; Riffe, Jane; Peck, Terrill; Kaczor, Cheryl; Nix, Kelly; Faulkner-Van Deysen, Angela

2014-01-01

Extension educators provide resources to community coalitions. The study reported here adds to what is known about community coalitions and applies an assessment framework to a state-level coalition-based Extension program on healthy relationships and marriages. The study combines the Internal Coalition Outcome Hierarchy (ICOH) framework with four…

Quality Assurance in Victorian Schools: An Approach to School Improvement. The School Review Program in Victoria, Australia: An Evaluation.

ERIC Educational Resources Information Center

Fearnside, Rob

The Victorian school accountability framework is designed specifically for Victorian public schooling in the 1990s. These schools have three chief characteristics: (1) a high level of school autonomy in operational decisions about research allocation, human-resource management, and staff selection; (2) a common framework for curriculum and…

Decision Support Framework (DSF) For Evaluating Planned Land And Resource Use Decisions: Hypothetical Application Of The DSF To Address Nutrient Loads In The Florida Keys

EPA Science Inventory

The mission of ORD's Ecosystme Services Research Program (ESRP) is to provide the information and methods needed by decision-makers to assess the benefits of ecosystem goods and services to human well-being for inclusion in management alternatives. The Decision Support Framework...

Illuminating the Black Box of Entrepreneurship Education Programs

ERIC Educational Resources Information Center

Maritz, Alex; Brown, Christopher R.

2013-01-01

Purpose: The aim of this paper is to explore the components of entrepreneurship education programs (EEPs) and their interrelationships to develop a conceptual framework through which entrepreneurship education may be contextually evaluated and developed. Design/methodology/approach: The paper presents an extensive literature review of the…

Rebooting Kirkpatrick: Integrating Information System Theory Into the Evaluation of Web-based Continuing Professional Development Interventions for Interprofessional Education.

PubMed

Shen, Nelson; Yufe, Shira; Saadatfard, Omid; Sockalingam, Sanjeev; Wiljer, David

2017-01-01

Information system research has stressed the importance of theory in understanding how user perceptions can motivate the use and adoption of technology such as web-based continuing professional development programs for interprofessional education (WCPD-IPE). A systematic review was conducted to provide an information system perspective on the current state of WCPD-IPE program evaluation and how current evaluations capture essential theoretical constructs in promoting technology adoption. Six databases were searched to identify studies evaluating WCPD-IPE. Three investigators determined eligibility of the articles. Evaluation items extracted from the studies were assessed using the Kirkpatrick-Barr framework and mapped to the Benefits Evaluation Framework. Thirty-seven eligible studies yielded 362 evaluation items for analysis. Most items (n = 252) were assessed as Kirkpatrick-Barr level 1 (reaction) and were mainly focused on the quality (information, service, and quality) and satisfaction dimensions of the Benefits Evaluation. System quality was the least evaluated quality dimension, accounting for 26 items across 13 studies. WCPD-IPE use was reported in 17 studies and its antecedent factors were evaluated in varying degrees of comprehensiveness. Although user reactions were commonly evaluated, greater focus on user perceptions of system quality (ie, functionality and performance), usefulness, and usability of the web-based platform is required. Surprisingly, WCPD-IPE use was reported in less than half of the studies. This is problematic as use is a prerequisite to realizing any individual, organizational, or societal benefit of WCPD-IPE. This review proposes an integrated framework which accounts for these factors and provides a theoretically grounded guide for future evaluations.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

Expert consensus on best evaluative practices in community-based rehabilitation.

PubMed

Grandisson, Marie; Thibeault, Rachel; Hébert, Michèle; Cameron, Debra

2016-01-01

The objective of this study was to generate expert consensus on best evaluative practices for community-based rehabilitation (CBR). This consensus includes key features of the evaluation process and methods, and discussion of whether a shared framework should be used to report findings and, if so, which framework should play this role. A Delphi study with two predefined rounds was conducted. Experts in CBR from a wide range of geographical areas and disciplinary backgrounds were recruited to complete the questionnaires. Both quantitative and qualitative analyses were performed to generate the recommendations for best practices in CBR evaluation. A panel of 42 experts reached consensus on 13 recommendations for best evaluative practices in CBR. In regard to the critical qualities of sound CBR evaluation processes, panellists emphasized that these processes should be inclusive, participatory, empowering and respectful of local cultures and languages. The group agreed that evaluators should consider the use of mixed methods and participatory tools, and should combine indicators from a universal list of CBR indicators with locally generated ones. The group also agreed that a common framework should guide CBR evaluations, and that this framework should be a flexible combination between the CBR Matrix and the CBR Principles. An expert panel reached consensus on key features of best evaluative practices in CBR. Knowledge transfer initiatives are now required to develop guidelines, tools and training opportunities to facilitate CBR program evaluations. CBR evaluation processes should strive to be inclusive, participatory, empowering and respectful of local cultures and languages. CBR evaluators should strongly consider using mixed methods, participatory tools, a combination of indicators generated with the local community and with others from a bank of CBR indicators. CBR evaluations should be situated within a shared, but flexible, framework. This shared framework could combine the CBR Matrix and the CBR Principles.

Framework for End-User Programming of Cross-Smart Space Applications

PubMed Central

Palviainen, Marko; Kuusijärvi, Jarkko; Ovaska, Eila

2012-01-01

Cross-smart space applications are specific types of software services that enable users to share information, monitor the physical and logical surroundings and control it in a way that is meaningful for the user's situation. For developing cross-smart space applications, this paper makes two main contributions: it introduces (i) a component design and scripting method for end-user programming of cross-smart space applications and (ii) a backend framework of components that interwork to support the brunt of the RDFScript translation, and the use and execution of ontology models. Before end-user programming activities, the software professionals must develop easy-to-apply Driver components for the APIs of existing software systems. Thereafter, end-users are able to create applications from the commands of the Driver components with the help of the provided toolset. The paper also introduces the reference implementation of the framework, tools for the Driver component development and end-user programming of cross-smart space applications and the first evaluation results on their application. PMID:23202169

A Plan for Evaluating Teacher Training Workshops and Institutes. Technical Report 87-2-3.

ERIC Educational Resources Information Center

Ayers, Jerry B.

A plan for evaluating teacher training workshops and institutes is presented. Juxtaposition of the target group and the type of evaluation provides the framework for evaluating such a program. Evaluation is formative, aimed at modifying and improving the plan as it is being developed, and summative, assessed at the end of the experience. The use…

Mourning dove hunting regulation strategy based on annual harvest statistics and banding data

USGS Publications Warehouse

Otis, D.L.

2006-01-01

Although managers should strive to base game bird harvest management strategies on mechanistic population models, monitoring programs required to build and continuously update these models may not be in place. Alternatively, If estimates of total harvest and harvest rates are available, then population estimates derived from these harvest data can serve as the basis for making hunting regulation decisions based on population growth rates derived from these estimates. I present a statistically rigorous approach for regulation decision-making using a hypothesis-testing framework and an assumed framework of 3 hunting regulation alternatives. I illustrate and evaluate the technique with historical data on the mid-continent mallard (Anas platyrhynchos) population. I evaluate the statistical properties of the hypothesis-testing framework using the best available data on mourning doves (Zenaida macroura). I use these results to discuss practical implementation of the technique as an interim harvest strategy for mourning doves until reliable mechanistic population models and associated monitoring programs are developed.

A Formative Evaluation of a Diabetes Prevention Program Using the RE-AIM Framework in a Learning Health Care System, Utah, 2013-2015.

PubMed

Brunisholz, Kimberly D; Kim, Jaewhan; Savitz, Lucy A; Hashibe, Mia; Gren, Lisa H; Hamilton, Sharon; Huynh, Kelly; Joy, Elizabeth A

2017-07-20

Evaluation of interventions can help to close the gap between research and practice but seldom takes place during implementation. Using the RE-AIM framework, we conducted a formative evaluation of the first year of the Intermountain Healthcare Diabetes Prevention Program (DPP). Adult patients who met the criteria for prediabetes (HbA1c of 5.70%-6.49% or fasting plasma glucose of 100-125 mg/dL) were attributed to a primary care provider from August 1, 2013, through July 31, 2014. Physicians invited eligible patients to participate in the program during an office visit. We evaluated 1) reach, with data on patient eligibility, participation, and representativeness; 2) effectiveness, with data on attaining a 5% weight loss; 3) adoption, with data on providers and clinics that referred patients to the program; and 4) implementation, with data on patient encounters. We did not measure maintenance. Of the 6,862 prediabetes patients who had an in-person office visit with their provider, 8.4% of eligible patients enrolled. Likelihood of participation was higher among patients who were female, aged 70 years or older, or overweight; had depression and higher weight at study enrollment; or were prescribed metformin. DPP participants were more likely than nonparticipants to achieve a 5% weight loss (odds ratio, 1.70; 95% confidence interval, 1.29-2.25; P < .001). Providers from 7 of 8 regions referred patients to the DPP; 174 providers at 53 clinics enrolled patients. The mean number of DPP counseling encounters per patient was 2.3 (range, 1-16). The RE-AIM framework was useful for estimating the formative impact (ie, reach, effectiveness, adoption, and implementation fidelity) of a DPP-based lifestyle intervention deployed in a learning health care system.

Total Performance Development Systems: Blueprints for Building and Sustaining Organizational Excellence

ERIC Educational Resources Information Center

Schanie, Charles F.; Kemper, James E.

2008-01-01

Most "performance evaluation" or "performance development" programs in higher education today are little more than metrically-weak, bureaucratic programs aimed simply at establishing a legally-grounded employee record and a rough basis for merit increases. This article outlines the rationale and procedural framework for a talent development and…

Illinois Programs of Study Guide: 2009

ERIC Educational Resources Information Center

Taylor, Jason L.; Kirby, Catherine L., Bragg, Debra D.; Oertle, Kathleen M.; Jankowski, Natasha A.; Khan, Sadya S.

2009-01-01

This guide begins with background information useful to understanding Illinois' framework for implementation and evaluation of Programs of Study. It starts with a visual depiction of the relationships between activity at the federal, state and local levels that evolved to the creation of Illinois' Career Cluster Model. This Model, which is based…

Practitioner Assessment of Conflict Resolution Programs. ERIC Digest Number 163.

ERIC Educational Resources Information Center

Deutsch, Morton

There are many ways to assess the effectiveness of school conflict resolution training (CRT) programs. Some methods require extensive resources, but others, conducted by CRT practitioners themselves, also provide useful information. This digest presents a framework for CRT evaluation by practitioners that enables them to reflect productively on…

Innovation and Persistence: The Evaluation of the C.U.P.L.E. Studio Physics Course.

ERIC Educational Resources Information Center

Cooper, Marie A.; O'Donnell, Angela M.

The last decade has seen the development of a number of computer-based interactive physics programs at the university level. Set in a cognitive apprenticeship framework, such programs view the instructor as a mentor, and the essential learning constructed in a collaborative process. It is expected that such programs, grounded as they are in…

An Evaluation with Respect to e-Learning and Economic Analysis of the Graduate Program Offered in Anadolu University's Institute of Educational Sciences

ERIC Educational Resources Information Center

Bayrak, Coskun; Kesim, Eren

2005-01-01

In this study, an e-learning platform was formed to enable school teachers and administrators to attend graduate programs in the field of educational administration, supervision, planning and economics. In this framework, for the non-thesis educational administration, supervision, planning and economics graduate programs to be conducted in the…

NASA Small Business Innovation Research program

NASA Technical Reports Server (NTRS)

Johnson, Harry W.

1985-01-01

NASA activities in the framework of the 11-agency federal Small Business Innovation Research program are outlined in tables and graphs and briefly characterized. Statistics on the program are given; the technical topics covered are listed; and the procedures involved in evaluating applications for support are discussed. A number of typical defects in proposals are indicated, and recommendations for avoiding them are provided.

Evaluating the Implementation of Performance Improvement Training: The E[superscript 3] Process for Success

ERIC Educational Resources Information Center

Larbi-Apau, Josephine A.; Moseley, James L.

2008-01-01

This article provides a comprehensive approach to careful review and evaluation of the implementation of performance training intervention. It discusses the E[superscript 3] process for success, a basic framework for evaluating the implementation phase of a training program implemented as a broad-based performance improvement strategy. The intent…

Alternative Methods in the Evaluation of School District Cash Management Programs.

ERIC Educational Resources Information Center

Dembowski, Frederick L.

1980-01-01

Empirically evaluates three measures of effectiveness of school district cash management: the rate of return method in common use and two new measures--efficiency rating and Net Present Value (NPV). The NPV approach allows examination of efficiency and provides a framework for evaluating other areas of educational policy. (Author/IRT)

Operationalizing the 21st Century Learning Skills Framework for the NASA Mission to Mars Program

NASA Astrophysics Data System (ADS)

Smith, Burgess; Research, MSI; Evaluation Team; Interactive Videoconferences Teamlt/p>, MSI

2013-06-01

Internal evaluators working with the NASA Mission to Mars program, an out-of-school collaborative videoconferencing program at the Museum of Science and Industry Chicago (MSI), developed an observation protocol to collect evidence about the collaborative learning opportunities offered by the program’s unique technology. Details about the protocol’s development are discussed, along with results of the pilot observations of the program.

Putting program evaluation to work: a framework for creating actionable knowledge for suicide prevention practice.

PubMed

Wilkins, Natalie; Thigpen, Sally; Lockman, Jennifer; Mackin, Juliette; Madden, Mary; Perkins, Tamara; Schut, James; Van Regenmorter, Christina; Williams, Lygia; Donovan, John

2013-06-01

The economic and human cost of suicidal behavior to individuals, families, communities, and society makes suicide a serious public health concern, both in the US and around the world. As research and evaluation continue to identify strategies that have the potential to reduce or ultimately prevent suicidal behavior, the need for translating these findings into practice grows. The development of actionable knowledge is an emerging process for translating important research and evaluation findings into action to benefit practice settings. In an effort to apply evaluation findings to strengthen suicide prevention practice, the Centers for Disease Control and Prevention (CDC) and the Substance Abuse and Mental Health Services Administration (SAMHSA) supported the development of three actionable knowledge products that make key findings and lessons learned from youth suicide prevention program evaluations accessible and useable for action. This paper describes the actionable knowledge framework (adapted from the knowledge transfer literature), the three products that resulted, and recommendations for further research into this emerging method for translating research and evaluation findings and bridging the knowledge-action gap.

MOE vs. M&E: considering the difference between measuring strategic effectiveness and monitoring tactical evaluation.

PubMed

Diehl, Glen; Major, Solomon

2015-01-01

Measuring the effectiveness of military Global Health Engagements (GHEs) has become an area of increasing interest to the military medical field. As a result, there have been efforts to more logically and rigorously evaluate GHE projects and programs; many of these have been based on the Logic and Results Frameworks. However, while these Frameworks are apt and appropriate planning tools, they are not ideally suited to measuring programs' effectiveness. This article introduces military medicine professionals to the Measures of Effectiveness for Defense Engagement and Learning (MODEL) program, which implements a new method of assessment, one that seeks to rigorously use Measures of Effectiveness (vs. Measures of Performance) to gauge programs' and projects' success and fidelity to Theater Campaign goals. While the MODEL method draws on the Logic and Results Frameworks where appropriate, it goes beyond their planning focus by using the latest social scientific and econometric evaluation methodologies to link on-the-ground GHE "lines of effort" to the realization of national and strategic goals and end-states. It is hoped these methods will find use beyond the MODEL project itself, and will catalyze a new body of rigorous, empirically based work, which measures the effectiveness of a broad spectrum of GHE and security cooperation activities. We based our strategies on the principle that it is much more cost-effective to prevent conflicts than it is to stop one once it's started. I cannot overstate the importance of our theater security cooperation programs as the centerpiece to securing our Homeland from the irregular and catastrophic threats of the 21st Century.-GEN James L. Jones, USMC (Ret.). Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

Interdisciplinary research and education in the Vienna Doctoral Programme on Water Resource Systems: a framework for evaluation

NASA Astrophysics Data System (ADS)

Bloeschl, G.; Carr, G.; Loucks, D. P.

2017-12-01

Greater understanding of how interdisciplinary research and education evolves is critical for identifying and implementing appropriate programme management strategies. We propose a program evaluation framework that is based on social learning processes (individual learning, interdisciplinary research practices, and interaction between researchers with different backgrounds); social capital outcomes (ability to interact, interpersonal connectivity, and shared understanding); and knowledge and human capital outcomes (new knowledge that integrates multiple research fields). The framework is tested on established case study doctoral program: the Vienna Doctoral Program on Water Resource Systems. Data are collected via mixed qualitative/quantitative methods that include semi-structured interviews, publication co-author analysis, analysis of research proposals, categorisation of the interdisciplinarity of publications and graduate analysis. Through the evaluation and analysis, several interesting findings about how interdisciplinary research evolves and can be supported are identified. Firstly, different aspects of individual learning seem to contribute to a researcher's ability to interact with researchers from other research fields and work collaboratively. These include learning new material from different research fields, learning how to learn new material and learning how to integrate different material. Secondly, shared interdisciplinary research practices can be identified that may be common to other programs and support interaction and shared understanding between different researchers. They include clarification and questioning, harnessing differences and setting defensible research boundaries. Thirdly, intensive interaction between researchers from different backgrounds support connectivity between the researchers, further enabling cross-disciplinary collaborative work. The case study data suggest that social learning processes and social capital outcomes precede new interdisciplinary research findings and are therefore a critical aspect to consider in interdisciplinary program management.

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Effects of donor proliferation in development aid for health on health program performance: A conceptual framework.

PubMed

Pallas, Sarah Wood; Ruger, Jennifer Prah

2017-02-01

Development aid for health increased dramatically during the past two decades, raising concerns about inefficiency and lack of coherence among the growing number of global health donors. However, we lack a framework for how donor proliferation affects health program performance to inform theory-based evaluation of aid effectiveness policies. A review of academic and gray literature was conducted. Data were extracted from the literature sample on study design and evidence for hypothesized effects of donor proliferation on health program performance, which were iteratively grouped into categories and mapped into a new conceptual framework. In the framework, increases in the number of donors are hypothesized to increase inter-donor competition, transaction costs, donor poaching of recipient staff, recipient control over aid, and donor fragmentation, and to decrease donors' sense of accountability for overall development outcomes. There is mixed evidence on whether donor proliferation increases or decreases aid volume. These primary effects in turn affect donor innovation, information hoarding, and aid disbursement volatility, as well as recipient country health budget levels, human resource capacity, and corruption, and the determinants of health program performance. The net effect of donor proliferation on health will vary depending on the magnitude of the framework's competing effects in specific country settings. The conceptual framework provides a foundation for improving design of aid effectiveness practices to mitigate negative effects from donor proliferation while preserving its potential benefits. Copyright © 2017 Elsevier Ltd. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dale, Virginia H.; Efroymson, Rebecca Ann; Kline, Keith L.

A framework for selecting and evaluating indicators of bioenergy sustainability is presented. This framework is designed to facilitate decision-making about which indicators are useful for assessing sustainability of bioenergy systems and supporting their deployment. Efforts to develop sustainability indicators in the United States and Europe are reviewed. The first steps of the framework for indicator selection are defining the sustainability goals and other goals for a bioenergy project or program, gaining an understanding of the context, and identifying the values of stakeholders. From the goals, context, and stakeholders, the objectives for analysis and criteria for indicator selection can be developed.more » The user of the framework identifies and ranks indicators, applies them in an assessment, and then evaluates their effectiveness, while identifying gaps that prevent goals from being met, assessing lessons learned, and moving toward best practices. The framework approach emphasizes that the selection of appropriate criteria and indicators is driven by the specific purpose of an analysis. Realistic goals and measures of bioenergy sustainability can be developed systematically with the help of the framework presented here.« less

Striding toward social justice: the ecologic milieu of physical activity.

PubMed

Lee, Rebecca E; Cubbin, Catherine

2009-01-01

Disparities in physical activity should be investigated in light of social justice principles. This article critically evaluates evidence and trends in disparities research within an ecologic framework, focusing on multilevel factors such as neighborhood and racial discrimination that influence physical activity. Discussion focuses on strategies for integrating social justice into physical activity promotion and intervention programming within an ecologic framework.

OpenCluster: A Flexible Distributed Computing Framework for Astronomical Data Processing

NASA Astrophysics Data System (ADS)

Wei, Shoulin; Wang, Feng; Deng, Hui; Liu, Cuiyin; Dai, Wei; Liang, Bo; Mei, Ying; Shi, Congming; Liu, Yingbo; Wu, Jingping

2017-02-01

The volume of data generated by modern astronomical telescopes is extremely large and rapidly growing. However, current high-performance data processing architectures/frameworks are not well suited for astronomers because of their limitations and programming difficulties. In this paper, we therefore present OpenCluster, an open-source distributed computing framework to support rapidly developing high-performance processing pipelines of astronomical big data. We first detail the OpenCluster design principles and implementations and present the APIs facilitated by the framework. We then demonstrate a case in which OpenCluster is used to resolve complex data processing problems for developing a pipeline for the Mingantu Ultrawide Spectral Radioheliograph. Finally, we present our OpenCluster performance evaluation. Overall, OpenCluster provides not only high fault tolerance and simple programming interfaces, but also a flexible means of scaling up the number of interacting entities. OpenCluster thereby provides an easily integrated distributed computing framework for quickly developing a high-performance data processing system of astronomical telescopes and for significantly reducing software development expenses.

Conceptual Soundness, Metric Development, Benchmarking, and Targeting for PATH Subprogram Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mosey. G.; Doris, E.; Coggeshall, C.

The objective of this study is to evaluate the conceptual soundness of the U.S. Department of Housing and Urban Development (HUD) Partnership for Advancing Technology in Housing (PATH) program's revised goals and establish and apply a framework to identify and recommend metrics that are the most useful for measuring PATH's progress. This report provides an evaluative review of PATH's revised goals, outlines a structured method for identifying and selecting metrics, proposes metrics and benchmarks for a sampling of individual PATH programs, and discusses other metrics that potentially could be developed that may add value to the evaluation process. The frameworkmore » and individual program metrics can be used for ongoing management improvement efforts and to inform broader program-level metrics for government reporting requirements.« less

Grounding theories of W(e)Learn: a framework for online interprofessional education.

PubMed

Casimiro, Lynn; MacDonald, Colla J; Thompson, Terrie Lynn; Stodel, Emma J

2009-07-01

Interprofessional care (IPC) is a prerequisite for enhanced communication between healthcare team members, improved quality of care, and better outcomes for patients. A move to an IPC model requires changing the learning experiences of healthcare providers during and after their qualification program. With the rapid growth of online and blended approaches to learning, an educational framework that explains how to construct quality learning events to provide IPC is pressing. Such a framework would offer a quality standard to help educators design, develop, deliver, and evaluate online interprofessional education (IPE) programs. IPE is an extremely delicate process due to issues related to knowledge, status, power, accountability, personality traits, and culture that surround IPC. In this paper, a review of the pertinent literature that would inform the development of such a framework is presented. The review covers IPC, IPE, learning theories, and eLearning in healthcare.

Evaluation of intrinsic and extrinsic motivation interventions with a self-help smoking cessation program.

PubMed

Curry, S J; Wagner, E H; Grothaus, L C

1991-04-01

Personalized feedback and a financial incentive, developed from an intrinsic/extrinsic motivation framework, were evaluated as adjuncts to self-help materials for smoking cessation. Ss (N = 1,217) were randomized to 4 treatment groups and were followed up at 3 and 12 months. Consistent with hypotheses derived from the motivation framework, the financial incentive increased the use of self-help materials, did not increase cessation rates among program users, and was associated with higher relapse rates among those who did manage to quit. The personalized feedback increased both smoking cessation and use of the materials 3 months after distribution of the materials. Continuous abstinence (abstinence at 3 and 12 months) in the group that received the personalized feedback alone was twice the rate of the other groups.

Policy advocacy and leadership training for formerly incarcerated women: an empowerment evaluation of ReConnect, a program of the Women in Prison Project, Correctional Association of New York.

PubMed

Pinto, R M; Rahman, R; Williams, A

2014-12-01

There is limited knowledge on re-entry initiatives for formerly incarcerated women specifically on building women's advocacy and leadership skills. Our research highlights an empowerment evaluation on ReConnect, a 12-session; innovative advocacy and leadership development program rooted in an integrated framework of empowerment, and transformational leadership theories. Using thematic analysis, we coded three focus groups with 24 graduates, for themes that matched our framework's concepts. ReConnect graduates reported being empowered by the information they received on parental rights, housing, and employment. Participants agreed that ReConnect improved their communication skills, preparing them to advocate for themselves and community members. Copyright © 2014 Elsevier Ltd. All rights reserved.

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program

PubMed Central

2014-01-01

Background Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. Methods A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. Results The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students’ learning experiences. Conclusions The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system. PMID:25078124

A Research Framework for Reducing Preventable Patient Harm

PubMed Central

Weinstein, Robert; Cardo, Denise M.; Goeschel, Christine A.; Berenholtz, Sean M.; Saint, Sanjay; Jernigan, John A.

2011-01-01

Programs to reduce central line–associated bloodstream infections (CLABSIs) have improved the safety of hospitalized patients. Efforts are underway to disseminate these successes broadly to reduce other types of hospital-acquired infectious and noninfectious preventable harms. Unfortunately, the ability to broadly measure and prevent other types of preventable harms, especially infectious harms, needs enhancement. Moreover, an overarching research framework for creating and integrating evidence will help expedite the development of national prevention programs. This article outlines a 5-phase translational (T) framework to develop robust research programs that reduce preventable harm, as follows: phase T0, discover opportunities and approaches to prevent adverse health care events; phase T1, use T0 discoveries to develop and test interventions on a small scale; phase T2, broaden and strengthen the evidence base for promising interventions to develop evidence-based guidelines; phase T3, translate guidelines into clinical practice; and phase T4, implement and evaluate T3 work on a national and international scale. Policy makers should use this framework to fill in the knowledge gaps, coordinate efforts among federal agencies, and prioritize research funding. PMID:21258104

Framework for Evaluating the Health Impact of the Scale-Up of Malaria Control Interventions on All-Cause Child Mortality in Sub-Saharan Africa.

PubMed

Yé, Yazoume; Eisele, Thomas P; Eckert, Erin; Korenromp, Eline; Shah, Jui A; Hershey, Christine L; Ivanovich, Elizabeth; Newby, Holly; Carvajal-Velez, Liliana; Lynch, Michael; Komatsu, Ryuichi; Cibulskis, Richard E; Moore, Zhuzhi; Bhattarai, Achuyt

2017-09-01

Concerted efforts from national and international partners have scaled up malaria control interventions, including insecticide-treated nets, indoor residual spraying, diagnostics, prompt and effective treatment of malaria cases, and intermittent preventive treatment during pregnancy in sub-Saharan Africa (SSA). This scale-up warrants an assessment of its health impact to guide future efforts and investments; however, measuring malaria-specific mortality and the overall impact of malaria control interventions remains challenging. In 2007, Roll Back Malaria's Monitoring and Evaluation Reference Group proposed a theoretical framework for evaluating the impact of full-coverage malaria control interventions on morbidity and mortality in high-burden SSA countries. Recently, several evaluations have contributed new ideas and lessons to strengthen this plausibility design. This paper harnesses that new evaluation experience to expand the framework, with additional features, such as stratification, to examine subgroups most likely to experience improvement if control programs are working; the use of a national platform framework; and analysis of complete birth histories from national household surveys. The refined framework has shown that, despite persisting data challenges, combining multiple sources of data, considering potential contributions from both fundamental and proximate contextual factors, and conducting subnational analyses allows identification of the plausible contributions of malaria control interventions on malaria morbidity and mortality.

A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research.

PubMed

Reeves, Todd D; Marbach-Ad, Gili; Miller, Kristen R; Ridgway, Judith; Gardner, Grant E; Schussler, Elisabeth E; Wischusen, E William

2016-01-01

Biology graduate teaching assistants (GTAs) are significant contributors to the educational mission of universities, particularly in introductory courses, yet there is a lack of empirical data on how to best prepare them for their teaching roles. This essay proposes a conceptual framework for biology GTA teaching professional development (TPD) program evaluation and research with three overarching variable categories for consideration: outcome variables, contextual variables, and moderating variables. The framework's outcome variables go beyond GTA satisfaction and instead position GTA cognition, GTA teaching practice, and undergraduate learning outcomes as the foci of GTA TPD evaluation and research. For each GTA TPD outcome variable, key evaluation questions and example assessment instruments are introduced to demonstrate how the framework can be used to guide GTA TPD evaluation and research plans. A common conceptual framework is also essential to coordinating the collection and synthesis of empirical data on GTA TPD nationally. Thus, the proposed conceptual framework serves as both a guide for conducting GTA TPD evaluation at single institutions and as a means to coordinate research across institutions at a national level. © 2016 T. D. Reeves et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Evaluation of an online continuing education program from the perspective of new graduate nurses.

PubMed

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

EPA OFFICE OF RESEARCH AND DEVELOPMENT GUIDELINES FOR TECHNICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide direction f...

STRATEGIES FOR EVALUATING INDICATORS BASED ON GUIDELINES FROM THE ENVIRONMENTAL PROTECTION AGENCY'S OFFICE OF RESEARCH AND DEVELOPMENT.

EPA Science Inventory

The Environmental Protection Agency's Office of Research and Development (ORD) has prepared technical guidelines to evaluate the suitability of ecological indicators for monitoring programs. The guidelines were adopted by ORD to provide a consistent framework for indicator review...

Evaluation of a community-based, family focused healthy weights initiative using the RE-AIM framework.

PubMed

Jung, Mary E; Bourne, Jessica E; Gainforth, Heather L

2018-01-26

Childhood overweight and obesity is a major public health concern. Community-based interventions have the potential to reach caregivers and children. However, the overall health impact of these programs is rarely comprehensively assessed. This study evaluated a physical activity and healthy eating family program (Healthy Together; HT) using the RE-AIM framework. Ten sites implemented the 5-week program. Thirty-nine staff members and 277 program participants (126 caregivers [M age  = 35.6] and 151 children [M age  = 13]) participated in the evaluation. Each RE-AIM dimension was assessed independently using a mixed-methods approach. Sources of data included archival records, interviews and surveys. Effectiveness outcome variables were assessed at pre- and post-intervention and 6-month follow-up. Reach: HT participants were almost entirely recruited from existing programs within sites. Effectiveness: Caregivers' nutrition related efficacy beliefs increased following HT (ps < .03). Participation in HT was not associated with significant changes in physical activity or nutrition behaviour or perceived social support (ps > .05). Knowledge surrounding healthy diets and physical activity increased in children and caregivers (ps < .05). Adoption: Thirty-five percent of sites approached to implement HT expressed interest. The 10 sites selected recruited existing staff members to implement HT. Program objectives were met 72.8% of the time and 71 adaptations were made. HT was finance- and time-dependent. Maintenance: Two sites fully implemented HT in the follow-up year and 5 sites incorporated aspects of HT into other programs. Working alongside organizations that develop community programs to conduct comprehensive, arms-length evaluations can systematically highlight areas of success and challenges. Overall HT represents a feasible community-based intervention; however further support is required in order to ensure the program is effective at positively targeting the desired outcomes. As a result of this evaluation, modifications are currently being implemented to HT.

DRUG EVALUATION AND DECISION MAKING IN CATALONIA: DEVELOPMENT AND VALIDATION OF A METHODOLOGICAL FRAMEWORK BASED ON MULTI-CRITERIA DECISION ANALYSIS (MCDA) FOR ORPHAN DRUGS.

PubMed

Gilabert-Perramon, Antoni; Torrent-Farnell, Josep; Catalan, Arancha; Prat, Alba; Fontanet, Manel; Puig-Peiró, Ruth; Merino-Montero, Sandra; Khoury, Hanane; Goetghebeur, Mireille M; Badia, Xavier

2017-01-01

The aim of this study was to adapt and assess the value of a Multi-Criteria Decision Analysis (MCDA) framework (EVIDEM) for the evaluation of Orphan drugs in Catalonia (Catalan Health Service). The standard evaluation and decision-making procedures of CatSalut were compared with the EVIDEM methodology and contents. The EVIDEM framework was adapted to the Catalan context, focusing on the evaluation of Orphan drugs (PASFTAC program), during a Workshop with sixteen PASFTAC members. The criteria weighting was done using two different techniques (nonhierarchical and hierarchical). Reliability was assessed by re-test. The EVIDEM framework and methodology was found useful and feasible for Orphan drugs evaluation and decision making in Catalonia. All the criteria considered for the development of the CatSalut Technical Reports and decision making were considered in the framework. Nevertheless, the framework could improve the reporting of some of these criteria (i.e., "unmet needs" or "nonmedical costs"). Some Contextual criteria were removed (i.e., "Mandate and scope of healthcare system", "Environmental impact") or adapted ("population priorities and access") for CatSalut purposes. Independently of the weighting technique considered, the most important evaluation criteria identified for orphan drugs were: "disease severity", "unmet needs" and "comparative effectiveness", while the "size of the population" had the lowest relevance for decision making. Test-retest analysis showed weight consistency among techniques, supporting reliability overtime. MCDA (EVIDEM framework) could be a useful tool to complement the current evaluation methods of CatSalut, contributing to standardization and pragmatism, providing a method to tackle ethical dilemmas and facilitating discussions related to decision making.

Water resources management. World Bank policy paper; Gestion des ressources en eau

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

1993-12-31

The management framework presented in this study addresses the demand for water in Asia caused by rapid population growth and economic development. It focuses on three key actions to meet the challenge: evaluate how the region manages water resources; identify guidelines for the Bank`s water resource programs; and develop country-specific strategies and promote joint programs. Reforms built into the framework seek to modernize institutions that affect water sources. The authors suggest ways to improve planning and long-term management, streamline economic and financial policy, and upgrade `real-time` management, operation, and maintenance.

A framework for selecting indicators of bioenergy sustainability

DOE PAGES

Dale, Virginia H.; Efroymson, Rebecca Ann; Kline, Keith L.; ...

2015-05-11

A framework for selecting and evaluating indicators of bioenergy sustainability is presented. This framework is designed to facilitate decision-making about which indicators are useful for assessing sustainability of bioenergy systems and supporting their deployment. Efforts to develop sustainability indicators in the United States and Europe are reviewed. The first steps of the framework for indicator selection are defining the sustainability goals and other goals for a bioenergy project or program, gaining an understanding of the context, and identifying the values of stakeholders. From the goals, context, and stakeholders, the objectives for analysis and criteria for indicator selection can be developed.more » The user of the framework identifies and ranks indicators, applies them in an assessment, and then evaluates their effectiveness, while identifying gaps that prevent goals from being met, assessing lessons learned, and moving toward best practices. The framework approach emphasizes that the selection of appropriate criteria and indicators is driven by the specific purpose of an analysis. Realistic goals and measures of bioenergy sustainability can be developed systematically with the help of the framework presented here.« less

The Impact of a Dual-Project Action Learning Program: A Case of a Large IT Manufacturing Company in South Korea

ERIC Educational Resources Information Center

Yoon, Hyung Joon; Cho, Yonjoo; Bong, Hyeon-Cheol

2012-01-01

The primary purpose of this article is to evaluate the impact of a dual-project action learning program (DPALP) conducted in South Korea. A dual-project program requires each participant to carry out both team and individual projects. Cho and Egan's [2009. Action learning research: A systematic review and conceptual framework. "Human Resource…

Efficacy of the California Bureau of Land Management Community Assistance and Hazardous Fuels Programs

Treesearch

David J. Ganz; David S. Saah; Matthew A. Wilson; Austin Troy

2007-01-01

This study provides a framework for assessing the social and environmental benefits and public education outcomes associated with the U.S. Department of the Interior, Bureau of Land Management’s Community Assistance and Hazardous Fuel Programs in California. Evaluations of fire hazard mitigation programs tend to focus primarily on the number of acres treated and...

A program wide framework for evaluating data driven teaching and learning - earth analytics approaches, results and lessons learned

NASA Astrophysics Data System (ADS)

Wasser, L. A.; Gold, A. U.

2017-12-01

There is a deluge of earth systems data available to address cutting edge science problems yet specific skills are required to work with these data. The Earth analytics education program, a core component of Earth Lab at the University of Colorado - Boulder - is building a data intensive program that provides training in realms including 1) interdisciplinary communication and collaboration 2) earth science domain knowledge including geospatial science and remote sensing and 3) reproducible, open science workflows ("earth analytics"). The earth analytics program includes an undergraduate internship, undergraduate and graduate level courses and a professional certificate / degree program. All programs share the goals of preparing a STEM workforce for successful earth analytics driven careers. We are developing an program-wide evaluation framework that assesses the effectiveness of data intensive instruction combined with domain science learning to better understand and improve data-intensive teaching approaches using blends of online, in situ, asynchronous and synchronous learning. We are using targeted online search engine optimization (SEO) to increase visibility and in turn program reach. Finally our design targets longitudinal program impacts on participant career tracts over time.. Here we present results from evaluation of both an interdisciplinary undergrad / graduate level earth analytics course and and undergraduate internship. Early results suggest that a blended approach to learning and teaching that includes both synchronous in-person teaching and active classroom hands-on learning combined with asynchronous learning in the form of online materials lead to student success. Further we will present our model for longitudinal tracking of participant's career focus overtime to better understand long-term program impacts. We also demonstrate the impact of SEO optimization on online content reach and program visibility.

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Design of CIAO, a research program to support the development of an integrated approach to prevent overweight and obesity in the Netherlands.

PubMed

van Koperen, Marije Tm; van der Kleij, Rianne Mjj; Renders, Carry Cm; Crone, Matty Mr; Hendriks, Anna-Marie Am; Jansen, Maria M; van de Gaar, Vivian Vm; Raat, Hein Jh; Ruiter, Emilie Elm; Molleman, Gerard Grm; Schuit, Jantine Aj; Seidell, Jacob Jc

2014-01-01

The aim of this paper is to describe the research aims, concepts and methods of the research Consortium Integrated Approach of Overweight (CIAO). CIAO is a concerted action of five Academic Collaborative Centres, local collaborations between academic institutions, regional public health services, local authorities and other relevant sectors in the Netherlands. Prior research revealed lacunas in knowledge of and skills related to five elements of the integrated approach of overweight prevention in children (based upon the French EPODE approach), namely political support, parental education, implementation, social marketing and evaluation. CIAO aims to gain theoretical and practical insight of these elements through five sub-studies and to develop, based on these data, a framework for monitoring and evaluation. For this research program, mixed methods are used in all the five sub-studies. First, problem specification through literature research and consultation of stakeholders, experts, health promotion specialists, parents and policy makers will be carried out. Based on this information, models, theoretical frameworks and practical instruments will be developed, tested and evaluated in the communities that implement the integrated approach to prevent overweight in children. Knowledge obtained from these studies and insights from experts and stakeholders will be combined to create an evaluation framework to evaluate the integrated approach at central, local and individual levels that will be applicable to daily practice. This innovative research program stimulates sub-studies to collaborate with local stakeholders and to share and integrate their knowledge, methodology and results. Therefore, the output of this program (both knowledge and practical tools) will be matched and form building blocks of a blueprint for a local evidence- and practice-based integrated approach towards prevention of overweight in children. The output will then support various communities to further optimize the implementation and subsequently the effects of this approach.

Intensive Evaluation of Head Start Implementation in the Tucson Early Education Model.

ERIC Educational Resources Information Center

Rentfrow, Robert K.

As part of the national Head Start Planned Variation Study, this study used a relatively small sample in an intensive evaluation of program implementation in one field community using the Tucson Early Education Model (TEEM). A modified Solomon four-group research design formed the organization framework. Evaluation of six TEEM classrooms and two…

In Pursuit of Social Betterment: A Proposal to Evaluate the Da Vinci Learning Model

ERIC Educational Resources Information Center

Henry, Gary T.

2005-01-01

The author presents a proposal that is roughly based on a contingency-based theory of evaluation developed in his book, "Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs" (Mark, Henry, and Julnes, 2000). He and his coauthors stated in this book that social betterment was the ultimate goal of…

Does One-to-One Technology Really Work: An Evaluation through the Lens of Activity Theory

ERIC Educational Resources Information Center

Holen, Jodi Bergland; Hung, Woei; Gourneau, Bonni

2017-01-01

This program evaluation study examines an implementation of a one-to-one laptop initiative in a rural high school. Specifically, the researchers adopted a holistic view in evaluating the process and outcomes of this implementation by examining the interrelationships among the key participants using activity theory as a conceptual framework.…

Lessons Learned about Collaborative Evaluation Using the Capacity for Applying Project Evaluation (CAPE) Framework with School and District Leaders

ERIC Educational Resources Information Center

Corn, Jenifer O.; Byrom, Elizabeth; Knestis, Kirk; Matzen, Nita; Thrift, Beth

2012-01-01

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

Designing a Measurement Framework for Response to Intervention in Early Childhood Programs

ERIC Educational Resources Information Center

McConnell, Scott R.; Wackerle-Hollman, Alisha K.; Roloff, Tracy A.; Rodriguez, Michael

2014-01-01

The overall architecture and major components of a measurement system designed and evaluated to support Response to Intervention (RTI) in the areas of language and literacy in early childhood programs are described. Efficient and reliable measurement is essential for implementing any viable RTI system, and implementing such a system in early…

Diffusion of Innovations Theory: A Unifying Framework for HIV Peer Education

ERIC Educational Resources Information Center

Ramseyer Winter, Virginia

2013-01-01

Peer education programs are a popular approach to preventing HIV infection among adolescents. While the programs show promise for effectively preventing HIV among the peers who are provided education, little evaluation research has been conducted to determine if the peer educators themselves experience knowledge, attitude, and behavior changes. A…

Promoting Physical Activity among Youth through Community-Based Prevention Marketing

ERIC Educational Resources Information Center

Bryant, Carol A.; Courtney, Anita H.; McDermott, Robert J.; Alfonso, Moya L.; Baldwin, Julie A.; Nickelson, Jen; Brown, Kelli R. McCormack; DeBate, Rita D.; Phillips, Leah M.; Thompson, Zachary; Zhu, Yiliang

2010-01-01

Background: Community-based prevention marketing (CBPM) is a program planning framework that blends community-organizing principles with a social marketing mind-set to design, implement, and evaluate public health interventions. A community coalition used CBPM to create a physical activity promotion program for tweens (youth 9-13 years of age)…

A Conceptual Framework for Consumers' Education: Teacher Education Module 2.

ERIC Educational Resources Information Center

Florida State Dept. of Education, Tallahassee.

The document is the second in a series of four competency-based inservice teacher education modules in consumer education. The main objective of the program is to assist curriculum developers and elementary and secondary classroom teachers as they plan, develop, implement, and evaluate a multidisciplinary consumer education program. The present…

An Evaluation of an Innovative Drug Education Program: Follow-Up Results.

ERIC Educational Resources Information Center

Moskowitz, Joel M.; And Others

This study provides a follow-up assessment of an innovative drug education program for seventh and eighth graders. Students learned Lasswell's framework for understanding human needs and motives, a systematic decision-making procedure, and information about the pharmacological, psychological, and social consequences of licit and illicit drug use.…

Training Partnership Dyads for Community-Based Participatory Research: Strategies and Lessons Learned From the Community Engaged Scholars Program

PubMed Central

Andrews, Jeannette O.; Cox, Melissa J.; Newman, Susan D.; Gillenwater, Gwen; Warner, Gloria; Winkler, Joyce A.; White, Brandi; Wolf, Sharon; Leite, Renata; Ford, Marvella E.; Slaughter, Sabra

2014-01-01

This article describes the development, implementation, evaluation framework, and initial outcomes of a unique campus–community training initiative for community-based participatory research (CBPR). The South Carolina Clinical & Translational Research Center for Community Health Partnerships, which functions as the institution’s Clinical Translational and Science Award Community Engagement Program, leads the training initiative known as the Community Engaged Scholars Program (CES-P). The CES-P provides simultaneous training to CBPR teams, with each team consisting of at least one community partner and one academic partner. Program elements include 12 months of monthly interactive group sessions, mentorship with apprenticeship opportunities, and funding for a CBPR pilot project. A modified RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework guides the process, impact, and outcome evaluation plan. Lessons learned include challenges of group instruction with varying levels of readiness among the CBPR partners, navigating the institutional review board process with community co-investigators, and finding appropriate academic investigators to match community research interests. Future directions are recommended for this promising and unique dyadic training of academic and community partners. PMID:23091303

UWALK: the development of a multi-strategy, community-wide physical activity program.

PubMed

Jennings, Cally A; Berry, Tanya R; Carson, Valerie; Culos-Reed, S Nicole; Duncan, Mitch J; Loitz, Christina C; McCormack, Gavin R; McHugh, Tara-Leigh F; Spence, John C; Vallance, Jeff K; Mummery, W Kerry

2017-03-01

UWALK is a multi-strategy, multi-sector, theory-informed, community-wide approach using e and mHealth to promote physical activity in Alberta, Canada. The aim of UWALK is to promote physical activity, primarily via the accumulation of steps and flights of stairs, through a single over-arching brand. This paper describes the development of the UWALK program. A social ecological model and the social cognitive theory guided the development of key strategies, including the marketing and communication activities, establishing partnerships with key stakeholders, and e and mHealth programs. The program promotes the use of physical activity monitoring devices to self-monitor physical activity. This includes pedometers, electronic devices, and smartphone applications. In addition to entering physical activity data manually, the e and mHealth program provides the function for objective data to be automatically uploaded from select electronic devices (Fitbit®, Garmin and the smartphone application Moves) The RE-AIM framework is used to guide the evaluation of UWALK. Funding for the program commenced in February 2013. The UWALK brand was introduced on April 12, 2013 with the official launch, including the UWALK website on September 20, 2013. This paper describes the development and evaluation framework of a physical activity promotion program. This program has the potential for population level dissemination and uptake of an ecologically valid physical activity promotion program that is evidence-based and theoretically framed.

Striding Toward Social Justice: The Ecologic Milieu of Physical Activity

PubMed Central

Lee, Rebecca E.; Cubbin, Catherine

2009-01-01

Disparities in physical activity should be investigated in light of social justice principles. This manuscript critically evaluates evidence and trends in disparities research within an ecologic framework, focusing on multi-level factors such as neighborhood and racial discrimination that influence physical activity. Discussion focuses on strategies for integrating social justice into physical activity promotion and intervention programming within an ecologic framework. PMID:19098519

U.S. EPA OFFICE OF RESEARCH AND DEVELOPMENT GUIDELINES FOR TECHNICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide direction f...

Frameworks: A Community-Based Approach to Preventing Youth Suicide

ERIC Educational Resources Information Center

Baber, Kristine; Bean, Gretchen

2009-01-01

Few youth suicide prevention programs are theory based and systematically evaluated. This study evaluated the pilot implementation of a community-based youth suicide prevention project guided by an ecological perspective. One hundred fifty-seven adults representing various constituencies from educators to health care providers and 131 ninth-grade…

Evaluation Report on the Community Learning Center.

ERIC Educational Resources Information Center

Fried, Robert L.

The Community Learning Center (CLC) evaluation is based on on-site visits and interviews with staff and students of widely differing ethnic backgrounds. Teaching resources are varied. The Model Cities program is the basic source for CLC funding; the Cambridge Public Library is the center's local sponsor. The external bureaucratic framework needs…

A Framework for Evaluating Implementation of Community College Workforce Education Partnerships and Programs

ERIC Educational Resources Information Center

Yarnall, Louise; Tennant, Elizabeth; Stites, Regie

2016-01-01

Greater investments in community college workforce education are fostering large-scale partnerships between employers and educators. However, the evaluation work in this area has focused on outcome and productivity metrics, rather than addressing measures of implementation quality, which is critical to scaling any innovation. To deepen…

Dreamtime astronomy: development of a new indigenous program at Sydney Observatory

NASA Astrophysics Data System (ADS)

Wyatt, Geoffrey; Stephenson, Toner; Hamacher, Duane W.

2014-07-01

The Australian National Curriculum promotes Indigenous culture in school education programs. To foster a broader appreciation of cultural astronomy, to utilise the unique astronomical heritage of the site, and to develop an educational program within the framework of the National Curriculum, Sydney Observatory launched Dreamtime Astronomy - a program incorporating Australian Indigenous culture, astronomy, and Sydney's astronomical history and heritage. This paper reviews the development and implementation of this program and discusses modifications following an evaluation that was conducted by schools.

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Increasing the Translation of Evidence Into Practice, Policy, and Public Health Improvements: A Framework for Training Health Professionals in Implementation and Dissemination Science

PubMed Central

Gonzales, Ralph; Handley, Margaret A.; Ackerman, Sara; O’Sullivan, Patricia S.

2012-01-01

The authors describe a conceptual framework for implementation and dissemination science (IDS) and propose competencies for IDS training. Their framework is designed to facilitate the application of theories and methods from the distinct domains of clinical disciplines (e.g., medicine, public health), population sciences (e.g., biostatistics, epidemiology) and translational disciplines (e.g., social and behavioral sciences, business administration education). They explore three principles that guided the development of their conceptual framework: Behavior change among organizations and/or individuals (providers, patients) is inherent in the translation process; engagement of stakeholder organizations, health care delivery systems, and individuals is imperative to achieve effective translation and sustained improvements; and IDS research is iterative, benefiting from cycles and collaborative, bidirectional relationships. The authors propose seven domains for IDS training--team science, context identification, literature identification and assessment, community engagement, intervention design and research implementation, evaluation of effect of translational activity, behavioral change communication strategies--and define twelve IDS training competencies within these domains. As a model, they describe specific courses introduced at the University of California, San Francisco, which they designed to develop these competencies. The authors encourage other training programs and institutions to use (or adapt) the design principles, conceptual framework, And proposed competencies to evaluate their current IDS training needs and to support new program development. PMID:22373617

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Flow Restoration in the Columbia River Basin: An Evaluation of a Flow Restoration Accounting Framework

NASA Astrophysics Data System (ADS)

McCoy, Amy L.; Holmes, S. Rankin; Boisjolie, Brett A.

2018-03-01

Securing environmental flows in support of freshwater biodiversity is an evolving field of practice. An example of a large-scale program dedicated to restoring environmental flows is the Columbia Basin Water Transactions Program in the Pacific Northwest region of North America, which has been restoring flows in dewatered tributary habitats for imperiled salmon species over the past decade. This paper discusses a four-tiered flow restoration accounting framework for tracking the implementation and impacts of water transactions as an effective tool for adaptive management. The flow restoration accounting framework provides compliance and flow accounting information to monitor transaction efficacy. We review the implementation of the flow restoration accounting framework monitoring framework to demonstrate (a) the extent of water transactions that have been implemented over the past decade, (b) the volumes of restored flow in meeting flow targets for restoring habitat for anadromous fish species, and (c) an example of aquatic habitat enhancement that resulted from Columbia Basin Water Transactions Program investments. Project results show that from 2002 to 2015, the Columbia Basin Water Transactions Program has completed more than 450 water rights transactions, restoring approximately 1.59 million megaliters to date, with an additional 10.98 million megaliters of flow protected for use over the next 100 years. This has resulted in the watering of over 2414 stream kilometers within the Columbia Basin. We conclude with a discussion of the insights gained through the implementation of the flow restoration accounting framework. Understanding the approach and efficacy of a monitoring framework applied across a large river basin can be informative to emerging flow-restoration and adaptive management efforts in areas of conservation concern.

Flow Restoration in the Columbia River Basin: An Evaluation of a Flow Restoration Accounting Framework.

PubMed

McCoy, Amy L; Holmes, S Rankin; Boisjolie, Brett A

2018-03-01

Securing environmental flows in support of freshwater biodiversity is an evolving field of practice. An example of a large-scale program dedicated to restoring environmental flows is the Columbia Basin Water Transactions Program in the Pacific Northwest region of North America, which has been restoring flows in dewatered tributary habitats for imperiled salmon species over the past decade. This paper discusses a four-tiered flow restoration accounting framework for tracking the implementation and impacts of water transactions as an effective tool for adaptive management. The flow restoration accounting framework provides compliance and flow accounting information to monitor transaction efficacy. We review the implementation of the flow restoration accounting framework monitoring framework to demonstrate (a) the extent of water transactions that have been implemented over the past decade, (b) the volumes of restored flow in meeting flow targets for restoring habitat for anadromous fish species, and (c) an example of aquatic habitat enhancement that resulted from Columbia Basin Water Transactions Program investments. Project results show that from 2002 to 2015, the Columbia Basin Water Transactions Program has completed more than 450 water rights transactions, restoring approximately 1.59 million megaliters to date, with an additional 10.98 million megaliters of flow protected for use over the next 100 years. This has resulted in the watering of over 2414 stream kilometers within the Columbia Basin. We conclude with a discussion of the insights gained through the implementation of the flow restoration accounting framework. Understanding the approach and efficacy of a monitoring framework applied across a large river basin can be informative to emerging flow-restoration and adaptive management efforts in areas of conservation concern.

A Health Systems Approach to Integrated Community Case Management of Childhood Illness: Methods and Tools

PubMed Central

McGorman, Laura; Marsh, David R.; Guenther, Tanya; Gilroy, Kate; Barat, Lawrence M.; Hammamy, Diaa; Wansi, Emmanuel; Peterson, Stefan; Hamer, Davidson H.; George, Asha

2012-01-01

Integrated community case management (iCCM) of childhood illness is an increasingly popular strategy to expand life-saving health services to underserved communities. However, community health approaches vary widely across countries and do not always distribute resources evenly across local health systems. We present a harmonized framework, developed through interagency consultation and review, which supports the design of CCM by using a systems approach. To verify that the framework produces results, we also suggest a list of complementary indicators, including nine global metrics, and a menu of 39 country-specific measures. When used by program managers and evaluators, we propose that the framework and indicators can facilitate the design, implementation, and evaluation of community case management. PMID:23136280

An Information Technology Framework for Strengthening Telehealthcare Service Delivery

PubMed Central

Chen, Chi-Wen; Weng, Yung-Ching; Shang, Rung-Ji; Yu, Hui-Chu; Chung, Yufang; Lai, Feipei

2012-01-01

Abstract Objective: Telehealthcare has been used to provide healthcare service, and information technology infrastructure appears to be essential while providing telehealthcare service. Insufficiencies have been identified, such as lack of integration, need of accommodation of diverse biometric sensors, and accessing diverse networks as different houses have varying facilities, which challenge the promotion of telehealthcare. This study designs an information technology framework to strengthen telehealthcare delivery. Materials and Methods: The proposed framework consists of a system architecture design and a network transmission design. The aim of the framework is to integrate data from existing information systems, to adopt medical informatics standards, to integrate diverse biometric sensors, and to provide different data transmission networks to support a patient's house network despite the facilities. The proposed framework has been evaluated with a case study of two telehealthcare programs, with and without the adoption of the framework. Results: The proposed framework facilitates the functionality of the program and enables steady patient enrollments. The overall patient participations are increased, and the patient outcomes appear positive. The attitudes toward the service and self-improvement also are positive. Conclusions: The findings of this study add up to the construction of a telehealthcare system. Implementing the proposed framework further assists the functionality of the service and enhances the availability of the service and patient acceptances. PMID:23061641

An information technology framework for strengthening telehealthcare service delivery.

PubMed

Chen, Li-Chin; Chen, Chi-Wen; Weng, Yung-Ching; Shang, Rung-Ji; Yu, Hui-Chu; Chung, Yufang; Lai, Feipei

2012-10-01

Telehealthcare has been used to provide healthcare service, and information technology infrastructure appears to be essential while providing telehealthcare service. Insufficiencies have been identified, such as lack of integration, need of accommodation of diverse biometric sensors, and accessing diverse networks as different houses have varying facilities, which challenge the promotion of telehealthcare. This study designs an information technology framework to strengthen telehealthcare delivery. The proposed framework consists of a system architecture design and a network transmission design. The aim of the framework is to integrate data from existing information systems, to adopt medical informatics standards, to integrate diverse biometric sensors, and to provide different data transmission networks to support a patient's house network despite the facilities. The proposed framework has been evaluated with a case study of two telehealthcare programs, with and without the adoption of the framework. The proposed framework facilitates the functionality of the program and enables steady patient enrollments. The overall patient participations are increased, and the patient outcomes appear positive. The attitudes toward the service and self-improvement also are positive. The findings of this study add up to the construction of a telehealthcare system. Implementing the proposed framework further assists the functionality of the service and enhances the availability of the service and patient acceptances.

Micro-costing in public health economics: steps towards a standardized framework, using the incredible years toddler parenting program as a worked example.

PubMed

Charles, J M; Edwards, R T; Bywater, T; Hutchings, J

2013-08-01

Complex interventions, such as parenting programs, are rarely evaluated from a public sector, multi-agency perspective. An exception is the Incredible Years (IY) Basic Parenting Program; which has a growing clinical and cost-effectiveness evidence base for preventing or reducing children's conduct problems. The aim of this paper was to provide a micro-costing framework for use by future researchers, by micro-costing the 12-session IY Toddler Parenting Program from a public sector, multi-agency perspective. This micro-costing was undertaken as part of a community-based randomized controlled trial of the program in disadvantaged Flying Start areas in Wales, U.K. Program delivery costs were collected by group leader cost diaries. Training and supervision costs were recorded. Sensitivity analysis assessed the effects of a London cost weighting and group size. Costs were reported in 2008/2009 pounds sterling. Direct program initial set-up costs were £3305.73; recurrent delivery costs for the program based on eight parents attending a group were £752.63 per child, falling to £633.61 based on 10 parents. Under research contexts (with weekly supervision) delivery costs were £1509.28 per child based on eight parents, falling to £1238.94 per child based on 10 parents. When applying a London weighting, overall program costs increased in all contexts. Costs at a micro-level must be accurately calculated to conduct meaningful cost-effectiveness/cost-benefit analysis. A standardized framework for assessing costs is needed; this paper outlines a suggested framework. In prevention science it is important for decision makers to be aware of intervention costs in order to allocate scarce resources effectively.

The "déjà vu effect:" evaluation of United States medical device legislation, regulation, and the Food and Drug Administration's contentious 510(k) program.

PubMed

Bauman, Jordan

2012-01-01

With the Medical Device Amendments of 1976, Congress granted FDA authority to regulate medical devices by implementing a risk-based regulatory framework. Several years prior to this legislation, the Cooper Committee reviewed the medical device regulatory landscape and uncovered weaknesses that could be detrimental to public health. However, only after several high-profile incidents involving unsafe medical devices did Congress respond with strong legislation. Since 1976, additional medical device legislative revisions have been enacted to address deficiencies highlighted by various groups representing Congress, FDA, and industry. A repetitive conclusion from these groups has been that the 510(k) program is incapable of serving as a premarket evaluation of safety and effectiveness under the existing statutory framework. However, these legislative revisions did not change the statutory framework despite these repeated findings. In 2009, CDRH convened separate groups to again review the 510(k) program. While more comprehensive than previous initiatives, the observed deficiencies and the proposed recommendations are remarkably similar to those identified by their predecessors. This cyclical review of the medical device regulatory landscape whereby the same observations and recommendations are repeated yet the output of such review does not yield major legislative revision of the existing statutory framework can be described as the "déjà vu effect." This will continue unless Congress enacts legislation that implements a new statutory framework with a different standard other than substantial equivalence. In the past, Congress has implemented major legislation only after a public health crisis. Hopefully this will not be the driving force in the future.

An examination of Eyal & Hurst’s (2008) framework for promoting retention in resource-poor settings through locally-relevant training: A case study for the University of Guyana Surgical Training Program

PubMed Central

Prashad, Anupa J.; Cameron, Brian H.; McConnell, Meghan; Rambaran, Madan; Grierson, Lawrence E. M.

2017-01-01

Background Eyal and Hurst proposed that locally relevant medical education can offset the prevalence of physician “brain drain” in resource-poor regions of the world, and presented a framework of the ethical and pragmatic benefits and concerns posed by these initiatives. The present study explored the framework’s utility through a case study of the University of Guyana Diploma in Surgery (UGDS) program Methods The framework’s utility was evaluated using a case study design that included review and analysis of documents and semi-structured interviews with graduates, trainees, faculty members, and policy makers associated with the UGDS program. Data were analyzed from constructivist and interpretivist perspectives, and compared against the benefits and concerns described by Eyal and Hurst. Results The framework is a useful template for capturing the breadth of experience of locally relevant training in the Guyanese setting. However, the results suggest that delineating the framework factors as either beneficial or concerning may constrict its applicability. The case study design also provided specific insights about the UGDS program, which indicate that the Program has promoted the retention of graduates and a sustainable culture of postgraduate medical education in Guyana. Conclusion It is suggested that the framework be modified so as to represent the benefits and concerns of locally relevant training along a continuum of advantage. These approaches may help us understand retention within a resource-poor country, but also within particularly remote areas and public health care systems generally. PMID:29114344

The Integration of a Family Systems Approach for Understanding Youth Obesity, Physical Activity, and Dietary Programs

PubMed Central

Wilson, Dawn K.; St. George, Sara M.; Lawman, Hannah; Segal, Michelle; Fairchild, Amanda

2012-01-01

Rates of overweight in youth have reached epidemic proportions and are associated with adverse health outcomes. Family-based programs have been widely used to treat overweight in youth. However, few programs incorporate a theoretical framework for studying a family systems approach in relation to youth health behavior change. Therefore, this review provides a family systems theory framework for evaluating family-level variables in weight loss, physical activity, and dietary approaches in youth. Studies were reviewed and effect sizes were calculated for interventions that manipulated the family system, including components that targeted parenting styles, parenting skills, or family functioning, or which had novel approaches for including the family. Twenty-one weight loss interventions were identified, and 25 interventions related to physical activity and/or diet were identified. Overall, family-based treatment programs that incorporated training for authoritative parenting styles, parenting skills, or child management, and family functioning had positive effects on youth weight loss. Programs to improve physical activity and dietary behaviors that targeted the family system also demonstrated improvements in youth health behaviors; however, direct effects of parent-targeted programming is not clear. Both treatment and prevention programs would benefit from evaluating family functioning and parenting styles as possible mediators of intervention outcomes. Recommendations are provided to guide the development of future family-based obesity prevention and treatment programs for youth. PMID:20689989

Making sense of "consumer engagement" initiatives to improve health and health care: a conceptual framework to guide policy and practice.

PubMed

Mittler, Jessica N; Martsolf, Grant R; Telenko, Shannon J; Scanlon, Dennis P

2013-03-01

Policymakers and practitioners continue to pursue initiatives designed to engage individuals in their health and health care despite discordant views and mixed evidence regarding the ability to cultivate greater individual engagement that improves Americans' health and well-being and helps manage health care costs. There is limited and mixed evidence regarding the value of different interventions. Based on our involvement in evaluating various community-based consumer engagement initiatives and a targeted literature review of models of behavior change, we identified the need for a framework to classify the universe of consumer engagement initiatives toward advancing policymakers' and practitioners' knowledge of their value and fit in various contexts. We developed a framework that expanded our conceptualization of consumer engagement, building on elements of two common models, the individually focused transtheoretical model of behavior and the broader, multilevel social ecological model. Finally, we applied this framework to one community's existing consumer engagement program. Consumer engagement in health and health care refers to the performance of specific behaviors ("engaged behaviors") and/or an individual's capacity and motivation to perform these behaviors ("activation"). These two dimensions are related but distinct and thus should be differentiated. The framework creates four classification schemas, by (1) targeted behavior types (self-management, health care encounter, shopping, and health behaviors) and by (2) individual, (3) group, and (4) community dimensions. Our example illustrates that the framework can systematically classify a variety of consumer engagement programs, and that this exercise and resulting characterization can provide a structured way to consider the program and how its components fit program goals both individually and collectively. Applying the framework could help advance the field by making policymakers and practitioners aware of the wide range of approaches, providing a structured way to organize and characterize interventions retrospectively, and helping them consider how they can meet the program's goals both individually and collectively. © 2013 Milbank Memorial Fund.

Making Sense of “Consumer Engagement” Initiatives to Improve Health and Health Care: A Conceptual Framework to Guide Policy and Practice

PubMed Central

Mittler, Jessica N; Martsolf, Grant R; Telenko, Shannon J; Scanlon, Dennis P

2013-01-01

Context Policymakers and practitioners continue to pursue initiatives designed to engage individuals in their health and health care despite discordant views and mixed evidence regarding the ability to cultivate greater individual engagement that improves Americans’ health and well-being and helps manage health care costs. There is limited and mixed evidence regarding the value of different interventions. Methods Based on our involvement in evaluating various community-based consumer engagement initiatives and a targeted literature review of models of behavior change, we identified the need for a framework to classify the universe of consumer engagement initiatives toward advancing policymakers' and practitioners' knowledge of their value and fit in various contexts. We developed a framework that expanded our conceptualization of consumer engagement, building on elements of two common models, the individually focused transtheoretical model of behavior and the broader, multilevel social ecological model. Finally, we applied this framework to one community's existing consumer engagement program. Findings Consumer engagement in health and health care refers to the performance of specific behaviors (“engaged behaviors”) and/or an individual's capacity and motivation to perform these behaviors (“activation”). These two dimensions are related but distinct and thus should be differentiated. The framework creates four classification schemas, by (1) targeted behavior types (self-management, health care encounter, shopping, and health behaviors) and by (2) individual, (3) group, and (4) community dimensions. Our example illustrates that the framework can systematically classify a variety of consumer engagement programs, and that this exercise and resulting characterization can provide a structured way to consider the program and how its components fit program goals both individually and collectively. Conclusions Applying the framework could help advance the field by making policymakers and practitioners aware of the wide range of approaches, providing a structured way to organize and characterize interventions retrospectively, and helping them consider how they can meet the program's goals both individually and collectively. PMID:23488711

Medical-device risk management and public safety: using cost-benefit as a measurement of effectiveness

NASA Astrophysics Data System (ADS)

Hughes, Allen A.

1994-12-01

Public safety can be enhanced through the development of a comprehensive medical device risk management. This can be accomplished through case studies using a framework that incorporates cost-benefit analysis in the evaluation of risk management attributes. This paper presents a framework for evaluating the risk management system for regulatory Class III medical devices. The framework consists of the following sixteen attributes of a comprehensive medical device risk management system: fault/failure analysis, premarket testing/clinical trials, post-approval studies, manufacturer sponsored hospital studies, product labeling, establishment inspections, problem reporting program, mandatory hospital reporting, medical literature surveillance, device/patient registries, device performance monitoring, returned product analysis, autopsy program, emergency treatment funds/interim compensation, product liability, and alternative compensation mechanisms. Review of performance histories for several medical devices can reveal the value of information for many attributes, and also the inter-dependencies of the attributes in generating risk information flow. Such an information flow network is presented as a starting point for enhancing medical device risk management by focusing on attributes with high net benefit values and potential to spur information dissemination.

Learning framework of “Integrating Techniques” for Solving Problems and Its Empirical Application in Doctoral Course in Mechanical Engineering

NASA Astrophysics Data System (ADS)

Otsuka, Yuichi; Ohta, Kazuhide; Noguchi, Hiroshi

The 21st century Center of Excellence (COE) program in Department of Mechanical Engineering Science at Kyushu University construct the training framework of learning “Integrating Techniques” by research presentations for students in different majors and accident analyses for practical cases by Ph.D course students. The training framework is composed of three processes : 1) Peer review among Ph.D course students for the presentations, 2) Instructions by teachers in order to improve the quality of the presentations based on the result of the peer-reviews, 3) Final evaluation for the improved presentations by teachers and the students. This research has elucidated the quantitative effectiveness of the framework by the evaluations using questionnaires for the presentations. Furthermore, the result of investigation for the course students has observed positive correlation between the significance of integration techniques and the enthusiasm for participating the course, which reveals the efficacy of the learning framework proposed.

Coalescent: an open-science framework for importance sampling in coalescent theory.

PubMed

Tewari, Susanta; Spouge, John L

2015-01-01

Background. In coalescent theory, computer programs often use importance sampling to calculate likelihoods and other statistical quantities. An importance sampling scheme can exploit human intuition to improve statistical efficiency of computations, but unfortunately, in the absence of general computer frameworks on importance sampling, researchers often struggle to translate new sampling schemes computationally or benchmark against different schemes, in a manner that is reliable and maintainable. Moreover, most studies use computer programs lacking a convenient user interface or the flexibility to meet the current demands of open science. In particular, current computer frameworks can only evaluate the efficiency of a single importance sampling scheme or compare the efficiencies of different schemes in an ad hoc manner. Results. We have designed a general framework (http://coalescent.sourceforge.net; language: Java; License: GPLv3) for importance sampling that computes likelihoods under the standard neutral coalescent model of a single, well-mixed population of constant size over time following infinite sites model of mutation. The framework models the necessary core concepts, comes integrated with several data sets of varying size, implements the standard competing proposals, and integrates tightly with our previous framework for calculating exact probabilities. For a given dataset, it computes the likelihood and provides the maximum likelihood estimate of the mutation parameter. Well-known benchmarks in the coalescent literature validate the accuracy of the framework. The framework provides an intuitive user interface with minimal clutter. For performance, the framework switches automatically to modern multicore hardware, if available. It runs on three major platforms (Windows, Mac and Linux). Extensive tests and coverage make the framework reliable and maintainable. Conclusions. In coalescent theory, many studies of computational efficiency consider only effective sample size. Here, we evaluate proposals in the coalescent literature, to discover that the order of efficiency among the three importance sampling schemes changes when one considers running time as well as effective sample size. We also describe a computational technique called "just-in-time delegation" available to improve the trade-off between running time and precision by constructing improved importance sampling schemes from existing ones. Thus, our systems approach is a potential solution to the "2(8) programs problem" highlighted by Felsenstein, because it provides the flexibility to include or exclude various features of similar coalescent models or importance sampling schemes.

Formative process evaluation for implementing a social marketing intervention to increase walking among African Americans in the Positive Action for Today's Health trial.

PubMed

Coulon, Sandra M; Wilson, Dawn K; Griffin, Sarah; St George, Sara M; Alia, Kassandra A; Trumpeter, Nevelyn N; Wandersman, Abraham K; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-12-01

Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today's Health trial. We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

How to improve patient retention in an antiretroviral treatment program in Ethiopia: a mixed-methods study

PubMed Central

2014-01-01

Background Patient retention, defined as continuous engagement of patients in care, is one of the crucial indicators for monitoring and evaluating the performance of antiretroviral treatment (ART) programs. It has been identified that suboptimal patient retention in care is one of the challenges of ART programs in many settings. ART programs have, therefore, been striving hard to identify and implement interventions that improve their suboptimal levels of retention. The objective of this study was to develop a framework for improving patient retention in care based on interventions implemented in health facilities that have achieved higher levels of retention in care. Methods A mixed-methods study, based on the positive deviance approach, was conducted in Ethiopia in 2011/12. Quantitative data were collected to estimate and compare the levels of retention in care in nine health facilities. Key informant interviews and focus group discussions were conducted to identify a package of interventions implemented in the health facilities with relatively higher or improving levels of retention. Results Retention in care in the Ethiopian ART program was found to be variable across health facilities. Among hospitals, the poorest performer had 0.46 (0.35, 0.60) times less retention than the reference; among health centers, the poorest performers had 0.44 (0.28, 0.70) times less retention than the reference. Health facilities with higher and improving patient retention were found to implement a comprehensive package of interventions: (1) retention promoting activities by health facilities, (2) retention promoting activities by community-based organizations, (3) coordination of these activities by case manager(s), and (4) patient information systems by data clerk(s). On the contrary, such interventions were either poorly implemented or did not exist in health facilities with lower retention in care. A framework to improve retention in care was developed based on the evidence found by applying the positive deviance approach. Conclusion A framework for improving retention in care of patients on ART was developed. We recommend that health facilities implement the framework, monitor and evaluate their levels of retention in care, and, if necessary, adapt the framework to their own contexts. PMID:24475889

Implementation and Evaluation of Technology Mentoring Program Developed for Teacher Educators: A 6M-Framework

ERIC Educational Resources Information Center

Gunuc, Selim

2015-01-01

The purpose of this basic research is to determine the problems experienced in the Technology Mentoring Program (TMP), and the study discusses how these problems affect the process in general. The implementation was carried out with teacher educators in the education faculty. 8 doctorate students (mentors) provided technology mentoring…

Evaluating Navy's Funded Graduate Education Program: A Return-on-Investment Framework. Monograph

ERIC Educational Resources Information Center

Kamarck, Kristy N.; Thie, Harry J.; Adelson, Marisa; Krull, Heather

2010-01-01

The U.S. military services send officers to graduate schools each year to pursue advanced degrees, primarily to fill billet requirements later. This can be costly, including such things as tuition, housing, and pay but also the opportunity cost of the officer not filling an operational billet. Participation in such a program incurs specific…

Community mental health accreditation: a pilot study.

PubMed

Dorgan, R E; Gerhard, R J; Kennard, E D

1977-01-01

The Balanced Services System is the conceptual framework for the newly initiated community mental health accreditation program sponsored by the Joint Commission on Accreditation of Hospitals (JCAH). The program design and performance of CMH systems are reviewed and judged according to a series of evaluation criteria that prescribe the desired operating state for each functional area in the center.

The Effect of an Experiential Learning Program on Middle School Students' Motivation toward Mathematics and Science

ERIC Educational Resources Information Center

Weinberg, Andrea E.; Basile, Carole G.; Albright, Leonard

2011-01-01

A mixed methods design was used to evaluate the effects of four experiential learning programs on the interest and motivation of middle school students toward mathematics and science. The Expectancy-Value model provided a theoretical framework for the exploration of 336 middle school student participants. Initially, participants were generally…

The Bilingual Academic Services and Integrated Career Systems Program, BASICS 1988-1989. OREA Evaluation Section Report.

ERIC Educational Resources Information Center

Berney, Tomi D.; Barrera, Marbella

In its second year, the Bilingual Academic Services and Integrated Career Systems (BASICS) Program served 104 limited-English-proficient students at Bayside High School in Queens (New York City). Project goals were to develop English literacy skills, produce an organizing framework of thinking and language skills across the curriculum, generate a…

Utilizing the RE-AIM Framework in formative evaluation and program planning for a healthy food choice intervention in the Lower Mississippi Delta

USDA-ARS?s Scientific Manuscript database

A robust approach to program planning is needed for the development and execution of effective and sustainable behavioral interventions with large public health impact. The purpose of this formative research was to apply dimensions of the RE-AIM (i.e., Reach, Effectiveness, Adoption, Implementation,...

Supporting Museums--Serving Communities: An Evaluation of the Museums for America Program. Executive Summary

ERIC Educational Resources Information Center

Institute of Museum and Library Services, 2011

2011-01-01

Museums for America (MFA) is the largest IMLS grant program for museums; it supports institutions by investing in high-priority, high-value activities that are clearly linked to the institution's strategic plan and enhance its value to its community. MFA grants situate projects within a framework of meeting three strategic goals: engaging…

Making Healthy Eating and Physical Activity Policy Practice: Process Evaluation of a Group Randomized Controlled Intervention in Afterschool Programs

ERIC Educational Resources Information Center

Weaver, R. Glenn; Beets, Michael W.; Hutto, Brent; Saunders, Ruth P.; Moore, Justin B.; Turner-McGrievy, Gabrielle; Huberty, Jennifer L.; Ward, Dianne S.; Pate, Russell R.; Beighle, Aaron; Freedman, Darcy

2015-01-01

This study describes the link between level of implementation and outcomes from an intervention to increase afterschool programs' (ASPs) achievement of healthy eating and physical activity (HE-PA) Standards. Ten intervention ASPs implemented the Strategies-To-Enhance-Practice (STEPs), a multi-component, adaptive intervention framework identifying…

A Science-Based Framework for Early Childhood Policy: Using Evidence to Improve Outcomes in Learning, Behavior, and Health for Vulnerable Children

ERIC Educational Resources Information Center

Center on the Developing Child at Harvard University, 2007

2007-01-01

This report combines neuroscience, child development research, and program evaluation data to better inform policymakers' decisions about investing in and supporting existing early childhood programs. Core child development concepts highlight the importance of early experiences on the development of brain architecture and, in turn, future…

An Evaluation Model for a Multidisciplinary Chronic Pelvic Pain Clinic: Application of the RE-AIM Framework.

PubMed

Chen, Innie; Money, Deborah; Yong, Paul; Williams, Christina; Allaire, Catherine

2015-09-01

Chronic pelvic pain (CPP) is a prevalent, debilitating, and costly condition. Although national guidelines and empiric evidence support the use of a multidisciplinary model of care for such patients, such clinics are uncommon in Canada. The BC Women's Centre for Pelvic Pain and Endometriosis was created to respond to this need, and there is interest in this model of care's impact on the burden of disease in British Columbia. We sought to create an approach to its evaluation using the RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) evaluation framework to assess the impact of the care model and to guide clinical decision-making and policy. The RE-AIM evaluation framework was applied to consider the different dimensions of impact of the BC Centre. The proposed measures, data sources, and data management strategies for this mixed-methods approach were identified. The five dimensions of impact were considered at individual and organizational levels, and corresponding indicators were proposed to enable integration into existing data infrastructure to facilitate collection and early program evaluation. The RE-AIM framework can be applied to the evaluation of a multidisciplinary chronic pelvic pain clinic. This will allow better assessment of the impact of innovative models of care for women with chronic pelvic pain.

C++ Programming Language

NASA Technical Reports Server (NTRS)

Shaykhian, Gholam Ali

2007-01-01

C++ Programming Language: The C++ seminar covers the fundamentals of C++ programming language. The C++ fundamentals are grouped into three parts where each part includes both concept and programming examples aimed at for hands-on practice. The first part covers the functional aspect of C++ programming language with emphasis on function parameters and efficient memory utilization. The second part covers the essential framework of C++ programming language, the object-oriented aspects. Information necessary to evaluate various features of object-oriented programming; including encapsulation, polymorphism and inheritance will be discussed. The last part of the seminar covers template and generic programming. Examples include both user defined and standard templates.

Dimensionality and R4P: A Health Equity Framework for Research Planning and Evaluation in African American Populations.

PubMed

Hogan, Vijaya; Rowley, Diane L; White, Stephanie Baker; Faustin, Yanica

2018-02-01

Introduction Existing health disparities frameworks do not adequately incorporate unique interacting contributing factors leading to health inequities among African Americans, resulting in public health stakeholders' inability to translate these frameworks into practice. Methods We developed dimensionality and R4P to integrate multiple theoretical perspectives into a framework of action to eliminate health inequities experienced by African Americans. Results The dimensional framework incorporates Critical Race Theory and intersectionality, and includes dimensions of time-past, present and future. Dimensionality captures the complex linear and non-linear array of influences that cause health inequities, but these pathways do not lend themselves to approaches to developing empirically derived programs, policies and interventions to promote health equity. R4P provides a framework for addressing the scope of actions needed. The five components of R4P are (1) Remove, (2) Repair, (3) Remediate, (4) Restructure and (5) Provide. Conclusion R4P is designed to translate complex causality into a public health equity planning, assessment, evaluation and research tool.

Applying the RE-AIM conceptual framework for the promotion of physical activity in low- and middle-income countries

PubMed Central

Lee, Rebecca E.; Galavíz, Karla I.; Soltero, Erica G.; Rosales Chavez, Jose; Jauregui, Edtna; Lévesque, Lucie; Hernández, Luis Ortiz; Lopez y Taylor, Juan; Estabrooks, Paul A.

2017-01-01

ABSTRACT Objective: the RE-AIM framework has been widely used to evaluate internal and external validity of interventions aimed to promote physical activity, helping to provide comprehensive evaluation of the reach, efficacy, adoption, implementation and maintenance of research and programming. Despite this progress, the RE-AIM framework has not been used widely in Latin America. The purpose of this manuscript is to describe the RE-AIM framework, the process and materials developed for a one-day workshop in Guadalajara, and the acceptability and satisfaction of participants that attended the workshop. Methods: lecture, interactive examples and an agenda were developed for a one-day RE-AIM workshop over a three month period. Results: thirty two health care practitioners (M age = 30.6, SD=9.9 years) attended the workshop. Most (100%) rated the workshop as credible, useful (100%) and intended to apply it in current or future research (95%). Conclusion: results suggest intuitive appeal of the RE-AIM framework, and provide a strategy for introducing the utility and practical application of the framework in practice settings in Mexico and Latin America.

Framework for Evaluating the Health Impact of the Scale-Up of Malaria Control Interventions on All-Cause Child Mortality in Sub-Saharan Africa

PubMed Central

Yé, Yazoume; Eisele, Thomas P.; Eckert, Erin; Korenromp, Eline; Shah, Jui A.; Hershey, Christine L.; Ivanovich, Elizabeth; Newby, Holly; Carvajal-Velez, Liliana; Lynch, Michael; Komatsu, Ryuichi; Cibulskis, Richard E.; Moore, Zhuzhi; Bhattarai, Achuyt

2017-01-01

Abstract. Concerted efforts from national and international partners have scaled up malaria control interventions, including insecticide-treated nets, indoor residual spraying, diagnostics, prompt and effective treatment of malaria cases, and intermittent preventive treatment during pregnancy in sub-Saharan Africa (SSA). This scale-up warrants an assessment of its health impact to guide future efforts and investments; however, measuring malaria-specific mortality and the overall impact of malaria control interventions remains challenging. In 2007, Roll Back Malaria's Monitoring and Evaluation Reference Group proposed a theoretical framework for evaluating the impact of full-coverage malaria control interventions on morbidity and mortality in high-burden SSA countries. Recently, several evaluations have contributed new ideas and lessons to strengthen this plausibility design. This paper harnesses that new evaluation experience to expand the framework, with additional features, such as stratification, to examine subgroups most likely to experience improvement if control programs are working; the use of a national platform framework; and analysis of complete birth histories from national household surveys. The refined framework has shown that, despite persisting data challenges, combining multiple sources of data, considering potential contributions from both fundamental and proximate contextual factors, and conducting subnational analyses allows identification of the plausible contributions of malaria control interventions on malaria morbidity and mortality. PMID:28990923

The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System

PubMed Central

Hunter, Sarah B.; Ebener, Patricia; Paddock, Susan M.; Stillman, Lindsey; Imm, Pamela; Wandersman, Abraham

2010-01-01

Communities are increasingly being required by state and federal funders to achieve outcomes and be accountable, yet are often not provided the guidance or the tools needed to successfully meet this challenge. To improve the likelihood of achieving positive outcomes, the Getting To Outcomes (GTO) intervention (manual, training, technical assistance) is designed to provide the necessary guidance and tools, tailored to community needs, in order to build individual capacity and program performance. GTO is an example of a Prevention Support System intervention, which as conceptualized by the Interactive Systems Framework, plays a key role in bridging the gap between prevention science (Prevention Synthesis and Translation System) and prevention practice (Prevention Delivery System). We evaluated the impact of GTO on individual capacity and program performance using survey- and interview-based methods. We tracked the implementation of GTO and gathered user feedback about its utility and acceptability. The evaluation of GTO suggests that it can build individual capacity and program performance and as such demonstrates that the Prevention Support System can successfully fulfill its intended role. Lessons learned from the implementation of GTO relevant to illuminating the framework are discussed. PMID:18278551

Systematic review of positive youth development programs for adolescents with chronic illness.

PubMed

Maslow, Gary R; Chung, Richard J

2013-05-01

The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.

Development and Evaluation of Innovative Peer-Led Physical Activity Programs for Mental Health Service Users

PubMed Central

Graham, Candida R.; Larstone, Roseann; Griffiths, Brenda; de Leeuw, Sarah; Anderson, Lesley; Powell-Hellyer, Stephanie; Long, Nansi

2017-01-01

Abstract Mental health service users (MHSUs) have elevated rates of cardiometabolic disturbance. Improvements occur with physical activity (PA) programs. We report the development and evaluation of three innovative peer-developed and peer-led PA programs: 1) walking; 2) fitness; and 3) yoga. Qualitative evaluation with 33 MHSUs in British Columbia, Canada, occurred. These programs yielded improvements for participants, highlighted by powerful narratives of health improvement, and improved social connections. The feasibility and acceptability of innovative peer-developed and peer-led programs were shown. Analyses revealed concepts related to engagement and change. Relating core categories, we theorize effective engagement of MHSUs requires accessibility on three levels (geographic, cost, and program flexibility) and health behavior change occurs within co-constituent relationships (to self, to peers, and to the wider community). This study highlights the benefits of peer involvement in developing and implementing PA programs and provides a theoretical framework of understanding engagement and behavior change in health programs for MHSUs. PMID:28953007

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation. Volume 1: Study results

NASA Technical Reports Server (NTRS)

Lowrie, J. W.; Fermelia, A. J.; Haley, D. C.; Gremban, K. D.; Vanbaalen, J.; Walsh, R. W.

1982-01-01

A variety of artificial intelligence techniques which could be used with regard to NASA space applications and robotics were evaluated. The techniques studied were decision tree manipulators, problem solvers, rule based systems, logic programming languages, representation language languages, and expert systems. The overall structure of a robotic simulation tool was defined and a framework for that tool developed. Nonlinear and linearized dynamics equations were formulated for n link manipulator configurations. A framework for the robotic simulation was established which uses validated manipulator component models connected according to a user defined configuration.

Use of Diffusion of Innovations Theory To Drive a Federal Agency's Program Evaluation.

ERIC Educational Resources Information Center

Hubbard, Susan M.; Hayashi, Susan W.

2003-01-01

Provides the conceptual framework for the Treatment Improvement Protocols (TIPs) evaluation project, using the diffusion of innovations theory as the theoretical foundation to understand and assess the development of TIPs. Summarizes principles of diffusion theory, and discusses how the model was used to structure the TIPs studies. (SLD)

A Realist Evaluation Approach to Unpacking the Impacts of the Sentencing Guidelines

ERIC Educational Resources Information Center

Hunt, Kim Steven; Sridharan, Sanjeev

2010-01-01

Evaluations of complex interventions such as sentencing guidelines provide an opportunity to understand the mechanisms by which policies and programs can impact intermediate and long-term outcomes. There is limited previous discussion of the underlying frameworks by which sentencing guidelines can impact outcomes such as crime rates. Guided by a…

Evaluating the Effect of Program Visualization on Student Motivation

ERIC Educational Resources Information Center

Velázquez-Iturbide, J. Ángel; Hernán-Losada, Isidoro; Paredes-Velasco, Maximiliano

2017-01-01

An increase in student motivation is often cited as an expected effect of software visualization, but, as far as the authors are aware, no controlled experiments have yet demonstrated this. This paper therefore presents a controlled evaluation of this effect, conducted within the framework of self-determination theory. Students were tasked with…

An Evaluation of an Innovative Drug Education Program: First Year Results.

ERIC Educational Resources Information Center

Schaps, Eric; And Others

An innovative drug education course was taught to seventh and eighth graders and evaluated in a true experiment. Students learned Lasswell's framework for understanding human needs and motives, a systematic decision-making procedure, and information about the pharmacological, psychological, and social consequences of licit and illicit drug use.…

Environment, Safety and Health Self-Assessment Report Fiscal Year 2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robinson, Scott

2011-03-23

The Lawrence Berkeley National Laboratory (LBNL) Environment, Safety, and Health (ES&H) Self-Assessment Program was established to ensure that Integrated Safety Management (ISM) is implemented institutionally and by all divisions. The ES&H Self-Assessment Program, managed by the Office of Contractor Assurance (OCA), provides for an internal evaluation of all ES&H programs and systems at LBNL. The primary objective of the program is to ensure that work is conducted safely and with minimal negative impact to workers, the public, and the environment. Self-assessment follows the five core functions and guiding principles of ISM. Self-assessment is the mechanism used to promote the continuousmore » improvement of the Laboratory's ES&H programs. The process is described in the Environment, Safety, and Health Assurance Plan (PUB-5344) and is composed of three types of self-assessments: Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review. The Division ES&H Self-Assessment Manual (PUB-3105) provides the framework by which divisions conduct formal ES&H self-assessments to systematically identify program deficiencies. Issue-specific assessments are designed and implemented by the divisions and focus on areas of interest to division management. They may be conducted by teams and involve advance planning to ensure that appropriate resources are available. The ES&H Technical Assurance Program Manual (PUB-913E) provides the framework for systematic reviews of ES&H programs and processes. The ES&H Technical Assurance Program Assessment is designed to evaluate whether ES&H programs and processes are compliant with guiding regulations, are effective, and are properly implemented by LBNL divisions. The Division ES&H Peer Review Manual provides the framework by which division ISM systems are evaluated and improved. Peer Reviews are conducted by teams under the direction of senior division management and focus on higher-level management issues. Peer Review teams are selected on the basis of members knowledge and experience in the issues of interest to the division director. LBNL periodically requests in-depth independent assessments of selected ES&H programs. Such assessments augment LBNL's established assessment processes and provide an objective view of ES&H program effectiveness. Institutional Findings, Observations, and Noteworthy Practices identified during independent assessments are specifically intended to help LBNL identify opportunities for program improvement. This report includes the results of the Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review, respectively.« less

Evaluating Mobile Survey Tools (MSTs) for Field-Level Monitoring and Data Collection: Development of a Novel Evaluation Framework, and Application to MSTs for Rural Water and Sanitation Monitoring

PubMed Central

Fisher, Michael B.; Mann, Benjamin H.; Cronk, Ryan D.; Shields, Katherine F.; Klug, Tori L.; Ramaswamy, Rohit

2016-01-01

Information and communications technologies (ICTs) such as mobile survey tools (MSTs) can facilitate field-level data collection to drive improvements in national and international development programs. MSTs allow users to gather and transmit field data in real time, standardize data storage and management, automate routine analyses, and visualize data. Dozens of diverse MST options are available, and users may struggle to select suitable options. We developed a systematic MST Evaluation Framework (EF), based on International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) software quality modeling standards, to objectively assess MSTs and assist program implementers in identifying suitable MST options. The EF is applicable to MSTs for a broad variety of applications. We also conducted an MST user survey to elucidate needs and priorities of current MST users. Finally, the EF was used to assess seven MSTs currently used for water and sanitation monitoring, as a validation exercise. The results suggest that the EF is a promising method for evaluating MSTs. PMID:27563916

Evaluating Mobile Survey Tools (MSTs) for Field-Level Monitoring and Data Collection: Development of a Novel Evaluation Framework, and Application to MSTs for Rural Water and Sanitation Monitoring.

PubMed

Fisher, Michael B; Mann, Benjamin H; Cronk, Ryan D; Shields, Katherine F; Klug, Tori L; Ramaswamy, Rohit

2016-08-23

Information and communications technologies (ICTs) such as mobile survey tools (MSTs) can facilitate field-level data collection to drive improvements in national and international development programs. MSTs allow users to gather and transmit field data in real time, standardize data storage and management, automate routine analyses, and visualize data. Dozens of diverse MST options are available, and users may struggle to select suitable options. We developed a systematic MST Evaluation Framework (EF), based on International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) software quality modeling standards, to objectively assess MSTs and assist program implementers in identifying suitable MST options. The EF is applicable to MSTs for a broad variety of applications. We also conducted an MST user survey to elucidate needs and priorities of current MST users. Finally, the EF was used to assess seven MSTs currently used for water and sanitation monitoring, as a validation exercise. The results suggest that the EF is a promising method for evaluating MSTs.

Decision support in vaccination policies.

PubMed

Piso, B; Wild, C

2009-10-09

Looking across boarders reveals that the national immunization programs of various countries differ in their vaccination schedules and decisions regarding the implementation and funding of new vaccines. The aim of this review is to identify decision aids and crucial criteria for a rational decision-making process on vaccine introduction and to develop a theoretical framework for decision-making based on available literature. Systematic literature search supplemented by hand-search. We identified five published decision aids for vaccine introduction and program planning in industrialized countries. Their comparison revealed an overall similarity with some differences in the approach as well as criteria. Burden of disease and vaccine characteristics play a key role in all decision aids, but authors vary in their views on the significance of cost-effectiveness analyses. Other relevant factors that should be considered before vaccine introduction are discussed to highly differing extents. These factors include the immunization program itself as well as its conformity with other programs, its feasibility, acceptability, and equity, as well as ethical, legal and political considerations. Assuming that the most comprehensive framework possible will not provide a feasible tool for decision-makers, we suggest a stepwise procedure. Though even the best rational approach and most comprehensive evaluation is limited by remaining uncertainties, frameworks provide at least a structured approach to evaluate the various aspects of vaccine implementation decision-making. This process is essential in making consistently sound decisions and will facilitate the public's confidence in the decision and its realization.

A methodological approach and framework for sustainability assessment in NGO-implemented primary health care programs.

PubMed

Sarriot, Eric G; Winch, Peter J; Ryan, Leo J; Bowie, Janice; Kouletio, Michelle; Swedberg, Eric; LeBan, Karen; Edison, Jay; Welch, Rikki; Pacqué, Michel C

2004-01-01

An estimated 10.8 million children under 5 continue to die each year in developing countries from causes easily treatable or preventable. Non governmental organizations (NGOs) are frontline implementers of low-cost and effective child health interventions, but their progress toward sustainable child health gains is a challenge to evaluate. This paper presents the Child Survival Sustainability Assessment (CSSA) methodology--a framework and process--to map progress towards sustainable child health from the community level and upward. The CSSA was developed with NGOs through a participatory process of research and dialogue. Commitment to sustainability requires a systematic and systemic consideration of human, social and organizational processes beyond a purely biomedical perspective. The CSSA is organized around three interrelated dimensions of evaluation: (1) health and health services; (2) capacity and viability of local organizations; (3) capacity of the community in its social ecological context. The CSSA uses a participatory, action-planning process, engaging a 'local system' of stakeholders in the contextual definition of objectives and indicators. Improved conditions measured in the three dimensions correspond to progress toward a sustainable health situation for the population. This framework opens new opportunities for evaluation and research design and places sustainability at the center of primary health care programming.

Using Intervention Mapping to Develop an Oral Health e-Curriculum for Secondary Prevention of Eating Disorders.

PubMed

DeBate, Rita D; Bleck, Jennifer R; Raven, Jessica; Severson, Herb

2017-06-01

Preventing oral-systemic health issues relies on evidence-based interventions across various system-level target groups. Although the use of theory- and evidence-based approaches has been encouraged in developing oral health behavior change programs, the translation of theoretical constructs and principles to behavior change interventions has not been well described. Based on a series of six systematic steps, Intervention Mapping provides a framework for effective decision making with regard to developing, implementing, and evaluating theory- and evidence-informed, system-based behavior change programs. This article describes the application of the Intervention Mapping framework to develop the EAT (evaluating, assessing, and treating) evidence-based intervention with the goal of increasing the capacity of oral health providers to engage in secondary prevention of oral-systemic issues associated with disordered eating behaviors. Examples of data and deliverables for each step are described. In addition, results from evaluation of the intervention via randomized control trial are described, with statistically significant differences observed in behavioral outcomes in the intervention group with effect sizes ranging from r=0.62 to 0.83. These results suggest that intervention mapping, via the six systematic steps, can be useful as a framework for continued development of preventive interventions.

Development of an existential support training program for healthcare professionals.

PubMed

Henoch, Ingela; Strang, Susann; Browall, Maria; Danielson, Ella; Melin-Johansson, Christina

2015-12-01

Our aim was to describe the developmental process of a training program for nurses to communicate existential issues with severely ill patients. The Medical Research Council (MRC) framework for the development and evaluation of complex interventions was used to develop a training program for nurses to communicate about existential issues with their patients. The steps in the framework were employed to describe the development of the training intervention, and the development, feasibility and piloting, evaluation, and implementation phases. The development and feasibility phases are described in the Methods section. The evaluation and implementation phases are described in the Results section. In the evaluation phase, the effectiveness of the intervention was shown as nurses' confidence in communication increased after training. The understanding of the change process was considered to be that the nurses could describe their way of communicating in terms of prerequisites, process, and content. Some efforts have been made to implement the training intervention, but these require further elaboration. Existential and spiritual issues are very important to severely ill patients, and healthcare professionals need to be attentive to such questions. It is important that professionals be properly prepared when patients need this communication. An evidence-based training intervention could provide such preparation. Healthcare staff were able to identify situations where existential issues were apparent, and they reported that their confidence in communication about existential issues increased after attending a short-term training program that included reflection. In order to design a program that should be permanently implemented, more knowledge is needed of patients' perceptions of the quality of the healthcare staff's existential support.

International Review of Frameworks for Impact Evaluation of Appliance Standards, Labeling, and Incentives

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhou, Nan; Romankiewicz, John; Vine, Edward

2012-12-15

In recent years, the number of energy efficiency policies implemented has grown very rapidly as energy security and climate change have become top policy issues for many governments around the world. Within the sphere of energy efficiency policy, governments (federal and local), electric utilities, and other types of businesses and institutions are implementing a wide variety of programs to spread energy efficiency practices in industry, buildings, transport, and electricity. As programs proliferate, there is an administrative and business imperative to evaluate the savings and processes of these programs to ensure that program funds spent are indeed leading to a moremore » energy-efficient economy.« less

Theory of Planned Behavior in School-Based Adolescent Problem Gambling Prevention: A Conceptual Framework.

PubMed

St-Pierre, Renée A; Temcheff, Caroline E; Derevensky, Jeffrey L; Gupta, Rina

2015-12-01

Given its serious implications for psychological and socio-emotional health, the prevention of problem gambling among adolescents is increasingly acknowledged as an area requiring attention. The theory of planned behavior (TPB) is a well-established model of behavior change that has been studied in the development and evaluation of primary preventive interventions aimed at modifying cognitions and behavior. However, the utility of the TPB has yet to be explored as a framework for the development of adolescent problem gambling prevention initiatives. This paper first examines the existing empirical literature addressing the effectiveness of school-based primary prevention programs for adolescent gambling. Given the limitations of existing programs, we then present a conceptual framework for the integration of the TPB in the development of effective problem gambling preventive interventions. The paper describes the TPB, demonstrates how the framework has been applied to gambling behavior, and reviews the strengths and limitations of the model for the design of primary prevention initiatives targeting adolescent risk and addictive behaviors, including adolescent gambling.

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers.

PubMed

Viester, Laura; Verhagen, Evert A L M; Bongers, Paulien M; van der Beek, Allard J

2014-11-01

To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions. Effectiveness was assessed on motivational stage-of-change, self-efficacy, and decisional balance for physical activity and dietary behavior. The external validity of the trial was satisfactory with representative reach of workers and adoption of workplace units in the participating construction company. The extent to which the program was implemented as intended was modest. The intervention was effective on participants' progress through stages of behavior change. Based on the RE-AIM dimensions, it is concluded that for construction workers, the program is feasible and potentially effective, but adjustments are required before widespread implementation.

Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies

PubMed Central

Wherton, Joseph; Papoutsi, Chrysanthi; Lynch, Jennifer; Hughes, Gemma; A'Court, Christine; Hinder, Susan; Fahy, Nick; Procter, Rob; Shaw, Sara

2017-01-01

Background Many promising technological innovations in health and social care are characterized by nonadoption or abandonment by individuals or by failed attempts to scale up locally, spread distantly, or sustain the innovation long term at the organization or system level. Objective Our objective was to produce an evidence-based, theory-informed, and pragmatic framework to help predict and evaluate the success of a technology-supported health or social care program. Methods The study had 2 parallel components: (1) secondary research (hermeneutic systematic review) to identify key domains, and (2) empirical case studies of technology implementation to explore, test, and refine these domains. We studied 6 technology-supported programs—video outpatient consultations, global positioning system tracking for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organizing software, and integrated case management via data sharing—using longitudinal ethnography and action research for up to 3 years across more than 20 organizations. Data were collected at micro level (individual technology users), meso level (organizational processes and systems), and macro level (national policy and wider context). Analysis and synthesis was aided by sociotechnically informed theories of individual, organizational, and system change. The draft framework was shared with colleagues who were introducing or evaluating other technology-supported health or care programs and refined in response to feedback. Results The literature review identified 28 previous technology implementation frameworks, of which 14 had taken a dynamic systems approach (including 2 integrative reviews of previous work). Our empirical dataset consisted of over 400 hours of ethnographic observation, 165 semistructured interviews, and 200 documents. The final nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework included questions in 7 domains: the condition or illness, the technology, the value proposition, the adopter system (comprising professional staff, patient, and lay caregivers), the organization(s), the wider (institutional and societal) context, and the interaction and mutual adaptation between all these domains over time. Our empirical case studies raised a variety of challenges across all 7 domains, each classified as simple (straightforward, predictable, few components), complicated (multiple interacting components or issues), or complex (dynamic, unpredictable, not easily disaggregated into constituent components). Programs characterized by complicatedness proved difficult but not impossible to implement. Those characterized by complexity in multiple NASSS domains rarely, if ever, became mainstreamed. The framework showed promise when applied (both prospectively and retrospectively) to other programs. Conclusions Subject to further empirical testing, NASSS could be applied across a range of technological innovations in health and social care. It has several potential uses: (1) to inform the design of a new technology; (2) to identify technological solutions that (perhaps despite policy or industry enthusiasm) have a limited chance of achieving large-scale, sustained adoption; (3) to plan the implementation, scale-up, or rollout of a technology program; and (4) to explain and learn from program failures. PMID:29092808

A Framework for Evaluating Induction into Teaching.

ERIC Educational Resources Information Center

Schlechty, Phillip C.

1985-01-01

Indicators and characteristics of effective induction systems are described using efforts of the Charlotte-Mecklenburg Schools' Career Development Program as an example. Fundamental changes needed in the way teacher education is conceptualized by school personnel are discussed. (DF)

Creating Critical Objectives and Assessments Using a Critical Communication Pedagogical Framework

ERIC Educational Resources Information Center

Kahl, David H., Jr.

2018-01-01

Courses: Instructional Communication, Graduate Teaching Assistant Training Programs. Objectives: Students will (1) understand critical communication pedagogy (CCP); (2) evaluate traditional and critical objectives and assessment procedures; and (3) create critical objectives and assessment procedures.

Development and implementation of the Saskatchewan Leadership Program: Leading for healthcare transformation.

PubMed

Mutwiri, Betty; Witt, Christine; Denysek, Christina; Halferdahl, Susan; McLeod, Katherine M

2016-01-01

The Saskatchewan Leadership Program (SLP) was developed based on the LEADS framework and aligned with Lean management to build leadership renewal and sustainability conducive to transformational change in the Saskatchewan health system. This article describes the development, implementation, and evaluation of the SLP, including experiences and lessons learned. © 2015 The Canadian College of Health Leaders.

Facilitating admissions of diverse students: A six-point, evidence-informed framework for pipeline and program development.

PubMed

Young, Meredith E; Thomas, Aliki; Varpio, Lara; Razack, Saleem I; Hanson, Mark D; Slade, Steve; Dayem, Katharine L; McKnight, David J

2017-04-01

Several national level calls have encouraged reconsideration of diversity issues in medical education. Particular interest has been placed on admissions, as decisions made here shape the nature of the future physician workforce. Critical analysis of current practices paired with evidence-informed policies may counter some of the barriers impeding access for underrepresented groups. We present a framework for diversity-related program development and evaluation grounded within a knowledge translation framework, and supported by the initiation of longitudinal collection of diversity-related data. We provide an illustrative case study for each component of the framework. Descriptive analyses are presented of pre/post intervention diversity metrics if applicable and available. The framework's focal points are: 1) data-driven identification of underrepresented groups, 2) pipeline development and targeted recruitment, 3) ensuring an inclusive process, 4) ensuring inclusive assessment, 5) ensuring inclusive selection, and 6) iterative use of diversity-related data. Case studies ranged from wording changes on admissions websites to the establishment of educational and administrative offices addressing needs of underrepresented populations. We propose that diversity-related data must be collected on a variety of markers, developed in partnership with stakeholders who are most likely to facilitate implementation of best practices and new policies. These data can facilitate the design, implementation, and evaluation of evidence-informed diversity initiatives and provide a structure for continued investigation into 'interventions' supporting diversity-related initiatives.

Interprofessional educator development : Build it and they will come.

PubMed

Pien, Lily C; Stiber, Michaela; Prelosky, Allison; Colbert, Colleen Y

2018-04-16

We describe an interprofessional educator development program, designed intentionally, that was implemented at an academic healthcare centre. In 2014, we purposefully adapted our pre-existing educator development program to be able to include all interprofessional educators at our institution. The program's goals were to enhance educator skills, a common need due to requirements of accreditation, and to create a local interprofessional community of teachers. The framework of the program was based upon adult learning principles, reflective practice, experiential learning and peer groups, all key characteristics of faculty development programs. It was also longitudinal and immersive. Kirkpatrick's program evaluation model was used for identifying results; participants' self-reported evaluation forms were collected and their narrative comments were analyzed. After we opened our educator program to all interprofessional staff, our number of program participants increased. The interprofessional participants included, but was not limited to, physicians, physician trainees, nurses, physician assistants, audiologists, perfusionists, and basic science researchers. Our number of program sessions and program faculty were expanded. Our interprofessional participants reported that they were able to learn essential knowledge, skills and attitudes for their growth and development as educators, in the context of an interprofessional community, while also appreciating the diversity of their peers. We share our insights with the redesign and implementation of an interprofessional educator program so that others can learn from our experiences. Key takeaways include using a conceptual framework for teaching effectiveness, involving interprofessional stakeholders and obtaining their perspectives, reviewing interprofessional literature and competencies, and highlighting best practices across the disciplines.

Framework for a National Testing and Evaluation Program ...

EPA Pesticide Factsheets

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Application of a policy framework for the public funding of drugs for rare diseases.

PubMed

Winquist, Eric; Coyle, Doug; Clarke, Joe T R; Evans, Gerald A; Seager, Christine; Chan, Winnie; Martin, Janet

2014-08-01

In many countries, decisions about the public funding of drugs are preferentially based on the results of randomized trials. For truly rare diseases, such trials are not typically available, and approaches by public payers are highly variable. In view of this, a policy framework intended to fairly evaluate these drugs was developed by the Drugs for Rare Diseases Working Group (DRDWG) at the request of the Ontario Public Drug Programs. To report the initial experience of applying a novel evaluation framework to funding applications for drugs for rare diseases. Retrospective observational cohort study. Clinical effectiveness, costs, funding recommendations, funding approval. Between March 2008 and February 2013, eight drugs were evaluated using the DRDWG framework. The estimated average annual drug cost per patient ranged from 28,000 to 1,200,000 Canadian dollars (CAD). For five drugs, full evaluations were completed, specific funding recommendations were made by the DRDWG, and funding was approved after risk-sharing agreements with the manufacturers were negotiated. For two drugs, the disease indications were determined to be ineligible for consideration. For one drug, there was insufficient natural history data for the disease to provide a basis for recommendation. For the five drugs fully evaluated, 32 patients met the predefined eligibility criteria for funding, and five were denied based on predefined exclusion criteria. The framework improved transparency and consistency for evaluation and public funding of drugs for rare diseases in Ontario. The evaluation process will continue to be iteratively refined as feedback on actual versus expected clinical and economic outcomes is incorporated.

Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies.

PubMed

Greenhalgh, Trisha; Wherton, Joseph; Papoutsi, Chrysanthi; Lynch, Jennifer; Hughes, Gemma; A'Court, Christine; Hinder, Susan; Fahy, Nick; Procter, Rob; Shaw, Sara

2017-11-01

Many promising technological innovations in health and social care are characterized by nonadoption or abandonment by individuals or by failed attempts to scale up locally, spread distantly, or sustain the innovation long term at the organization or system level. Our objective was to produce an evidence-based, theory-informed, and pragmatic framework to help predict and evaluate the success of a technology-supported health or social care program. The study had 2 parallel components: (1) secondary research (hermeneutic systematic review) to identify key domains, and (2) empirical case studies of technology implementation to explore, test, and refine these domains. We studied 6 technology-supported programs-video outpatient consultations, global positioning system tracking for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organizing software, and integrated case management via data sharing-using longitudinal ethnography and action research for up to 3 years across more than 20 organizations. Data were collected at micro level (individual technology users), meso level (organizational processes and systems), and macro level (national policy and wider context). Analysis and synthesis was aided by sociotechnically informed theories of individual, organizational, and system change. The draft framework was shared with colleagues who were introducing or evaluating other technology-supported health or care programs and refined in response to feedback. The literature review identified 28 previous technology implementation frameworks, of which 14 had taken a dynamic systems approach (including 2 integrative reviews of previous work). Our empirical dataset consisted of over 400 hours of ethnographic observation, 165 semistructured interviews, and 200 documents. The final nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework included questions in 7 domains: the condition or illness, the technology, the value proposition, the adopter system (comprising professional staff, patient, and lay caregivers), the organization(s), the wider (institutional and societal) context, and the interaction and mutual adaptation between all these domains over time. Our empirical case studies raised a variety of challenges across all 7 domains, each classified as simple (straightforward, predictable, few components), complicated (multiple interacting components or issues), or complex (dynamic, unpredictable, not easily disaggregated into constituent components). Programs characterized by complicatedness proved difficult but not impossible to implement. Those characterized by complexity in multiple NASSS domains rarely, if ever, became mainstreamed. The framework showed promise when applied (both prospectively and retrospectively) to other programs. Subject to further empirical testing, NASSS could be applied across a range of technological innovations in health and social care. It has several potential uses: (1) to inform the design of a new technology; (2) to identify technological solutions that (perhaps despite policy or industry enthusiasm) have a limited chance of achieving large-scale, sustained adoption; (3) to plan the implementation, scale-up, or rollout of a technology program; and (4) to explain and learn from program failures. ©Trisha Greenhalgh, Joseph Wherton, Chrysanthi Papoutsi, Jennifer Lynch, Gemma Hughes, Christine A'Court, Susan Hinder, Nick Fahy, Rob Procter, Sara Shaw. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 01.11.2017.

Evaluation of the Capillary Blood Glucose Self-monitoring Program

PubMed Central

Augusto, Mariana Cristina; Nitsche, Maria José Trevizani; Parada, Cristina Maria Garcia de Lima; Zanetti, Maria Lúcia; Carvalhaes, Maria Antonieta de Barros Leite

2014-01-01

OBJECTIVE: to evaluate the structure, process and results of the Capillary Blood Glucose Self-monitoring Program in a Brazilian city. METHOD: epidemiological, cross-sectional study. The methodological framework of Donabedian was used to construct indicators of structure, process and outcome. A random sample (n = 288) of users enrolled and 96 health professionals who worked in the program was studied. Two questionnaires were used that were constructed for this study, one for professionals and one for users, both containing data for the evaluation of structure, process and outcome. Anthropometric measures and laboratory results were collected by consulting the patients' health records. The analysis involved descriptive statistics. RESULTS: most of the professionals were not qualified to work in the program and were not knowledgeable about the set of criteria for patient registration. None of the patients received complete and correct orientations about the program and the percentage with skills to perform conducts autonomously was 10%. As regards the result indicators, 86.4% of the patients and 81.3% of the professionals evaluated the program positively. CONCLUSION: the evaluation indicators designed revealed that one of the main objectives of the program, self-care skills, has not been achieved. PMID:25493676

Content knowledge development in a chemistry teacher preparation program: A current potentials and challenges

NASA Astrophysics Data System (ADS)

Widhiyanti, Tuszie; Treagust, David F.; Mocerino, Mauro; Vishnumolakala, Venkat

2017-08-01

One of the essential facets in teacher education program is the development of the teachers' content knowledge and it has been suggested by many scholars that the study to analyse the process of content knowledge development in teacher education program is necessary. Regarding this, the aim of this research is to evaluate the existing program of developing pre-service chemistry teachers' content knowledge, especially in the topic about the particulate nature of matter. The curriculum of content knowledge development was analysed using the forms of the curriculum evaluation (Akker, 1998; Goodlad, Klein, and Tye (1979); Treagust, 1987). Within this framework, the curriculum was evaluated in several aspects including the vision and intention of the curriculum as mentioned in the curriculum documents (intended curriculum), the users' interpretation and perception about the curriculum (perceived curriculum), the actual process of curriculum implementation (implemented curriculum), and the outcomes of the curriculum (achieved curriculum). According to the framework used for this study, the research combined qualitative and quantitative methods of data collection and the interpretation including document analysis, classroom observation, interviews, and two-tier diagnostic test. Through this research we examined the coherence among those aspects. The results reveal that although the content knowledge development is explicitly intended in a curriculum, its implementation and lecturers' perceptions give influence in the results as appear in pre-service teachers' achievements. In general, this research provides basic information about the effectiveness of the program including the challenges and the potentials for a reconsideration of the program in the future.

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Use of Theory in Behavior Change Interventions: An Analysis of Programs to Increase Physical Activity in Posttreatment Breast Cancer Survivors

ERIC Educational Resources Information Center

Bluethmann, Shirley M.; Bartholomew, L. Kay; Murphy, Caitlin C.; Vernon, Sally W.

2017-01-01

Objective: Theory use may enhance effectiveness of behavioral interventions, yet critics question whether theory-based interventions have been sufficiently scrutinized. This study applied a framework to evaluate theory use in physical activity interventions for breast cancer survivors. The aims were to (1) evaluate theory application intensity and…

The Development and Initial Evaluation of the Human Readiness Level Framework

DTIC Science & Technology

2010-06-01

View ICD Initial Capabilities Document ICW Interactive Course Ware ILE Interactive Learning Environment ILT Instructor Led Training IOC...Programmatic Environmental Safety and Health Evaluation PHA Preliminary Hazard Analysis PHL Preliminary Hazard List xiv PM Program Manager PQS...Occupational Health SOW Statement of Work SRD System Requirements Document SPS System Performance Specification SRR System Requirements Review SVR

The Evaluation Life Cycle: A Retrospective Assessment of Stages and Phases of the Circles of Care Initiative

ERIC Educational Resources Information Center

Bess, Gary; Allen, James; Deters, Pamela B.

2004-01-01

A life cycle metaphor characterizes the evolving relationship between the evaluator and program staff. This framework suggests that common developmental dynamics occur in roughly the same order across groups and settings. There are stage-specific dynamics that begin with Pre-History, which characterize the relationship between the grantees and…

Integrating theory and practice to increase scientific workforce diversity: a framework for career development in graduate research training.

PubMed

Byars-Winston, Angela; Gutierrez, Belinda; Topp, Sharon; Carnes, Molly

2011-01-01

Few, if any, educational interventions intended to increase underrepresented minority (URM) graduate students in biological and behavioral sciences are informed by theory and research on career persistence. Training and Education to Advance Minority Scholars in Science (TEAM-Science) is a program funded by the National Institute of General Medical Sciences at the University of Wisconsin-Madison with the twin goals of increasing the number of URM students entering and completing a PhD in BBS and increasing the number of these students who pursue academic careers. A framework for career development in graduate research training is proposed using social cognitive career theory. Based on this framework, TEAM-Science has five core components: 1) mentor training for the research advisor, 2) eight consensus-derived fundamental competencies required for a successful academic career, 3) career coaching by a senior faculty member, 4) an individualized career development plan that aligns students' activities with the eight fundamental competencies, and 5) a strengths, weaknesses, opportunities, and threats personal career analysis. This paper describes the theoretical framework used to guide development of these components, the research and evaluation plan, and early experience implementing the program. We discuss the potential of this framework to increase desired career outcomes for URM graduate trainees in mentored research programs and, thereby, strengthen the effectiveness of such interventions on participants' career behaviors.

Integrating Theory and Practice to Increase Scientific Workforce Diversity: A Framework for Career Development in Graduate Research Training

PubMed Central

Byars-Winston, Angela; Gutierrez, Belinda; Topp, Sharon; Carnes, Molly

2011-01-01

Few, if any, educational interventions intended to increase underrepresented minority (URM) graduate students in biological and behavioral sciences are informed by theory and research on career persistence. Training and Education to Advance Minority Scholars in Science (TEAM-Science) is a program funded by the National Institute of General Medical Sciences at the University of Wisconsin–Madison with the twin goals of increasing the number of URM students entering and completing a PhD in BBS and increasing the number of these students who pursue academic careers. A framework for career development in graduate research training is proposed using social cognitive career theory. Based on this framework, TEAM-Science has five core components: 1) mentor training for the research advisor, 2) eight consensus-derived fundamental competencies required for a successful academic career, 3) career coaching by a senior faculty member, 4) an individualized career development plan that aligns students’ activities with the eight fundamental competencies, and 5) a strengths, weaknesses, opportunities, and threats personal career analysis. This paper describes the theoretical framework used to guide development of these components, the research and evaluation plan, and early experience implementing the program. We discuss the potential of this framework to increase desired career outcomes for URM graduate trainees in mentored research programs and, thereby, strengthen the effectiveness of such interventions on participants’ career behaviors. PMID:22135370

Evaluating an accelerated nursing program: a dashboard for diversity.

PubMed

Schmidt, Bonnie J; MacWilliams, Brent R

2015-01-01

Diversity is a topic of increasing attention in higher education and the nursing workforce. Experts have called for a nursing workforce that mirrors the population it serves. Students in nursing programs in the United States do not reflect our country's diverse population; therefore, much work is needed before that goal can be reached. Diversity cannot be successfully achieved in nursing education without inclusion and attention to quality. The Inclusive Excellence framework can be used by nurse educators to promote inclusion, diversity, and excellence. In this framework, excellence and diversity are linked in an intentional metric-driven process. Accelerated programs offer a possible venue to promote diversity, and one accelerated program is examined using a set of metrics and a dashboard approach commonly used in business settings. Several recommendations were made for future assessment, interventions, and monitoring. Nurse educators are called to examine and adopt a diversity dashboard in all nursing programs. Copyright © 2015 Elsevier Inc. All rights reserved.

Formative Process Evaluation for Implementing a Social Marketing Intervention to Increase Walking Among African Americans in the Positive Action for Today’s Health Trial

PubMed Central

Wilson, Dawn K.; Griffin, Sarah; St. George, Sara M.; Alia, Kassandra A.; Trumpeter, Nevelyn N.; Wandersman, Abraham K.; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-01-01

Objectives. Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today’s Health trial. Methods: We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Results: Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Conclusions: Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities. PMID:23078486

Strengthening the HIV Care Continuum in the Dominican Republic: Application of a Triadic Implementation Framework to Meet the UNAIDS 90-90-90 Treatment Goal.

PubMed

Bowman, Alex S; Mehta, Mili; Lerebours Nadal, Leonel; Halpern, Mina; Nicholas, Stephen W; Amesty, Silvia

2017-10-01

Innovative empirical frameworks to evaluate progress in efforts addressing HIV treatment and prevention barriers in resource-limited areas are sorely needed to achieve the UNAIDS 90-90-90 goal (90% diagnosed, 90% on treatment, and 90% virally suppressed). A triadic implementation framework (TIF) is a comprehensive conceptual tool for (1) monitoring attrition, (2) evaluating operational programs, and (3) measuring the impact of specific implementation goals within the care continuum. TIF will assess the effects of enhanced programs on adherence and virologic suppression within the HIV care continuum at a regional clinic in the Dominican Republic (Clínica de Familia La Romana [CFLR]) and its program serving high-risk, migratory batey (sugarcane cultivation) communities. A retrospective cohort study completed during 2015 collected deidentified data from a CFLR chart review of adult HIV patients diagnosed in 2013. The results were quantitatively analyzed and compared to 2011 cohort data. In 2013, 310 patients were diagnosed HIV positive. The results demonstrated 73% enrolling in care, 28% adhering to care, and 16% achieving viral load suppression. Engagement increased across all steps of the care continuum compared to a 2011 cohort, culminating in a significant increase in undetectable viral load from 4% to 16% (p < 0.001). The batey program showed significant increases in patient enrollment compared to the 2011 cohort (p < 0.001). Meeting the UNAIDS 90-90-90 goal requires enhanced services in high-burden, resource-limited regions. CFLR employs TIF to assess progress and programmatic areas in need of strengthening. Data suggest enhanced CFLR services improve outcomes. Given improvements, maintenance and expansion of similar programs are warranted to achieve the 90-90-90 goal.

Studying citizen science through adaptive management and learning feedbacks as mechanisms for improving conservation.

PubMed

Jordan, Rebecca; Gray, Steven; Sorensen, Amanda; Newman, Greg; Mellor, David; Newman, Greg; Hmelo-Silver, Cindy; LaDeau, Shannon; Biehler, Dawn; Crall, Alycia

2016-06-01

Citizen science has generated a growing interest among scientists and community groups, and citizen science programs have been created specifically for conservation. We examined collaborative science, a highly interactive form of citizen science, which we developed within a theoretically informed framework. In this essay, we focused on 2 aspects of our framework: social learning and adaptive management. Social learning, in contrast to individual-based learning, stresses collaborative and generative insight making and is well-suited for adaptive management. Adaptive-management integrates feedback loops that are informed by what is learned and is guided by iterative decision making. Participants engaged in citizen science are able to add to what they are learning through primary data collection, which can result in the real-time information that is often necessary for conservation. Our work is particularly timely because research publications consistently report a lack of established frameworks and evaluation plans to address the extent of conservation outcomes in citizen science. To illustrate how our framework supports conservation through citizen science, we examined how 2 programs enacted our collaborative science framework. Further, we inspected preliminary conservation outcomes of our case-study programs. These programs, despite their recent implementation, are demonstrating promise with regard to positive conservation outcomes. To date, they are independently earning funds to support research, earning buy-in from local partners to engage in experimentation, and, in the absence of leading scientists, are collecting data to test ideas. We argue that this success is due to citizen scientists being organized around local issues and engaging in iterative, collaborative, and adaptive learning. © 2016 Society for Conservation Biology.

Sustainability in Health care by Allocating Resources Effectively (SHARE) 10: operationalising disinvestment in a conceptual framework for resource allocation.

PubMed

Harris, Claire; Green, Sally; Elshaug, Adam G

2017-09-08

This is the tenth in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. After more than a decade of research, there is little published evidence of active and successful disinvestment. The paucity of frameworks, methods and tools is reported to be a factor in the lack of success. However there are clear and consistent messages in the literature that can be used to inform development of a framework for operationalising disinvestment. This paper, along with the conceptual review of disinvestment in Paper 9 of this series, aims to integrate the findings of the SHARE Program with the existing disinvestment literature to address the lack of information regarding systematic organisation-wide approaches to disinvestment at the local health service level. A framework for disinvestment in a local healthcare setting is proposed. Definitions for essential terms and key concepts underpinning the framework have been made explicit to address the lack of consistent terminology. Given the negative connotations of the word 'disinvestment' and the problems inherent in considering disinvestment in isolation, the basis for the proposed framework is 'resource allocation' to address the spectrum of decision-making from investment to disinvestment. The focus is positive: optimising healthcare, improving health outcomes, using resources effectively. The framework is based on three components: a program for decision-making, projects to implement decisions and evaluate outcomes, and research to understand and improve the program and project activities. The program consists of principles for decision-making and settings that provide opportunities to introduce systematic prompts and triggers to initiate disinvestment. The projects follow the steps in the disinvestment process. Potential methods and tools are presented, however the framework does not stipulate project design or conduct; allowing application of any theories, methods or tools at each step. Barriers are discussed and examples illustrating constituent elements are provided. The framework can be employed at network, institutional, departmental, ward or committee level. It is proposed as an organisation-wide application, embedded within existing systems and processes, which can be responsive to needs and priorities at the level of implementation. It can be used in policy, management or clinical contexts.

NIST biometric evaluations and developments

NASA Astrophysics Data System (ADS)

Garris, Michael D.; Wilson, Charles L.

2005-05-01

This paper presents an R&D framework used by the National Institute of Standards and Technology (NIST) for biometric technology testing and evaluation. The focus of this paper is on fingerprint-based verification and identification. Since 9-11 the NIST Image Group has been mandated by Congress to run a program for biometric technology assessment and biometric systems certification. Four essential areas of activity are discussed: 1) developing test datasets, 2) conducting performance assessment; 3) technology development; and 4) standards participation. A description of activities and accomplishments are provided for each of these areas. In the process, methods of performance testing are described and results from specific biometric technology evaluations are presented. This framework is anticipated to have broad applicability to other technology and application domains.

Theoretically-Driven Infrastructure for Supporting Healthcare Teams Training at a Military Treatment Facility

NASA Technical Reports Server (NTRS)

Turner, Robert T.; Parodi, Andrea V.

2011-01-01

The Team Resource Center (TRC) at Naval Medical Center Portsmouth (NMCP) currently hosts a tri-service healthcare teams training course three times annually . The course consists of didactic learning coupled with simulation exercises to provide an interactive educational experience for healthcare professionals. The course is also the foundation of a research program designed to explore the use of simulation technologies for enhancing team training and evaluation. The TRC has adopted theoretical frameworks for evaluating training readiness and efficacy, and is using these frameworks to guide a systematic reconfiguration of the infrastructure supporting healthcare teams training and research initiatives at NMCP.

Peer engagement in harm reduction strategies and services: a critical case study and evaluation framework from British Columbia, Canada.

PubMed

Greer, Alissa M; Luchenski, Serena A; Amlani, Ashraf A; Lacroix, Katie; Burmeister, Charlene; Buxton, Jane A

2016-05-27

Engaging people with drug use experience, or 'peers,' in decision-making helps to ensure harm reduction services reflect current need. There is little published on the implementation, evaluation, and effectiveness of meaningful peer engagement. This paper aims to describe and evaluate peer engagement in British Columbia from 2010-2014. A process evaluation framework specific to peer engagement was developed and used to assess progress made, lessons learned, and future opportunities under four domains: supportive environment, equitable participation, capacity building and empowerment, and improved programming and policy. The evaluation was conducted by reviewing primary and secondary qualitative data including focus groups, formal documents, and meeting minutes. Peer engagement was an iterative process that increased and improved over time as a consequence of reflexive learning. Practical ways to develop trust, redress power imbalances, and improve relationships were crosscutting themes. Lack of support, coordination, and building on existing capacity were factors that could undermine peer engagement. Peers involved across the province reviewed and provided feedback on these results. Recommendations from this evaluation can be applied to other peer engagement initiatives in decision-making settings to improve relationships between peers and professionals and to ensure programs and policies are relevant and equitable.

Curriculum Mapping of the Master's Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework.

PubMed

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-05-02

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana's Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana's academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana's graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist's profession in a more balanced way.

Curriculum Mapping of the Master’s Program in Pharmacy in Slovenia with the PHAR-QA Competency Framework

PubMed Central

Gmeiner, Tanja; Horvat, Nejc; Kos, Mitja; Obreza, Aleš; Vovk, Tomaž; Grabnar, Iztok; Božič, Borut

2017-01-01

This article presents the results of mapping the Slovenian pharmacy curriculum to evaluate the adequacy of the recently developed and validated European Pharmacy Competences Framework (EPCF). The mapping was carried out and evaluated progressively by seven members of the teaching staff at the University of Ljubljana’s Faculty of Pharmacy. Consensus was achieved by using a two-round modified Delphi technique to evaluate the coverage of competences in the current curriculum. The preliminary results of the curriculum mapping showed that all of the competences as defined by the EPCF are covered in Ljubljana’s academic program. However, because most EPCF competences cover healthcare-oriented pharmacy practice, a lack of competences was observed for the drug development and production perspectives. Both of these perspectives are important because a pharmacist is (or should be) responsible for the entire process, from the development and production of medicines to pharmaceutical care in contact with patients. Nevertheless, Ljubljana’s graduates are employed in both of these pharmaceutical professions in comparable proportions. The Delphi study revealed that the majority of differences in scoring arise from different perspectives on the pharmacy profession (e.g., community, hospital, industrial, etc.). Nevertheless, it can be concluded that curriculum mapping using the EPCF is very useful for evaluating and recognizing weak and strong points of the curriculum. However, the competences of the framework should address various fields of the pharmacist’s profession in a more balanced way. PMID:28970436

Systematic framework to evaluate the status of physical activity research for persons with multiple sclerosis.

PubMed

Dixon-Ibarra, Alicia; Vanderbom, Kerri; Dugala, Anisia; Driver, Simon

2014-04-01

Exploring the current state of health behavior research for individuals with multiple sclerosis is essential to understanding the next steps required to reducing preventable disability. A way to link research to translational health promotion programs is by utilizing the Behavioral Epidemiological Framework, which describes a sequence of phases used to categorize health-related behavioral research. This critical audit of the literature examines the current state of physical activity research for persons with multiple sclerosis by utilizing the proposed Behavioral Epidemiological Framework. After searching MEDLINE, PUBMED, PsycINFO, Google Scholar and several major areas within EBSCOHOST (2000 to present), retrieved articles were categorized according to the framework phases and coding rules. Of 139 articles, 49% were in phase 1 (establishing links between behavior and health), 18% phase 2 (developing methods for measuring behavior), 24% phase 3 (identifying factors influencing behavior and implications for theory), and 9% phase 4 and 5 (evaluating interventions to change behavior and translating research into practice). Emphasis on phase 1 research indicates the field is in its early stages of development. Providing those with multiple sclerosis with necessary tools through health promotion programs is needed to reduce secondary conditions and co-morbidities. Reassessment of the field of physical activity and multiple sclerosis in the future could provide insight into whether the field is evolving over time or remaining stagnant. Published by Elsevier Inc.

Causes of Low Graduation Rates in a Rural High School Located in South Carolina: A Case Study

ERIC Educational Resources Information Center

Sumter, Pamela Robinson

2013-01-01

This qualitative case study examined causes of low graduation rates for young adults. The purpose of this study was to evaluate students participating in an after-school program and reflect on their perceptions of that program a year after they graduated. The theoretical framework for this study reflected upon an open social system. The research…

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Redesigning Orientation in an Intensive Care Unit Using 2 Theoretical Models.

PubMed

Kozub, Elizabeth; Hibanada-Laserna, Maribel; Harget, Gwen; Ecoff, Laurie

2015-01-01

To accommodate a higher demand for critical care nurses, an orientation program in a surgical intensive care unit was revised and streamlined. Two theoretical models served as a foundation for the revision and resulted in clear clinical benchmarks for orientation progress evaluation. The purpose of the project was to integrate theoretical frameworks into practice to improve the unit orientation program. Performance improvement methods served as a framework for the revision, and outcomes were measured before and after implementation. The revised orientation program increased 1- and 2-year nurse retention and decreased turnover. Critical care knowledge increased after orientation for both the preintervention and postintervention groups. Incorporating a theoretical basis for orientation has been shown to be successful in increasing the number of nurses completing orientation and improving retention, turnover rates, and knowledge gained.

Individualized education and competency development of Croatian community pharmacists using the general level framework.

PubMed

Meštrović, Arijana; Staničić, Zivka; Hadžiabdić, Maja Ortner; Mucalo, Iva; Bates, Ian; Duggan, Catherine; Carter, Sarah; Bruno, Andreia; Košiček, Miljenko

2012-03-12

To measure Croatian community pharmacists' progress in competency development using the General Level Framework (GLF) as an educational tool in a longitudinal study. Patient care competencies of 100 community pharmacists were evaluated twice, in 2009 and in 2010 in a prospective cohort study. During this 12-month period, tailored educational programs based on the GLF were organized and conducted, new services and standard operating procedures were implemented, and documentation of contributions to patient care in the pharmacist's portfolio became mandatory. Pharmacists' development of all GLF patient care competencies was significant with the greatest improvements seen in the following competencies: patient consultation, monitoring drug therapy, medicine information and patient education, and evaluation of outcomes. This study, which retested the effectiveness of an evidence-based competency framework, confirmed that GLF is a valid educational tool for pharmacist development.

Exploiting Vector and Multicore Parallelsim for Recursive, Data- and Task-Parallel Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ren, Bin; Krishnamoorthy, Sriram; Agrawal, Kunal

Modern hardware contains parallel execution resources that are well-suited for data-parallelism-vector units-and task parallelism-multicores. However, most work on parallel scheduling focuses on one type of hardware or the other. In this work, we present a scheduling framework that allows for a unified treatment of task- and data-parallelism. Our key insight is an abstraction, task blocks, that uniformly handles data-parallel iterations and task-parallel tasks, allowing them to be scheduled on vector units or executed independently as multicores. Our framework allows us to define schedulers that can dynamically select between executing task- blocks on vector units or multicores. We show that thesemore » schedulers are asymptotically optimal, and deliver the maximum amount of parallelism available in computation trees. To evaluate our schedulers, we develop program transformations that can convert mixed data- and task-parallel pro- grams into task block-based programs. Using a prototype instantiation of our scheduling framework, we show that, on an 8-core system, we can simultaneously exploit vector and multicore parallelism to achieve 14×-108× speedup over sequential baselines.« less

Translation of an Effective Tai Chi Intervention Into a Community-Based Falls-Prevention Program

PubMed Central

Li, Fuzhong; Harmer, Peter; Glasgow, Russell; Mack, Karin A.; Sleet, David; Fisher, K. John; Kohn, Melvin A.; Millet, Lisa M.; Mead, Jennifer; Xu, Junheng; Lin, Mei-Li; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-01-01

Tai Chi—Moving for Better Balance, a falls-prevention program developed from a randomized controlled trial for community-based use, was evaluated with the RE-AIM framework in 6 community centers. The program had a 100% adoption rate and 87% reach into the target older adult population. All centers implemented the intervention with good fidelity, and participants showed significant improvements in health-related outcome measures. This evidence-based tai chi program is practical to disseminate and can be effectively implemented and maintained in community settings. PMID:18511723

An organizing framework for informal caregiver interventions: detailing caregiving activities and caregiver and care recipient outcomes to optimize evaluation efforts

PubMed Central

2011-01-01

Background Caregiver interventions may help improve the quality of informal care. Yet the lack of a systematic framework specifying the targets and outcomes of caregiver interventions hampers our ability to understand what has been studied, to evaluate existing programs, and to inform the design of future programs. Our goal was to develop an organizing framework detailing the components of the caregiving activities and the caregiver and care recipient outcomes that should be affected by an intervention. In so doing, we characterize what has been measured in the published literature to date and what should be measured in future studies to enable comparisons across interventions and across time. Methods Our data set comprises 121 reports of caregiver interventions conducted in the United States and published between 2000 and 2009. We extracted information on variables that have been examined as primary and secondary outcomes. These variables were grouped into categories, which then informed the organizing framework. We calculated the frequency with which the interventions examined each framework component to identify areas about which we have the most knowledge and under-studied areas that deserve attention in future research. Results The framework stipulates that caregiver interventions seek to change caregiving activities, which in turn affect caregiver and care recipient outcomes. The most frequently assessed variables have been caregiver psychological outcomes (especially depression and burden) and care recipient physical and health care use outcomes. Conclusions Based on the organizing framework, we make three key recommendations to guide interventions and inform research and policy. First, all intervention studies should assess quality and/or quantity of caregiving activities to help understand to what extent and how well the intervention worked. Second, intervention studies should assess a broad range of caregiver and care recipient outcomes, including considering whether expanding to economic status and health care use of the caregiver can be accommodated, to ease subsequent economic evaluations of caregiving. Third, intervention studies should measure a common set of outcomes to facilitate cross-time and cross-study comparisons of effectiveness. PMID:22107600

Dissemination and Implementation Strategies of Lower Extremity Preventive Training Programs in Youth: A Clinical Review.

PubMed

DiStefano, Lindsay J; Frank, Barnett S; Root, Hayley J; Padua, Darin A

Neuromuscular preventive training programs effectively reduce injury and improve performance in youth athletes. However, program effectiveness is directly linked to program compliance, fidelity, and dosage. Preventive training programs are not widely adopted by youth sport coaches. One way to promote widespread dissemination and compliance is to identify implementation strategies that influence program adoption and maintenance. It is unknown how previously published programs have followed the elements of an implementation framework. The objective of this review was to evaluate how elements of the 7 steps of implementation, developed by Padua et al, have been performed in the evidence of lower extremity preventive training programs. A systematic review of the literature from 1996 through September 2016 was conducted using electronic databases. Investigations that documented implementation of a sport team-based neuromuscular preventive training program in youth athletes and measured lower extremity injury rates were included. Clinical review. Level 4. A total of 12 studies met the inclusion criteria and were reviewed. Information regarding the completion of any of the 7 steps within the implementation framework developed by Padua et al was extracted. None of the 12 articles documented completion of all 7 steps. While each study addressed some of the 7 steps, no study addressed maintenance or an exit strategy for youth athletes. Program implementation appears limited in obtaining administrative support, utilizing an interdisciplinary implementation team, and monitoring or promoting fidelity of the intervention. Despite strong evidence supporting the effectiveness of preventive training programs in youth athletes, there is a gap between short-term improvements and long-term implementation strategies. Future interventions should include all 7 steps of the implementation framework to promote transparent dissemination of preventive training programs.

The effect of simulator motion cues on initial training of airline pilots

DOT National Transportation Integrated Search

2005-08-15

Two earlier studies conducted in the framework of the Federal Aviation Administration/Volpe Flight Simulator Human Factors Program examining the effect of simulator motion on recurrent training and evaluation of airline pilots have found that in the ...

Peer support to improve diabetes care: an implementation evaluation of the Australasian Peers for Progress Diabetes Program.

PubMed

Aziz, Zahra; Riddell, Michaela A; Absetz, Pilvikki; Brand, Margaret; Oldenburg, Brian

2018-02-17

Several studies have now demonstrated the benefits of peer support in promoting diabetes control. The aim of this study is to evaluate the implementation of a cluster randomised controlled trial of a group-based, peer support program to improve diabetes self-management and thereby, diabetes control in people with Type 2 Diabetes in Victoria, Australia. The intervention program was designed to address four key peer support functions i.e. 1) assistance in daily management, 2) social and emotional support, 3) regular linkage to clinical care, and 4) ongoing and sustained support to assist with the lifelong needs of diabetes self-care management. The intervention participants attended monthly group meetings facilitated by a trained peer leader for 12 months. Data was collected on the intervention's reach, participation, implementation fidelity, groups' effectiveness and participants' perceived support and satisfaction with the intervention. The RE-AIM and PIPE frameworks were used to guide this evaluation. The trial reached a high proportion (79%) of its target population through mailed invitations. Out of a total of 441 eligible individuals, 273 (61.9%) were willing to participate. The intervention fidelity was high (92.7%). The proportion of successful participants who demonstrated a reduction in 5 years cardiovascular disease risk score was 65.1 and 44.8% in the intervention and control arm respectively. Ninety-four percent (94%) of the intervention participants stated that the program helped them manage their diabetes on a day to day basis. Overall, attending monthly group meetings provided 'a lot of support' to 57% and 'moderate' support to 34% of the participants. Peer support programs are feasible, acceptable and can be used to supplement treatment for patients motivated to improve behaviours related to diabetes. However, program planners need to focus on the participation component in designing future programs. The use of two evaluation frameworks allowed a comprehensive evaluation of the trial from the provider-, participant- and public health perspective. The learnings gained from this evaluation will guide and improve future implementation by improving program feasibility for adoption and acceptability among participants, and will ultimately increase the likelihood of program effectiveness for the participants. Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12609000469213 . Registered 16 June 2009.

Improving clinician competency in communication about schizophrenia: a pilot educational program for psychiatry trainees.

PubMed

Loughland, Carmel; Kelly, Brian; Ditton-Phare, Philippa; Sandhu, Harsimrat; Vamos, Marina; Outram, Sue; Levin, Tomer

2015-04-01

Important gaps are observed in clinicians' communication with patients and families about psychiatric disorders such as schizophrenia. Communication skills can be taught, and models for education in these skills have been developed in other fields of medicine, such as oncology, providing a framework for training communication skills relevant to psychiatric practice. This study evaluated a pilot communication skills education program for psychiatry trainees, focusing on discussing schizophrenia diagnosis and prognosis. Communication skills training modules were developed based on an existing theoretical framework (ComSkil), adapted for discussing a schizophrenia diagnosis and prognosis. Pre-post training rating of self-reported confidence in a range of communication tasks was obtained, along with trainee views on the training methods. Thirty-eight participants completed the training. Significant improvements in confidence were reported post training for discussing schizophrenia prognosis, including an increased capacity to critically evaluate their own communication skills. Participants reported high levels of satisfaction with the program. This preliminary study provides support for the translation of a well-established educational model to psychiatric training addressing core clinical communication tasks and provides the foundation for the development of a more comprehensive evaluation and an extended curriculum regarding other aspects of care for patients with schizophrenia: ongoing management and recovery, dealing with conflict, and conducting a family interview.

Linking Governance to Sustainable Management Outcomes: Applying Dynamic Indicator Profiles to River Basin Organization Case Studies around the World.

NASA Astrophysics Data System (ADS)

Wei, Y.; Bouckaert, F. W.

2017-12-01

Institutional best practice for integrated river basin management advocates the river basin organisation (RBO) model as pivotal to achieve sustainable management outcomes and stakeholder engagement. The model has been widely practiced in transboundary settings and is increasingly adopted at national scales, though its effectiveness remains poorly studied. A meta-analysis of four river basins has been conducted to assess governance models and linking it to evaluation of biophysical management outcomes. The analysis is based on a Theory of Change framework, and includes functional dynamic governance indicator profiles, coupled to sustainable ecosystem management outcome profiles. The governance and outcome profiles, informed by context specific indicators, demand that targets for setting objectives are required in multiple dimensions, and trajectory outlines are a useful tool to track progress along the journey mapped out by the Theory of Change framework. Priorities, trade-offs and objectives vary in each basin, but the diagnostics tool allows comparison between basins in their capacity to reach targets through successive evaluations. The distance between capacity and target scores determines how program planning should be prioritized and resources allocated for implementation; this is a dynamic process requiring regular evaluations and adaptive management. The findings of this study provide a conceptual framework for combining dimensions of integrated water management principles that bridge tensions between (i) stakeholder engagement and participatory management (bottom-up approach) using localized knowledge and (ii) decision-making, control-and-command, system-scale, accountable and equitable management (top-down approach).The notion of adaptive management is broadened to include whole-of-program learnings, rather than single hypothesis based learning adjustments. This triple loop learning combines exploitative methods refinement with explorative evaluation of underlying paradigms. The significance of these findings suggests that in order to achieve effective management outcomes, a framework is required that combines governance performance with evaluations of bio-physical outcomes.

FIA BioSum: a tool to evaluate financial costs, opportunities and effectiveness of fuel treatments.

Treesearch

Jeremy Fried; Glenn Christensen

2004-01-01

FIA BioSum, a tool developed by the USDA Forest Services Forest Inventory and Analysis (FIA) Program, generates reliable cost estimates, identifies opportunities and evaluates the effectiveness of fuel treatments in forested landscapes. BioSum is an analytic framework that integrates a suite of widely used computer models with a foundation of attribute-rich,...

Multilevel Analysis of Multiple-Baseline Data Evaluating Precision Teaching as an Intervention for Improving Fluency in Foundational Reading Skills for at Risk Readers

ERIC Educational Resources Information Center

Brosnan, Julie; Moeyaert, Mariola; Brooks Newsome, Kendra; Healy, Olive; Heyvaert, Mieke; Onghena, Patrick; Van den Noortgate, Wim

2018-01-01

In this article, multiple-baseline across participants designs were used to evaluate the impact of a precision teaching (PT) program, within a Tier 2 Response to Intervention framework, targeting fluency in foundational reading skills with at risk kindergarten readers. Thirteen multiple-baseline design experiments that included participation from…

Comparison of Expert-Based and Empirical Evaluation Methodologies in the Case of a CBL Environment: The ''Orestis'' Experience

ERIC Educational Resources Information Center

Karoulis, Athanasis; Demetriadis, Stavros; Pombortsis, Andreas

2006-01-01

This paper compares several interface evaluation methods applied in the case of a computer based learning (CBL) environment, during a longitudinal study performed in three European countries, Greece, Germany, and Holland, and within the framework of an EC funded Leonardo da Vinci program. The paper firstly considers the particularities of the CBL…

A qualitative assessment of program characteristics for preventing secondary conditions in individuals with fetal alcohol spectrum disorders.

PubMed

Patrenko, Christie L M; Tahir, Naira; Mahoney, Erin C; Chin, Nancy P

2014-01-01

Fetal alcohol spectrum disorders (FASD) are a major public health problem that affects 2 to 5 percent of the population. Individuals with FASD are at high risk for secondary conditions, such as mental health problems, school disruptions, and trouble with the law. Evidence-based intervention programs are needed to prevent and treat secondary conditions in this population. The purpose of this study was to identify intervention program characteristics for preventing secondary conditions in individuals with FASD from the perspectives of parents and service providers. This qualitative study utilized a phenomenological approach to identify program characteristics for preventing secondary conditions. Twenty-five parents of children (ages 3 to 33) with FASD and 18 service providers participated in focus groups or individual interviews. Data was systematically analyzed using a framework approach. Themes did not differ by participant type. Participants emphasized five primary characteristics of intervention programs for individuals with FASD. Programs need to 1) be available to individuals across the lifespan, 2) have a prevention focus, 3) be individualized, 4) be comprehensive, and 5) be coordinated across systems and developmental stages. Participants discussed a variety of specific intervention strategies for each developmental stage and setting. Program characteristics identified in this study are consistent with a positive behavior support framework. This framework is discussed in the context of research on existing interventions for individuals with FASD, and recommendations for future intervention development and evaluation are highlighted.

Teaching Assistant Professional Development in Biology: Designed for and Driven by Multidimensional Data.

PubMed

Wyse, Sara A; Long, Tammy M; Ebert-May, Diane

2014-01-01

Graduate teaching assistants (TAs) are increasingly responsible for instruction in undergraduate science, technology, engineering, and mathematics (STEM) courses. Various professional development (PD) programs have been developed and implemented to prepare TAs for this role, but data about effectiveness are lacking and are derived almost exclusively from self-reported surveys. In this study, we describe the design of a reformed PD (RPD) model and apply Kirkpatrick's Evaluation Framework to evaluate multiple outcomes of TA PD before, during, and after implementing RPD. This framework allows evaluation that includes both direct measures and self-reported data. In RPD, TAs created and aligned learning objectives and assessments and incorporated more learner-centered instructional practices in their teaching. However, these data are inconsistent with TAs' self-reported perceptions about RPD and suggest that single measures are insufficient to evaluate TA PD programs. © 2014 Wyse et al. CBE—Life Sciences Education © 2014 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Exploring conceptual and theoretical frameworks for nurse practitioner education: a scoping review protocol.

PubMed

Wilson, Rosemary; Godfrey, Christina M; Sears, Kim; Medves, Jennifer; Ross-White, Amanda; Lambert, Natalie

2015-10-01

The objective of this review is to examine conceptual and/or theoretical frameworks that are relevant to nurse practitioner education.The specific review question is: What conceptual and/or theoretical frameworks are available that are relevant to the structuring of nurse practitioner education? The use of conceptual and theoretical frameworks to organize the educational curriculum of nursing programs is essential to protect and preserve the focus and clarity of nursing's distinct contribution to health care. Conceptual frameworks of nursing provide a means to look at nursing in relationship to external factors, thereby assigning meaning to the practice. Graduate level nursing education in the preparation of Nurse Practitioners (NPs) specifically and Advanced Practice Nurses (APNs) in general, is significantly compromised by the tendency to conceptualize the learning in these complex programs as being primarily related to skills-based tasks and competencies alone. According to Baumann, advanced nursing education must focus on the uniqueness of the NP position, in contrast to other health care professions. To do this, Baumann suggests using a conceptual nursing model and nursing theory as opposed to a strictly biomedical model. This allows NPs to interpret information in a way that differs from the strict biomedical model, providing opportunities for the NPs to be truly present in the lives of their patients.Canadian Nurse Practitioner (NP) practice competency documents are based primarily on the Canadian Nurses Association (CNA) Nurse Practitioner (NP) Core Competency Framework. This document defines the core set of entry-level competencies required for all NPs to practice in all Canadian jurisdictions, settings and client populations. The Core Competencies in the CNA NP Framework are organized within four main categories: professional role, responsibility and accountability; health assessment and diagnosis; therapeutic management; and health promotion and prevention of illness and injury. Although vital to the organization of provincial entry-level registration standards, this framework provides little direction to educational providers for curricula organization and philosophical perspectives.The Canadian Association of Schools of Nursing developed a national framework for NP education following a multi-phase consultation and literature and curriculum synthesis project. While the task force addressed the guiding principles and essential components of NP education along with contextual factors that impact on the delivery of curricula in Canadian jurisdictions, the philosophical approaches guiding and organizing the education were not addressed.A similar set of documents has been created in the United States by the National Organization of Nurse Practitioner Faculties (NONPF). These documents are organized by six population level foci (including the specialty of family/individual across the lifespan) and outline core competencies for entry to practice and registration and educational standards. The Core Competency documents provided by the NONPF are presented in the same manner as the CNA NP Framework and likewise, do not provide a guiding or organizing framework or philosophy for NP education.A full curriculum overhaul based on the NONPF competency requirements was performed at a university center in Oregon. The new curriculum was based on competencies that students must acquire, rather than learning objectives. While the NONPF Framework does provide an extensive list of entry-level requirements for NPs, the challenges faced by the institution as it aimed to incorporate the framework into the curriculum clearly provide evidence that these overarching frameworks need to include both a philosophical and organizational component to help guide educators.Conceptual frameworks are useful for establishing a congruent relationship between program curricula, objectives and content. Walker and Avant advance the utility of conceptual frameworks as providing the logic behind the interrelationships of terms and variables, and improving explanation and understanding. Gold, Haas & King assert that conceptual frameworks facilitate grounding of a nursing lens in the curricula of advanced practice nursing programs. It has been noted that newly practicing NPs have demonstrated an allegiance withmedical model thinking, second only in importance to wellness/health promotion considerations. Blasdell and colleagues surveyed 188 practicing NPs to investigate the relationship between education and the use of theory in clinical practice. Educated graduate NPs rated the importance of nursing theory to the NP practice role significantly higher than did diploma and baccalaureate degree NPs (4.05±2.06 versus 2.65±1.69, p<.001) but both groups rated the nursing models as less important for practice than a medical model approach.Huckabay highlighted the need for the use of a harmonized nursing model at the undergraduate level to ensure that students have a thorough understanding of what nursing is and what nursing care entails. At the graduate level, Huckabay suggested the use of multiple nursing models, depending on specialty. Regardless of the educational level, a conceptual framework used for education must enable nurse educators to have sufficient guidelines to construct a curriculum and determine what knowledge and skills are needed by the nursing students. Further, Furlong identified the need for Advanced Practice Nursing (APN) curriculae to be innovative and critically reflective, preparing students to be readily adaptable to challenges in the work place. Furlong suggests that to do this, the curriculum must rely upon an interdisciplinary framework to deliver content. Gold, Haas & King suggest that core curricula based on a medical model or a skill-related task list do not reflect the critical thinking of nurses, nor the uniqueness of the profession. Thus, conceptual models used for curricula development must: encompass the distinct nursing worldview, promote learning, and be efficient and comprehensive.Frameworks have been proposed and tested to guide the development and implementation of inter-professional education (IPE) and collaborative practice curricula for NP and medical students. A qualitative assessment of a framework guided IPE module illustrated the benefit of improving the focus on role awareness in participating students. However, this particular curriculum was limited to a two-week period and not presented as a pervasive approach to the educational programs of each discipline.In education, an overarching philosophy can provide a road map for goal identification, teaching material development and the formulation of evaluation methods. For instance, when creating a curriculum that was a result of the collaboration of three different post-secondary institutions, the SHARE (students, humor, administrative support, resources, and educational technology) model was used. This model brings together resources, students and faculty, surrounding them with humor, which was viewed as a fundamental part of the process while the program was still in its early stages. According to the authors, the program has been widely successful and the reliance on humor as an underlying philosophy has enabled the students and faculty to deal with problems arising in the new program.Focusing on evaluation, Kapborg & Fischbein promoted the use of the Education Interaction Model. The model identifies how educational influences can interact with abilities of students and how the consequences of this interaction can be evaluated by observing changes in both students and programs. The authors argue that, while the educational interaction model is effective, it is not the only model that can be used to carry out evaluations. The authors stress that the model chosen to perform an evaluation should be based upon what or who is going to be evaluated.The standards outlined in the CNA NP framework are an essential part of organizing the education process for NPs and ensuring that NPs have acquired the necessary skills to practice in Canada as an NP. However, the framework is lacking philosophy and organization regarding NP education programs to ensure that the curriculum is preparing the NPs for the ever-changing work environment.An Australian survey of NP education documents from relevant universities as well as interviews with NPs and academic conveners from Australia and New Zealand found that, while NP educational programs need to have strong clinical and science based learning components, student directed and flexible learning models act to ensure the capability of NPs as they strive to adapt to practice situations. Capability, as an approach to the learning process, includes the flexibility to respond to the specific, self-identified learning needs of students. Knowing how to learn, having high self-efficacy, applying competencies to new tasks, collaborating with others, and being creative are all signs of a capable practitioner. Gardner et al. emphasized the need for a program that fosters both competent and capable NPs. In a follow-up study, using the same data, Gardner et al. confirmed that NPs viewed the attributes of a capable NP as imperative to practice. Thus, a framework for NP education must include both competency building elements, such as those currently found in the CNA NP framework and capability building elements which can be fostered through self-directed learning.Similarly, Schaefer investigated the role of caring in nursing practice through a class for APN students in which the students reflected on their narratives of caring for patients. This qualitative study revealed that when APN students provide care by meeting the complex needs of suffering patients, the art and science of nursing combine. (ABSTRACT TRUNCATED)

Promoting physical activity among youth through community-based prevention marketing.

PubMed

Bryant, Carol A; Courtney, Anita H; McDermott, Robert J; Alfonso, Moya L; Baldwin, Julie A; Nickelson, Jen; McCormack Brown, Kelli R; Debate, Rita D; Phillips, Leah M; Thompson, Zachary; Zhu, Yiliang

2010-05-01

Community-based prevention marketing (CBPM) is a program planning framework that blends community-organizing principles with a social marketing mind-set to design, implement, and evaluate public health interventions. A community coalition used CBPM to create a physical activity promotion program for tweens (youth 9-13 years of age) called VERB Summer Scorecard. Based on the national VERB media campaign, the program offered opportunities for tweens to try new types of physical activity during the summer months. The VERB Summer Scorecard was implemented and monitored between 2004 and 2007 using the 9-step CBPM framework. Program performance was assessed through in-depth interviews and a school-based survey of youth. The CBPM process and principles used by school and community personnel to promote physical activity among tweens are presented. Observed declines may become less steep if school officials adopt a marketing mind-set to encourage youth physical activity: deemphasizing health benefits but promoting activity as something fun that fosters spending time with friends while trying and mastering new skills. Community-based programs can augment and provide continuity to school-based prevention programs to increase physical activity among tweens.

The value of program science to optimize knowledge brokering on infectious diseases for public health.

PubMed

Becker, Marissa; Haworth-Brockman, Margaret; Keynan, Yoav

2018-05-02

Knowledge translation (KT) and related terms have variously been defined as process and as products. In this paper we contribute to debates on effective KT, specifically knowledge brokering, by describing an adaptation of Program Science that aligns with the real-world of public health activities. We describe an adaptation of the Program Science framework to our knowledge translation and brokering planning and projects at the National Collaborating Centre for Infectious Diseases. The systematic approach allows for layering of knowledge year to year and translating knowledge from one infectious disease content area to another. Using a recent forum on syphilis outbreaks as an example, we also demonstrate the value of using Program Science to shape the design and delivery of the knowledge brokering event. The use of scientific knowledge to improve public health program design, implementation and evaluation forms the basis for the program science framework. Providing the right public health information to the right audience at the right time can foster long-term outcomes of networks and new partnerships which can potentially improve delivery of public health services.

Increasing Mathematics and Science Achievement for Culturally Diverse Students through Teaching Training

NASA Technical Reports Server (NTRS)

Mahon, Lee

1997-01-01

The purpose of this proposal was to field test and evaluate a Teacher Training program that would prepare teachers to increase the motivation and achievement of culturally diverse students in the areas of science and mathematics. Designed as a three year program, this report covers the first two years of the training program at the Ronald McNair School in the Ravenswood School district, using the resources of the NASA Ames Research Center and the California Framework for Mathematics and Science.

Effects of a Meditation Program on Nurses' Power and Quality of Life.

PubMed

Chang, Sun Ju; Kwak, Eun Young; Hahm, Bong-Jin; Seo, Se Hee; Lee, Da Woon; Jang, Sun Joo

2016-07-01

This study evaluated the effects of meditation programs on nurses' power and quality of life. In this study, Barrett's power theory derived from Rogers' unitary human being science was used as a theoretical framework. A randomized controlled design with 50 recruited and randomly allocated participants was used. The results demonstrated that the eight-week meditation program significantly improved nurses' power and quality of life. These results suggest that meditation has positive effects on power and quality of life. © The Author(s) 2016.

Creating a Novel Online Digital Badge-Awarding Program in Patient Navigation to Address Healthcare Access.

PubMed

Rohan, Annie J; Fullerton, Judith; Escallier, Lori A; Pati, Susmita

A novel, sustainable digital badge-awarding online course was developed to prepare learners with familiarity of patient navigation. Learners offered favorable endorsement of essentially all elements of the program, especially the utility of the Blackboard learning management software program. Quality Matters standards provided a rigorous framework for the challenges of designing, implementing, and evaluating online curricula. Online education is an effective method for meeting the professional development needs of those seeking careers in care coordination/patient navigation.

The effect of using different competence frameworks to audit the content of a masters program in public health.

PubMed

Harrison, Roger A; Gemmell, Isla; Reed, Katie

2015-01-01

(1) To quantify the effect of using different public health competence frameworks to audit the curriculum of an online distance learning MPH program, and (2) to measure variation in the outcomes of the audit depending on which competence framework is used. Retrospective audit. We compared the teaching content of an online distance learning MPH program against each competence listed in different public health competence frameworks relevant to an MPH. We then compared the number of competences covered in each module in the program's teaching curriculum and in the program overall, for each of the competence frameworks used in this audit. A comprehensive search of the literature identified two competence frameworks specific to MPH programs and two for public health professional/specialty training. The number of individual competences in each framework were 32 for the taught aspects of the UK Faculty of Public Health Specialist Training Program, 117 for the American Association of Public Health, 282 for the exam curriculum of the UK Faculty of Public Health Part A exam, and 393 for the European Core Competencies for MPH Education. This gave a total of 824 competences included in the audit. Overall, the online MPH program covered 88-96% of the competences depending on the specific framework used. This fell when the audit focused on just the three mandatory modules in the program, and the variation between the different competence frameworks was much larger. Using different competence frameworks to audit the curriculum of an MPH program can give different indications of its quality, especially as it fails to capture teaching considered to be relevant, yet not included in an existing competence framework. The strengths and weaknesses of using competence frameworks to audit the content of an MPH program have largely been ignored. These debates are vital given that external organizations responsible for accreditation specify a particular competence framework to be used. Our study found that each of four different competence frameworks suggested different levels of quality in our teaching program, at least in terms of the competences included in the curriculum. Relying on just one established framework missed some aspects of the curriculum included in other frameworks used in this study. Conversely, each framework included items not covered by the others. Thus, levels of agreement with the content of our MPH and established areas of competence were, in part, dependent on the competence framework used to compare its' content. While not entirely a surprising finding, this study makes an important point and makes explicit the challenges of selecting an appropriate competence framework to inform MPH programs, and especially one which recruits students from around the world.

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

A framework for improving the cost-effectiveness of DSM program evaluations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sonnenblick, R.; Eto, J.

The prudence of utility demand-side management (DSM) investments hinges on their performance, yet evaluating performance is complicated because the energy saved by DSM programs can never be observed directly but only inferred. This study frames and begins to answer the following questions: (1) how well do current evaluation methods perform in improving confidence in the measurement of energy savings produced by DSM programs; (2) in view of this performance, how can limited evaluation resources be best allocated to maximize the value of the information they provide? The authors review three major classes of methods for estimating annual energy savings: trackingmore » database (sometimes called engineering estimates), end-use metering, and billing analysis and examine them in light of the uncertainties in current estimates of DSM program measure lifetimes. The authors assess the accuracy and precision of each method and construct trade-off curves to examine the costs of increases in accuracy or precision. Several approaches for improving evaluations for the purpose of assessing program cost effectiveness are demonstrated. The methods can be easily generalized to other evaluation objectives, such as shared savings incentive payments.« less

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Democratic Learning in U.S. Career Education

ERIC Educational Resources Information Center

Benjamin, Amanda; Hyslop-Margison, Emery; Taylor, Josh

2010-01-01

This paper analyzes various U.S. career education programs through a democratic learning framework that adopts three foundational principles: 1) Democratic career education respects student rationality by encouraging student critique and evaluation of course material; 2) Democratic career education includes alternative perspectives on vocationally…

The Environment of the Child.

ERIC Educational Resources Information Center

Nunes, Terezinha

1994-01-01

Offers a framework for the analysis and evaluation of actions taken on behalf of children upon their environment. Examines defining suitable child development outcomes for intervention programs. Discusses poverty and prejudice, two examples of environmental conditions that threaten children's development. Summarizes the characteristics of a…

Lakatos Revisited.

ERIC Educational Resources Information Center

Court, Deborah

1999-01-01

Revisits and reviews Imre Lakatos' ideas on "Falsification and the Methodology of Scientific Research Programmes." Suggests that Lakatos' framework offers an insightful way of looking at the relationship between theory and research that is relevant not only for evaluating research programs in theoretical physics, but in the social…

Long Island Transportation Plan to Manage Congestion: Framework for Developing and Evaluating Improvement Strategies

DOT National Transportation Integrated Search

2002-04-20

The Long Island Transportation Plan to Manage Congestion (LITP 2000) will establish an integrated, multi-modal transportation program of cost-effective strategies to manage congestion and improve the movement of people and goods in Nassau and Suffolk...

Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting.

PubMed

Smith, Katherine; Firth, Kimberly; Smeeding, Sandra; Wolever, Ruth; Kaufman, Joanna; Delgado, Roxana; Bellanti, Dawn; Xenakis, Lea

2016-01-01

Research suggests that the development of mind-body skills can improve individual and family resilience, particularly related to the stresses of illness, trauma, and caregiving. To operationalize the research evidence that mind-body skills help with health and recovery, Samueli Institute, in partnership with experts in mind-body programming, created a set of guidelines for developing and evaluating mind-body programs for service members, veterans, and their families. The Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting outline key strategies and issues to consider when developing, implementing, and evaluating a mind-body focused family empowerment approach in a military healthcare setting. Although these guidelines were developed specifically for a military setting, most of the same principles can be applied to the development of programs in the civilian setting as well. The guidelines particularly address issues unique to mind-body programs, such as choosing evidence-based modalities, licensure and credentialing, safety and contraindications, and choosing evaluation measures that capture the holistic nature of these types of programs. The guidelines are practical, practice-based guidelines, developed by experts in the fields of program development and evaluation, mind-body therapies, patient- and family-centered care, as well as, experts in military and veteran's health systems. They provide a flexible framework to create mind-body family empowerment programs and describe important issues that program developers and evaluators are encouraged to address to ensure the development of the most impactful, successful, evidence-supported programs possible. Copyright © 2016 Elsevier Inc. All rights reserved.

Milestones: Critical Elements in Clinical Informatics Fellowship Programs

PubMed Central

Lehmann, Christoph U.; Munger, Benson

2016-01-01

Summary Background Milestones refer to points along a continuum of a competency from novice to expert. Resident and fellow assessment and program evaluation processes adopted by the ACGME include the mandate that programs report the educational progress of residents and fellows twice annually utilizing Milestones developed by a specialty specific ACGME working group of experts. Milestones in clinical training programs are largely unmapped to specific assessment tools. Residents and fellows are mainly assessed using locally derived assessment instruments. These assessments are then reviewed by the Clinical Competency Committee which assigns and reports trainee ratings using the specialty specific reporting Milestones. Methods and Results The challenge and opportunity facing the nascent specialty of Clinical Informatics is how to optimally utilize this framework across a growing number of accredited fellowships. The authors review how a mapped milestone framework, in which each required sub-competency is mapped to a single milestone assessment grid, can enable the use of milestones for multiple uses including individualized learning plans, fellow assessments, and program evaluation. Furthermore, such a mapped strategy will foster the ability to compare fellow progress within and between Clinical Informatics Fellowships in a structured and reliable fashion. Clinical Informatics currently has far less variability across programs and thus could easily utilize a more tightly defined set of milestones with a clear mapping to sub-competencies. This approach would enable greater standardization of assessment instruments and processes across programs while allowing for variability in how those sub-competencies are taught. Conclusions A mapped strategy for Milestones offers significant advantages for Clinical Informatics programs. PMID:27081414

Evaluation of Hospital-Based Palliative Care Programs.

PubMed

Hall, Karen Lynn; Rafalson, Lisa; Mariano, Kathleen; Michalek, Arthur

2016-02-01

This study evaluated current hospital-based palliative care programs using recommendations from the Center to Advance Palliative Care (CAPC) as a framework. Seven hospitals located in Buffalo, New York were included based on the existence of a hospital-based palliative care program. Data was collected from August through October of 2013 by means of key informant interviews with nine staff members from these hospitals using a guide comprised of questions based on CAPC's recommendations. A gap analysis was conducted to analyze the current state of each hospital's program based upon CAPC's definition of a quality palliative care program. The findings identify challenges facing both existing/evolving palliative care programs, and establish a foundation for strategies to attain best practices not yet implemented. This study affirms the growing availability of palliative care services among these selected hospitals along with opportunities to improve the scope of services in line with national recommendations. © The Author(s) 2014.

Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

PubMed

Wand, Timothy; White, Kathryn; Patching, Joanna

2011-06-01

Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

Implementation evaluation of the Telephone Lifestyle Coaching (TLC) program: organizational factors associated with successful implementation.

PubMed

Damschroder, Laura J; Reardon, Caitlin M; Sperber, Nina; Robinson, Claire H; Fickel, Jacqueline J; Oddone, Eugene Z

2017-06-01

The Telephone Lifestyle Coaching (TLC) program provided telephone-based coaching for six lifestyle behaviors to 5321 Veterans at 24 Veterans Health Administration (VHA) medical facilities. The purpose of the study was to conduct an evaluation of the TLC program to identify factors associated with successful implementation. A mixed-methods study design was used. Quantitative measures of organizational readiness for implementation and facility complexity were used to purposively select a subset of facilities for in-depth evaluation. Context assessments were conducted using interview transcripts. The Consolidated Framework for Implementation Research (CFIR) was used to guide qualitative data collection and analysis. Factors most strongly correlated with referral rates included having a skilled implementation leader who used effective multi-component strategies to engage primary care clinicians as well as general clinic structures that supported implementation. Evaluation findings pointed to recommendations for local and national leaders to help anticipate and mitigate potential barriers to successful implementation.

Development of a recovery education program for inpatient mental health providers.

PubMed

Chen, Shu-Ping; Krupa, Terry; Lysaght, Rosemary; McCay, Elizabeth; Piat, Myra

2014-12-01

Mental health system transformation toward a recovery-orientation has created a demand for education to equip providers with recovery competencies. This report describes the development of a recovery education program designed specifically for inpatient providers. Part 1 of the education is a self-learning program introducing recovery concepts and a recovery competency framework; Part 2 is a group-learning program focusing on real-life dilemmas and applying the Appreciative Inquiry approach to address these clinical dilemmas. A pilot study with a pretest/posttest design was used to evaluate the program. Participants included 26 inpatient multidisciplinary providers from 3 hospitals. The results showed participants' improvement on recovery knowledge (z = -2.55, p = .011) after the self-learning program. Evaluations of the group-learning program were high (4.21 out of 5). These results support continued efforts to refine the program. Inpatient providers could use this program to lead interprofessional practice in promoting recovery. (c) 2014 APA, all rights reserved.

Development and Initial Evaluation of the Web-Based Self-Management Program "Partner in Balance" for Family Caregivers of People With Early Stage Dementia: An Exploratory Mixed-Methods Study.

PubMed

Boots, Lizzy Mm; de Vugt, Marjolein E; Withagen, Hanneke Ej; Kempen, Gertrudis Ijm; Verhey, Frans Rj

2016-03-01

People with dementia increasingly depend on informal caregivers. Internet-based self-management interventions hold considerable promise for meeting the educational and support needs of early stage dementia caregivers (EDCs) at a reduced cost. This study aimed to (1) develop an online self-management program for EDC to increase self-efficacy and goal attainment, and (2) evaluate the program's feasibility and report preliminary data on effectiveness. Based on the Medical Research Council (MRC) framework for the development and evaluation of complex interventions, a stepwise approach was adopted to explore potential user needs and develop and validate the content by means of (1) focus group discussions with dementia caregivers (N=28), (2) interviews with dementia care professionals (N=11), and (3) individual think-aloud usability tests with EDC (N=2) and experts (N=2). A pilot evaluation was conducted with EDC (N=17) to test the feasibility and establish preliminary effects. Self-report measures of feasibility were completed after the completion of intervention. Self-efficacy and goal attainment were evaluated before and after the intervention. The different steps provided useful information about the needs of potential users regarding the content and delivery of the program. This resulted in the newly developed "Partner in Balance" program. At the start, system failures resulted in a high noncompleter rate (7/17, 41%), but at the end, an acceptable feasibility score of 209 (range 54-234) was found. The convenience of completing the program at home, the tailored content, and the guidance (face-to-face and online) were appraised positively. Preliminary effects on caregiver self-efficacy (P<.05) and goal attainment (T>50) were promising. Adaptations were made to the program to limit the amount of system failures and prevent high noncompleter rates. As recommended by the MRC framework, confirming the feasibility and preliminary effectiveness is a valuable step toward examining the effectiveness of this newly developed intervention. Dutch Trial Register (NTR): NTR4217; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4217 (Archived by WebCite at http://www.webcitation.org/6f6B8lvRP).

Building capacity for knowledge translation in occupational therapy: learning through participatory action research.

PubMed

Bennett, Sally; Whitehead, Mary; Eames, Sally; Fleming, Jennifer; Low, Shanling; Caldwell, Elizabeth

2016-10-01

There has been widespread acknowledgement of the need to build capacity in knowledge translation however much of the existing work focuses on building capacity amongst researchers rather than with clinicians directly. This paper's aim is to describe a research project for developing a knowledge translation capacity building program for occupational therapy clinicians. Participatory action research methods were used to both develop and evaluate the knowledge translation capacity-building program. Participants were occupational therapists from a large metropolitan hospital in Australia. Researchers and clinicians worked together to use the action cycle of the Knowledge to Action Framework to increase use of knowledge translation itself within the department in general, within their clinical teams, and to facilitate knowledge translation becoming part of the department's culture. Barriers and enablers to using knowledge translation were identified through a survey based on the Theoretical Domains Framework and through focus groups. Multiple interventions were used to develop a knowledge translation capacity-building program. Fifty-two occupational therapists participated initially, but only 20 across the first 18 months of the project. Barriers and enablers were identified across all domains of the Theoretical Domains Framework. Interventions selected to address these barriers or facilitate enablers were categorised into ten different categories: educational outreach; teams working on clinical knowledge translation case studies; identifying time blocks for knowledge translation; mentoring; leadership strategies; communication strategies; documentation and resources to support knowledge translation; funding a knowledge translation champion one day per week; setting goals for knowledge translation; and knowledge translation reporting strategies. Use of these strategies was, and continues to be monitored. Participants continue to be actively involved in learning and shaping the knowledge translation program across the department and within their specific clinical areas. To build capacity for knowledge translation, it is important to involve clinicians. The action cycle of the Knowledge to Action framework is a useful guide to introduce the knowledge translation process to clinicians. It may be used to engage the department as a whole, and facilitate the learning and application of knowledge translation within specific clinical areas. Research evaluating this knowledge translation program is being conducted.

Nurse confidence in gynaecological oncology practice and the evaluation of a professional development module.

PubMed

Philp, Shannon; Barnett, Catherine; D'Abrew, Natalie; White, Kate

2017-04-01

A tertiary-based education program on gynaecological oncology was attended by 62 registered nurses (RN). The program aimed to update nurses' knowledge, improve skills and ability to manage common situations and to assess program efficacy. Evaluation framework with specifically designed pre-post questionnaire about program content and nurse confidence. RN interested in gynaecological oncology were invited to attend. Nurses rated their confidence about gynaecological oncology skills one week prior to the program, immediately post-course, 3 months post and 12 months post. Speaker presentations were evaluated immediately post-course. Participants indicated improved confidence immediately after participating in the course (z = -6.515, p < .001); whilst confidence subsequently declined and stabilised up to 12 months post-course, it still remained significantly higher than before the course: 3 months post- (z = -5.284, p < .001) and 12 months post- (z = -4.155, p < .001). Results support the value of continuing professional education for improving nurse confidence in the gynaecological oncology setting.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Evaluating Payments for Environmental Services: Methodological Challenges

PubMed Central

2016-01-01

Over the last fifteen years, Payments for Environmental Services (PES) schemes have become very popular environmental policy instruments, but the academic literature has begun to question their additionality. The literature attempts to estimate the causal effect of these programs by applying impact evaluation (IE) techniques. However, PES programs are complex instruments and IE methods cannot be directly applied without adjustments. Based on a systematic review of the literature, this article proposes a framework for the methodological process of designing an IE for PES schemes. It revises and discusses the methodological choices at each step of the process and proposes guidelines for practitioners. PMID:26910850

The Certification Bandwagon: Know Where You're Headed before Jumping On.

ERIC Educational Resources Information Center

Barksdale, Susan B.; Lund, Teri B.

1998-01-01

Presents results of research focusing on identifying "certification best practices" to provide a framework for business managers and certification practitioners. Describes a 10-step process for evaluating certification programs that takes into consideration four perspectives: audience, learning, business, and financial. (AEF)

Creating a Culture of Continuous Assessment to Improve Student Learning through Curriculum Review

ERIC Educational Resources Information Center

Kalu, Frances; Dyjur, Patti

2018-01-01

This chapter describes a curriculum review framework that fosters continuous assessment through collaboration with multiple stakeholders, alignment with program level learning outcomes, evaluation based on multiple sources of evidence, and facilitated development of action plans to improve student learning.

ECONOMICS OF SAMPLE COMPOSITING AS A SCREENING TOOL IN GROUND WATER QUALITY MONITORING

EPA Science Inventory

Recent advances in high throughput/automated compositing with robotics/field-screening methods offer seldom-tapped opportunities for achieving cost-reduction in ground water quality monitoring programs. n economic framework is presented in this paper for the evaluation of sample ...

Curriculum Development through YTS Modular Credit Accumulation.

ERIC Educational Resources Information Center

Further Education Unit, London (England).

This document reports the evaluation of the collaborately developed Modular Training Framework (MainFrame), a British curriculum development project, built around a commitment to a competency-based, modular credit accumulation program. The collaborators were three local education authorities (LEAs), those of Bedfordshire, Haringey, and Sheffield,…

Language of Possibility: 1991 Accreditation Criteria.

ERIC Educational Resources Information Center

Siler, Bobbie; And Others

1994-01-01

Evaluation of the National League for Nursing's 1991 Criteria for Baccalaureate and Higher Degree Programs using Huebner's value frameworks (technical, scientific, political, esthetic, ethical) finds the values incorporated to some degree. The new criteria shift power in curriculum design to individual nursing units, allowing adoption of…

The Identity Crisis in Early Childhood Special Education: A Call for Professional Role Clarification.

ERIC Educational Resources Information Center

Buysse, Virginia; Wesley, Patricia W.

1993-01-01

Professional roles in early childhood special education (ECSE) are expanding beyond traditional frameworks of direct service, to include consultation services, program planning and evaluating, and marketing. Potential dangers of role conflict and role overload are noted. (Author/DB)

HIV Pre-exposure Prophylaxis Program Implementation Using Intervention Mapping.

PubMed

Flash, Charlene A; Frost, Elizabeth L T; Giordano, Thomas P; Amico, K Rivet; Cully, Jeffrey A; Markham, Christine M

2018-04-01

HIV pre-exposure prophylaxis has been proven to be an effective tool in HIV prevention. However, numerous barriers still exist in pre-exposure prophylaxis implementation. The framework of Intervention Mapping was used from August 2016 to October 2017 to describe the process of adoption, implementation, and maintenance of an HIV prevention program from 2012 through 2017 in Houston, Texas, that is nested within a county health system HIV clinic. Using the tasks outlined in the Intervention Mapping framework, potential program implementers were identified, outcomes and performance objectives established, matrices of change objectives created, and methods and practical applications formed. Results include the formation of three matrices that document program outcomes, change agents involved in the process, and the determinants needed to facilitate program adoption, implementation, and maintenance. Key features that facilitated successful program adoption and implementation were obtaining leadership buy-in, leveraging existing resources, systematic evaluation of operations, ongoing education for both clinical and nonclinical staff, and attention to emergent issues during launch. The utilization of Intervention Mapping to delineate the program planning steps can provide a model for pre-exposure prophylaxis implementation in other settings. Copyright © 2018. Published by Elsevier Inc.

Using the Context, Input, Process, and Product Evaluation Model (CIPP) as a Comprehensive Framework to Guide the Planning, Implementation, and Assessment of Service-Learning Programs

ERIC Educational Resources Information Center

Zhang, Guili; Zeller, Nancy; Griffith, Robin; Metcalf, Debbie; Williams, Jennifer; Shea, Christine; Misulis, Katherine

2011-01-01

Planning, implementing, and assessing a service-learning project can be a complex task because service-learning projects often involve multiple constituencies and aim to meet both the needs of service providers and community partners. In this article, Stufflebeam's Context, Input, Process, and Product (CIPP) evaluation model is recommended as a…

Building an Assessment Argument to Design and Use Next Generation Science Assessments in Efficacy Studies of Curriculum Interventions

ERIC Educational Resources Information Center

DeBarger, Angela Haydel; Penuel, William R.; Harris, Christopher J.; Kennedy, Cathleen A.

2016-01-01

Evaluators must employ research designs that generate compelling evidence related to the worth or value of programs, of which assessment data often play a critical role. This article focuses on assessment design in the context of evaluation. It describes the process of using the Framework for K-12 Science Education and Next Generation Science…

Business Education. Vocational Education Program Courses Standards.

ERIC Educational Resources Information Center

Florida State Dept. of Education, Tallahassee. Div. of Vocational, Adult, and Community Education.

This document contains vocational education program courses standards (curriculum frameworks and student performance standards) for business technology education programs in Florida. Each program courses standard is composed of two parts: a curriculum framework and student performance standards. The curriculum framework includes four major…

A multiple perspective modeling and simulation approach for renewable energy policy evaluation

NASA Astrophysics Data System (ADS)

Alyamani, Talal M.

Environmental issues and reliance on fossil fuel sources, including coal, oil, and natural gas, are the two most common energy issues that are currently faced by the United States (U.S.). Incorporation of renewable energy sources, a non-economical option in electricity generation compared to conventional sources that burn fossil fuels, single handedly promises a viable solution for both of these issues. Several energy policies have concordantly been suggested to reduce the financial burden of adopting renewable energy technologies and make such technologies competitive with conventional sources throughout the U.S. This study presents a modeling and analysis approach for comprehensive evaluation of renewable energy policies with respect to their benefits to various related stakeholders--customers, utilities, governmental and environmental agencies--where the debilitating impacts, advantages, and disadvantages of such policies can be assessed and quantified at the state level. In this work, a novel simulation framework is presented to help policymakers promptly assess and evaluate policies from different perspectives of its stakeholders. The proposed framework is composed of four modules: 1) a database that collates the economic, operational, and environmental data; 2) elucidation of policy, which devises the policy for the simulation model; 3) a preliminary analysis, which makes predictions for consumption, supply, and prices; and 4) a simulation model. After the validity of the proposed framework is demonstrated, a series of planned Florida and Texas renewable energy policies are implemented into the presented framework as case studies. Two solar and one energy efficiency programs are selected as part of the Florida case study. A utility rebate and federal tax credit programs are selected as part of the Texas case study. The results obtained from the simulation and conclusions drawn on the assessment of current energy policies are presented with respect to the conflicting objectives of different stakeholders.

Beacon communities' public health initiatives: a case study analysis.

PubMed

Massoudi, Barbara L; Marcial, Laura H; Haque, Saira; Bailey, Robert; Chester, Kelley; Cunningham, Shellery; Riley, Amanda; Soper, Paula

2014-01-01

The Beacon Communities for Public Health (BCPH) project was launched in 2011 to gain a better understanding of the range of activities currently being conducted in population- and public health by the Beacon Communities. The project highlighted the successes and challenges of these efforts with the aim of sharing this information broadly among the public health community. The Beacon Community Program, designed to showcase technology-enabled, community-based initiatives to improve outcomes, focused on: building and strengthening health information technology (IT) infrastructure and exchange capabilities; translating investments in health IT to measureable improvements in cost, quality, and population health; and, developing innovative approaches to performance measurement, technology, and care delivery. Four multimethod case studies were conducted based on a modified sociotechnical framework to learn more about public health initiative implementation and use in the Beacon Communities. Our methodological approach included using document review and semistructured key informant interviews. NACCHO Model Practice Program criteria were used to select the public health initiatives included in the case studies. Despite differences among the case studies, common barriers and facilitators were found to be present in all areas of the sociotechnical framework application including structure, people, technology, tasks, overarching considerations, and sustainability. Overall, there were many more facilitators (range = 7-14) present for each Beacon compared to barriers (range = 4-6). Four influential promising practices were identified through the work: forging strong and sustainable partnerships; ensuring a good task-technology fit and a flexible and iterative design; fostering technology acceptance; and, providing education and demonstrating value. A common weakness was the lack of a framework or model for the Beacon Communities evaluation work. Sharing a framework or approach to evaluation at the beginning of implementation made the work more effective. Supporting evaluation to inform future implementations is important.

Program theory-driven evaluation science in a youth development context.

PubMed

Deane, Kelsey L; Harré, Niki

2014-08-01

Program theory-driven evaluation science (PTDES) provides a useful framework for uncovering the mechanisms responsible for positive change resulting from participation in youth development (YD) programs. Yet it is difficult to find examples of PTDES that capture the complexity of such experiences. This article offers a much-needed example of PTDES applied to Project K, a youth development program with adventure, service-learning and mentoring components. Findings from eight program staff focus groups, 351 youth participants' comments, four key program documents, and results from six previous Project K research projects were integrated to produce a theory of change for the program. A direct logic analysis was then conducted to assess the plausibility of the proposed theory against relevant research literature. This demonstrated that Project K incorporates many of the best practice principles discussed in the literature that covers the three components of the program. The contributions of this theory-building process to organizational learning and development are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluating a multispecies adaptive management framework: Must uncertainty impede effective decision-making?

USGS Publications Warehouse

Smith, David R.; McGowan, Conor P.; Daily, Jonathan P.; Nichols, James D.; Sweka, John A.; Lyons, James E.

2013-01-01

Application of adaptive management to complex natural resource systems requires careful evaluation to ensure that the process leads to improved decision-making. As part of that evaluation, adaptive policies can be compared with alternative nonadaptive management scenarios. Also, the value of reducing structural (ecological) uncertainty to achieving management objectives can be quantified.A multispecies adaptive management framework was recently adopted by the Atlantic States Marine Fisheries Commission for sustainable harvest of Delaware Bay horseshoe crabs Limulus polyphemus, while maintaining adequate stopover habitat for migrating red knots Calidris canutus rufa, the focal shorebird species. The predictive model set encompassed the structural uncertainty in the relationships between horseshoe crab spawning, red knot weight gain and red knot vital rates. Stochastic dynamic programming was used to generate a state-dependent strategy for harvest decisions given that uncertainty. In this paper, we employed a management strategy evaluation approach to evaluate the performance of this adaptive management framework. Active adaptive management was used by including model weights as state variables in the optimization and reducing structural uncertainty by model weight updating.We found that the value of information for reducing structural uncertainty is expected to be low, because the uncertainty does not appear to impede effective management. Harvest policy responded to abundance levels of both species regardless of uncertainty in the specific relationship that generated those abundances. Thus, the expected horseshoe crab harvest and red knot abundance were similar when the population generating model was uncertain or known, and harvest policy was robust to structural uncertainty as specified.Synthesis and applications. The combination of management strategy evaluation with state-dependent strategies from stochastic dynamic programming was an informative approach to evaluate adaptive management performance and value of learning. Although natural resource decisions are characterized by uncertainty, not all uncertainty will cause decisions to be altered substantially, as we found in this case. It is important to incorporate uncertainty into the decision framing and evaluate the effect of reducing that uncertainty on achieving the desired outcomes

The contributions and future direction of Program Science in HIV/STI prevention.

PubMed

Becker, Marissa; Mishra, Sharmistha; Aral, Sevgi; Bhattacharjee, Parinita; Lorway, Rob; Green, Kalada; Anthony, John; Isac, Shajy; Emmanuel, Faran; Musyoki, Helgar; Lazarus, Lisa; Thompson, Laura H; Cheuk, Eve; Blanchard, James F

2018-01-01

Program Science is an iterative, multi-phase research and program framework where programs drive the scientific inquiry, and both program and science are aligned towards a collective goal of improving population health. To achieve this, Program Science involves the systematic application of theoretical and empirical knowledge to optimize the scale, quality and impact of public health programs. Program Science tools and approaches developed for strategic planning, program implementation, and program management and evaluation have been incorporated into HIV and sexually transmitted infection prevention programs in Kenya, Nigeria, India, and the United States. In this paper, we highlight key scientific contributions that emerged from the growing application of Program Science in the field of HIV and STI prevention, and conclude by proposing future directions for Program Science.

76 FR 38602 - Bovine Tuberculosis and Brucellosis; Program Framework

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-01

...] Bovine Tuberculosis and Brucellosis; Program Framework AGENCY: Animal and Plant Health Inspection Service... framework being developed for the bovine tuberculosis and brucellosis programs in the United States. This... proposed revisions to its programs regarding bovine tuberculosis (TB) and bovine brucellosis in the United...

Cost-effectiveness analysis of the diarrhea alleviation through zinc and oral rehydration therapy (DAZT) program in rural Gujarat India: an application of the net-benefit regression framework.

PubMed

Shillcutt, Samuel D; LeFevre, Amnesty E; Fischer-Walker, Christa L; Taneja, Sunita; Black, Robert E; Mazumder, Sarmila

2017-01-01

This study evaluates the cost-effectiveness of the DAZT program for scaling up treatment of acute child diarrhea in Gujarat India using a net-benefit regression framework. Costs were calculated from societal and caregivers' perspectives and effectiveness was assessed in terms of coverage of zinc and both zinc and Oral Rehydration Salt. Regression models were tested in simple linear regression, with a specified set of covariates, and with a specified set of covariates and interaction terms using linear regression with endogenous treatment effects was used as the reference case. The DAZT program was cost-effective with over 95% certainty above $5.50 and $7.50 per appropriately treated child in the unadjusted and adjusted models respectively, with specifications including interaction terms being cost-effective with 85-97% certainty. Findings from this study should be combined with other evidence when considering decisions to scale up programs such as the DAZT program to promote the use of ORS and zinc to treat child diarrhea.

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

Assumptions at the philosophical and programmatic levels in evaluation.

PubMed

Mertens, Donna M

2016-12-01

Stakeholders and evaluators hold a variety of levels of assumptions at the philosophical, methodological, and programmatic levels. The use of a transformative philosophical framework is presented as a way for evaluators to become more aware of the implications of various assumptions made by themselves and program stakeholders. The argument is examined and demonstrated that evaluators who are aware of the assumptions that underlie their evaluation choices are able to provide useful support for stakeholders in the examination of the assumptions they hold with regard to the nature of the problem being addressed, the program designed to solve the problem, and the approach to evaluation that is appropriate in that context. Such an informed approach has the potential for development of more appropriate and culturally responsive programs being implemented in ways that lead to the desired impacts, as well as to lead to evaluation approaches that support effective solutions to intransigent social problems. These arguments are illustrated through examples of evaluations from multiple sectors; additional challenges are also identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

Designing a physician leadership development program based on effective models of physician education.

PubMed

Hopkins, Joseph; Fassiotto, Magali; Ku, Manwai Candy; Mammo, Dagem; Valantine, Hannah

2017-02-02

Because of modern challenges in quality, safety, patient centeredness, and cost, health care is evolving to adopt leadership practices of highly effective organizations. Traditional physician training includes little focus on developing leadership skills, which necessitates further training to achieve the potential of collaborative management. The aim of this study was to design a leadership program using established models for continuing medical education and to assess its impact on participants' knowledge, skills, attitudes, and performance. The program, delivered over 9 months, addressed leadership topics and was designed around a framework based on how physicians learn new clinical skills, using multiple experiential learning methods, including a leadership active learning project. The program was evaluated using Kirkpatrick's assessment levels: reaction to the program, learning, changes in behavior, and results. Four cohorts are evaluated (2008-2011). Reaction: The program was rated highly by participants (mean = 4.5 of 5). Learning: Significant improvements were reported in knowledge, skills, and attitudes surrounding leadership competencies. Behavior: The majority (80%-100%) of participants reported plans to use learned leadership skills in their work. Improved team leadership behaviors were shown by increased engagement of project team members. All participants completed a team project during the program, adding value to the institution. Results support the hypothesis that learning approaches known to be effective for other types of physician education are successful when applied to leadership development training. Across all four assessment levels, the program was effective in improving leadership competencies essential to meeting the complex needs of the changing health care system. Developing in-house programs that fit the framework established for continuing medical education can increase physician leadership competencies and add value to health care institutions. Active learning projects provide opportunities to practice leadership skills addressing real word problems.

Conflict of Interest in the Evaluation and Dissemination of “Model” School-based Drug and Violence Prevention Programs

PubMed Central

Gorman, Dennis M.; Conde, Eugenia

2010-01-01

Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been that of financial relationships between investigators and research sponsors. The potential for conflicts of interest to arise in the evaluation of drug prevention programs was raised by Moskowitz in this journal in 1993, but to date there has been no attempt made to estimate the scope of this problem. The present study addressed this issue using a sample of “model” school-based drug and violence prevention interventions by first, identifying the types or relationships that exist between program developers and program distributors, and, second, by assessing how many of the evaluations of these programs published in peer-reviewed journals had been conducted by the developers of the programs compared to independent evaluation teams. The data presented indicate that there are relatively few published evaluations that do not involve program developers and that there are few instances in which there is complete separation between the program developer and program distributor. Using the open systems model of the Institute of Medicine Committee on Research Integrity as a framework, it is argued that the culture and norms of the program developer and those of the program evaluator are fundamentally distinct and therefore failure to separate these roles produces high potential for conflict of interest to arise. PMID:17945143

Disease Management, Case Management, Care Management, and Care Coordination: A Framework and a Brief Manual for Care Programs and Staff.

PubMed

Ahmed, Osman I

2016-01-01

With the changing landscape of health care delivery in the United States since the passage of the Patient Protection and Affordable Care Act in 2010, health care organizations have struggled to keep pace with the evolving paradigm, particularly as it pertains to population health management. New nomenclature emerged to describe components of the new environment, and familiar words were put to use in an entirely different context. This article proposes a working framework for activities performed in case management, disease management, care management, and care coordination. The author offers standard working definitions for some of the most frequently used words in the health care industry with the goal of increasing consistency for their use, especially in the backdrop of the Centers for Medicaid & Medicare Services offering a "chronic case management fee" to primary care providers for managing the sickest, high-cost Medicare patients. Health care organizations performing case management, care management, disease management, and care coordination. Road map for consistency among users, in reporting, comparison, and for success of care management/coordination programs. This article offers a working framework for disease managers, case and care managers, and care coordinators. It suggests standard definitions to use for disease management, case management, care management, and care coordination. Moreover, the use of clear terminology will facilitate comparing, contrasting, and evaluating all care programs and increase consistency. The article can improve understanding of care program components and success factors, estimate program value and effectiveness, heighten awareness of consumer engagement tools, recognize current state and challenges for care programs, understand the role of health information technology solutions in care programs, and use information and knowledge gained to assess and improve care programs to design the "next generation" of programs.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

Framework for Architecture Trade Study Using MBSE and Performance Simulation

NASA Technical Reports Server (NTRS)

Ryan, Jessica; Sarkani, Shahram; Mazzuchim, Thomas

2012-01-01

Increasing complexity in modern systems as well as cost and schedule constraints require a new paradigm of system engineering to fulfill stakeholder needs. Challenges facing efficient trade studies include poor tool interoperability, lack of simulation coordination (design parameters) and requirements flowdown. A recent trend toward Model Based System Engineering (MBSE) includes flexible architecture definition, program documentation, requirements traceability and system engineering reuse. As a new domain MBSE still lacks governing standards and commonly accepted frameworks. This paper proposes a framework for efficient architecture definition using MBSE in conjunction with Domain Specific simulation to evaluate trade studies. A general framework is provided followed with a specific example including a method for designing a trade study, defining candidate architectures, planning simulations to fulfill requirements and finally a weighted decision analysis to optimize system objectives.

It’s Your Game…Keep It Real: Can innovative public health prevention research thrive within a comparative effectiveness research framework?

PubMed Central

Shegog, Ross; Markham, Christine M.; Peskin, Melissa F.; Johnson, Kimberly; Cuccaro, Paula; Tortolero, Susan R.

2013-01-01

The federal comparative effectiveness research (CER) initiative is designed to evaluate best practices in health care settings where they can be disseminated for immediate benefit to patients. The CER strategic framework comprises four categories (research, human and scientific capital, data infrastructure, and dissemination) with three crosscutting themes (conditions, patient populations, and types of intervention). The challenge for the field of public health has been accommodating the CER framework within prevention research. Applying a medicine-based, research-to-practice CER approach to public health prevention research has raised concerns regarding definitions of acceptable evidence (an evidence challenge), effective intervention dissemination within heterogeneous communities (a dissemination and implementation challenge), and rewards for best practice at the cost of other promising but high-risk approaches (an innovation challenge). Herein, a dynamic operationalization of the CER framework is described that is compatible with the development, evaluation, and dissemination of innovative public health prevention interventions. An effective HIV, STI, and pregnancy prevention program, It’s Your Game…Keep It Real, provides a case study of this application, providing support that the CER framework can compatibly coexist with innovative, community-based public health prevention research. PMID:23344633

It's Your Game…Keep It Real: can innovative public health prevention research thrive within a comparative effectiveness research framework?

PubMed

Shegog, Ross; Markham, Christine M; Peskin, Melissa F; Johnson, Kimberly; Cuccaro, Paula; Tortolero, Susan R

2013-04-01

The federal comparative effectiveness research (CER) initiative is designed to evaluate best practices in health care settings where they can be disseminated for immediate benefit to patients. The CER strategic framework comprises four categories (research, human and scientific capital, data infrastructure, and dissemination) with three crosscutting themes (conditions, patient populations, and types of intervention). The challenge for the field of public health has been accommodating the CER framework within prevention research. Applying a medicine-based, research-to-practice CER approach to public health prevention research has raised concerns regarding definitions of acceptable evidence (an evidence challenge), effective intervention dissemination within heterogeneous communities (a dissemination and implementation challenge), and rewards for best practice at the cost of other promising but high-risk approaches (an innovation challenge). Herein, a dynamic operationalization of the CER framework is described that is compatible with the development, evaluation, and dissemination of innovative public health prevention interventions. An effective HIV, STI, and pregnancy prevention program, It's Your Game…Keep It Real, provides a case study of this application, providing support that the CER framework can compatibly coexist with innovative, community-based public health prevention research.

Scaling Up of Breastfeeding Promotion Programs in Low- and Middle-Income Countries: the “Breastfeeding Gear” Model12

PubMed Central

Pérez-Escamilla, Rafael; Curry, Leslie; Minhas, Dilpreet; Taylor, Lauren; Bradley, Elizabeth

2012-01-01

Breastfeeding (BF) promotion is one of the most cost-effective interventions to advance mother–child health. Evidence-based frameworks and models to promote the effective scale up and sustainability of BF programs are still lacking. A systematic review of peer-reviewed and gray literature reports was conducted to identify key barriers and facilitators for scale up of BF programs in low- and middle-income countries. The review identified BF programs located in 28 countries in Africa, Latin America and the Caribbean, and Asia. Study designs included case studies, qualitative studies, and observational quantitative studies. Only 1 randomized, controlled trial was identified. A total of 22 enabling factors and 15 barriers were mapped into a scale-up framework termed “AIDED” that was used to build the parsimonious breastfeeding gear model (BFGM). Analogous to a well-oiled engine, the BFGM indicates the need for several key “gears” to be working in synchrony and coordination. Evidence-based advocacy is needed to generate the necessary political will to enact legislation and policies to protect, promote, and support BF at the hospital and community levels. This political-policy axis in turn drives the resources needed to support workforce development, program delivery, and promotion. Research and evaluation are needed to sustain the decentralized program coordination “gear” required for goal setting and system feedback. The BFGM helps explain the different levels of performance in national BF outcomes in Mexico and Brazil. Empirical research is recommended to further test the usefulness of the AIDED framework and BFGM for global scaling up of BF programs. PMID:23153733

Audiovisual Materials.

ERIC Educational Resources Information Center

American Council on Education, Washington, DC. HEATH/Closer Look Resource Center.

The fact sheet presents a suggested evaluation framework for use in previewing audiovisual materials, a list of selected resources, and an annotated list of films which were shown at the AHSSPPE '83 Media Fair as part of the national conference of the Association on Handicapped Student Service Programs in Postsecondary Education. Evaluation…

Effectiveness of the Mississippi communities for healthy living (MCHL) nutrition intervention

USDA-ARS?s Scientific Manuscript database

The objective of our study was to determine the effectiveness of two nutrition interventions targeting women's social/civic organizations in the Lower Mississippi Delta. Diffusion of Innovation theory and the RE-AIM structured framework for program development and evaluation guided the 6-month MCHL ...

Mississippi Curriculum Framework for Horticulture Technology Cluster (Program CIP: 01.0601--Horticulture Serv. Op. & Mgmt., Gen.) (Program CIP: 01.0605--Landscaping Op. & Mgmt.). Postsecondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which is intended for use by community and junior colleges throughout Mississippi, contains curriculum frameworks for the course sequences in the horticulture technology programs cluster. Presented in the introductory section are a framework of programs and courses, description of the programs, and suggested course sequences for…

Posture and gait abilities in patients with myotonic dystrophy (Steinert disease). Evaluation on the short-term of a rehabilitation program.

PubMed

Missaoui, B; Rakotovao, E; Bendaya, S; Mane, M; Pichon, B; Faucher, M; Thoumie, P

2010-01-01

To evaluate the effects of a rehabilitation program in terms of balance, gait and muscle strength in a population of patients with myotonic dystrophy. Twenty patients benefited, as outpatients in a hospital setting, from a rehabilitation program with clinical and instrumental evaluations. The evaluation focused on quantitative balance measurement by clinical and stabilometer tests, gait assessed by Locometre and extensors and flexors knee muscle strength measured in isokinetic concentric mode at 60°/s. After the rehabilitation program, we observed a significant improvement in the patients' balance capacities measured with the Berg Balance Scale (BBS), fast gait speed and muscle strength. However, the instrumental evaluation did not report any gains for static balance and spontaneous gait speed after the training program. No correlation was found between the various improvements. A rehabilitation program focused on strength, gait and balance allowed for significant improvements in some parameters of myotonic dystrophy. These results attest to the relevance of a short-term rehabilitation protocol for these patients in the framework of a multidisciplinary therapeutic care. The disparity observed in the results measured for these patients suggest the contribution of cognitive involvement in the limitations felt by patients with myotonic dystrophy in the areas of gait and balance. Copyright 2010 Elsevier Masson SAS. All rights reserved.

Flexible Residential Smart Grid Simulation Framework

NASA Astrophysics Data System (ADS)

Xiang, Wang

Different scheduling and coordination algorithms controlling household appliances' operations can potentially lead to energy consumption reduction and/or load balancing in conjunction with different electricity pricing methods used in smart grid programs. In order to easily implement different algorithms and evaluate their efficiency against other ideas, a flexible simulation framework is desirable in both research and business fields. However, such a platform is currently lacking or underdeveloped. In this thesis, we provide a simulation framework to focus on demand side residential energy consumption coordination in response to different pricing methods. This simulation framework, equipped with an appliance consumption library using realistic values, aims to closely represent the average usage of different types of appliances. The simulation results of traditional usage yield close matching values compared to surveyed real life consumption records. Several sample coordination algorithms, pricing schemes, and communication scenarios are also implemented to illustrate the use of the simulation framework.

Asian Care Certificate (ACC): a care quality assurance framework.

PubMed

Talaie, Tony

2018-04-16

Purpose Quality assuring elderly care through a viable and feasible standard framework is a major challenge for Asian governments. Although several attempts have been made to tackle foreign care worker (FCW) shortage, assuring the quality of the care they provide has been overlooked. The original framework allowed a better control over service quality to assure the elderly about their care according to the agreed standards. The paper aims to discuss these issues. Design/methodology/approach Through several Japanese Governmental meetings, a new Asian Care Certificate (ACC) program is discussed based on the Japanese Care Certificate (JCC). The governments' representatives adopted the JCC to form the ACC, which enables the ACC board to evaluate care workers and to intervene whenever the desired quality level is not achieved. Findings The author describes a new program. The findings of this paper will be confirmed when the ACC is implemented. Practical implications Using the ACC framework, the challenge in providing a high-quality care service using FCWs across Asia would be partly resolved. FCWs' quality of life might also gradually improve especially regarding to their human rights. Originality/value The ACC provides a new framework. Its value is recognized if one considers that many Asian populations are rapidly aging and many governments compromise quality by employing overseas workers to solve care worker shortages.

Applying the RE-AIM Framework to Evaluate Integrative Medicine Group Visits Among Diverse Women with Chronic Pelvic Pain.

PubMed

Chao, Maria T; Abercrombie, Priscilla D; Santana, Trilce; Duncan, Larissa G

2015-12-01

The purpose of this study was to evaluate group medical visits using an integrative health approach for underserved women with chronic pelvic pain (CPP). We implemented an integrative medicine program to improve quality of life among women with CPP using Centering, a group-based model that combines healthcare assessment, education, and social support. Patients were from university-affiliated and public hospital-affiliated clinics. We evaluated the program with qualitative and quantitative data to address components of the RE-AIM framework: Reach, Effectiveness, Adoption, Implementation, and Maintenance. Participants of the Centering CPP Program participants (n = 26) were demographically similar to a sample of women with CPP who sought care at Bay Area hospitals (n = 701). Participants were on average 40 years of age, a majority of whom were racial/ethnic minorities with low household income (76%). Women who attended four or more sessions (n = 16) had improved health-related quality of life, including decreases in average number of unhealthy days in the past month (from 24 to 18, p < .05), depressive symptoms (from 11.7 to 9.0, p < .05), and symptom severity (from 4.2 to 3.1, p < .01). Sexual health outcomes also improved (30.5 to 50.3, p = .02). No improvements were observed for pain catastrophizing. Our pilot program provides preliminary data that an integrative health approach using a group-based model can be adapted and implemented to reach diverse women with CPP to improve physical and psychological well-being. Given these promising findings, rigorous evaluation of implementation and effectiveness of this approach compared with usual care is warranted. Copyright © 2015 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Progress towards autonomous, intelligent systems

NASA Technical Reports Server (NTRS)

Lum, Henry; Heer, Ewald

1987-01-01

An aggressive program has been initiated to develop, integrate, and implement autonomous systems technologies starting with today's expert systems and evolving to autonomous, intelligent systems by the end of the 1990s. This program includes core technology developments and demonstration projects for technology evaluation and validation. This paper discusses key operational frameworks in the content of systems autonomy applications and then identifies major technological challenges, primarily in artificial intelligence areas. Program content and progress made towards critical technologies and demonstrations that have been initiated to achieve the required future capabilities in the year 2000 era are discussed.

Formative evaluation on a physical activity health promotion program for the group home setting.

PubMed

Dixon-Ibarra, Alicia; Driver, Simon; VanVolkenburg, Haley; Humphries, Kathleen

2017-02-01

Physical inactivity and high rates of chronic conditions is a public health concern for adults with intellectual disability. Few health promotion programs target the group home setting which is the pre-dominant form of residential accommodation for persons with intellectual disability. A process evaluation of a physical activity health promotion program, Menu-Choice, was conducted with five group home sites for adults with intellectual and developmental disabilities. Menu-Choice assists group home staff in including physical activity goals within resident schedules. The physical activity program was designed based on theoretical frameworks, community-based participatory approaches, and established health promotion guidelines for adults with disabilities. Fourteen program coordinators (age M 39; 77% females), 22 staff (age M 39; 82% females), and 18 residents (age M 59; 72% females; 56% ambulatory) participated. Results from the fidelity survey and program completion highlight potential challenges with implementation. Findings will assist with the refinement of the program for continued implementation trials in the group home community. Published by Elsevier Ltd.

Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program.

PubMed

Hallinan, Christine M

2010-01-01

In this paper, program logic will be used to 'map out' the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.

Evaluating the social and economic impact of community-based prenatal care.

PubMed

Cramer, Mary E; Chen, Li-Wu; Roberts, Sara; Clute, Dorothea

2007-01-01

This article describes the evaluation and findings of a community-based prenatal care program, Omaha Healthy Start (OHS), designed to reduce local racial disparities in birth outcomes. This evaluative study used a comparative descriptive design, and Targeting Outcomes of Programs was the conceptual framework for evaluation. The evaluation followed 3 groups for 2 years: OHS birth mothers (N=79; N=157); non-OHS participant birth mothers (N=746; N=774); and Douglas County birth mothers (N=7,962; N=7,987). OHS provided case management, home visits, screening, referral, transportation, and health education to participants. Program outcome measures included low birth weight, infant mortality, adequacy of care, trimester of care, and costs of care. OHS birth outcomes improved during year 2, and there was a 31% cost saving in the average hospital expenditure compared with the nonparticipant groups. Preliminary evaluative analysis indicates that prenatal case management and community outreach can improve birth outcomes for minority women, while producing cost savings. Further prospective study is needed to document trends over a longer period of time regarding the relationship between community-based case management programs for minority populations, birth outcomes, and costs of care.

Evaluation Guidelines for the Clinical and Translational Science Awards (CTSAs)

PubMed Central

Rubio, Doris M.; Thomas, Veronica G.

2013-01-01

Abstract The National Center for Advancing Translational Sciences (NCATS), a part of the National Institutes of Health, currently funds the Clinical and Translational Science Awards (CTSAs), a national consortium of 61 medical research institutions in 30 states and the District of Columbia. The program seeks to transform the way biomedical research is conducted, speed the translation of laboratory discoveries into treatments for patients, engage communities in clinical research efforts, and train a new generation of clinical and translational researchers. An endeavor as ambitious and complex as the CTSA program requires high‐quality evaluations in order to show that the program is well implemented, efficiently managed, and demonstrably effective. In this paper, the Evaluation Key Function Committee of the CTSA Consortium presents an overall framework for evaluating the CTSA program and offers policies to guide the evaluation work. The guidelines set forth are designed to serve as a tool for education within the CTSA community by illuminating key issues and practices that should be considered during evaluation planning, implementation, and utilization. Additionally, these guidelines can provide a basis for ongoing discussions about how the principles articulated in this paper can most effectively be translated into operational reality. PMID:23919366

The pillars of well-constructed simulated patient programs: A qualitative study with experienced educators.

PubMed

Pritchard, Shane A; Blackstock, Felicity C; Keating, Jennifer L; Nestel, Debra

2017-11-01

The inclusion of simulated patients (SPs) in health professional education is growing internationally. However, there is limited evidence for best practice in SP methodology. This study investigated how experienced SP educators support SPs in providing SP-based education for health professional students. Experienced SP educators were identified via relevant professional associations, peer-reviewed publications, and peer referral. Semi-structured individual interviews were conducted via telephone. Data were analyzed independently by three researchers using principles of inductive thematic analysis. Four themes were identified that represent the key structural components of SP programs considered by educators seeking to optimize learning for health professional students in SP programs: managing SPs by operationalizing an effective program, selecting SPs by rigorously screening for suitability, preparing SPs by educating for a specific scenario, and directing SPs by leading safe and meaningful interactions. Within these components, subthemes were described, with considerable variation in approaches. Key structural components to SP programs were consistently described by experienced SP educators who operationalize them. A framework has been proposed to assist educators in designing high-quality SP programs that support SPs and learners. Future research is required to evaluate and refine this framework and other evidence-based resources for SP educators.

DEVELOPING A LANDSCAPE APPROACH TO EVALUATION OF WETLAND CONDITION IN THE SOUTHERN ROCKY MOUNTAINS: PHASE II.

EPA Science Inventory

This proposal details a project whose goal is to develop a rapid assessment tool for determining the success of compensatory wetland mitigation within a hydrogeomorphic framework. Phase I of this program, currently in progress and funded through FY 2000 RARE funds, is developing...

Adoption of Technological Innovations: A Case Study of the ASSESS Website

ERIC Educational Resources Information Center

Brooks, Sarah; Brown, Shane; Davis, Denny; LeBeau, Jennifer

2014-01-01

In engineering education, assessment instruments are often developed to evaluate programs and projects. Unfortunately, these innovations are not always adopted by intended audiences. Rogers' Diffusion of Innovations (DI) Theory provides a framework to analyze characteristics of an innovation that will affect adoption. The Appraisal System for…

Teaching Ecologically-Based Communication Skills to Persons Who Are Developmentally Delayed.

ERIC Educational Resources Information Center

Sousie, Susan P.

The paper offers a framework for the design, implementation, and evaluation of appropriate, effective communication instructional programs for persons who are severely developmentally delayed. The use of an ecological approach that incorporates the instruction of communication skills with that of activities of daily living (ADL) is emphasized.…

Evaluating Organizational Change Strategies for University Continuing Education.

ERIC Educational Resources Information Center

Votruba, James C.

The development of a conceptual framework for the design and management of planned institutional change for continuing education programs is described, based on a change project developed by Hanna and Pollicita. Conceptual approaches to planned change in complex organizations and the views of Havelock and Lindquist are considered. The importance…

The Role of New Technologies to Foster Positive Youth Development

ERIC Educational Resources Information Center

Bers, Marina Umaschi

2006-01-01

This article describes a developmental systems approach to applied developmental science (ADS), which provides a framework to design and evaluate technology-rich programs that promote positive development by emphasizing the strengths and assets of young people instead of focusing on diminishing or preventing risk-taking behaviors. Until now, most…

Metocognitive Support Accelerates Computer Assisted Learning for Novice Programmers

ERIC Educational Resources Information Center

Rum, Siti Nurulain Mohd; Ismail, Maizatul Akmar

2017-01-01

Computer programming is a part of the curriculum in computer science education, and high drop rates for this subject are a universal problem. Development of metacognitive skills, including the conceptual framework provided by socio-cognitive theories that afford reflective thinking, such as actively monitoring, evaluating, and modifying one's…

Using the RE-AIM framework to evaluate a community-based summer camp for children with obesity: a prospective feasibility study.

PubMed

Burke, Shauna M; Shapiro, Sheree; Petrella, Robert J; Irwin, Jennifer D; Jackman, Michelle; Pearson, Erin S; Prapavessis, Harry; Shoemaker, Joel Kevin

2015-01-01

Increasing rates of childhood overweight and obesity highlight a need for the evaluation of lifestyle interventions. The purpose of the study was to determine the Reach, Effectiveness, Adoption, Implementation and Maintenance of a novel family-focused program targeting children with obesity (i.e., the Children's Health and Activity Modification Program [C.H.A.M.P.]) using the RE-AIM framework, an evaluation tool for community-based health interventions. A single-centre, single cohort interventional feasibility study was conducted over the course of two years. Children with obesity and their families completed a 4-week group-based lifestyle intervention in Year 1 (n = 15; M age = 10.6; 53% female) and/or Year 2 (n = 25; M age = 10.6; 56% female). Outcome variables were measured pre- and post-intervention, as well as 6- and 12-months following completion of the formal program. Overall, C.H.A.M.P. had high reach in terms of participant representativeness. In addition, participation in the program was associated with significantly improved standardized body mass index (BMI-z), body fat percentage, lean mass percentage, and child- and parent-proxy reported quality of life (QOL; effectiveness/individual maintenance). Furthermore, a number of community partnerships were built, strengthened, and maintained prior to, during, and following implementation of the two-year program (adoption/setting maintenance, respectively). Finally, the intervention was delivered as intended as evidenced by high adherence to the schedule, attendance rates, and cost effectiveness (implementation). Based on RE-AIM metrics, C.H.A.M.P. appears to be a promising childhood obesity program. The findings reported will inform researchers and practitioners on how to design and implement future community-based programs addressing pediatric obesity. ISRCTN Registry, Study ID ISRCTN13143236. Registered 27 March 2015.

Viral Hepatitis Strategic Information to Achieve Elimination by 2030: Key Elements for HIV Program Managers

PubMed Central

Low-Beer, Daniel; Bergeri, Isabel; Hess, Sarah; Garcia-Calleja, Jesus Maria; Hayashi, Chika; Mozalevskis, Antons; Rinder Stengaard, Annemarie; Sabin, Keith; Harmanci, Hande; Bulterys, Marc

2017-01-01

Evidence documenting the global burden of disease from viral hepatitis was essential for the World Health Assembly to endorse the first Global Health Sector Strategy (GHSS) on viral hepatitis in May 2016. The GHSS on viral hepatitis proposes to eliminate viral hepatitis as a public health threat by 2030. The GHSS on viral hepatitis is in line with targets for HIV infection and tuberculosis as part of the Sustainable Development Goals. As coordination between hepatitis and HIV programs aims to optimize the use of resources, guidance is also needed to align the strategic information components of the 2 programs. The World Health Organization monitoring and evaluation framework for viral hepatitis B and C follows an approach similar to the one of HIV, including components on the following: (1) context (prevalence of infection), (2) input, (3) output and outcome, including the cascade of prevention and treatment, and (4) impact (incidence and mortality). Data systems that are needed to inform this framework include (1) surveillance for acute hepatitis, chronic infections, and sequelae and (2) program data documenting prevention and treatment, which for the latter includes a database of patients. Overall, the commonalities between HIV and hepatitis at the strategic, policy, technical, and implementation levels justify coordination, strategic linkage, or integration, depending on the type of HIV and viral hepatitis epidemics. Strategic information is a critical area of this alignment under the principle of what gets measured gets done. It is facilitated because the monitoring and evaluation frameworks for HIV and viral hepatitis were constructed using a similar approach. However, for areas where elimination of viral hepatitis requires data that cannot be collected through the HIV program, collaborations are needed with immunization, communicable disease control, tuberculosis, and hepatology centers to ensure collection of information for the remaining indicators. PMID:29246882

Transmission models and management of lymphatic filariasis elimination.

PubMed

Michael, Edwin; Gambhir, Manoj

2010-01-01

The planning and evaluation of parasitic control programmes are complicated by the many interacting population dynamic and programmatic factors that determine infection trends under different control options. A key need is quantification about the status of the parasite system state at any one given timepoint and the dynamic change brought upon that state as an intervention program proceeds. Here, we focus on the control and elimination of the vector-borne disease, lymphatic filariasis, to show how mathematical models of parasite transmission can provide a quantitative framework for aiding the design of parasite elimination and monitoring programs by their ability to support (1) conducting rational analysis and definition of endpoints for different programmatic aims or objectives, including transmission endpoints for disease elimination, (2) undertaking strategic analysis to aid the optimal design of intervention programs to meet set endpoints under different endemic settings and (3) providing support for performing informed evaluations of ongoing programs, including aiding the formation of timely adaptive management strategies to correct for any observed deficiencies in program effectiveness. The results also highlight how the use of a model-based framework will be critical to addressing the impacts of ecological complexities, heterogeneities and uncertainties on effective parasite management and thereby guiding the development of strategies to resolve and overcome such real-world complexities. In particular, we underscore how this approach can provide a link between ecological science and policy by revealing novel tools and measures to appraise and enhance the biological controllability or eradicability of parasitic diseases. We conclude by emphasizing an urgent need to develop and apply flexible adaptive management frameworks informed by mathematical models that are based on learning and reducing uncertainty using monitoring data, apply phased or sequential decision-making to address extant uncertainty and focus on developing ecologically resilient management strategies, in ongoing efforts to control or eliminate filariasis and other parasitic diseases in resource-poor communities.

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

PubMed

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Entrepreneurship education: A strength-based approach to substance use and suicide prevention for American Indian adolescents.

PubMed

Tingey, Lauren; Larzelere-Hinton, Francene; Goklish, Novalene; Ingalls, Allison; Craft, Todd; Sprengeler, Feather; McGuire, Courtney; Barlow, Allison

2016-01-01

American Indian (AI) adolescents suffer the largest disparities in substance use and suicide. Predominating prevention models focus primarily on risk and utilize deficit-based approaches. The fields of substance use and suicide prevention research urge for positive youth development frameworks that are strength based and target change at individual and community levels. Entrepreneurship education is an innovative approach that reflects the gap in available programs. This paper describes the development and evaluation of a youth entrepreneurship education program in partnership with one AI community. We detail the curriculum, process evaluation results, and the randomized controlled trial evaluating its efficacy for increasing protective factors. Lessons learned may be applicable to other AI communities.

Substance misuse prevention and economic analysis: challenges and opportunities regarding international utility.

PubMed

Guyll, Max; Spoth, Richard; Cornish, Marilyn A

2012-01-01

Economic analyses of substance misuse prevention assess the intervention cost necessary to achieve a particular outcome, and thereby provide an additional dimension for evaluating prevention programming. This article reviews several types of economic analysis, considers how they can be applied to substance misuse prevention, and discusses challenges to enhancing their international relevance, particularly their usefulness for informing policy decisions. Important first steps taken to address these challenges are presented, including the disease burden concept and the development of generalized cost-effectiveness, advances that facilitate international policy discussions by providing a common framework for evaluating health care needs and program effects.

The robotized workstation "MASTER" for users with tetraplegia: description and evaluation.

PubMed

Busnel, M; Cammoun, R; Coulon-Lauture, F; Détriché, J M; Le Claire, G; Lesigne, B

1999-07-01

The rehabilitation robotics MASTER program was developed by the French Atomic Energy Commission (CEA) and evaluated by the APPROCHE Rehabilitation centers. The aim of this program is to increase the autonomy and quality of life of persons with tetraplegia in domestic and vocational environments. Taking advantage of its experience in nuclear robotics, the CEA has supported studies dealing with the use of such technical aids in the medical area since 1975 with the SPARTACUS project, followed by MASTER 10 years later, and its European extension in the framework of the TIDE/RAID program. The present system is composed of a fixed robotized workstation that includes a six-axis SCARA robot mounted on a rail to allow horizontal movement and is equipped with tools for various tasks. The Operator Interface (OI) has been carefully adapted to the most severe tetraplegia. Results are given following a 2-year evaluation in real-life situations.

Findings From the National Machine Guarding Program: A Small Business Intervention: Lockout/Tagout.

PubMed

Parker, David L; Yamin, Samuel C; Xi, Min; Brosseau, Lisa M; Gordon, Robert; Most, Ivan G; Stanley, Rodney

2016-01-01

Failure to implement lockout/tagout (LOTO) procedures adversely affects the rate of work-related fatalities and serious traumatic injury and is one of the most frequently cited Occupational Safety and Health Administration standards. This study assesses the impact of a nationwide intervention to improve LOTO in small metal fabrication businesses. Insurance safety consultants conducted a standardized and validated evaluation of LOTO programs and procedures. Businesses received a baseline evaluation, two intervention visits, and a 12-month follow-up evaluation. The intervention was completed by 160 businesses. The mean LOTO procedure score improved from 8% to 33% (P < 0.0001), the mean program score went from 55% to 76% (P < 0.0001), and the presence of lockable disconnects went from 88% to 92% (P < 0.0001). This nationwide intervention showed substantial improvements in LOTO. It provides a framework for assessing and improving LOTO.

Evaluation of a theory-driven e-learning intervention for future oral healthcare providers on secondary prevention of disordered eating behaviors.

PubMed

DeBate, Rita D; Severson, Herbert H; Cragun, Deborah L; Gau, Jeff M; Merrell, Laura K; Bleck, Jennifer R; Christiansen, Steve; Koerber, Anne; Tomar, Scott L; McCormack Brown, Kelli R; Tedesco, Lisa A; Hendricson, William

2013-06-01

Oral healthcare providers have a clinical opportunity for early detection of disordered eating behaviors because they are often the first health professionals to observe overt oral and physical signs. Curricula regarding early recognition of this oral/systemic medical condition are limited in oral health educational programs. Web-based learning can supplement and reinforce traditional learning and has the potential to develop skills. The study purpose was to determine the efficacy of a theory-driven Web-based training program to increase the capacity of oral health students to perform behaviors related to the secondary prevention of disordered eating behaviors. Using the Reach, Effectiveness, Adoption, Implementation and Maintenance evaluation framework, a longitudinal group-randomized controlled trial involving 27 oral health classes from 12 oral health education programs in the United States was implemented to assess the efficacy of the Web-based training on attitudes, knowledge, self-efficacy and skills related to the secondary prevention of disordered eating behaviors. Mixed-model analysis of covariance indicated substantial improvements among students in the intervention group (effect sizes: 0.51-0.83) on all six outcomes of interest. Results suggest that the Web-based training program may increase the capacity of oral healthcare providers to deliver secondary prevention of disordered eating behaviors. Implications and value of using the Reach, Effectiveness, Adoption, Implementation and Maintenance framework are discussed.

Evaluation of a theory-driven e-learning intervention for future oral healthcare providers on secondary prevention of disordered eating behaviors

PubMed Central

DeBate, Rita D.; Severson, Herbert H.; Cragun, Deborah L.; Gau, Jeff M.; Merrell, Laura K.; Bleck, Jennifer R.; Christiansen, Steve; Koerber, Anne; Tomar, Scott L.; McCormack Brown, Kelli R.; Tedesco, Lisa A.; Hendricson, William

2013-01-01

Oral healthcare providers have a clinical opportunity for early detection of disordered eating behaviors because they are often the first health professionals to observe overt oral and physical signs. Curricula regarding early recognition of this oral/systemic medical condition are limited in oral health educational programs. Web-based learning can supplement and reinforce traditional learning and has the potential to develop skills. The study purpose was to determine the efficacy of a theory-driven Web-based training program to increase the capacity of oral health students to perform behaviors related to the secondary prevention of disordered eating behaviors. Using the Reach, Effectiveness, Adoption, Implementation and Maintenance evaluation framework, a longitudinal group-randomized controlled trial involving 27 oral health classes from 12 oral health education programs in the United States was implemented to assess the efficacy of the Web-based training on attitudes, knowledge, self-efficacy and skills related to the secondary prevention of disordered eating behaviors. Mixed-model analysis of covariance indicated substantial improvements among students in the intervention group (effect sizes: 0.51–0.83) on all six outcomes of interest. Results suggest that the Web-based training program may increase the capacity of oral healthcare providers to deliver secondary prevention of disordered eating behaviors. Implications and value of using the Reach, Effectiveness, Adoption, Implementation and Maintenance framework are discussed. PMID:23564725

A benchmarking program to reduce red blood cell outdating: implementation, evaluation, and a conceptual framework.

PubMed

Barty, Rebecca L; Gagliardi, Kathleen; Owens, Wendy; Lauzon, Deborah; Scheuermann, Sheena; Liu, Yang; Wang, Grace; Pai, Menaka; Heddle, Nancy M

2015-07-01

Benchmarking is a quality improvement tool that compares an organization's performance to that of its peers for selected indicators, to improve practice. Processes to develop evidence-based benchmarks for red blood cell (RBC) outdating in Ontario hospitals, based on RBC hospital disposition data from Canadian Blood Services, have been previously reported. These benchmarks were implemented in 160 hospitals provincewide with a multifaceted approach, which included hospital education, inventory management tools and resources, summaries of best practice recommendations, recognition of high-performing sites, and audit tools on the Transfusion Ontario website (http://transfusionontario.org). In this study we describe the implementation process and the impact of the benchmarking program on RBC outdating. A conceptual framework for continuous quality improvement of a benchmarking program was also developed. The RBC outdating rate for all hospitals trended downward continuously from April 2006 to February 2012, irrespective of hospitals' transfusion rates or their distance from the blood supplier. The highest annual outdating rate was 2.82%, at the beginning of the observation period. Each year brought further reductions, with a nadir outdating rate of 1.02% achieved in 2011. The key elements of the successful benchmarking strategy included dynamic targets, a comprehensive and evidence-based implementation strategy, ongoing information sharing, and a robust data system to track information. The Ontario benchmarking program for RBC outdating resulted in continuous and sustained quality improvement. Our conceptual iterative framework for benchmarking provides a guide for institutions implementing a benchmarking program. © 2015 AABB.

Evaluation in undergraduate medical education: Conceptualizing and validating a novel questionnaire for assessing the quality of bedside teaching.

PubMed

Dreiling, Katharina; Montano, Diego; Poinstingl, Herbert; Müller, Tjark; Schiekirka-Schwake, Sarah; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-01

Evaluation is an integral part of curriculum development in medical education. Given the peculiarities of bedside teaching, specific evaluation tools for this instructional format are needed. Development of these tools should be informed by appropriate frameworks. The purpose of this study was to develop a specific evaluation tool for bedside teaching based on the Stanford Faculty Development Program's clinical teaching framework. Based on a literature review yielding 47 evaluation items, an 18-item questionnaire was compiled and subsequently completed by undergraduate medical students at two German universities. Reliability and validity were assessed in an exploratory full information item factor analysis (study one) and a confirmatory factor analysis as well as a measurement invariance analysis (study two). The exploratory analysis involving 824 students revealed a three-factor structure. Reliability estimates of the subscales were satisfactory (α = 0.71-0.84). The model yielded satisfactory fit indices in the confirmatory factor analysis involving 1043 students. The new questionnaire is short and yet based on a widely-used framework for clinical teaching. The analyses presented here indicate good reliability and validity of the instrument. Future research needs to investigate whether feedback generated from this tool helps to improve teaching quality and student learning outcome.

Development of Evaluation Indicators for Hospice and Palliative Care Professionals Training Programs in Korea.

PubMed

Kang, Jina; Park, Kyoung-Ok

2017-01-01

The importance of training for Hospice and Palliative Care (HPC) professionals has been increasing with the systemization of HPC in Korea. Hence, the need and importance of training quality for HPC professionals are growing. This study evaluated the construct validity and reliability of the Evaluation Indicators for standard Hospice and Palliative Care Training (EIHPCT) program. As a framework to develop evaluation indicators, an invented theoretical model combining Stufflebeam's CIPP (Context-Input-Process-Product) evaluation model with PRECEDE-PROCEED model was used. To verify the construct validity of the EIHPCT program, a structured survey was performed with 169 professionals who were the HPC training program administrators, trainers, and trainees. To examine the validity of the areas of the EIHPCT program, exploratory factor analysis and confirmatory factor analysis were conducted. First, in the exploratory factor analysis, the indicators with factor loadings above 0.4 were chosen as desirable items, and some cross-loaded items that loaded at 0.4 or higher on two or more factors were adjusted as the higher factor. Second, the model fit of the modified EIHPCT program was quite good in the confirmatory factor analysis (Goodness-of-Fit Index > 0.70, Comparative Fit Index > 0.80, Normed Fit Index > 0.80, Root Mean square of Residuals < 0.05). The modified model of the EIHPCT comprised 4 areas, 13 subdomains, and 61 indicators. The evaluation indicators of the modified model will be valuable references for improving the HPC professional training program.

Development and feasibility of an evidence-informed self-management education program in pediatric concussion rehabilitation.

PubMed

Hunt, Anne W; De Feo, Luciano; Macintyre, Jennifer; Greenspoon, Dayna; Dick, Talia; Mah, Katherine; Paniccia, Melissa; Provvidenza, Christine; Reed, Nick

2016-08-17

Concussion is a considerable public health problem in youth. However, identifying, understanding and implementing best evidence informed recovery guidelines may be challenging for families given the vast amount of information available in the public domains (e.g. Internet). The objective of this study was to develop, implement and evaluate the feasibility of an evidence-informed self-management education program for concussion recovery in youth. Synthesis of best evidence, principles of knowledge translation and exchange, and expert opinion were integrated within a self-management program framework to develop a comprehensive curriculum. The program was implemented and evaluated in a children's rehabilitation hospital within a universal health care system. A retrospective secondary analysis of anonymous data from a program evaluation survey was used to evaluate program feasibility, to identify features of importance to program participants and to assess changes in participants' knowledge. The program, "Concussion & You" includes a comprehensive, evidence informed, population specific curriculum that teaches participants practical strategies for management of return to school and play, sleep, nutrition, relaxation and energy conservation. A 'wheel of health' is used to facilitate participants' self-management action plan. Results from eighty-seven participant surveys indicate that the program is feasible and participant knowledge increased in all areas of the program with the highest changes reported in knowledge about sleep hygiene, rest and energy conservation. Findings indicate that "Concussion & You" is a feasible program that is acceptable to youth and their families, and fills a health system service gap.

Inter-organizational relationships of seven Veterans Affairs Medical Centers and their affiliated medical schools: results of a multiple-case-study investigation.

PubMed

Leeman, J; Kilpatrick, K

2000-10-01

This study describes the costs and and value added to Veterans Affairs Medical Centers (VAMCs) through their affiliations with medical schools. The study also creates a conceptual framework for evaluating the critical dimensions across which these affiliations vary. Case studies of seven VAMCs' affiliations with medical schools, ranging from two highly affiliated VAMCs to one with only one funded residency position, were conducted in 1997 and 1998 using a survey and in-depth interviews with 78 key individuals at the institutions. The qualitative data were then used to develop a conceptual framework for evaluating these affiliations. The results are reported in two stages. In stage one, three organizing themes emerged from the data that formed the conceptual framework for evaluating affiliations: (1) the characteristics of each VAMC and its environment, (2) the characteristics of the relationships between each VAMC and its medical school affiliates, and (3) the costs and value that medical school affiliations add to VAMCs. The affiliations that were most beneficial to VAMCs were characterized by a relationship of trust, extensively shared education and research programs, and a high degree of physician interaction. The achievement of these characteristics is influenced by the distance between the VAMCs and their affiliated medical schools, the VAMCs' levels of organizational complexity, the degree of managed care penetration, and the continuity and academic orientation of leadership at the VAMCs. In stage two, study data were used to create a conceptual framework to evaluate the characteristics of VAMCs and their affiliations with medical schools. The study supplied data to construct a conceptual framework that describes many of the relationships among the different affiliations in the study. The framework offers a tool for evaluating the dimensions across which affiliations vary and how these differences influence the costs and value of medical school affiliations to VAMCs.

What makes public health studies ethical? Dissolving the boundary between research and practice.

PubMed

Willison, Donald J; Ondrusek, Nancy; Dawson, Angus; Emerson, Claudia; Ferris, Lorraine E; Saginur, Raphael; Sampson, Heather; Upshur, Ross

2014-08-08

The generation of evidence is integral to the work of public health and health service providers. Traditionally, ethics has been addressed differently in research projects, compared with other forms of evidence generation, such as quality improvement, program evaluation, and surveillance, with review of non-research activities falling outside the purview of the research ethics board. However, the boundaries between research and these other evaluative activities are not distinct. Efforts to delineate a boundary - whether on grounds of primary purpose, temporality, underlying legal authority, departure from usual practice, or direct benefits to participants - have been unsatisfactory.Public Health Ontario has eschewed this distinction between research and other evaluative activities, choosing to adopt a common framework and process to guide ethical reflection on all public health evaluative projects throughout their lifecycle - from initial planning through to knowledge exchange. The Public Health Ontario framework was developed by a working group of public health and ethics professionals and scholars, in consultation with individuals representing a wide range of public health roles. The first part of the framework interprets the existing Canadian research ethics policy statement (commonly known as the TCPS 2) through a public health lens. The second part consists of ten questions that guide the investigator in the application of the core ethical principles to public health initiatives.The framework is intended for use by those designing and executing public health evaluations, as well as those charged with ethics review of projects. The goal is to move toward a culture of ethical integrity among investigators, reviewers and decision-makers, rather than mere compliance with rules. The framework is consonant with the perspective of the learning organization and is generalizable to other public health organizations, to health services organizations, and beyond. Public Health Ontario has developed an ethics framework that is applicable to any evidence-generating activity, regardless of whether it is labelled research. While developed in a public health context, it is readily adaptable to other health services organizations and beyond.

Development and implementation of a comprehensive quality assurance program at a community endoscopy facility.

PubMed

Hilsden, Robert Jay; Rostom, Alaa; Dubé, Catherine; Pontifex, Darlene; McGregor, S Elizabeth; Bridges, Ronald J

2011-10-01

Quality assurance (QA) is a process that includes the systematic evaluation of a service, institution of improvements and ongoing evaluation to ensure that effective changes were made. QA is a fundamental component of any organized colorectal cancer screening program. However, it should play an equally important role in opportunistic screening. Establishing the processes and procedures for a comprehensive QA program can be a daunting proposition for an endoscopy unit. The present article describes the steps taken to establish a QA program at the Forzani & MacPhail Colon Cancer Screening Centre (Calgary, Alberta) - a colorectal cancer screening centre and nonhospital endoscopy unit that is dedicated to providing colorectal cancer screening-related colonoscopies. Lessons drawn from the authors' experience may help others develop their own initiatives. The Global Rating Scale, a quality assessment and improvement tool developed for the gastrointestinal endoscopy services of the United Kingdom's National Health Service, was used as the framework to develop the QA program. QA activities include monitoring the patient experience through surveys, creating endoscopist report cards on colonoscopy performance, tracking and evaluating adverse events and monitoring wait times.

An example of international drug politics--the development and distribution of substance prevention programs directed at adolescents.

PubMed

Lilja, John; Giota, Joanna; Hamilton, David; Larsson, Sam

2007-01-01

Many substance use prevention programs directed at adolescents exist that have been developed by researchers in the United States and are intended to be used in school settings. Some of the problems associated with such programs are reviewed, including their accessibility, ease of use, copyright status, evaluation options, program scales, and ratings, together with an overall consideration of the factors and processes posited to be associated with substance use and non-use (posited "at-risk" and "protective" mechanisms). The authors contend that there is a great need to: (a) develop substance use prevention programs which are commercially available but are not protected by copyright, (b) assess empirically each component in a program separately, and (c) encourage funding bodies to be more active in supporting the production of manuals and evaluation instruments for substance use prevention programs directed at adolescents. We need more and better process evaluations that are also sensitive to both endogenous and exogenous forces in order to know the processes by which a successful prevention program achieves its effects, is prevented from doing so and which processes are irrelevant. A social competence framework might be used as both a goal and as a theoretical base to achieve a better understanding of the processes by which substance use prevention programs reach their effects.

A FRAMEWORK FOR A COMPUTATIONAL TOXICOLOGY RESEARCH PROGRAM IN ORD

EPA Science Inventory

"A Framework for a Computational Toxicology Research Program in ORD" was drafted by a Technical Writing Team having representatives from all of ORD's Laboratories and Centers. The document describes a framework for the development of an program within ORD to utilize approaches d...

How Successful are U.S. Efforts to Build Capacity in Developing Countries? A Framework to Assess the Global Train and Equip 1206 Program

DTIC Science & Technology

2011-01-01

CARE INFRASTRUCTURE AND TRANSPORTATION INTERNATIONAL AFFAIRS LAW AND BUSINESS NATIONAL SECURITY POPULATION AND AGING PUBLIC SAFETY SCIENCE AND...Prevention—International cooperation—Evaluation. 5. Combined operations (Military science )—Evaluation. 6. United States—Military relations—Foreign...as well as to elicit informa- tion regarding assessment guidance and skills. 7 See Jennifer D. P. Moroney, Jefferson P. Marquis, Cathryn Quantic

Biometric Border Security Evaluation Framework (Biometrique Cadre D’evaluation de la Securite des Frontieres)

DTIC Science & Technology

2011-10-01

those least likely to change significantly over time: upper ridges of the eye sockets, areas around the cheekbones, sides of the mouth , nose shape, and...conduct self-process using their electronic passports. ACS processes roughly 22 million visitors annually in airport environments. The program was...the electronic passport. A successful match permits a traveler to clear through the customs control point, whereas an unsuccessful match alerts the

It Takes a Village to Prevent Falls: Reconceptualizing Fall Prevention and Management for Older Adults

PubMed Central

Ganz, David A.; Alkema, Gretchen E.; Wu, Shinyi

2013-01-01

Systematic evidence reviews support the efficacy of physical activity programs and multifactorial strategies for fall prevention. However, community settings where fall prevention programs occur often differ substantially from the research settings in which efficacy was first demonstrated. Because of these differences, alternative approaches are needed to judge the adequacy of fall prevention activities occurring as part of standard medical care or community efforts. This paper uses the World Health Organization Innovative Care for Chronic Conditions (ICCC) framework to rethink how fall prevention programs might be implemented routinely in both medical and community settings. We highlight examples of innovative programs and policies that provide fall prevention strategies consistent with the ICCC framework, and provide evidence where available on the effects of these strategies on processes and outcomes of care. We close by proposing a “no wrong door” approach to fall prevention and management, in which older adults who are found to be at risk for falls in either a medical or community setting are linked to a standard fall risk evaluation across three domains (physical activity, medical risks and home safety). PMID:18676787

An Agenda for Research on the Sustainability of Public Health Programs

PubMed Central

Dearing, James W.

2011-01-01

Funders of programs in public health and community health are increasingly concerned about the sustainability of changes they initiate. Despite a recent increase in sustainability research and evaluation, this literature has not developed a widely used paradigm for conducting research that can accumulate into generalizable findings. We provide guidance for research and evaluation of health program sustainability, including definitions and types of sustainability, specifications and measurements of dependent variables, definitions of independent variables or factors that influence sustainability, and suggestions for designs for research and data collection. We suggest viewing sustainability research as a further stage in the translation or dissemination of research-based interventions into practice. This perspective emphasizes ongoing relationships with earlier stages of a broader diffusion framework, including adoption and implementation processes. PMID:21940916

Using online program development to foster curricular change and innovation.

PubMed

Gwozdek, Anne E; Springfield, Emily C; Peet, Melissa R; Kerschbaum, Wendy E

2011-03-01

Distance education offers an opportunity to catalyze sweeping curricular change. Faculty members of the University of Michigan Dental Hygiene Program spent eighteen months researching best practices, planning outcomes and courses, and implementing an e-learning (online) dental hygiene degree completion program. The result is a collaborative and portfolio-integrated program that focuses on the development of reflective practitioners and leaders in the profession. A team-based, systems-oriented model for production, implementation, and evaluation has been critical to the program's success. The models and best practices on which this program was founded are described. Also provided is a framework of strategies for development, including the utilization of backward course design, which can be used in many areas of professional education.

A sensor simulation framework for the testing and evaluation of external hazard monitors and integrated alerting and notification functions

NASA Astrophysics Data System (ADS)

Uijt de Haag, Maarten; Venable, Kyle; Bezawada, Rajesh; Adami, Tony; Vadlamani, Ananth K.

2009-05-01

This paper discusses a sensor simulator/synthesizer framework that can be used to test and evaluate various sensor integration strategies for the implementation of an External Hazard Monitor (EHM) and Integrated Alerting and Notification (IAN) function as part of NASA's Integrated Intelligent Flight Deck (IIFD) project. The IIFD project under the NASA's Aviation Safety program "pursues technologies related to the flight deck that ensure crew workload and situational awareness are both safely optimized and adapted to the future operational environment as envisioned by NextGen." Within the simulation framework, various inputs to the IIFD and its subsystems, the EHM and IAN, are simulated, synthesized from actual collected data, or played back from actual flight test sensor data. Sensors and avionics included in this framework are TCAS, ADS-B, Forward-Looking Infrared, Vision cameras, GPS, Inertial navigators, EGPWS, Laser Detection and Ranging sensors, altimeters, communication links with ATC, and weather radar. The framework is implemented in Simulink, a modeling language developed by The Mathworks. This modeling language allows for test and evaluation of various sensor and communication link configurations as well as the inclusion of feedback from the pilot on the performance of the aircraft. Specifically, this paper addresses the architecture of the simulator, the sensor model interfaces, the timing and database (environment) aspects of the sensor models, the user interface of the modeling environment, and the various avionics implementations.

A framework for analysis of sentinel events in medical student education.

PubMed

Cohen, Daniel M; Clinchot, Daniel M; Werman, Howard A

2013-11-01

Although previous studies have addressed student factors contributing to dismissal or withdrawal from medical school for academic reasons, little information is available regarding institutional factors that may hinder student progress. The authors describe the development and application of a framework for sentinel event (SE) root cause analysis to evaluate cases in which students are dismissed or withdraw because of failure to progress in the medical school curriculum. The SE in medical student education (MSE) framework was piloted at the Ohio State University College of Medicine (OSUCOM) during 2010-2012. Faculty presented cases using the framework during academic oversight committee discussions. Nine SEs in MSE were presented using the framework. Major institution-level findings included the need for improved communication, documentation of cognitive and noncognitive (e.g., mental health) issues, clarification of requirements for remediation and fitness for duty, and additional psychological services. Challenges related to alternative and combined programs were identified as well. The OSUCOM undertook system changes based on the action plans developed through the discussions of these SEs. An SE analysis process appears to be a useful method for making system changes in response to institutional issues identified in evaluation of cases in which students fail to progress in the medical school curriculum. The authors plan to continue to refine the SE in MSE framework and analysis process. Next steps include assessing whether analysis using this framework yields improved student outcomes with universal applications for other institutions.

Green Marine: An environmental program to establish sustainability in marine transportation.

PubMed

Walker, Tony R

2016-04-15

European maritime companies have adopted programs to limit operational impacts on the environment. For maritime companies in North America, the Green Marine Environmental Program (GMEP) offers a framework to establish and reduce environmental footprints. Green Marine (GM) participants demonstrate annual improvements of specific environmental performance indicators (e.g., reductions in air pollution emissions) to maintain certification. Participants complete annual self-evaluations with results determining rankings for performance indicators on a 1-to-5 scale. Self-evaluations are independently verified every two years to ensure rigor and individual results are made publicly available annually to achieve transparency. GM benefits the marine industry across North America by encouraging sustainable development initiatives. GM's credibility is reflected through a diverse network of environmental groups and government agencies that endorse and help shape the program. Merits of this relatively new maritime certification (not previously described in the academic literature), are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using baldrige performance excellence program approaches in the pursuit of radiation oncology quality care, patient satisfaction, and workforce commitment.

PubMed

Sternick, Edward S

2011-01-01

The Malcolm Baldrige National Quality Improvement Act was signed into law in 1987 to advance US business competitiveness and economic growth. Administered by the National Institute of Standards and Technology, the Act created the Baldrige National Quality Program, recently renamed the Baldrige Performance Excellence Program. The comprehensive analytical approaches referred to as the Baldrige Healthcare Criteria, are very well-suited for the evaluation and sustainable improvement of radiation oncology management and operations. A multidisciplinary self-assessment approach is used for radiotherapy program evaluation and development in order to generate a fact-based, knowledge-driven system for improving quality of care, increasing patient satisfaction, enhancing leadership effectiveness, building employee engagement, and boosting organizational innovation. This methodology also provides a valuable framework for benchmarking an individual radiation oncology practice's operations and results against guidelines defined by accreditation and professional organizations and regulatory agencies.

Linking departmental priorities to knowledge management: the experiences of Santa Cruz County's Human Services Department.

PubMed

Lindberg, Arley

2012-01-01

Federal welfare reform, local service collaborations, and the evolution of statewide information systems inspired agency interest in evidence-informed practice and knowledge sharing systems. Four agency leaders, including the Director, Deputy Director, Director of Planning and Evaluation, and Staff Development Program Manager championed the development of a learning organization based on knowledge management throughout the agency. Internal department restructuring helped to strengthen the Planning and Evaluation, Staff Development, and Personnel units, which have become central to supporting knowledge sharing activities. The Four Pillars of Knowledge framework was designed to capture agency directions in relationship to future knowledge management goals. Featuring People, Practice, Technology and Budget, the framework links the agency's services, mission and goals to the process of becoming a learning organization. Built through an iterative process, the framework was created by observing existing activities in each department rather than being designed from the top down. Knowledge management can help the department to fulfill its mission despite reduced resources. Copyright © Taylor & Francis Group, LLC

Cutting through the noise: an evaluative framework for research communication

NASA Astrophysics Data System (ADS)

Strickert, G. E.; Bradford, L. E.; Shantz, S.; Steelman, T.; Orozs, C.; Rose, I.

2017-12-01

With an ever-increasing amount of research, there is a parallel challenge to mobilize the research for decision making, policy development and management actions. The tradition of "loading dock" model of science to policy is under renovation, replaced by more engaging methods of research communication. Research communication falls on a continuum from passive methods (e.g. reports, social media, infographics) to more active methods (e.g. forum theatre, decision labs, and stakeholder planning, and mix media installations that blend, art, science and traditional knowledge). Drawing on a five-year water science research program in the Saskatchewan River Basin, an evaluation framework is presented that draws on a wide communities of knowledge users including: First Nation and Metis, Community Organizers, Farmers, Consultants, Researchers, and Civil Servants. A mixed method framework consisting of quantitative surveys, qualitative interviews, focus groups, and q-sorts demonstrates that participants prefer more active means of research communication to draw them into the research, but they also value more traditional and passive methods to provide more in-depth information when needed.

Sustainability of NGO capacity building in southern Africa: successes and opportunities.

PubMed

Humphries, Debbie; Gomez, Ligia; Hartwig, Kari

2011-01-01

Despite an increase in organizational capacity building efforts by external organizations in low and middle income countries, the documentation of these efforts and their effects on health programs and systems remains limited. This paper reviews key frameworks for considering sustainability of capacity building and applies these frameworks to an evaluation of the sustainability of an AIDS non-governmental organization (NGO) capacity building initiative. From 2004-2007 Bristol-Myers Squibb Foundation's Secure the Future(TM) initiative in southern Africa funded a five country program, the NGO Training Institute (NGOTI), to build capacity of NGOs working to address HIV/AIDS. Lessons learned from this project include issues of ownership, the importance of integrating planning for sustainability within capacity-building projects, and the value of identifying primary capacity-building objectives in order to select sustainability strategies that are focused on maintaining program benefits. Sustainability for capacity building projects can be developed by discussing key issues early in the planning process with all primary stakeholders. Copyright © 2010 John Wiley & Sons, Ltd.

La Educacion Continua de Profesionales de la Salud--Un Modelo para su Desarrollo

ERIC Educational Resources Information Center

Stensland, Per G.

1974-01-01

The author suggests a framework for planning and evaluating continuing education, giving attention to the learner, his objectives, and the learning process; these components are discussed in determining the special characteristics of the continuing education of professional health workers, and a model program is presented. The article is in…

Educational Game Design as Gateway for Operationalizing Computational Thinking Skills among Middle School Students

ERIC Educational Resources Information Center

Wu, Min Lun

2018-01-01

This qualitative case study reports descriptive findings of digital game-based learning involving 15 Taiwanese middle school students' use of computational thinking skills elicited through programmed activities in a game design workshop. Situated learning theory is utilized as framework to evaluate novice game designers' individual advancement in…

Sewing for a Cause: Implementing and Evaluating Service-Learning in a Clothing Construction Course

ERIC Educational Resources Information Center

Freeman, Charles; Kobia, Caroline

2016-01-01

The purpose of this exploratory investigation is to examine the use of a pedagogical framework to guide the development of a successful service-learning project within a technical program (clothing construction) as determined by increased student engagement and qualitative feedback. This investigation uses student reflection comparisons to assess…

A Confirmatory Factor Analysis of Teaching Presence within the Florida Online Reading Professional Development Program

ERIC Educational Resources Information Center

Stevison, Melinda Gay

2009-01-01

The Community of Inquiry model provides a framework for recognizing and evaluating interpersonal behaviors in online educational settings. One of its three components, teaching presence (TP), describes those behaviors that are under the auspices of the online instructor. By examining these interactions and behaviors through the theoretical lens…

The Prevention of Alcohol Use by Rural Youth.

ERIC Educational Resources Information Center

D'Onofrio, Carol N.

Little is known about preventing alcohol use by youth in rural America, and almost no rural alcohol prevention program has been evaluated. To address these deficiencies, this paper critically examines the issue of alcohol use by rural youth within a public health framework. The literature is reviewed to identify what is known about the prevalence…

El Ambiente del Nino (The Environment of the Child). Occasional Paper No. 6.

ERIC Educational Resources Information Center

Nunes, Terezinha

This Spanish-language report offers a framework for the analysis and evaluation of intervention on children's behalf against which to analyze actions upon their environment. The first section looks at the complex issue of defining suitable child development outcomes for intervention programs, noting that because the concept of childhood varies…

Navigating the Turbulent Waters of School Reform Guided by Complexity Theory

ERIC Educational Resources Information Center

White, David G.; Levin, James A.

2016-01-01

The goal of this research study has been to develop, implement, and evaluate a school reform design experiment at a continuation high school with low-income, low-performing underrepresented minority students. The complexity sciences served as a theoretical framework for this design experiment. Treating an innovative college preparatory program as…

An Evaluation of the Early Implementation of School-Based Bullying Prevention Programs in Massachusetts

ERIC Educational Resources Information Center

Sautter Errichetti, Karen

2014-01-01

Background: A quarter of U.S. children are bullied annually. State legislatures have responded to high profile media exposure of bullying and increased public concern by passing legislation aimed at preventing bullying among school children. Methods: The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework was used to…

Studios Abroad: A Challenge in Innovative Pedagogy

ERIC Educational Resources Information Center

Macedo, Joseli

2017-01-01

Study abroad programs offer a unique opportunity to evaluate pedagogic models. The role of studios in design and planning pedagogy has been examined. However, how the general framework of a studio supports other pedagogic models has not been widely discussed. This article assesses a series of urban planning and design studios conducted abroad to…

Multi-Armed RCTs: A Design-Based Framework. NCEE 2017-4027

ERIC Educational Resources Information Center

Schochet, Peter Z.

2017-01-01

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…

Command and Control Rapid Prototyping Continuum (C2RPC): The Framework for Achieving a New C2 Strategy

DTIC Science & Technology

2011-06-01

Sync Matrix Assessing J/ADOCS (Fires) TBMCS (ATO) Executing Monitoring (SA) C2 Strategy Objectives • Provide Expanded Mission Management...Computers, and Intelligence T&E Test and Evaluation PMW150 Program Warfare Office Command and Control TBMCS Theater Battle Management Core System POR

Mobile Learning in Nursing Practice Education: Applying Koole's FRAME Model

ERIC Educational Resources Information Center

Kenny, Richard F.; Van Neste-Kenny, Jocelyne M. C.; Park, Caroline L.; Burton, Pamela A.; Meiers, Jan

2009-01-01

We report here on an exploratory formative evaluation of a project to integrate mobile learning into a Western Canadian college nursing program. Third-year students used Hewlett Packard iPAQ mobile devices for five weeks in a practice education course in April-May, 2007. Koole's (2009) "Framework for the Rational Analysis of Mobile…