ERIC Educational Resources Information Center
Cornell, Dewey; Maeng, Jennifer L.; Burnette, Anna Grace; Jia, Yuane; Huang, Francis; Konold, Timothy; Datta, Pooja; Malone, Marisa; Meyer, Patrick
2018-01-01
Threat assessment has been widely endorsed as a school safety practice, but there is little research on its implementation. In 2013, Virginia became the first state to mandate student threat assessment in its public schools. The purpose of this study was to examine the statewide implementation of threat assessment and to identify how threat…
Grimm, Sabine E; Dixon, Simon; Stevens, John W
2017-07-01
With low implementation of cost-effective health technologies being a problem in many health systems, it is worth considering the potential effects of research on implementation at the time of health technology assessment. Meaningful and realistic implementation estimates must be of dynamic nature. To extend existing methods for assessing the value of research studies in terms of both reduction of uncertainty and improvement in implementation by considering diffusion based on expert beliefs with and without further research conditional on the strength of evidence. We use expected value of sample information and expected value of specific implementation measure concepts accounting for the effects of specific research studies on implementation and the reduction of uncertainty. Diffusion theory and elicitation of expert beliefs about the shape of diffusion curves inform implementation dynamics. We illustrate use of the resulting dynamic expected value of research in a preterm birth screening technology and results are compared with those from a static analysis. Allowing for diffusion based on expert beliefs had a significant impact on the expected value of research in the case study, suggesting that mistakes are made where static implementation levels are assumed. Incorporating the effects of research on implementation resulted in an increase in the expected value of research compared to the expected value of sample information alone. Assessing the expected value of research in reducing uncertainty and improving implementation dynamics has the potential to complement currently used analyses in health technology assessments, especially in recommendations for further research. The combination of expected value of research, diffusion theory, and elicitation described in this article is an important addition to the existing methods of health technology assessment.
Implementation of the nursing process in a health area: models and assessment structures used
Huitzi-Egilegor, Joseba Xabier; Elorza-Puyadena, Maria Isabel; Urkia-Etxabe, Jose Maria; Asurabarrena-Iraola, Carmen
2014-01-01
OBJECTIVE: to analyze what nursing models and nursing assessment structures have been used in the implementation of the nursing process at the public and private centers in the health area Gipuzkoa (Basque Country). METHOD: a retrospective study was undertaken, based on the analysis of the nursing records used at the 158 centers studied. RESULTS: the Henderson model, Carpenito's bifocal structure, Gordon's assessment structure and the Resident Assessment Instrument Nursing Home 2.0 have been used as nursing models and assessment structures to implement the nursing process. At some centers, the selected model or assessment structure has varied over time. CONCLUSION: Henderson's model has been the most used to implement the nursing process. Furthermore, the trend is observed to complement or replace Henderson's model by nursing assessment structures. PMID:25493672
Implementing Peer Assessment in a Post-Secondary (16-18) Physics Classroom
ERIC Educational Resources Information Center
Chetcuti, Deborah; Cutajar, Catherine
2014-01-01
This study explores the implementation of peer assessment with a group of students studying physics at Advanced level in a post-secondary school in Malta. The study that draws on action research methodology looks at how the views of students regarding peer assessment evolve as they engage with peer assessment. The research involved the actual…
Implementation of the Short-Term Assessment of Risk and Treatability over two phases.
Kroppan, Erik; Nonstad, Kåre; Iversen, Runar Busch; Søndenaa, Erik
2017-01-01
Over the last decade, the Short-Term Assessment of Risk and Treatability (START) has provided a strong evidence base to predict a range of problem behaviors. The implementation of START and adaptation of the services to the use of START have so far been sparsely described in the literature. The purpose of this study was to describe the continuation and the interdisciplinarity of risk assessments through the two phases. Over a period of 10 years, the forensic mental health services at Brøset has implemented START in two phases: initially with implementing the instrument (2005-2009) and secondarily by customizing the instrument to everyday treatment and planning (since 2009). This implementation was based on data from 887 START assessments for 181 patients over a decade (2005-2015). The results showed that the number of START assessments has been stable throughout the past 10 years and the interval between the ratings has decreased significantly ( p <0.05). The involvement by diversity of professionals has increased significantly over the two implementation phases. This study also addressed the continuity and organization of the implementation process and presented an overview of how START has been widespread in the service through treatment. The results showed an increased multidisciplinary participation and a continuing rate of assessments as the implementation progressed from assessment to a combined assessment-treatment phase.
ERIC Educational Resources Information Center
Close, Brandy
2017-01-01
This study describes faculty perceptions of formative assessment and the influence their perceptions have on implementation practices. Assessment is often misunderstood and too often becomes an afterthought in the teaching process. Measuring curricular success by overall student outcomes means instructional and assessment methods have a…
Fazey
2000-03-01
In between the description of the methodology and the discussion of assessment results, lies a crucial area, namely that of implementation. If assessment methods cannot be implemented, there will be no assessment report, and no recommendations for intervention or policy development. Implementation is a critical, yet neglected, area of drug policy delivery. This paper describes some of the problems associated with the implementation of rapid assessment studies commissioned by the United Nations International Drug Control Programme (UNDCP) over the last 5 years. Drawing on the author's experience of commissioning rapid assessments on the extent and nature of drug use in a variety of international settings and political contexts, the paper draws eight main lessons for rapid assessments commissioned within the context of international development programmes. These are: (1) the need to get high level political support; (2) the need to employ competent social scientists to run the assessment; (3) the need to define exactly the object of the assessment; (4) the necessity of spelling out the methodology and the time scale; (5) the careful establishment of the financial framework; (6) the importance of cultivating contacts; (7) the necessity of actually getting a report; and (8) the danger of accepting an unseen or unread consultant's report as the basis for programme implementation. The paper emphasises the critical importance of planning prior to implementation and flexibility during it.
Implementation of the Short-Term Assessment of Risk and Treatability over two phases
Kroppan, Erik; Nonstad, Kåre; Iversen, Runar Busch; Søndenaa, Erik
2017-01-01
Background Over the last decade, the Short-Term Assessment of Risk and Treatability (START) has provided a strong evidence base to predict a range of problem behaviors. The implementation of START and adaptation of the services to the use of START have so far been sparsely described in the literature. The purpose of this study was to describe the continuation and the interdisciplinarity of risk assessments through the two phases. Methods Over a period of 10 years, the forensic mental health services at Brøset has implemented START in two phases: initially with implementing the instrument (2005–2009) and secondarily by customizing the instrument to everyday treatment and planning (since 2009). This implementation was based on data from 887 START assessments for 181 patients over a decade (2005–2015). Results The results showed that the number of START assessments has been stable throughout the past 10 years and the interval between the ratings has decreased significantly (p<0.05). The involvement by diversity of professionals has increased significantly over the two implementation phases. Conclusion This study also addressed the continuity and organization of the implementation process and presented an overview of how START has been widespread in the service through treatment. The results showed an increased multidisciplinary participation and a continuing rate of assessments as the implementation progressed from assessment to a combined assessment–treatment phase. PMID:28860799
Pre-Service Teachers' Assessment Literacy and Its Implementation into Practice
ERIC Educational Resources Information Center
Ogan-Bekiroglu, Feral; Suzuk, Erol
2014-01-01
This research study was conducted to address pre-service physics teachers' assessment literacy and its implementation into practice. The research was both quantitative and qualitative in nature. For the quantitative aspect of the study, the researchers determined the participants' assessment literacy after their enrolment with the…
ERIC Educational Resources Information Center
Choi, Jinyoung
2017-01-01
This study explores how teachers implemented an assessment reform in South Korea, with an analysis of different aspects of the reform. Using a mixed method design, this study reveals that the relation between policy and practice depends upon the nature of the changes that reform policies propose. Teachers' implementation varies in terms of…
NASA Astrophysics Data System (ADS)
Parmin; Savitri, E. N.; Amalia, A. V.; Pratama, M. R.
2018-04-01
This study aims to measure the performance of graduates in implementing conservation-based science teaching. The study employed a qualitative method by collecting the self-assessment data from alumni and the performance assessment from the headmasters of schools where the graduates are currently teaching. There are nine indicators of conservation insight examined in this study. The study concluded that the 78 alumni, who have become teachers when the study was conducted, perform well in implementing conservative science lessons.
Brusamento, Serena; Legido-Quigley, Helena; Panteli, Dimitra; Turk, Eva; Knai, Cecile; Saliba, Vanessa; Car, Josip; McKee, Martin; Busse, Reinhard
2012-10-01
This review aimed to evaluate the effectiveness of strategies to implement clinical guidelines for chronic disease management in primary care in EU Member States. We conducted a systematic review of interventional studies assessing the implementation of clinical guidelines. We searched five databases (EMBASE, MEDLINE, CENTRAL, Eppi-Centre and Clinicaltrials.gov) following a strict Cochrane methodology. We included studies focusing on the management of chronic diseases in adults in primary care. A total of 21 studies were found. The implementation strategy was fully effective in only four (19%), partially effective in eight (38%), and not effective in nine (43%). The probability that an intervention would be effective was only slightly higher with multifaceted strategies, compared to single interventions. However, effect size varied across studies; therefore it was not possible to determine the most successful strategy. Only eight studies evaluated the impact on patients' health and only two of those showed significant improvement, while in five there was an improvement in the process of care which did not translate into an improvement in health outcomes. Only four studies reported any data on the cost of the implementation but none undertook a cost-effectiveness analysis. Only one study presented data on the barriers to the implementation of guidelines, noting a lack of awareness and agreement about clinical guidelines. Our results reveal that there are only a few rigorous studies which assess the effectiveness of a strategy to implement clinical guidelines in Europe. Moreover, the results are not consistent in showing which strategy is the most appropriate to facilitate their implementation. Therefore, further research is needed to develop more rigorous studies to evaluate health outcomes associated with the implementation of clinical guidelines; to assess the cost-effectiveness of implementing clinical guidelines; and to investigate the perspective of service users and health service staff. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.
NASA Astrophysics Data System (ADS)
Hardyanti, R. C.; Hartono; Fianti
2018-03-01
Physics Learning in Curriculum of 2013 is closely related to the implementation of scientific approach and authentic assessment in learning. This study aims to analyze the implementation of scientific approaches and authentic assessment in physics learning, as well as to analyze the constraints of scientific approach and authentic assessment in physics learning. The data collection techniques used in this study are questionnaires, observations, interviews, and documentation. The calculation results used are percentage techniques and analyzed by using qualitative descriptive approach. Based on the results of research and discussion, the implementation of physics learning based on the scientific approach goes well with the percentage of 84.60%. Physical learning activity based on authentic assessment also goes well with the percentage of 88%. The results of the percentage of scientific approaches and authentic assessment approaches are less than 100%. It shows that there are obstacles to the implementation of the scientific approach and the constraints of authentic assessment. The obstacles to the implementation of scientific approach include time, heavy load of material, input or ability of learners, the willingness of learners in asking questions, laboratory support, and the ability of students to process data. While the obstacles to the implementation of authentic assessment include the limited time for carrying out of authentic assessment, the components of the criteria in carrying out the authentic assessment, the lack of discipline in administering the administration, the difficulty of changing habits in carrying out the assessment from traditional assessment to the authentic assessment, the obstacle to process the score in accordance with the format Curriculum of 2013.
Schmidt, Barbara; Watt, Kerrianne; McDermott, Robyn; Mills, Jane
2017-07-17
Better systems of care are required to address chronic disease in Indigenous people to ensure they can access all their care needs. Health research has produced evidence about effective models of care and chronic disease strategies to address Indigenous health, however the transfer of research findings into routine clinical practice has proven challenging. Complex interventions, such as those related to chronic disease, have many components that are often poorly implemented and hence rarely achieve implementation fidelity. Implementation fidelity is "the degree to which programs are implemented as intended by the program developer". Knowing if an intervention was implemented as planned is fundamental to knowing what has contributed to the success of an intervention. The aim of this study is to adapt the implementation fidelity framework developed by Keith et al. and apply it to the intervention implemented in phase 1 of the Getting Better at Chronic Care in North Queensland study. The objectives are to quantify the level of implementation fidelity achieved during phase 1 of the study, measure the association between implementation fidelity and health outcomes and to explore the features of the primary health care system that contributed to improved health outcomes. A convergent parallel mixed methods study design will be used to develop a process for assessing implementation fidelity. Information collected via a questionnaire and routine data generated during phase 1 of the study will be used to explain the context for the intervention in each site and develop an implementation fidelity score for each component of the intervention. A weighting will be applied to each component of the intervention to calculate the overall implementation score for each participating community. Statistical analysis will assess the level of association between implementation fidelity scores and health outcomes. Health services research seeks to find solutions to social and technical problems to improve health outcomes. The development of a tool and methodology for assessing implementation fidelity in the Indigenous primary health care context will help address some of the barriers to the translation of research into practice. ACTRN12610000812099 : 29.9.2010.
Vitoratou, Silia; Sevdalis, Nick; Hull, Louise
2017-01-01
Introduction Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. Methods and analysis The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethics and dissemination Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research. Trial registration number International Prospective Register of Systematic Reviews (PROSPERO): CRD42017065348. PMID:28993392
Implementation of a Formative Assessment Model Incorporating Peer and Self-Assessment
ERIC Educational Resources Information Center
Orsmond, Paul; Merry, Stephen; Callaghan, Arthur
2004-01-01
This paper reports a study designed to enhance students' ability to implement assessment marking criteria and to develop the role of dialogue in student learning. Pairs or trios of undergraduate biology students were asked to complete a poster on the theme of histology using student/tutor-constructed marking criteria. The study showed: (1)…
Implementing a Portfolio Assessment System for Chapter 1 Program Improvement: A Case Study.
ERIC Educational Resources Information Center
Leitner, David; Trevisan, Mike
This paper presents findings of a case study that documented the implementation of a portfolio assessment system in response to mandated program improvement and assessed its impact on teacher and student behaviors. The sample included elementary and middle school teachers and students from three Chapter 1 schools in a rural California school…
The Portfolio Project: A Study of Assessment, Instruction, and Middle School Reform.
ERIC Educational Resources Information Center
Underwood, Terry
This book is a study, in research-based narrative form, of one middle school's implementation of a new portfolio assessment plan in response to statewide policy changes in California. The book highlights the interactions of state, district, and local forces as teachers work to implement a portfolio-assessment plan that collects student work and…
Muntinga, Maaike E; Van Leeuwen, Karen M; Schellevis, François G; Nijpels, Giel; Jansen, Aaltje P D
2015-01-22
Implementation fidelity, the degree to which a care program is implemented as intended, can influence program impact. Since results of trials that aim to implement comprehensive care programs for frail, older people have been conflicting, assessing implementation fidelity alongside these trials is essential to differentiate between flaws inherent to the program and implementation issues. This study demonstrates how a theory-based assessment of fidelity can increase insight in the implementation process of a complex intervention in primary elderly care. The Geriatric Care Model was implemented among 35 primary care practices in the Netherlands. During home visits, practice nurses conducted a comprehensive geriatric assessment and wrote a tailored care plan. Multidisciplinary team consultations were organized with the aim to enhance the coordination between professionals caring for a single patient with complex needs. To assess fidelity, we identified 5 key intervention components and formulated corresponding research questions using Carroll's framework for fidelity. Adherence (coverage, frequency, duration, content) was assessed per intervention component during and at the end of the intervention period. Two moderating factors (participant responsiveness and facilitation strategies) were assessed at the end of the intervention. Adherence to the geriatric assessments and care plans was high, but decreased over time. Adherence to multidisciplinary consultations was initially poor, but increased over time. We found that individual differences in adherence between practice nurses and primary care physicians were moderate, while differences in participant responsiveness (satisfaction, involvement) were more distinct. Nurses deviated from protocol due to contextual factors and personal work routines. Adherence to the Geriatric Care Model was high for most of the essential intervention components. Study limitations include the limited number of assessed moderating factors. We argue that a longitudinal investigation of adherence per intervention component is essential for a complete understanding of the implementation process, but that such investigations may be complicated by practical and methodological challenges. The Netherlands National Trial Register (NTR). 2160 .
ERIC Educational Resources Information Center
Mengistie, Solomon Melesse
2014-01-01
The present study tries to investigate the contribution of primary school teachers' peer- and self- assessment for effective implementation of active learning in their actual classrooms. In this study, areas in which self-reflection and peer assessment include three broad categories, such as methods of teaching and learning, instructional resource…
ERIC Educational Resources Information Center
Yusuf, Hanna Onyi
2014-01-01
This study assessed the implementation of the reading component of the Junior Secondary School English Language Curriculum for Basic Education in Nigeria. Ten (10) randomly selected public and private secondary schools from Kaduna metropolis in Kaduna State of Nigeria were used for the study. Among the factors assessed in relation to the…
Rosas, Scott R; Behar, Lenore B; Hydaker, William M
2016-01-01
Establishing a system of care requires communities to identify ways to successfully implement strategies and support positive outcomes for children and their families. Such community transformation is complex and communities vary in terms of their readiness for implementing sustainable community interventions. Assessing community readiness and guiding implementation, specifically for the funded communities implementing a system of care, requires a well-designed tool with sound psychometric properties. This scale development study used the results of a previously published concept mapping study to create, administer, and assess the psychometric characteristics of the System of Care Readiness and Implementation Measurement Scale (SOC-RIMS). The results indicate the SOC-RIMS possesses excellent internal consistency characteristics, measures clearly discernible dimensions of community readiness, and demonstrates the target constructs exist within a broad network of content. The SOC-RIMS can be a useful part of a comprehensive assessment in communities where system of care practices, principles, and philosophies are implemented and evaluated.
Balasubramanian, Bijal A.; Heurtin-Roberts, Suzanne; Krasny, Sarah; Rohweder, Catherine; Fair, Kayla; Olmos, Tanya; Stange, Kurt C.; Gorin, Sherri Sheinfeld
2018-01-01
Background Contextual factors relevant to health care improvement studies are important for translating findings to other settings; however, these are rarely collected systematically and reported. This study articulates a prospective method for assessing contextual factors and describes factors related to implementation and patient reach of a pragmatic multisite trial conducted in nine primary care practices. Methods In a qualitative case-series, contextual factors were assessed from the My Own Health Report (MOHR) study, focused on systematically conducting health risk assessments and goal setting for unhealthy behaviors and behavioral health in primary care. Data were collected prospectively at baseline, mid-point, and end of intervention using a template that guided conduct of interviews and observations at practice sites. A multidisciplinary team used an iterative process to summarize themes describing contextual factors related to intervention implementation and patient reach, calculated by dividing the number of patients who completed the MOHR assessment by the number of patients offered MOHR. Results Contextual factors operational both within and external to the practice environment influenced implementation and patient reach over time. These included practice members’ motivations towards the MOHR intervention, practice staff capacity to take on additional responsibilities for implementation, practice information system capacity, external resources to support quality improvement, linkages with community resources, and fit of implementation strategy to patient populations. Conclusions Systematic assessment of contextual factors throughout implementation of quality improvement initiatives is needed to meaningfully interpret findings and translate lessons learned to other health care settings. Thus, knowledge of contextual factors is essential for scaling up of effective improvement strategies. PMID:28484066
DOE Office of Scientific and Technical Information (OSTI.GOV)
U.S. Department of Energy
2001-08-05
This case study is the latest in a series on industrial firms who are implementing energy efficient technologies and system improvements into their manufacturing processes. The case studies document the activities, savings, and lessons learned on these projects.
Vos, A A; van Voorst, S F; Posthumus, A G; Waelput, A J M; Denktaş, S; Steegers, E A P
2017-09-01
To evaluate the implementation of a complex intervention in the antenatal healthcare field in 14 Dutch municipalities. The intervention consisted of the implementation of a systematic scorecard-based risk assessment in pregnancy, subsequent patient-tailored care pathways, and consultations of professionals from different medical and social disciplines. Saunders's seven-step method was used for the development of a programme implementation monitoring plan, with specific attention to the setting and context of the programme. Data were triangulated from multiple sources, and prespecified criteria were applied to examine the evidence for implementation. Six out of 11 municipalities (54%) met the implementation criteria for the entire risk assessment programme, whereas three municipalities (27%) met the criteria if the three components of implementation were analysed separately. A process evaluation of implementation of a complex intervention is possible. The results can be used to improve understanding of the associations between specific programme elements and programme outcomes on effectiveness of the intervention. Additionally, the results are important for formative purposes to assess how future implementation of antenatal risk assessment can be improved in comparable contexts. Copyright © 2017. Published by Elsevier Ltd.
ERIC Educational Resources Information Center
Barrick, R. Kirby; Samy, Mohamed M.; Roberts, T. Grady; Thoron, Andrew C.; Easterly, R. G., III
2011-01-01
The purpose of this study was to assess the perceptions of ATS instructors in Egypt related to implementing experiential learning in the form of internships. In July 2007, 90 ATS instructors attended workshops focused on conducting internship experiences. Self-perceived competency of ATS instructors to implement internships was assessed…
A Review of Implementation Outcome Measures of School-based Physical Activity Interventions
ERIC Educational Resources Information Center
Shah, Sonam; Allison, Kenneth R.; Schoueri-Mychasiw, Nour; Pach, Beata; Manson, Heather; Vu-Nguyen, Karen
2017-01-01
Background: Measuring the implementation of school-based physical activity (PA) interventions is an important prerequisite in assessing their impact. Prior to conducting a study to assess the implementation of the daily physical activity (DPA) policy in Ontario, Canada, a literature review was conducted to identify existing survey instruments to…
Berry, Carolyn; Kaplan, Sue A; Mijanovich, Tod; Mayer, Andrea
2014-01-01
The purpose of this paper is to examine the feasibility of collecting standardized, patient reported race and ethnicity (RE) data in hospitals, and to assess the impact on data quality and utility. Part of a larger evaluation that included a comprehensive assessment. Sites documented RE data collection procedures before and after program implementation. Primary data collected through qualitative interviewing with key respondents in ten hospitals to assess implementation. Nine hospitals provided RE data on the same patients before and after implementation new data collection procedures were implemented to assess impact. Implementation went smoothly in nine of ten hospitals and had substantial effects on the hospital staff awareness on the potential for disparities within their hospitals. New procedures had minimal impact on characterization of readmitted patients. This study demonstrated that it is feasible for staff in a diverse group of hospitals to implement systematic, internally standardized methods to collect self-reported RE data from patients. Although this study found little impact patients' demographic characterizations, other benefits included greater awareness of and attention to disparities, uncovering small pockets of minorities, and dramatically increased RE data use in quality improvement efforts.
ERIC Educational Resources Information Center
Berkeley-Jones, Catherine Spotswood
2012-01-01
The purpose of this study was to examine teacher Levels of Technology Implementation (LoTi) self-ratings and student Texas Assessment of Knowledge and Skills (TAKS) scores. The study assessed the relationship between LoTi ratings and TAKS scores of 6th, 7th, and 8th grade students as reported in student records at Alamo Heights Independent School…
2013-01-01
Background Improving quality in children’s mental health and social service settings will require implementation strategies capable of moving effective treatments and other innovations (e.g., assessment tools) into routine care. It is likely that efforts to identify, develop, and refine implementation strategies will be more successful if they are informed by relevant stakeholders and are responsive to the strengths and limitations of the contexts and implementation processes identified in usual care settings. This study will describe: the types of implementation strategies used; how organizational leaders make decisions about what to implement and how to approach the implementation process; organizational stakeholders’ perceptions of different implementation strategies; and the potential influence of organizational culture and climate on implementation strategy selection, implementation decision-making, and stakeholders’ perceptions of implementation strategies. Methods/design This study is a mixed methods multiple case study of seven children’s social service organizations in one Midwestern city in the United States that compose the control group of a larger randomized controlled trial. Qualitative data will include semi-structured interviews with organizational leaders (e.g., CEOs/directors, clinical directors, program managers) and a review of documents (e.g., implementation and quality improvement plans, program manuals, etc.) that will shed light on implementation decision-making and specific implementation strategies that are used to implement new programs and practices. Additionally, focus groups with clinicians will explore their perceptions of a range of implementation strategies. This qualitative work will inform the development of a Web-based survey that will assess the perceived effectiveness, relative importance, acceptability, feasibility, and appropriateness of implementation strategies from the perspective of both clinicians and organizational leaders. Finally, the Organizational Social Context measure will be used to assess organizational culture and climate. Qualitative, quantitative, and mixed methods data will be analyzed and interpreted at the case level as well as across cases in order to highlight meaningful similarities, differences, and site-specific experiences. Discussion This study is designed to inform efforts to develop more effective implementation strategies by fully describing the implementation experiences of a sample of community-based organizations that provide mental health services to youth in one Midwestern city. PMID:23961701
ERIC Educational Resources Information Center
Ghazali, Nor Hasnida Md
2016-01-01
A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…
ERIC Educational Resources Information Center
Antoniou, Panayiotis; James, Mary
2014-01-01
The importance of formative assessment in facilitating student learning has been well established in the literature. However, defining and implementing formative assessment in classroom settings is a rather complicated task. The aim of this study is to explore formative assessment, as implemented in primary classrooms in Cyprus, and develop a…
The Impact of RTI Practices on Student Reading Achievement
ERIC Educational Resources Information Center
Gleason, Tara Lynn
2013-01-01
The purpose of this study was to evaluate whether elementary schools that endorse implementing core components of Response to Intervention (RTI) differ in student outcomes on the Pennsylvania System of School Assessment (PSSA) Reading Assessment when compared to schools that do not endorse implementing RTI practices. This study also explored…
ERIC Educational Resources Information Center
Collier-Meek, Melissa A.; Sanetti, Lisa M. H.
2014-01-01
Reviews of treatment outcome literature indicate treatment integrity is not regularly assessed. In consultation, two levels of treatment integrity (i.e., consultant procedural integrity [CPI] and intervention treatment integrity [ITI]) provide relevant implementation data. Specifically, assessment of CPI and ITI are necessary to conclude (a)…
A Pilot Study of the Challenges and Prospects of Continuous Assessment Implementation in Nigeria
ERIC Educational Resources Information Center
Owolabi, Henry O.; Onuka, Adams O. U.
2010-01-01
This study obtained basic information from teachers and students on the challenges and prospects of implementing continuous assessment (CA) in the Nigerian school system. Secondary Schools in Ilorin, the capital city of Kwara State, located in the central region of Nigeria were sampled for use in the study. It employed survey research design…
Advancing implementation science through measure development and evaluation: a study protocol.
Lewis, Cara C; Weiner, Bryan J; Stanick, Cameo; Fischer, Sarah M
2015-07-22
Significant gaps related to measurement issues are among the most critical barriers to advancing implementation science. Three issues motivated the study aims: (a) the lack of stakeholder involvement in defining pragmatic measure qualities; (b) the dearth of measures, particularly for implementation outcomes; and (c) unknown psychometric and pragmatic strength of existing measures. Aim 1: Establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Aim 2: Develop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Aim 3: Identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that demonstrate both psychometric and pragmatic strength. For Aim 1, we will conduct (a) interviews with stakeholder panelists (N = 7) and complete a literature review to populate pragmatic measure construct criteria, (b) Q-sort activities (N = 20) to clarify the internal structure of the definition, (c) Delphi activities (N = 20) to achieve consensus on the dimension priorities, (d) test-retest and inter-rater reliability assessments of the emergent rating system, and (e) known-groups validity testing of the top three prioritized pragmatic criteria. For Aim 2, our systematic development process involves domain delineation, item generation, substantive validity assessment, structural validity assessment, reliability assessment, and predictive validity assessment. We will also assess discriminant validity, known-groups validity, structural invariance, sensitivity to change, and other pragmatic features. For Aim 3, we will refine our established evidence-based assessment (EBA) criteria, extract the relevant data from the literature, rate each measure using the EBA criteria, and summarize the data. The study outputs of each aim are expected to have a positive impact as they will establish and guide a comprehensive measurement-focused research agenda for implementation science and provide empirically supported measures, tools, and methods for accomplishing this work.
Allen, Jennifer D; Towne, Samuel D; Maxwell, Annette E; DiMartino, Lisa; Leyva, Bryan; Bowen, Deborah J; Linnan, Laura; Weiner, Bryan J
2017-08-23
This paper identifies and describes measures of constructs relevant to the adoption or implementation of innovations (i.e., new policies, programs or practices) at the organizational-level. This work is intended to advance the field of dissemination and implementation research by aiding scientists in the identification of existing measures and highlighting methodological issues that require additional attention. We searched for published studies (1973-2013) in 11 bibliographic databases for quantitative, empirical studies that presented outcome data related to adoption and/or implementation of an innovation. Included studies had to assess latent constructs related to the "inner setting" of the organization, as defined by the Consolidated Framework for Implementation Research. Of the 76 studies included, most (86%) were cross sectional and nearly half (49%) were conducted in health care settings. Nearly half (46%) involved implementation of evidence-based or "best practice" strategies; roughly a quarter (26%) examined use of new technologies. Primary outcomes most often assessed were innovation implementation (57%) and adoption (34%); while 4% of included studies assessed both outcomes. There was wide variability in conceptual and operational definitions of organizational constructs. The two most frequently assessed constructs included "organizational climate" and "readiness for implementation." More than half (55%) of the studies did not articulate an organizational theory or conceptual framework guiding the inquiry; about a third (34%) referenced Diffusion of Innovations theory. Overall, only 46% of articles reported psychometric properties of measures assessing latent organizational characteristics. Of these, 94% (33/35) described reliability and 71% (25/35) reported on validity. The lack of clarity associated with construct definitions, inconsistent use of theory, absence of standardized reporting criteria for implementation research, and the fact that few measures have demonstrated reliability or validity were among the limitations highlighted in our review. Given these findings, we recommend that increased attention be devoted toward the development or refinement of measures using common psychometric standards. In addition, there is a need for measure development and testing across diverse settings, among diverse population samples, and for a variety of types of innovations.
Krist, Alex H; Phillips, Siobhan M; Sabo, Roy T; Balasubramanian, Bijal A; Heurtin-Roberts, Suzanne; Ory, Marcia G; Johnson, Sallie Beth; Sheinfeld-Gorin, Sherri N; Estabrooks, Paul A; Ritzwoller, Debra P; Glasgow, Russell E
2014-01-01
Guidelines recommend screening patients for unhealthy behaviors and mental health concerns. Health risk assessments can systematically identify patient needs and trigger care. This study seeks to evaluate whether primary care practices can routinely implement such assessments into routine care. As part of a cluster-randomized pragmatic trial, 9 diverse primary care practices implemented My Own Health Report (MOHR)-an electronic or paper-based health behavior and mental health assessment and feedback system paired with counseling and goal setting. We observed how practices integrated MOHR into their workflows, what additional practice staff time it required, and what percentage of patients completed a MOHR assessment (Reach). Most practices approached (60%) agreed to adopt MOHR. How they implemented MOHR depended on practice resources, informatics capacity, and patient characteristics. Three practices mailed patients invitations to complete MOHR on the Web, 1 called patients and completed MOHR over the telephone, 1 had patients complete MOHR on paper in the office, and 4 had staff help patients complete MOHR on the Web in the office. Overall, 3,591 patients were approached and 1,782 completed MOHR (Reach = 49.6%). Reach varied by implementation strategy with higher reach when MOHR was completed by staff than by patients (71.2% vs 30.2%, P <.001). No practices were able to sustain the complete MOHR assessment without adaptations after study completion. Fielding MOHR increased staff and clinician time an average of 28 minutes per visit. Primary care practices can implement health behavior and mental health assessments, but counseling patients effectively requires effort. Practices will need more support to implement and sustain assessments. © 2014 Annals of Family Medicine, Inc.
Khadjesari, Zarnie; Vitoratou, Silia; Sevdalis, Nick; Hull, Louise
2017-10-08
Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research. International Prospective Register of Systematic Reviews (PROSPERO): CRD42017065348. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
ERIC Educational Resources Information Center
Cameto, Renee; Bergland, Frances; Knokey, Anne-Marie; Nagle, Katherine M.; Sanford, Christopher; Kalb, Sara C.; Blackorby, Jose; Sinclair, Beth; Riley, Derek L.; Ortega, Moreica
2010-01-01
The report is organized to provide information on the school-level implementation of alternate assessments for students with significant cognitive disabilities. Following the Introduction in Chapter 1, Chapter 2 describes the study design and methods, including the development of the teacher survey and data collection procedures and analyses.…
Implementing the dynamic appraisal of situational aggression in mental health units.
Lantta, Tella; Daffern, Michael; Kontio, Raija; Välimäki, Maritta
2015-01-01
The aims of this study are to explain the intervention of implementing a structured violence risk assessment procedure in mental health inpatient units using the Ottawa Model of Research Use (OMRU) as a guiding framework and to consider nurses' perspectives of its clinical utility and implementation process. Patient aggression toward staff is a global concern in mental health units. The limited extant literature exploring the use of structured violence risk assessments in mental health units, although small and inconsistent, reveals some positive impacts on the incidence of aggression and staff's use of restrictive interventions. Although numerous violence risk assessment instruments have been developed and tested, their systematic implementation and use are still limited. A project titled "Safer Working Management" (111298) was conducted in a Finnish hospital district, across 3 mental health units. The 6 steps of OMRU were followed during implementation of the Dynamic Appraisal of Situational Aggression (DASA). Nurses' views toward structured violence risk assessment procedures varied. Although implementation of the DASA was seen as a useful method to increase discussions with patients and nursing staff, some staff preferred their own clinical judgment for assessment of violence risk. It is possible to use a specific model to promote the implementation of risk assessment instruments in mental health units. However, the complex mental health inpatient environment and the difficulties in understanding and managing aggressive patients present challenges for the implementation of structured violence risk assessment methods. The OMRU provides a tool for clinical nurse specialists to guide implementation process in mental health units. Clinical nurse specialists must promote training for staff regarding use of new innovations, such as the DASA. Implementation processes should be reviewed so that clinical nurse specialists can lead and support mental health staff to properly use structured violence risk assessment measures.
Lyon, Aaron R; Connors, Elizabeth; Jensen-Doss, Amanda; Landes, Sara J; Lewis, Cara C; McLeod, Bryce D; Rutt, Christopher; Stanick, Cameo; Weiner, Bryan J
2017-09-01
The advancement of implementation science is dependent on identifying assessment strategies that can address implementation and clinical outcome variables in ways that are valid, relevant to stakeholders, and scalable. This paper presents a measurement agenda for implementation science that integrates the previously disparate assessment traditions of idiographic and nomothetic approaches. Although idiographic and nomothetic approaches are both used in implementation science, a review of the literature on this topic suggests that their selection can be indiscriminate, driven by convenience, and not explicitly tied to research study design. As a result, they are not typically combined deliberately or effectively. Thoughtful integration may simultaneously enhance both the rigor and relevance of assessments across multiple levels within health service systems. Background on nomothetic and idiographic assessment is provided as well as their potential to support research in implementation science. Drawing from an existing framework, seven structures (of various sequencing and weighting options) and five functions (Convergence, Complementarity, Expansion, Development, Sampling) for integrating conceptually distinct research methods are articulated as they apply to the deliberate, design-driven integration of nomothetic and idiographic assessment approaches. Specific examples and practical guidance are provided to inform research consistent with this framework. Selection and integration of idiographic and nomothetic assessments for implementation science research designs can be improved. The current paper argues for the deliberate application of a clear framework to improve the rigor and relevance of contemporary assessment strategies.
ERIC Educational Resources Information Center
Nichols, James O.
This is a collection of case studies on the implementation of institutional assessment and evaluation of student outcomes in higher education. The cases are drawn from eleven institutions. Research universities and four-year colleges included were: Clemson University (South Carolina), State University of New York (Albany), University of Kentucky…
Implementing Summative Assessment with a Formative Flavour: A Case Study in a Large Class
ERIC Educational Resources Information Center
Broadbent, Jaclyn; Panadero, Ernesto; Boud, David
2018-01-01
Teaching a large class can present real challenges in design, management and standardisation of assessment practices. One of the main dilemmas for university teachers is how to implement effective formative assessment practices with accompanying high-quality feedback consistently over time with large classroom groups. This article reports on how…
Problems and Prospects of Implementing Continuous Assessment at Adigrat University
ERIC Educational Resources Information Center
Berhe, Teklebrhan; Embiza, Samuel
2015-01-01
The purpose of the study is to assess the prospects and implementing continuous assessment (CA) in in higher education. Data were collected through a structured questionnaire from instructors and students of Adigrat University as well as Mekelle and Aksum Universities for comparison purpose. Both quantitative and qualitative data were carried out.…
ERIC Educational Resources Information Center
Modup, Ale Veronica; Sunday, Omirin Michael
2015-01-01
This study examined the practices and implementation of continuous assessment in Ekiti State Secondary Schools with special interest in Ado Local Government. The population for the study was the whole number of teachers in Ekiti State secondary school and the sample for the study was 160 secondary school teachers who were randomly selected from…
Sackey, Joachim; Zhang, Fang Fang; Rogers, Beatrice; Aryeetey, Richmond; Wanke, Christine
2018-05-01
In spite of the important role nutrition plays in the management of HIV, access to nutrition services is inadequate, especially in resource limited settings. In addition, nutrition programs for people living with HIV (PLWH) have not been sufficiently evaluated for efficacy and this study was conducted to address this gap. This study aimed to evaluate the implementation of the nutrition assessment, counseling and support (NACS) program in Accra, Ghana, and to assess whether the level of implementation of NACS was associated with the body mass index (BMI) of PLWH. A cross-sectional study was conducted in six HIV clinics (3 NACS designated and 3 non-NACS). Study participants were 152 adult PLWH at least 6 months on antiretroviral therapy and not pregnant or breastfeeding. Using a NACS implementation scale developed for this study ranging from 0 to 8 (a higher score indicating better NACS implementation), median NACS implementation score was not different between NACS-designated, and non-NACS HIV clinics (5 vs 4, p = 0.14). Almost half (47%) of the respondents were overweight or obese. A higher score on the NACS implementation scale was not significantly associated with overweight or obesity (BMI >24.9 kg/m 2 ) after adjusting for other covariates. It was concluded that, there was poor implementation of NACS in the NACS designated HIV clinics surveyed with no nutrition counseling offered nor food support available to those who might need it.
Bourbonnais, Anne; Ducharme, Francine; Landreville, Philippe; Michaud, Cécile; Gauthier, Marie-Andrée; Lavallée, Marie-Hélène
2018-03-01
Few studies have been conducted on strategies to promote the implementation of complex interventions in nursing homes (NHs). This article presents a pilot study intended to assess the strategies that would enable the optimal implementation of a complex intervention approach in NHs based on the meanings of screams of older people living with Alzheimer's disease. An action research approach was used with 19 formal and family caregivers from five NHs. Focus groups and individual interviews were held to assess different implementation strategies. A number of challenges were identified, as were strategies to overcome them. These latter included interactive training, intervention design, and external support. This study shows the feasibility of implementing a complex intervention to optimize older people's well-being. The article shares strategies that may promote the implementation of these types of interventions in NHs.
Kuyinu, Y A; Mohammed, A S; Adeyeye, O O; Odugbemi, B A; Goodman, O O; Odusanya, O O
2016-03-15
Tuberculosis infection among health care workers is capable of worsening the existing health human resource problems of low--and middle-income countries. Tuberculosis infection control is often weakly implemented in these parts of the world therefore, understanding the reasons for poor implementation of tuberculosis infection control guidelines are important. This study was aimed at assessing tuberculosis infection control practices and barriers to its implementation in Ikeja, Nigeria. A cross-sectional study in 20 tuberculosis care facilities (16 public and 4 private) in Ikeja, Lagos was conducted. The study included a facility survey to assess the availability of tuberculosis infection control guidelines, the adequacy of facilities to prevent transmission of tuberculosis and observations of practices to assess the implementation of tuberculosis infection control guidelines. Four focus group discussions were carried out to highlight HCWs' perceptions on tuberculosis infection control guidelines and barriers to its implementation. The observational study showed that none of the clinics had a tuberculosis infection control plan. No clinic was consistently screening patients for cough. Twelve facilities (60%) consistently provided masks to patients who were coughing. Ventilation in the waiting areas was assessed to be adequate in 60% of the clinics while four clinics (20%) possessed N-95 respirators. Findings from the focus group discussions showed weak managerial support, poor funding, under-staffing, lack of space and not wanting to be seen as stigmatizing against tuberculosis patients as barriers that hindered the implementation of TB infection control measures. Tuberculosis infection control measures were not adequately implemented in health facilities in Ikeja, Nigeria. A multi-pronged approach is required to address the identified barriers to the implementation of tuberculosis infection control guidelines.
ERIC Educational Resources Information Center
Day-Meeks, Angel LaKease
2011-01-01
This study investigated the implementation and impact of Reading First programs in 8 elementary schools across the state of Mississippi. The study assessed how principals, literacy coaches, and kindergarten through third grade teachers perceived the implementation of the Reading First program at their respective schools. Data from these three…
ERIC Educational Resources Information Center
Ateh, Comfort M.; Wyngowski, Aaron J.
2015-01-01
This article discusses the opportunity that the Common Core State Standards (CCSS) present for enhancing formative assessment (FA) in history and social studies classrooms. There is evidence that FA can enhance learning for students if implemented well. Unfortunately, teachers continue to be challenged in implementing FA in their classrooms. We…
ERIC Educational Resources Information Center
Abera, Gemechu; Kedir, Muhammed; Beyabeyin, Maeregu
2017-01-01
The study was aimed to investigate the implementations and challenges of continuous assessment in selected Public Universities of Eastern Ethiopia. Descriptive survey research design was employed to carry out this study because it is used to describe the characteristics of a given population in a systematic and accurate fashion. Stratified random…
ERIC Educational Resources Information Center
Pinger, Petra; Rakoczy, Katrin; Besser, Michael; Klieme, Eckhard
2018-01-01
The aim of this study was to contribute to the understanding of the effectiveness of formative assessment interventions by analysing how the "quality of programme delivery" affects students' mathematics achievement and interest. Teachers (n = 17) implemented formative assessment in their ninth-grade mathematics classes and provided their…
ERIC Educational Resources Information Center
Supovitz, Jonathan
2016-01-01
In this presentation discussed in this brief abstracted report, the author presents about an ongoing partnership with the Philadelphia School District (PSD) to implement and research the Ongoing Assessment Project (OGAP). OGAP is a systematic, intentional and iterative formative assessment system grounded in the research on how students learn…
ERIC Educational Resources Information Center
McLaughlin, Daniel; Smorodin, Calla; Smorodin, Ted; Timms, Mike
A study was conducted to determine how the Career Preparation Assessment portfolio (CPA), tailored to be used in local school reform efforts, was implemented in 10 schools in 1998-99. The research was organized and reported using these four clusters of research questions: tailoring the CPA, implementation, student performance and assessment, and…
ERIC Educational Resources Information Center
Yim, Su Yon; Cho, Young Hoan
2016-01-01
Despite the benefits of peer assessment, many teachers are not willing to implement it, particularly for low-achieving students. This study used the theory of planned behaviour to predict pre-service teachers' intention to use peer assessment for low-achieving students. A total of 229 pre-service teachers in Singapore participated in the survey…
Manser, Tanja; Frings, Janina; Heuser, Gregory; Mc Dermott, Fiona
2016-01-01
Despite the growing recognition of the need to implement systematic approaches for managing the risks associated with healthcare, few studies have investigated the level of implementation for clinical risk management (CRM) at a national level. Therefore, this study aimed to assess the current level of CRM implementation in German hospitals and to explore differences across hospital types. From March to June 2015, persons responsible for CRM in 2,617 hospitals and rehabilitation clinics in Germany were invited to participate in a voluntary online survey assessing the level of implementation for various aspects of CRM: CRM strategy, structures and processes; risk assessment (risk identification, risk analysis, risk evaluation) with a focus on incident reporting systems; risk mitigation measures; and risk monitoring and reporting. 572 hospitals participated in the survey (response rate 22 %). Most of these hospitals had a formalised, binding CRM strategy (72 %). 66 % had a centralised and 34 % a decentralised CRM structure. We also found that, despite a broad range of risk assessment methods being applied, there was a lack of integration of risk information from different data sources. Hospitals also reported a high level of implementation of critical incident reporting systems with a strong preference for local (74 %) over transorganisational systems. This study provides relevant data to inform targeted interventions concerning CRM implementation at a national level and to consider the specific context of different types of hospitals more carefully in this process. The approach to CRM assessment illustrated in this article could be the basis of a system for monitoring CRM over time and, thus, for evaluating the impact of strategy decisions at the policy level on CRM development. Copyright © 2016. Published by Elsevier GmbH.
Wolfenden, Luke; Finch, Meghan; Nathan, Nicole; Weaver, Natasha; Wiggers, John; Yoong, Sze Lin; Jones, Jannah; Dodds, Pennie; Wyse, Rebecca; Sutherland, Rachel; Gillham, Karen
2015-09-01
Many early childhood education and care (ECEC) services fail to implement recommended policies and practices supportive of healthy eating and physical activity. The purpose of this study was to assess whether certain theoretically-based factors are associated with implementation of healthy eating and physical activity policies and practices in a sample of ECEC services. A cross-sectional survey was conducted with Service Managers of ECEC services. The survey assessed the operational characteristics, policy, and practice implementation, and 13 factors were suggested by Damschroder's Consolidated Framework for Implementation Research to impede or promote implementation. Logistic regression analyses found a significant association between implementation factor score and full implementation (OR 1.38; 95% CI 1.18-1.61; p = <0.01), indicating that for every one point increase in implementation score, ECEC services were 38 % more likely to be fully implementing the policies and practices. The findings highlight the opportunities for improving implementation of obesity prevention interventions in this setting by developing interventions that address such factors.
Palinkas, Lawrence A; Campbell, Mark; Saldana, Lisa
2018-01-01
Background: This study examined influences on the decisions of administrators of youth-serving organizations to initiate and proceed with implementation of an evidence-based practice (EBP). Methods: Semi-structured interviews, developed using the Stages of Implementation Completion (SIC) as a framework, were conducted with 19 agency chief executive officers and program directors of 15 organizations serving children and adolescents. Results: Agency leaders' self-assessments of implementation feasibility and desirability prior to implementation (Pre-implementation) were influenced by intervention affordability, feasibility, requirements, validity, reliability, relevance, cost savings, positive outcomes, and adequacy of information; availability of funding, support from sources external to the agency, and adequacy of technical assistance; and staff availability and attitudes toward innovation in general and EBPs in particular, organizational capacity, fit between the EBP and agency mission and capacity, prior experience with implementation, experience with seeking evidence, and developing consensus. Assessments during the Implementation phase included intervention flexibility and requirements; availability of funding, adequacy of training and technical assistance, and getting sufficient and appropriate referrals; and staffing and implementing with fidelity. Assessments during the Sustainment phase included intervention costs and benefits; availability of funding, support from sources outside of the agency, and need for the EBP; and the fit between the EBP and the agency mission. Discussion: The results point to opportunities for using agency leader models to develop strategies to facilitate implementation of evidence-based and innovative practices for children and adolescents. The SIC provides a standardized framework for guiding agency leader self-assessments of implementation.
Palinkas, Lawrence A.; Campbell, Mark; Saldana, Lisa
2018-01-01
Background: This study examined influences on the decisions of administrators of youth-serving organizations to initiate and proceed with implementation of an evidence-based practice (EBP). Methods: Semi-structured interviews, developed using the Stages of Implementation Completion (SIC) as a framework, were conducted with 19 agency chief executive officers and program directors of 15 organizations serving children and adolescents. Results: Agency leaders' self-assessments of implementation feasibility and desirability prior to implementation (Pre-implementation) were influenced by intervention affordability, feasibility, requirements, validity, reliability, relevance, cost savings, positive outcomes, and adequacy of information; availability of funding, support from sources external to the agency, and adequacy of technical assistance; and staff availability and attitudes toward innovation in general and EBPs in particular, organizational capacity, fit between the EBP and agency mission and capacity, prior experience with implementation, experience with seeking evidence, and developing consensus. Assessments during the Implementation phase included intervention flexibility and requirements; availability of funding, adequacy of training and technical assistance, and getting sufficient and appropriate referrals; and staffing and implementing with fidelity. Assessments during the Sustainment phase included intervention costs and benefits; availability of funding, support from sources outside of the agency, and need for the EBP; and the fit between the EBP and the agency mission. Discussion: The results point to opportunities for using agency leader models to develop strategies to facilitate implementation of evidence-based and innovative practices for children and adolescents. The SIC provides a standardized framework for guiding agency leader self-assessments of implementation. PMID:29896471
NASA Technical Reports Server (NTRS)
1976-01-01
The engineering analyses and evaluation studies conducted for the Software Requirements Analysis are discussed. Included are the development of the study data base, synthesis of implementation approaches for software required by both mandatory onboard computer services and command/control functions, and identification and implementation of software for ground processing activities.
Somme, Dominique; Trouvé, Hélène; Perisset, Catherine; Corvol, Aline; Ankri, Joël; Saint-Jean, Olivier; de Stampa, Matthieu
2014-01-01
Introduction Many countries face ageing-related demographic and epidemiological challenges, notably neurodegenerative disorders, due to the multiple care services they require, thereby pleading for a more integrated system of care. The integrated Quebecois method issued from the Programme of Research to Integrate Services for the Maintenance of Autonomy inspired a French pilot experiment and the National Alzheimer Plan 2008–2012. Programme of Research to Integrate Services for the Maintenance of Autonomy method implementation was rated with an evaluation grid adapted to assess its successive degrees of completion. Discussion The approaching end of the president's term led to the method's institutionalization (2011–2012), before the implementation study ended. When the government changed, the study was interrupted. The results extracted from that ‘lost’ study (presented herein) have, nonetheless, ‘found’ some key lessons. Key lessons/conclusion It was possible to implement a Quebecois integrated-care method in France. We describe the lessons and pitfalls encountered in adapting this evaluation tool. This process is necessarily multidisciplinary and requires a test phase. A simple tool for quantitative assessment of integration was obtained. The first assessment of the tool was unsatisfactory but requires further studies. In the meantime, we recommend using mixed methodologies to assess the services integration level. PMID:24959112
ERIC Educational Resources Information Center
Jerotich, Florah; Kurgat, Susan J.; Kimutai, Chris K.
2017-01-01
The main purpose of this paper was to assess teacher preparedness in the implementation of the integrated Business Studies curriculum in public secondary schools in Kenya. Specifically, the study sought to: find out the level of preservice training of the Business Studies teachers implementing the integrated Business Studies curriculum and to find…
Shooshtari, Shahin; Temple, Beverley; Waldman, Celeste; Abraham, Sneha; Ouellette-Kuntz, Héléne; Lennox, Nicholas
2017-07-01
No standardized tool is used in Canada for comprehensive health assessments of adults with intellectual disabilities. This study was conducted to determine the feasibility of implementing the Comprehensive Health Assessment Program (CHAP) in Manitoba, Canada. This was a qualitative study using a purposive sample of physicians, nurse practitioners, support workers and families. Data were collected through individual interviews and focus groups and were analysed using content analysis. Use of the CHAP was perceived as beneficial for persons with intellectual disabilities. Improved continuity of care was of the reported benefits. Six barriers for the future implementation of the CHAP were identified including the time required to complete the CHAP, and the perceived lack of physicians' willingness to do comprehensive assessments. The future implementation of the CHAP was strongly supported. For its successful implementation, training of healthcare professionals and support staff and change in regulations and policies were recommended. © 2016 John Wiley & Sons Ltd.
Welsh, Wayne N; Lin, Hsiu-Ju; Peters, Roger H; Stahler, Gerald J; Lehman, Wayne E K; Stein, Lynda A R; Monico, Laura; Eggers, Michele; Abdel-Salam, Sami; Pierce, Joshua C; Hunt, Elizabeth; Gallagher, Colleen; Frisman, Linda K
2015-07-01
This implementation study examined the impact of an organizational process improvement intervention (OPII) on a continuum of evidence based practices related to assessment and community reentry of drug-involved offenders: Measurement/Instrumentation, Case Plan Integration, Conveyance/Utility, and Service Activation/Delivery. To assess implementation outcomes (staff perceptions of evidence-based assessment practices), a survey was administered to correctional and treatment staff (n=1509) at 21 sites randomly assigned to an Early- or Delayed-Start condition. Hierarchical linear models with repeated measures were used to examine changes in evidence-based assessment practices over time, and organizational characteristics were examined as covariates to control for differences across the 21 research sites. Results demonstrated significant intervention and sustainability effects for three of the four assessment domains examined, although stronger effects were obtained for intra- than inter-agency outcomes. No significant effects were found for Conveyance/Utility. Implementation interventions such as the OPII represent an important tool to enhance the use of evidence-based assessment practices in large and diverse correctional systems. Intra-agency assessment activities that were more directly under the control of correctional agencies were implemented most effectively. Activities in domains that required cross-systems collaboration were not as successfully implemented, although longer follow-up periods might afford detection of stronger effects. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
ERIC Educational Resources Information Center
Bresciani, Marilee J.
2011-01-01
The purpose of this study was to explore the manner in which a community college district planned to implement a systematic outcomes-based assessment program review process in order to have results inform institutional, district, and state policy discussions. Data derived from this grounded theory study indicated that there was not a shared…
ERIC Educational Resources Information Center
Guaglianone, Curtis L.; Payne, Maggie; Kinsey, Gary W.; Chiero, Robin
2009-01-01
This article is based on the perceptions of California State University administrators and provides a comparative study of the challenges and benefits resulting from the implementation of the teaching performance assessment requirement of SB 2042 standards 19-21 on the California State University (CSU) campuses. With 23 campuses and almost 450,000…
ERIC Educational Resources Information Center
Schütze, Birgit; Rakoczy, Katrin; Klieme, Eckhard; Besser, Michael; Leiss, Dominik
2017-01-01
Formative assessment has been identified as a promising intervention to support students' learning. How to successfully implement this means of assessment, however, is still an open issue. This study contributes to the implementation of formative assessment by analyzing the impact of a training measure on teachers' formative feedback practice,…
How best to measure implementation of school health curricula: a comparison of three measures.
Resnicow, K; Davis, M; Smith, M; Lazarus-Yaroch, A; Baranowski, T; Baranowski, J; Doyle, C; Wang, D T
1998-06-01
The impact of school health education programs is often attenuated by inadequate teacher implementation. Using data from a school-based nutrition education program delivered in a sample of fifth graders, this study examines the discriminant and predictive validity of three measures of curriculum implementation: class-room observation of fidelity, and two measures of completeness, teacher self-report questionnaire and post-implementation interview. A fourth measure, obtained during teacher observations, that assessed student and teacher interaction and student receptivity to the curriculum (labeled Rapport) was also obtained. Predictive validity was determined by examining the association of implementation measures with three study outcomes; health knowledge, asking behaviors related to fruit and vegetables, and fruit and vegetable intake, assessed by 7-day diary. Of the 37 teachers observed, 21 were observed for two sessions and 16 were observed once. Implementation measures were moderately correlated, an indication of discriminant validity. Predictive validity analyses indicated that the observed fidelity, Rapport and interview measures were significantly correlated with post-test student knowledge. The association between health knowledge and observed fidelity (based on dual observation only), Rapport and interview measures remained significant after adjustment for pre-test knowledge values. None of the implementation variables were significantly associated with student fruit and vegetable intake or asking behaviors controlling for pre-test values. These results indicate that the teacher self-report questionnaire was not a valid measure of implementation completeness in this study. Post-implementation completeness interviews and dual observations of fidelity and Rapport appear to be more valid, and largely independent methods of implementation assessment.
Kramer, Teresa L; Drummond, Karen L; Curran, Geoffrey M; Fortney, John C
2017-01-01
This study examines organizational factors relating to climate and culture that might facilitate or impede the implementation of evidence-based practices (EBP) targeting behavioral health in federally qualified health centers (FQHCs). Employees at six FQHCs participating in an evidence-based quality improvement (EBQI) initiative for mood disorders and alcohol abuse were interviewed (N=32) or surveyed using the Organizational Context Survey (OCS) assessing culture and climate (N=64). The FQHCs scored relatively well on proficiency, a previously established predictor of successful EBP implementation, but also logged high scores on scales assessing rigidity and resistance, which may hinder implementation. Qualitative data contextualized scores on FQHC culture and climate dimensions. Results suggest that the unique culture of FQHCs may influence implementation of evidence-based behavioral health interventions.
Ontology for assessment studies of human-computer-interaction in surgery.
Machno, Andrej; Jannin, Pierre; Dameron, Olivier; Korb, Werner; Scheuermann, Gerik; Meixensberger, Jürgen
2015-02-01
New technologies improve modern medicine, but may result in unwanted consequences. Some occur due to inadequate human-computer-interactions (HCI). To assess these consequences, an investigation model was developed to facilitate the planning, implementation and documentation of studies for HCI in surgery. The investigation model was formalized in Unified Modeling Language and implemented as an ontology. Four different top-level ontologies were compared: Object-Centered High-level Reference, Basic Formal Ontology, General Formal Ontology (GFO) and Descriptive Ontology for Linguistic and Cognitive Engineering, according to the three major requirements of the investigation model: the domain-specific view, the experimental scenario and the representation of fundamental relations. Furthermore, this article emphasizes the distinction of "information model" and "model of meaning" and shows the advantages of implementing the model in an ontology rather than in a database. The results of the comparison show that GFO fits the defined requirements adequately: the domain-specific view and the fundamental relations can be implemented directly, only the representation of the experimental scenario requires minor extensions. The other candidates require wide-ranging extensions, concerning at least one of the major implementation requirements. Therefore, the GFO was selected to realize an appropriate implementation of the developed investigation model. The ensuing development considered the concrete implementation of further model aspects and entities: sub-domains, space and time, processes, properties, relations and functions. The investigation model and its ontological implementation provide a modular guideline for study planning, implementation and documentation within the area of HCI research in surgery. This guideline helps to navigate through the whole study process in the form of a kind of standard or good clinical practice, based on the involved foundational frameworks. Furthermore, it allows to acquire the structured description of the applied assessment methods within a certain surgical domain and to consider this information for own study design or to perform a comparison of different studies. The investigation model and the corresponding ontology can be used further to create new knowledge bases of HCI assessment in surgery. Copyright © 2014 Elsevier B.V. All rights reserved.
Ament, Stephanie M C; de Kok, Mascha; van de Velde, Cornelis J H; Roukema, Jan A; Bell, Toine V R J; van der Ent, Fred W; van der Weijden, Trudy; von Meyenfeldt, Maarten F; Dirksen, Carmen D
2015-05-27
Despite the increased attention for assessing the effectiveness of implementation strategies, most implementation studies provide little or no information on its associated costs. The focus of the current study was to provide a detailed report of the resource use and costs associated with implementation of a short stay programme for breast cancer surgery in four Dutch hospitals. The analysis was performed alongside a multi-centre implementation study. The process of identification, measurement and valuation of the implementation activities was based on recommendations for the design, analysis and reporting of health technology assessments. A scoring form was developed to prospectively determine the implementation activities at professional and implementation expert level. A time horizon of 5 years was used to calculate the implementation costs per patient. Identified activities were consisted of development and execution of the implementation strategy during the implementation project. Total implementation costs over the four hospitals were €83.293. Mean implementation costs, calculated for 660 patients treated over a period of 5 years, were €25 per patient. Subgroup analyses showed that the implementation costs ranged from €3.942 to €32.000 on hospital level. From a local hospital perspective, overall implementation costs were €21 per patient, after exclusion of the costs made by the expert centre. We provided a detailed case description of how implementation costs can be determined. Notable differences in implementation costs between hospitals were observed. ISRCTN77253391.
Arora, Prerna G; Connors, Elizabeth H; George, Melissa W; Lyon, Aaron R; Wolk, Courtney B; Weist, Mark D
2016-12-01
Evidence-based assessment (EBA) is a critically important aspect of delivering high-quality, school-based mental health care for youth. However, research in this area is limited and additional applied research on how best to support the implementation of EBA in school mental health (SMH) is needed. Accordingly, this manuscript seeks to facilitate the advancement of research on EBA in SMH by reviewing relevant literature on EBA implementation in schools and providing recommendations for key research priorities. Given the limited number of published studies available, findings from child and adolescent mental health and implementation science research are also included to inform a robust and comprehensive research agenda on this topic. Based on this literature review, five priorities for research on EBA in SMH are outlined: (1) effective identification of assessment targets, (2) appropriate selection of assessment measures, (3) investigation of organizational readiness for EBA, (4) study of implementation support for EBA, and (5) promotion of EBA data integration and use. Each priority area includes recommended directions for future research. A comprehensive and robust research agenda is warranted to build the science and practice of implementing EBA in SMH. Specific directions for this agenda are offered.
Gas Turbine Engine Production Implementation Study : Volume 1. Executive Summary.
DOT National Transportation Integrated Search
1973-07-01
The report presents an assessment of available information pertaining to implementing mass production of gas turbine powered automobiles. The status of the technology and implementation schedule visibility reported herein is that existing at the time...
Gas Turbine Engine Production Implementation Study : Volume 2. Technical Discussion.
DOT National Transportation Integrated Search
1973-07-01
This report presents a summarization and assessment of available information pertaining to the potential for implementing mass production of gas turbine engine-powered automobiles. The main topic covered is the schedule requirement for that implement...
Stab, Nicole; Hacker, Winfried
2018-05-01
The main goal of the study was to apply and analyse a moderated participatory small-group procedure with registered nurses, which aims at the development and implementation of measures to improve work organisation in hospital wards and nursing units. Participation in job redesign is an essential prerequisite of the successful implementation of improvement measures in nursing. The study was carried out in a public hospital of maximum care in Germany. We selected 25 wards with the most critical reported exhaustion and general health and applied a series of moderated small-group sessions in which the registered nurses jointly identified deficits in their work organisation, developed improvement measures, and then implemented and assessed them. Registered nurses of 22 wards actively took part in the small-group procedure. All nursing units jointly identified organisational deficits, developed possible improvement measures, and implemented them. The nursing teams then evaluated the implemented measures which were already assessable at the end of our research period; nearly all (99.0%) showed improvements, while 69.4% actually attained the desired goals. Participatory small-group activities may be successfully applied in hospital nursing in order to improve work organisation. Participatory assessment and redesign of nurses' work organisation should be integrated into regular team meetings. The nursing management should actively support the implementation process. © 2018 John Wiley & Sons Ltd.
Developing a Fidelity of Implementation Measure for the "Responsive Classroom" Approach
ERIC Educational Resources Information Center
Nathanson, Lori
2009-01-01
This study examines the psychometric properties, reliability, and validity of a measure designed to assess fidelity of implementation of the "Responsive Classroom"[R] ("RC") approach. The Classroom Practices Teacher Survey (CPTS) assesses teachers' use of the "RC" approach, a social and emotional learning (SEL) intervention currently under…
Surveying the Commons: Current Implementation of Information Commons Web sites
ERIC Educational Resources Information Center
Leeder, Christopher
2009-01-01
This study assessed the content of 72 academic library Information Commons (IC) Web sites using content analysis, quantitative assessment and qualitative surveys of site administrators to analyze current implementation by the academic library community. Results show that IC Web sites vary widely in content, design and functionality, with few…
Making It Personal: Performance-Based Assessments, Ubiquitous Technology, and Advanced Learners
ERIC Educational Resources Information Center
Arispe, Kelly; Burston, Jack
2017-01-01
This pedagogical implementation study advocates for performance-driven assessments to help learners become aware of and improve upon presentational speaking skills at the advanced level. A social media content creation tool, Adobe Spark Video, enabled learners to practice oral skills outside of class. The task design, implementation, and…
Assessing Support for Campus Tobacco Policy in Tobacco Country
ERIC Educational Resources Information Center
Whipple, Kerry; Simmons, Susan J.; Caldwell, Rebecca; Dowd, Deborah
2010-01-01
Introduction: Implementation of comprehensive tobacco policies has shown positive results regarding limiting exposure to secondhand smoke. While many states were moving forward with respect to implementation of tobacco policies, North Carolina has lagged behind in this regard. Purpose: The purpose of this study was to assess support for a…
Amblàs-Novellas, Jordi; Casas, Sílvia; Catalán, Rosa María; Oriol-Ruscalleda, Margarita; Lucchetti, Gianni Enrico; Quer-Vall, Francesc Xavier
2016-01-01
Shared decision-making between patients and healthcare professionals is crucial to guarantee adequate coherence between patient values and preferences, caring aims and treatment intensity, which is key for the provision of patient-centred healthcare. The assessment of such interventions are essential for caring continuity purposes. To do this, reliable and easy-to-use assessment systems are required. This study describes the results of the implementation of a hospital treatment intensity assessment tool. The pre-implementation and post-implementation results were compared between two cohorts of patients assessed for one month. Some record of care was registered in 6.1% of patients in the pre-implementation group (n=673) compared to 31.6% of patients in the post-implementation group (n=832) (P<.01), with differences between services. Hospital mortality in both cohorts is 1.9%; in the pre-implementation group, 93.75% of deceased patients had treatment intensity assessment. In hospital settings, the availability of a specific tool seems to encourage very significantly shared decision-making processes between patients and healthcare professionals -multiplying by more than 5 times the treatment intensity assessment. Moreover, such tools help in the caring continuity processes between different teams and the personalisation of caring interventions to be monitored. More research is needed to continue improving shared decision-making for hospital patients. Copyright © 2015 SEGG. Published by Elsevier Espana. All rights reserved.
ERIC Educational Resources Information Center
Hanley, Tom V., Ed.; And Others
1984-01-01
Ten information bulletins on the implementation of microcomputers in special education are presented. Topics covered include the following: (1) implementation issues (including a description of a study assessing microcomputer applications in 12 local school districts' special education programs); (2) implementation strategies (which focuses on…
Weigl, M; Müller, A; Angerer, P; Petru, R
2016-03-01
The implementation of psychosocial risk assessment at the workplace often fails in practice. One reason is the lack of competence of those who are in charge of the process. We present a checklist for the effective implementation of psychosocial risk assessment at workplace. This tool shall support occupational physicians in the preparation, planning and implementation of a psychosocial risks assessment process. Based on a stepwise development and validation process, specific steps and factors for the successful implementation were identified qualitatively with 15 occupational physicians and experts. This was conducted in a 2-stage Delphi study. In the following, the identified steps and factors were transferred into a checklist. Subsequently, the checklist was evaluated in a focus group of occupational physicians (user evaluation). Thereafter, the contents were subjected to an expert evaluation. Our checklist for the effective implementation of the process of psychosocial risk management in the workplace aims to strengthen the competence of occupational physicians, especially in the implementation of risk assessments in small and medium-sized enterprises (SMEs). © Georg Thieme Verlag KG Stuttgart · New York.
ERIC Educational Resources Information Center
Merkel-Keller, Claudia
This paper examines the study plan for the National Assessment of Vocational Education (NAVE) and outlines some of the preliminary results that have been determined to date. According to the paper, the NAVE has identified five broad areas in which to conduct research: (1) implementation of the Carl D. Perkins Vocational Education Act; (2)…
Peltea, Alexandra; Berghea, Florian; Gudu, Tania; Ionescu, Ruxandra
2016-12-05
To identify and analyse existing data regarding knee ultrasound (US) feasibility in clinical practice. Material and methods: A systematic literature review was performed using the terms: ("knee") AND ("ultrasound" OR "ultrasonography") AND ("feasibility" OR "pilot" OR "proof of concept"). Feasibility studies regarding knee US or US aided maneuver involving knee joint, published during 2005-2015, were selected and evaluated against a complex framework constructed around mandatory key areas for feasibility studies: acceptability, demand, implementation, practicality, adaptation, integration and expansion. One hundred and fifty-nine publications were identified, of which 9 were included in the final analysis: 6 dealt with the development and implementation of novel US scores, while the rest focused on implementing MSUS in clinical practice, evaluating the usefulness of articular cartilage US assessment and the feasibility of sonography for intra-articular knee injections, respectively. Six studies quantified feasibility as time spent for the evaluation, with only two addressing areassuch as acceptability, implementation and practicality, although none of these systematically assessed all feasibility domains. Knee US feasibility is still poorly addressed; the time required for US assessment is the main area addressed. This information gap should be properly addressed in future works, in order to ensure the right place for this technique.
Web-Based System for Adaptable Rubrics: Case Study on CAD Assessment
ERIC Educational Resources Information Center
Company, Pedro; Contero, Manuel; Otey, Jeffrey; Camba, Jorge D.; Agost, María-Jesús; Pérez-López, David
2017-01-01
This paper describes the implementation and testing of our concept of adaptable rubrics, defined as analytical rubrics that arrange assessment criteria at multiple levels that can be expanded on demand. Because of its adaptable nature, these rubrics cannot be implemented in paper formats, neither are they supported by current Learning Management…
National Assessments for Student Teachers: Documenting Teaching Readiness to the Tipping Point
ERIC Educational Resources Information Center
Margolis, Jason; Doring, Anne
2013-01-01
To evaluate the impact of the emergent national teacher performance assessment (TPA) on student teachers, this study examined a pilot implementation at one university in Washington State during Spring 2011. The qualitative research focused on the lived experience of those directly affected by TPA implementation: student teachers, mentor teachers,…
ERIC Educational Resources Information Center
Bresciani, Marilee J.
2011-01-01
The purpose of this grounded theory study was to identify the typical barriers encountered by faculty and administrators when implementing outcomes-based assessment program review. An analysis of interviews with faculty and administrators at nine institutions revealed a theory that faculty and administrators' promotion, tenure (if applicable),…
Learning by Doing: Developing a Baseline Information Literacy Assessment
ERIC Educational Resources Information Center
Kiel, Stephen; Burclaff, Natalie; Johnson, Catherine
2015-01-01
This paper details the design and implementation of an initial baseline assessment of information literacy skills at the University of Baltimore in Maryland. To provide practical advice and experience for a novice audience, the authors discuss how they approached the design and implementation of the study through the use of a rubric-based…
Implementation of a Posted Schedule to Increase Class-Wide Interobserver Agreement Assessment
ERIC Educational Resources Information Center
Doucette, Stefanie; DiGennaro Reed, Florence D.; Reed, Derek D.; Maguire, Helena; Marquardt, Heidi
2012-01-01
The present study investigated the impact of an antecedent intervention in the form of a daily posted schedule on the interobserver agreement (IOA) assessment of educational goals implemented within a classroom at a private school serving individuals with disabilities. During baseline, the percentage of academic goals with interobserver agreement…
Assessing Fidelity of Implementation of an Unprescribed, Diagnostic Mathematics Intervention
ERIC Educational Resources Information Center
Munter, Charles; Wilhelm, Anne Garrison; Cobb, Paul; Cordray, David S.
2014-01-01
This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…
Implementation of Positive Behavior Support with a Sibling Set in a Home Environment
ERIC Educational Resources Information Center
Duda, Michelle A.; Clarke, Shelley; Fox, Lise; Dunlap, Glen
2008-01-01
This study provides a demonstration of the process of positive behavior support (PBS) within a home setting to address the challenging behavior of a sibling set within family routines. Although a growing data base is demonstrating the feasibility and effectiveness of conducting functional behavioral assessment and implementing assessment-based…
ERIC Educational Resources Information Center
Chandler-Olcott, Kelly; Fleming, Sarah
2017-01-01
Drawing on situated learning and communities of practice, this teacher-research study examined multiple stakeholders' perspectives about the purpose, design, and inaugural implementation of the edTPA, a teacher performance assessment mandated for state certification. Participants included teacher candidates, mentor teachers, a field placement…
Implementing a clinical ethics needs assessment survey: results of a pilot study (part 2 of 2).
Frolic, Andrea; Andreychuk, Sandra; Seidlitz, Wendy; Djuric-Paulin, Angela; Flaherty, Barb; Jennings, Barb; Peace, Donna
2013-03-01
This paper details the implementation of the Clinical Ethics Needs Assessment Survey (CENAS) through a pilot study in five units within Hamilton Health Sciences. We describe how these pilot sites were selected, how we implemented the survey, the significant results and our interpretation of the findings. The primary goal of this paper is to share our experiences using this tool, specifically the challenges we encountered conducting a staff ethics needs assessment across different units in a large teaching hospital, and the facilitators to our success. We conclude with a discussion of the limitations of this study, our plans for using the results to develop a proactive ethics education strategy, and suggestions for other organizations wishing to adapt the CENAS to assess their staff ethics needs. Our secondary goal is to advance the "quality agenda" for ethics programs by demonstrating how a tool like the CENAS can be used to design more effective educational interventions, and to support strategic planning and proactive priority-setting for ethics programs.
ERIC Educational Resources Information Center
Ruiz, María Isolina; Smith, Traci N.; Naquin, Gale M.; Morgan-D'Atrio, Cynthia; Dellinger, Amy B.
2014-01-01
Implementation fidelity is crucial to the success of behavioral interventions. However, measuring and maintaining intervention implementation fidelity in schools' natural settings can be challenging. This article reports findings from a study examining the implementation fidelity of check-in check-out interventions at an urban school district…
Assessing Legislative Control of Bureaucracy: The Implementation Contract.
ERIC Educational Resources Information Center
Wohlstetter, Priscilla
Findings from a study that explored the motivations of legislators to oversee and control program implementation are presented in this paper. Implementation is viewed as a contract between the legislative and executive branches with legislators acting as monitors who use oversight to control the agencies contracted to implement policy. A total of…
DOE Office of Scientific and Technical Information (OSTI.GOV)
Larrey-Lassalle, Pyrène, E-mail: pyrene.larrey-lassalle@irstea.fr; LGEI, Ecole des mines d'Alès, 6 avenue de Clavières, 30319 Alès Cedex; Catel, Laureline
Life Cycle Assessment (LCA) has been identified in the literature as a promising tool to increase the performance of environmental assessments at different steps in the Environmental Impact Assessment (EIA) procedure. However, few publications have proposed a methodology for an extensive integration, and none have compared the results with existing EIA conclusions without LCA. This paper proposes a comprehensive operational methodology for implementing an LCA within an EIA. Based on a literature review, we identified four EIA steps that could theoretically benefit from LCA implementation, i.e., (a) the environmental comparison of alternatives, (b) the identification of key impacts, (c) themore » impact assessment, and (d) the impact of mitigation measures. For each of these steps, an LCA was implemented with specific goal and scope definitions that resulted in a specific set of indicators. This approach has been implemented in two contrasting Wastewater Treatment Plant (WWTP) projects and compared to existing EIA studies. The results showed that the two procedures, i.e., EIAs with or without inputs from LCA, led to different conclusions. The environmental assessments of alternatives and mitigation measures were not carried out in the original studies and showed that other less polluting technologies could have been chosen. Regarding the scoping step, the selected environmental concerns were essentially different. Global impacts such as climate change or natural resource depletion were not taken into account in the original EIA studies. Impacts other than those occurring on the project site (off-site impacts) were not assessed, either. All these impacts can be significant compared to those initially considered. On the other hand, unlike current LCA applications, EIAs usually address natural and technological risks and neighbourhood disturbances such as noises or odours, which are very important for the public acceptability of projects. Regarding the impact assessment, even if the conclusions of the EIAs with or without LCA were partially common for local on-site impacts, LCA gives crucial additional information on global and off-site impacts and highlights the processes responsible for them. Finally, for all EIA steps investigated, interest in LCA was demonstrated for both WWTP case studies. The feasibility in terms of skills, time and cost of such implementation has also been assessed. - Highlights: • An innovative methodology for a first-stage implementation of LCA in EIA is proposed. • Its applicability is demonstrated on two Wastewater Treatment Plant case studies. • The conclusions for the four EIA steps investigated differ with or without LCA. • LCA provides valuable additional information on 1) global and 2) off-site impacts. • LCA identifies pollution transfers towards a life cycle perspective.« less
Using portfolios to assess learning in chemistry: One school's story of evolving assessment practice
NASA Astrophysics Data System (ADS)
Weaver, Starlin Dawn
The purpose of this study was to investigate the process of implementing an alternative form of assessment in chemistry classrooms. The current reform of science education involves the implementation of varied forms of instruction; it stands to reason that assessment will evolve with the curriculum (Baxter, Shavelson, Goldman & Pine, 1992). In an era for which the exclusive use of multiple-choice and similar tests i.e., fill-in the-blank, matching, and true/false are inappropriate measures of student abilities (Hamm & Adams, 1991), portfolios can offer a suitable alternative assessment, as well as a means for evaluation (Paulson, Paulson & Meyer, 1991). This study was conducted in a small math, science and technology high school and focused on three individual teachers and twelve of their students. The research focused on how teachers defined portfolios and implemented this assessment tool in their classrooms and how students and teachers perceived the use and value of the process. This study employed qualitative methodology using individual interviews, document analyses, and classroom observations. Data sources included documents, transcripts of interviews and fieldnotes. The primary research questions were: How do the teachers define and implement portfolios? How do the teachers' definitions of portfolios change during implementation? What are the students' understandings of portfolios and how they are used and do the students' understandings change? What do teachers and students believe portfolios represent regarding the learning that occurs in the science classroom? and What do the data collected via this study demonstrate about portfolios as a valid means of assessing student progress? The teachers' and students' definitions addressed four of the six components of portfolios identified in the literature. Both groups recognized a defined use, evidence, student and teacher made decisions, and reflection as key portfolio elements. Each group failed to identify the components of a defined goal and teacher student conferences. Portfolios were viewed by the teachers and students as a valuable tool. This value was defined in terms of student self assessment and evaluation, teacher assessment and evaluation, college admission, goal setting, promotion of student organizational skills and recognition of student success.
Chen, Ke-Yu; Harniss, Mark; Patel, Shwetak; Johnson, Kurt
2014-03-01
The goal of the study was to investigate the accuracy, feasibility and acceptability of implementing an embedded assessment system in the homes of individuals aging with disabilities. We developed and studied a location tracking system, UbiTrack, which can be used for both indoor and outdoor location sensing. The system was deployed in the homes of five participants with spinal cord injuries, muscular dystrophy, multiple sclerosis and late effects of polio. We collected sensor data throughout the deployment, conducted pre and post interviews and collected weekly diaries to measure ground truth. The system was deployed successfully although there were challenges related to system installation and calibration. System accuracy ranged from 62% to 87% depending upon room configuration and number of wireless access points installed. In general, participants reported that the system was easy to use, did not require significant effort on their part and did not interfere with their daily lives. Embedded assessment has great potential as a mechanism to gather ongoing information about the health of individuals aging with disabilities; however, there are significant challenges to its implementation in real-world settings with people with disabilities that will need to be resolved before it can be practically implemented. Technology-based embedded assessment has the potential to promote health for adults with disabilities and allow for aging in place. It may also reduce the difficulty, cost and intrusiveness of health measurement. Many new commercial and non-commercial products are available to support embedded assessment; however, most products have not been well-tested in real-world environments with individuals aging with disability. Community settings and diverse population of people with disabilities pose significant challenges to the implementation of embedded assessment systems.
ERIC Educational Resources Information Center
de Jong, O. R. W.; Hopman-Rock, M.; Tak, E. C. M. P.; Klazinga, N. S.
2004-01-01
Implementation studies are recommended to assess the feasibility and effectiveness in real-life of programmes which have been tested in randomized controlled trials (RCTs). We report on an implementation study of two evidence-based exercise and health education programmes for older adults with osteoarthritis (OA) of the knee or hip. Three types of…
Lee, Rebekka M; Ramanadhan, Shoba; Kruse, Gina R; Deutsch, Charles
2018-01-01
Background: Strong partnerships are critical to integrate evidence-based prevention interventions within clinical and community-based settings, offering multilevel and sustainable solutions to complex health issues. As part of Massachusetts' 2012 health reform, The Prevention and Wellness Trust Fund (PWTF) funded nine local partnerships throughout the state to address hypertension, pediatric asthma, falls among older adults, and tobacco use. The initiative was designed to improve health outcomes through prevention and disease management strategies and reduce healthcare costs. Purpose: Describe the mixed-methods study design for investigating PWTF implementation. Methods: The Consolidated Framework for Implementation Research guided the development of this evaluation. First, the study team conducted semi-structured qualitative interviews with leaders from each of nine partnerships to document partnership development and function, intervention adaptation and delivery, and the influence of contextual factors on implementation. The interview findings were used to develop a quantitative survey to assess the implementation experiences of 172 staff from clinical and community-based settings and a social network analysis to assess changes in the relationships among 72 PWTF partner organizations. The quantitative survey data on ratings of perceived implementation success were used to purposively select 24 staff for interviews to explore the most successful experiences of implementing evidence-based interventions for each of the four conditions. Conclusions: This mixed-methods approach for evaluation of implementation of evidence-based prevention interventions by PWTF partnerships can help decision-makers set future priorities for implementing and assessing clinical-community partnerships focused on prevention.
Barker, Anna Lucia; Kamar, Jeannette; Tyndall, Tamara Jane; White, Lyn; Hutchinson, Anastasia; Klopfer, Nicole; Weller, Carolina
2013-06-01
Pressure ulcers are a common but preventable problem in hospitals. Implementation of best practice guideline recommendations can prevent ulcers from occurring. This 9-year cohort study reports prevalence data from point prevalence surveys during the observation period, and three practice metrics to assess implementation of best practice guideline recommendations: (i) nurse compliance with use of a validated pressure ulcer risk assessment and intervention checklist; (ii) accuracy of risk assessment scoring in usual-care nurses and experienced injury prevention nurses; and (iii) use of pressure ulcer prevention strategies. The prevalence of hospital-acquired pressure ulcers decreased following implementation of an evidence-based prevention programme from 12·6% (2 years preprogramme implementation) to 2·6% (6 years postprogramme implementation) (P < 0·001). Audits between 2003 and 2011 of 4368 patient medical records identified compliance with pressure ulcer prevention documentation according to best practice guidelines was high (>84%). A sample of 270 patients formed the sample for the study of risk assessment scoring accuracy and use of prevention strategies. It was found usual-care nurses under-estimated patients' risk of pressure ulcer development and under-utilised prevention strategies compared with experienced injury prevention nurses. Despite a significant reduction in prevalence of hospital-acquired pressure ulcers and high documentation compliance, use of prevention strategies could further be improved to achieve better patient outcomes. Barriers to the use of prevention strategies by nurses in the acute hospital setting require further examination. This study provides important insights into the knowledge translation of pressure ulcer prevention best practice guideline recommendations at The Northern Hospital. © 2012 The Authors. International Wound Journal © 2012 John Wiley & Sons Ltd and Medicalhelplines.com Inc.
Johnson, Stacy R; Pas, Elise T; Bradshaw, Catherine P; Ialongo, Nicholas S
2018-05-01
There is growing awareness of the importance of implementation fidelity and the supports, such as coaching, to optimize it. This study examined how coaching activities (i.e., check-ins, needs assessment, modeling, and technical assistance) related directly and indirectly to implementation dosage and quality of the PAX Good Behavior Game, via a mediating pathway through working relationship. Mediation analyses of 138 teachers revealed direct effects of modeling and working relationship on implementation dosage, whereas needs assessment was associated with greater dosage indirectly, by higher ratings of the working relationship. Understanding how coaching activities promote implementation fidelity elements has implications for improving program effectiveness.
Di Tecco, Cristina; Ronchetti, Matteo; Ghelli, Monica; Russo, Simone; Persechino, Benedetta
2015-01-01
Studies on Intervention Process Evaluation are attracting growing attention in the literature on interventions linked to stress and the wellbeing of workers. There is evidence that some elements relating to the process and content of an intervention may have a decisive role in implementing it by facilitating or hindering the effectiveness of the results. This study aimed to provide a process evaluation on interventions to assess and manage risks related to work-related stress using a methodological path offered by INAIL. The final sample is composed of 124 companies participating to an interview on aspects relating to each phase of the INAIL methodological path put in place to implement the intervention. INAIL methodology has been defined as useful in the process of assessing and managing the risks related to work-related stress. Some factors related to the process (e.g., implementation of a preliminary phase, workers' involvement, and use of external consultants) showed a role in significant differences that emerged in the levels of risk, particularly in relation to findings from the preliminary assessment. Main findings provide information on the key aspects of process and content that are useful in implementing an intervention for assessing and managing risks related to work-related stress. PMID:26504788
Di Tecco, Cristina; Ronchetti, Matteo; Ghelli, Monica; Russo, Simone; Persechino, Benedetta; Iavicoli, Sergio
2015-01-01
Studies on Intervention Process Evaluation are attracting growing attention in the literature on interventions linked to stress and the wellbeing of workers. There is evidence that some elements relating to the process and content of an intervention may have a decisive role in implementing it by facilitating or hindering the effectiveness of the results. This study aimed to provide a process evaluation on interventions to assess and manage risks related to work-related stress using a methodological path offered by INAIL. The final sample is composed of 124 companies participating to an interview on aspects relating to each phase of the INAIL methodological path put in place to implement the intervention. INAIL methodology has been defined as useful in the process of assessing and managing the risks related to work-related stress. Some factors related to the process (e.g., implementation of a preliminary phase, workers' involvement, and use of external consultants) showed a role in significant differences that emerged in the levels of risk, particularly in relation to findings from the preliminary assessment. Main findings provide information on the key aspects of process and content that are useful in implementing an intervention for assessing and managing risks related to work-related stress.
Neal, Jeremy L; Lowe, Nancy K; Nacht, Amy S; Koschoreck, Kate; Anderson, Jessica
2016-01-01
Neal and Lowe developed a physiologic partograph to give clinicians an evidence-based, uniform approach to assessing active labor progress and diagnosing dystocia in high-resource settings. The aim of this pilot study was to examine the feasibility of implementing the Neal and Lowe partograph for in-hospital labor assessment. A descriptive study of low-risk, nulliparous women with spontaneous labor onset was performed at an academic medical center. Eight certified nurse-midwives from a single practice used the Neal and Lowe partograph for the assessment of labor progress. Descriptive statistics were used to summarize characteristics, interventions, and outcomes for women with partograph-assessed labors. Labors assessed by nurse-midwives (n = 83) or obstetricians (n = 75) using their usual assessment strategies were also described for the year prior to partograph introduction to contextualize partograph-assessed labor findings. Inferential statistical tests were not performed. Thirty-one of 34 (91.2%) partographs were used correctly. Seventy-one percent (n = 22) of these women progressed to complete dilatation within expected physiologic time frames while the remaining women (n = 9) experienced labor dystocia. Similar proportions of women in the partograph and usual labor assessment groups received oxytocin during labor. The cesarean rate was lower in the partograph group than in the usual care groups. No cesareans were performed for dystocia in active labor for women whose labors were assessed via partograph. Implementation of the Neal and Lowe partograph for in-hospital labor assessment is feasible. Incorrect plotting and/or interpretation of the partograph may be further minimized by providing clinicians opportunities for ongoing partograph training after implementation or through partograph software development. The Neal and Lowe partograph may assist clinicians in safely and significantly decreasing primary cesarean births performed for active labor dystocia in high-resource settings. Larger scale, hypothesis-testing studies of partograph implementation are now warranted. © 2016 by the American College of Nurse-Midwives.
ERIC Educational Resources Information Center
Isom, Jamie
2012-01-01
The purpose of this explanatory mixed methods study was to explore the perceptions of Nebraska teachers about their experiences in the transition from STARS to NeSA. The study explored their perceptions of the influence of the transition on implementation of a balanced assessment system. As defined by NDE, a balanced system included NeSA testing,…
Technological changes in the healthcare sector. A method to assess change readiness.
Kristensen, M; Nøhr, C
2000-01-01
This paper describes the theory, method and recent results of a study developing methods for assessment of change readiness. The empirical focus is on development and implementation of clinical IT systems in the Danish healthcare sector. To assess change readiness, a questionnaire has been developed. The questionnaire has been tested in a hospital department as a part of a pre analysis related to development and implementation of an IT quality assurance system. The study shows a general positive attitude to the IT system and the organisational changes, related to the implementation and use of the system. It also supplies the project organisation with specific information, useful to the project organisation to continue the essential dialogue with the healthcare professionals during the change process. Furthermore it provides a useful tool for planning the ongoing developing processes. Several other healthcare organisations are at the moment entering the study.
NASA Astrophysics Data System (ADS)
Septiani, A.; Rustaman, N. Y.
2017-02-01
A descriptive study about the implementation of performance assessment in STEM based instruction was carried out to investigate the tenth grade of Vocational school students’ science process skills during the teaching learning processes. A number of tenth grade agriculture students was involved as research subjects selected through cluster random sampling technique (n=35). Performance assessment was planned on skills during the teaching learning process through observation and on product resulted from their engineering practice design. The procedure conducted in this study included thinking phase (identifying problem and sharing idea), designing phase, construction phase, and evaluation phase. Data was collected through the use of science process skills (SPS) test, observation sheet on student activity, as well as tasks and rubrics for performance assessment during the instruction. Research findings show that the implementation of performance assessment in STEM education in planting media could detect students science process skills better from the observation individually compared through SPS test. It was also found that the result of performance assessment was diverse when it was correlated to each indicator of SPS (strong and positive; weak and positive).
Williford, Amanda P; Wolcott, Catherine Sanger; Whittaker, Jessica Vick; Locasale-Crouch, Jennifer
2015-11-01
This study examined the relationship among baseline program and teacher characteristics and subsequent implementation of Banking Time. Banking Time is a dyadic intervention intended to improve a teacher's interaction quality with a specific child. Banking Time implementation was examined in the current study using a sample of 59 teachers and preschool children displaying disruptive behaviors in the classroom (~three children per classroom). Predictors included preschool program type, teacher demographic characteristics (personal and professional), and teacher beliefs (self-efficacy, authoritarian beliefs, and negative attributions about child disruptive behavior). Multiple measures and methods (i.e., teacher report, consultant report, independent observations) were used to assess implementation. We created three implementation composite measures (dosage, quality, and generalized practice) that had high internal consistencies within each composite but were only modestly associated with one another, suggesting unique constructs of implementation. We found that type of preschool program was associated with dosage and quality. Aspects of teacher demographics related to all three implementation composites. Teacher beliefs predicted dosage and generalized practice. Results suggest that the factors that predict the implementation of Banking Time vary as a function of the type of implementation being assessed.
ERIC Educational Resources Information Center
Fettig, Angel; Barton, Erin E.; Carter, Alice S.; Eisenhower, Abbey S.
2016-01-01
This study examined the effects of e-coaching on the implementation of a functional assessment-based intervention delivered by an early intervention provider in reducing challenging behaviors during home visits. A multiple baseline design across behavior support plan components was used with a provider-child dyad. The e-coaching intervention…
ERIC Educational Resources Information Center
Fettig, Angel; Schultz, Tia R.; Sreckovic, Melissa A.
2015-01-01
This study examined the effects of coaching on the implementation of functional assessment--based parent intervention in reducing children's challenging behaviors. A multiple baseline across participants design was used with three parent-child dyads with children between the ages of 2 and 5 years. The intervention consisted of training and delayed…
Expanding Support for Graduate Students: Library Workshops on Research Funding Opportunities
ERIC Educational Resources Information Center
Forbes, Carrie; Schlesselman-Tarango, Gina; Keeran, Peggy
2017-01-01
This case study describes the development, implementation, and assessment of a series of grants research workshops for graduate students, which were implemented to fill a gap in graduate student support. We assessed the workshops through a series of focus groups, and findings show overall satisfaction with the grants tools and workshop. However,…
ERIC Educational Resources Information Center
Burns, Rosemary
2010-01-01
The purpose of this research study was to investigate the level of implementation of formative assessment strategies among Rhode Island high school teachers and students in three districts. Furthermore, the research analyzed the relationship of the disciplines taught, the amount and kinds of professional development teachers had, and district…
ERIC Educational Resources Information Center
Keane, Marilyn N.
2012-01-01
This study examined the relation between implementation of Positive Behavior Intervention and Supports (PBIS) and academic achievement in middle school math as measured by the Maryland State Assessment (MSA). In particular, the correlation of academic achievement in mathematics, grouped by PBIS implementation status to race, socioeconomic status…
From FBA to Implementation: A Look at What Is Actually Being Delivered
ERIC Educational Resources Information Center
Blood, Erika; Neel, Richard S.
2007-01-01
This study looks at the utilization of assessments on developing behavior intervention plans (BIPs) and their use in designing actual implementation for the children (elementary through high school) labeled EBD in a mid-sized district in eastern Washington. Files were reviewed to determine the types of assessments used, FBA components addressed,…
Implementation of building information modeling in Malaysian construction industry
NASA Astrophysics Data System (ADS)
Memon, Aftab Hameed; Rahman, Ismail Abdul; Harman, Nur Melly Edora
2014-10-01
This study has assessed the implementation level of Building Information Modeling (BIM) in the construction industry of Malaysia. It also investigated several computer software packages facilitating BIM and challenges affecting its implementation. Data collection for this study was carried out using questionnaire survey among the construction practitioners. 95 completed forms of questionnaire received against 150 distributed questionnaire sets from consultant, contractor and client organizations were analyzed statistically. Analysis findings indicated that the level of implementation of BIM in the construction industry of Malaysia is very low. Average index method employed to assess the effectiveness of various software packages of BIM highlighted that Bentley construction, AutoCAD and ArchiCAD are three most popular and effective software packages. Major challenges to BIM implementation are it requires enhanced collaboration, add work to a designer, interoperability and needs enhanced collaboration. For improving the level of implementing BIM in Malaysian industry, it is recommended that a flexible training program of BIM for all practitioners must be created.
ERIC Educational Resources Information Center
Bast, Lotus S.; Due, Pernille; Ersbøll, Annette K.; Damsgaard, Mogens T.; Andersen, Anette
2017-01-01
Background: Assessment of implementation is essential for the evaluation of school-based preventive activities. Interventions are more easily implemented in schools if detailed instructional manuals, lesson plans, and materials are provided; however, implementation may also be affected by other factors than the intervention itself--for example,…
Carlfjord, Siw; Festin, Karin
2015-09-10
There is a need for new knowledge regarding determinants of a successful implementation of new methods in health care. The role of a receptive context for change to support effective diffusion has been underlined, and could be studied by assessing the organizational climate. The aim of this study was to assess the association between organizational climate when a computer-based lifestyle intervention tool (CLT) was introduced in primary health care (PHC) and the implementation outcome in terms of how the tool was perceived and used after 2 years. The CLT was offered to 32 PHC units in Sweden, of which 22 units agreed to participate in the study. Before the introduction of the CLT, the creative climate at each participating unit was assessed. After 24 months, a follow-up questionnaire was distributed to the staff to assess how the CLT was perceived and how it was used. A question on the perceived need for the CLT was also included. The units were divided into three groups according to the creative climate: high, medium and low. The main finding was that the units identified as having a positive creative climate demonstrated more frequent use and more positive perceptions regarding the new tool than those with the least positive creative climate. More positive perceptions were seen at both individual and unit levels. According to the results from this study there is an association between organizational climate at baseline and implementation outcome after 2 years when a tool for lifestyle intervention is introduced in PHC in Sweden. Further studies are needed before measurement of organizational climate at baseline can be recommended in order to predict implementation outcome.
Sekhobo, Jackson P; Peck, Sanya R; Byun, Youjung; Allsopp, Marie A K; Holbrook, MaryEllen K; Edmunds, Lynn S; Yu, Chengxuan
2017-08-01
This research assessed the implementation of strategies piloted at 10 Special Supplemental Nutrition Program for Women, Infants and Children (WIC) clinics aimed at increasing retention in the program, by enhancing participants' shopping experiences. Under WIC Retention Promotion Study: Keep, Reconnect, Thrive (WIC RPS), clinics were recruited and assigned to implement one or a combination of strategies: a standardized Shopping Orientation (SO) curriculum, a Guided Shopping Tour (GST), and a Pictorial Foods Card (PFC) from November 2012 through August 2013. This paper presents results from the process evaluation of the retention strategies, using a mixed-methods comparative case study design employing WIC administrative data, interviews, and focus groups. Qualitative data were inductively coded, analyzed and mapped to the following implementation constructs: organizational capacity, fidelity, allowable adaptations, implementation challenges, and participant responsiveness, while quantitative data were analyzed using SAS to assess reach and dose. Several sites implemented the SO and PFC interventions with the necessary fidelity and dose needed to assess impact on participants' shopping experiences. Sites that were assigned the GST strategy struggled to implement this strategy. However, use of the standardized SO enabled staff to use a "consistent list of shopping tips" to educate participants about the proper use of checks, while use of the PFC increased participants' awareness of the variety of WIC-allowable foods. During follow-up telephone calls, 91 percent of participants reported the shopping tips as helpful. Future analyses will assess the impact of enhanced shopping experience on retention at intervention sites. Copyright © 2017 Elsevier Ltd. All rights reserved.
Amemori, Masamitsu; Korhonen, Tellervo; Kinnunen, Taru; Michie, Susan; Murtomaa, Heikki
2011-02-14
Tobacco use adversely affects oral health. Tobacco use prevention and cessation (TUPAC) counselling guidelines recommend that healthcare providers ask about each patient's tobacco use, assess the patient's readiness and willingness to stop, document tobacco use habits, advise the patient to stop, assist and help in quitting, and arrange monitoring of progress at follow-up appointments. Adherence to such guidelines, especially among dental providers, is poor. To improve guideline implementation, it is essential to understand factors influencing it and find effective ways to influence those factors. The aim of the present study protocol is to introduce a theory-based approach to diagnose implementation difficulties of TUPAC counselling guidelines among dental providers. Theories of behaviour change have been used to identify key theoretical domains relevant to the behaviours of healthcare providers involved in implementing clinical guidelines. These theoretical domains will inform the development of a questionnaire aimed at assessing the implementation of the TUPAC counselling guidelines among Finnish municipal dental providers. Specific items will be drawn from the guidelines and the literature on TUPAC studies. After identifying potential implementation difficulties, we will design two interventions using theories of behaviour change to link them with relevant behaviour change techniques aiming to improve guideline adherence. For assessing the implementation of TUPAC guidelines, the electronic dental record audit and self-reported questionnaires will be used. To improve guideline adherence, the theoretical-domains approach could provide a comprehensive basis for assessing implementation difficulties, as well as designing and evaluating interventions. After having identified implementation difficulties, we will design and test two interventions to enhance TUPAC guideline adherence. Using the cluster randomised controlled design, we aim to provide further evidence on intervention effects, as well as on the validity and feasibility of the theoretical-domain approach. The empirical data collected within this trial will be useful in testing whether this theoretical-domain approach can improve our understanding of the implementation of TUPAC guidelines among dental providers. Current Controlled Trials ISRCTN15427433.
Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C
2015-03-10
In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross-organizational findings about implementing healthcare innovations while also enhancing organizational capacity and accelerating translation of findings by facilitating continuous learning within individual sites. Researchers evaluating change initiatives and healthcare organizations implementing improvement initiatives may benefit from a Learning Evaluation approach.
Alcoa North American Extrusions Implements Energy Use Assessments at Multiple Facilities
DOE Office of Scientific and Technical Information (OSTI.GOV)
None
2001-08-01
This case study is the latest in a series on industrial firms who are implementing energy efficient technologies and system improvements into their manufacturing processes. The case studies document the activities, savings, and lessons learned on these projects.
Kritz, Steven; Brown, Lawrence S; Chu, Melissa; John-Hull, Carlota; Madray, Charles; Zavala, Roberto; Louie, Ben
2012-08-01
Electronic medical record (EMR) systems are commonly included in health care reform discussions. However, their embrace by the health care community has been slow. At Addiction Research and Treatment Corporation, an outpatient opioid agonist treatment programme that also provides primary medical care, HIV medical care and case management, substance abuse counselling and vocational services, we studied the implementation of an EMR in the domains of quality, productivity, satisfaction, risk management and financial performance utilizing a prospective pre- and post-implementation study design. This report details the research approach, pre-implementation findings for all five domains, analysis of the pre-implementation findings and some preliminary post-implementation results in the domains of quality and risk management. For quality, there was a highly statistically significant improvement in timely performance of annual medical assessments (P < 0.001) and annual multidiscipline assessments (P < 0.0001). For risk management, the number of events was not sufficient to perform valid statistical analysis. The preliminary findings in the domain of quality are very promising. Should the findings in the other domains prove to be positive, then the impetus to implement EMR in similar health care facilities will be advanced. © 2011 Blackwell Publishing Ltd.
Roberts, Megan C; Clyne, Mindy; Kennedy, Amy E; Chambers, David A; Khoury, Muin J
2017-10-26
PurposeImplementation science offers methods to evaluate the translation of genomic medicine research into practice. The extent to which the National Institutes of Health (NIH) human genomics grant portfolio includes implementation science is unknown. This brief report's objective is to describe recently funded implementation science studies in genomic medicine in the NIH grant portfolio, and identify remaining gaps.MethodsWe identified investigator-initiated NIH research grants on implementation science in genomic medicine (funding initiated 2012-2016). A codebook was adapted from the literature, three authors coded grants, and descriptive statistics were calculated for each code.ResultsForty-two grants fit the inclusion criteria (~1.75% of investigator-initiated genomics grants). The majority of included grants proposed qualitative and/or quantitative methods with cross-sectional study designs, and described clinical settings and primarily white, non-Hispanic study populations. Most grants were in oncology and examined genetic testing for risk assessment. Finally, grants lacked the use of implementation science frameworks, and most examined uptake of genomic medicine and/or assessed patient-centeredness.ConclusionWe identified large gaps in implementation science studies in genomic medicine in the funded NIH portfolio over the past 5 years. To move the genomics field forward, investigator-initiated research grants should employ rigorous implementation science methods within diverse settings and populations.Genetics in Medicine advance online publication, 26 October 2017; doi:10.1038/gim.2017.180.
Urban, Ruth A; Rowe, Dorothy J
2015-02-01
The purpose of this study was to survey dental hygienists to determine their knowledge, attitudes and practices regarding the implementation of caries risk assessment, particularly caries management by risk assessment (CAMBRA), in private dental practices. A 17 item survey was developed to evaluate dental hygienists' knowledge, attitudes and practices related to CAMBRA and perceived barriers to CAMBRA implementation in private dental practice. Surveys were mailed to a randomized sample of 1,000 dental hygienists licensed to practice in California. Responses were tabulated for each respondent, and the response frequency for each survey item was calculated. Respondents' comments to the open-ended question were compiled, according to themes. The response rate was 18%. Only 66% of the respondents were familiar with the term CAMBRA, although 89% agreed with its underlying principles of risk assessment. CAMBRA protocol had been implemented in 40% of the respondents' employment sites. Respondents disagreed that time (45%) and cost of products (68%) were barriers to implementation. Many did not know their employers' knowledge or attitudes about CAMBRA and its implementation, as evidenced by a "don't know" response range of 29 to 48% for the 4 relevant statements. Respondents' comments included both successes and barriers implementing CAMBRA. CAMBRA protocol has not been widely implemented in private practice, although the current data do not indicate insurmountable barriers. Broader dissemination may be feasible if dental hygienists would obtain more comprehensive knowledge of evidence-based risk assessment protocols and would assume a leadership role in implementing CAMBRA protocols and procedures in private dental practices. Copyright © 2015 The American Dental Hygienists’ Association.
Program Level Assessment: A Case Study for a University Clothing and Textile Major
ERIC Educational Resources Information Center
Yun, Zee-Sun; Frazier, Barbara J.
2016-01-01
This paper presents a framework for program assessment and a case study in assessment for a university clothing and textile program in family and consumer sciences. Assessment activities and the process implemented by the Textile and Apparel Studies (TAS) major at Western Michigan University are explained. The process adopts the International…
Gifford, Wendy A; Davies, Barbara; Graham, Ian D; Lefebre, Nancy; Tourangeau, Ann; Woodend, Kirsten
2008-12-10
Foot ulcers are a significant problem for people with diabetes. Comprehensive assessments of risk factors associated with diabetic foot ulcer are recommended in clinical guidelines to decrease complications such as prolonged healing, gangrene and amputations, and to promote effective management. However, the translation of clinical guidelines into nursing practice remains fragmented and inconsistent, and a recent homecare chart audit showed less than half the recommended risk factors for diabetic foot ulcers were assessed, and peripheral neuropathy (the most significant predictor of complications) was not assessed at all. Strong leadership is consistently described as significant to successfully transfer guidelines into practice. Limited research exists however regarding which leadership behaviours facilitate and support implementation in nursing. The purpose of this pilot study is to evaluate the impact of a leadership intervention in community nursing on implementing recommendations from a clinical guideline on the nursing assessment and management of diabetic foot ulcers. Two phase mixed methods design is proposed (ISRCTN 12345678). Phase I: Descriptive qualitative to understand barriers to implementing the guideline recommendations, and to inform the intervention. Phase II: Matched pair cluster randomized controlled trial (n = 4 centers) will evaluate differences in outcomes between two implementation strategies. Nursing assessments of client risk factors, a composite score of 8 items based on Diabetes/Foot Ulcer guideline recommendations. In addition to the organization's 'usual' implementation strategy, a 12 week leadership strategy will be offered to managerial and clinical leaders consisting of: a) printed materials, b) one day interactive workshop to develop a leadership action plan tailored to barriers to support implementation; c) three post-workshop teleconferences. This study will provide vital information on which leadership strategies are well received to facilitate and support guideline implementation. The anticipated outcomes will provide information to assist with effective management of foot ulcers for people with diabetes. By tracking clinical outcomes associated with guideline implementation, health care administrators will be better informed to influence organizational and policy decision-making to support evidence-based quality care. Findings will be useful to inform the design of future multi-centered trials on various clinical topics to enhance knowledge translation for positive outcomes.
Neta, Gila; Sanchez, Michael A; Chambers, David A; Phillips, Siobhan M; Leyva, Bryan; Cynkin, Laurie; Farrell, Margaret M; Heurtin-Roberts, Suzanne; Vinson, Cynthia
2015-01-08
The National Cancer Institute (NCI) has supported implementation science for over a decade. We explore the application of implementation science across the cancer control continuum, including prevention, screening, treatment, and survivorship. We reviewed funding trends of implementation science grants funded by the NCI between 2000 and 2012. We assessed study characteristics including cancer topic, position on the T2-T4 translational continuum, intended use of frameworks, study design, settings, methods, and replication and cost considerations. We identified 67 NCI grant awards having an implementation science focus. R01 was the most common mechanism, and the total number of all awards increased from four in 2003 to 15 in 2012. Prevention grants were most frequent (49.3%) and cancer treatment least common (4.5%). Diffusion of Innovations and Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) were the most widely reported frameworks, but it is unclear how implementation science models informed planned study measures. Most grants (69%) included mixed methods, and half reported replication and cost considerations (49.3%). Implementation science in cancer research is active and diverse but could be enhanced by greater focus on measures development, assessment of how conceptual frameworks and their constructs lead to improved dissemination and implementation outcomes, and harmonization of measures that are valid, reliable, and practical across multiple settings.
Data compression techniques applied to high resolution high frame rate video technology
NASA Technical Reports Server (NTRS)
Hartz, William G.; Alexovich, Robert E.; Neustadter, Marc S.
1989-01-01
An investigation is presented of video data compression applied to microgravity space experiments using High Resolution High Frame Rate Video Technology (HHVT). An extensive survey of methods of video data compression, described in the open literature, was conducted. The survey examines compression methods employing digital computing. The results of the survey are presented. They include a description of each method and assessment of image degradation and video data parameters. An assessment is made of present and near term future technology for implementation of video data compression in high speed imaging system. Results of the assessment are discussed and summarized. The results of a study of a baseline HHVT video system, and approaches for implementation of video data compression, are presented. Case studies of three microgravity experiments are presented and specific compression techniques and implementations are recommended.
ERIC Educational Resources Information Center
Cotter, Katie L.; Bacallao, Martica; Smokowski, Paul R.; Robertson, Caroline I. B.
2013-01-01
Objectives: This study examines the implementation and effectiveness of Parenting Wisely, an Internet-based parenting skills intervention. The study assesses whether parents benefit from Parenting Wisely participation and whether the delivery format influences program effectiveness. Method: This study uses a quasi-experimental design.…
Failure mode effect analysis and fault tree analysis as a combined methodology in risk management
NASA Astrophysics Data System (ADS)
Wessiani, N. A.; Yoshio, F.
2018-04-01
There have been many studies reported the implementation of Failure Mode Effect Analysis (FMEA) and Fault Tree Analysis (FTA) as a method in risk management. However, most of the studies usually only choose one of these two methods in their risk management methodology. On the other side, combining these two methods will reduce the drawbacks of each methods when implemented separately. This paper aims to combine the methodology of FMEA and FTA in assessing risk. A case study in the metal company will illustrate how this methodology can be implemented. In the case study, this combined methodology will assess the internal risks that occur in the production process. Further, those internal risks should be mitigated based on their level of risks.
Factors influencing a problem-based learning implementation: A case study of IT courses
NASA Astrophysics Data System (ADS)
Darus, Norida Muhd; Mohd, Haslina; Baharom, Fauziah; Saip, Mohamed Ali; Puteh, Nurnasran; Marzuki @ Matt, Zaharin; Husain, Mohd Zabidin; Yasin, Azman
2016-08-01
IT students must be trained to work efficiently as teamwork. One of the techniques that can be used to train them is through Problem-Based Learning (PBL) approach. The PBL implementation can be influenced by various factors depending on the ultimate goal of the study. This study is focusing on the IT students' perception of the PBL implementation. The student's perception is important to ensure the successfulness of the PBL implementation. Therefore, it is important to identify the factors that might influence the implementation of PBL of IT courses. This study aims to identify some catalyst factors that may influence the PBL implementation of IT courses. The study involved three (3) main phases: identifying PBL implementation factors, constructing a PBL model, and PBL model validation using statistical analysis. Four main factors are identified: PBL Characteristics, PBL Course Assessment, PBL Practices, and PBL Perception. Based on these four factors, a PBL model is constructed. Then, based on the proposed PBL model, four hypotheses are formulated and analyzed to validate the model. All hypotheses are significantly acceptable. The result shows that the PBL Characteristics and PBL Course Assessment factors are significantly influenced the PBL Practices and indirectly influenced the Students' Perception of the PBL Implementation for IT courses. This PBL model can assist decision makers in enhancing the PBL teaching and learning strategy for IT courses. It is also can be tested to other courses in the future.
ERIC Educational Resources Information Center
Wong, Hwei Ming
2017-01-01
Student academic self-assessment engages the students in deliberate reflection about what they are learning and how they are learning it. This intervention study investigated the effects of self-assessment training on students' perceptions towards self-assessment in two Singaporean primary schools. The study, which used a pretest-posttest design,…
Federal Register 2010, 2011, 2012, 2013, 2014
2013-03-08
... and Translation Webinar on the Assessment of Data Quality in Animal Studies; Notice of Public Webinar...- based meeting on the assessment of data quality in animal studies. The Office of Health Assessment and... meetings with a focus on methodological issues related to OHAT implementing systematic review. The first...
ERIC Educational Resources Information Center
Stinson, Wendy Bounds; Carr, Deborah; Nettles, Mary Frances; Johnson, James T.
2011-01-01
Purpose/Objectives: The objectives of this study were to assess the extent to which school nutrition (SN) programs have implemented food safety programs based on Hazard Analysis and Critical Control Point (HACCP) principles, as well as factors, barriers, and practices related to implementation of these programs. Methods: An online survey was…
Development, Implementation, and Assessment of a Distance Module in Endocrine Physiology
ERIC Educational Resources Information Center
Rangel, Elaine Maria Leite; Mendes, Isabel Amelia Costa; Carnio, Evelin Capellari; Alves, Leila Maria Marchi; de Godoy, Simone; Crispim, Juliane de Almeida
2010-01-01
This study aimed to develop, implement, and assess a distance module in endocrine physiology in TelEduc for undergraduate nursing students from a public university in Brazil, with a sample size of 44 students. "Stage 1" consisted of the development of the module, through the process of creating a distance course by means of the Web.…
ERIC Educational Resources Information Center
Waight, Noemi; Liu, Xiufeng; Gregorius, Roberto Ma.; Smith, Erica; Park, Mihwa
2014-01-01
This paper reports on a case study of an immersive and integrated multi-instructional approach (namely computer-based model introduction and connection with content; facilitation of individual student exploration guided by exploratory worksheet; use of associated differentiated labs and use of model-based assessments) in the implementation of…
ERIC Educational Resources Information Center
Davin, Kristin Johnson
2011-01-01
Although researchers have begun to explore the implementation of dynamic assessment (DA) with foreign language learners, few of these studies have occurred in the language classroom. Whereas DA is typically implemented in dyads, promising research in the field of foreign language learning suggests that DA may promote development with groups of…
ERIC Educational Resources Information Center
Casey, Michelle M.; Moscovice, Ira S.; Davidson, Gestur
2006-01-01
Context: Medication safety is clearly an important quality issue for rural hospitals. However, rural hospitals face special challenges implementing medication safety practices in terms of their staffing and financial and technical resources. Purpose: This study assessed the capacity of small rural hospitals to implement medication safety…
Examining Barriers to Sustained Implementation of School-Wide Prevention Practices
ERIC Educational Resources Information Center
Turri, Mary G.; Mercer, Sterett H.; McIntosh, Kent; Nese, Rhonda N. T.; Strickland-Cohen, M. Kathleen; Hoselton, Robert
2016-01-01
The purpose of this study was to determine if an experimental 5-item measure of barriers to implementing and sustaining school-wide prevention practices, the "Assessment of Barriers to Implementation and Sustainability in Schools" (ABISS), would relate to objective measures of school-wide positive behavioral interventions and supports…
Distributed Leadership and Organizational Change: Implementation of a Teaching Performance Measure
ERIC Educational Resources Information Center
Sloan, Tine
2013-01-01
This article explores leadership practice and change as evidenced in multiple data sources gathered during a self-study implementation of a teaching performance assessment. It offers promising models of distributed leadership and organizational change that can inform future program implementers and the field in general. Our experiences suggest…
Effects of Language of Implementation on Functional Analysis Outcomes
ERIC Educational Resources Information Center
Rispoli, Mandy; O'Reilly, Mark; Lang, Russell; Sigafoos, Jeff; Mulloy, Austin; Aguilar, Jeannie; Singer, George
2011-01-01
This study evaluated the influence of language of implementation on functional analysis outcomes for a child with a severe intellectual disability from a Spanish-speaking home. Challenging behavior was assessed during 5-min sessions under 4 conditions; attention, play-verbal, play-nonverbal, and demand and across 2 phases; implementation in…
Diaz, Theresa; Guenther, Tanya; Oliphant, Nicholas P; Muñiz, Maria
2014-12-01
To use a newly devised set of criteria to review the study design and scope of collection of process, outcomes and contextual data for evaluations and implementation research of integrated community case management (iCCM) in Sub-Saharan African. We examined 24 program evaluations and implementation research studies of iCCM in sub-Saharan Africa conducted in the last 5 years (2008-2013), assessed the design used and categorized them according to whether or not they collected sufficient information to conduct process and outcome evaluations. Five of the 24 studies used a stepped wedge design and two were randomized control trials. The remaining 17 were quasi-experimental of which 10 had comparison areas; however, not all comparison areas had a pre and post household survey. With regard to process data, 22 of the studies collected sufficient information to report on implementation strength, and all, except one, could report on program implementation. Most common missing data elements were health facility treatments, service costs, and qualitative data to assess demand. For the measurement of program outcomes, 7 of the 24 studies had a year or less of implementation at scale before the endline survey, 6 of the household surveys did not collect point of service, 10 did not collect timeliness (care seeking within 24 hours of symptoms) and 12 did not have socioeconomic (SES) information. Among the 16 studies with comparison areas, only 5 randomly selected comparison areas, while 10 had appropriate comparison areas. Several evaluations were done too soon after implementation, lacked information on health facility treatments, costs, demand, timeliness or SES and/or did not have a counterfactual. We propose several study designs and minimal data elements to be collected to provide sufficient information to assess whether iCCM increased timely coverage of treatment for the neediest children in a cost-efficient manner.
Amemori, Masamitsu; Michie, Susan; Korhonen, Tellervo; Murtomaa, Heikki; Kinnunen, Taru H
2011-05-26
Tobacco use adversely affects oral health. Clinical guidelines recommend that dental providers promote tobacco abstinence and provide patients who use tobacco with brief tobacco use cessation counselling. Research shows that these guidelines are seldom implemented, however. To improve guideline adherence and to develop effective interventions, it is essential to understand provider behaviour and challenges to implementation. This study aimed to develop a theoretically informed measure for assessing among dental providers implementation difficulties related to tobacco use prevention and cessation (TUPAC) counselling guidelines, to evaluate those difficulties among a sample of dental providers, and to investigate a possible underlying structure of applied theoretical domains. A 35-item questionnaire was developed based on key theoretical domains relevant to the implementation behaviours of healthcare providers. Specific items were drawn mostly from the literature on TUPAC counselling studies of healthcare providers. The data were collected from dentists (n = 73) and dental hygienists (n = 22) in 36 dental clinics in Finland using a web-based survey. Of 95 providers, 73 participated (76.8%). We used Cronbach's alpha to ascertain the internal consistency of the questionnaire. Mean domain scores were calculated to assess different aspects of implementation difficulties and exploratory factor analysis to assess the theoretical domain structure. The authors agreed on the labels assigned to the factors on the basis of their component domains and the broader behavioural and theoretical literature. Internal consistency values for theoretical domains varied from 0.50 ('emotion') to 0.71 ('environmental context and resources'). The domain environmental context and resources had the lowest mean score (21.3%; 95% confidence interval [CI], 17.2 to 25.4) and was identified as a potential implementation difficulty. The domain emotion provided the highest mean score (60%; 95% CI, 55.0 to 65.0). Three factors were extracted that explain 70.8% of the variance: motivation (47.6% of variance, α = 0.86), capability (13.3% of variance, α = 0.83), and opportunity (10.0% of variance, α = 0.71). This study demonstrated a theoretically informed approach to identifying possible implementation difficulties in TUPAC counselling among dental providers. This approach provides a method for moving from diagnosing implementation difficulties to designing and evaluating interventions.
Scholl, Isabelle; LaRussa, Allison; Hahlweg, Pola; Kobrin, Sarah; Elwyn, Glyn
2018-03-09
Shared decision-making (SDM) is poorly implemented in routine care, despite being promoted by health policies. No reviews have solely focused on an in-depth synthesis of the literature around organizational- and system-level characteristics (i.e., characteristics of healthcare organizations and of healthcare systems) that may affect SDM implementation. A synthesis would allow exploration of interventions to address these characteristics. The study aim was to compile a comprehensive overview of organizational- and system-level characteristics that are likely to influence the implementation of SDM, and to describe strategies to address those characteristics described in the literature. We conducted a scoping review using the Arksey and O'Malley framework. The search strategy included an electronic search and a secondary search including gray literature. We included publications reporting on projects that promoted implementation of SDM or other decision support interventions in routine healthcare. We screened titles and abstracts, and assessed full texts for eligibility. We used qualitative thematic analysis to identify organizational- and system-level characteristics. After screening 7745 records and assessing 354 full texts for eligibility, 48 publications on 32 distinct implementation projects were included. Most projects (N = 22) were conducted in the USA. Several organizational-level characteristics were described as influencing the implementation of SDM, including organizational leadership, culture, resources, and priorities, as well as teams and workflows. Described system-level characteristics included policies, clinical guidelines, incentives, culture, education, and licensing. We identified potential strategies to influence the described characteristics, e.g., examples how to facilitate distribution of decision aids in a healthcare institution. Although infrequently studied, organizational- and system-level characteristics appear to play a role in the failure to implement SDM in routine care. A wide range of characteristics described as supporting and inhibiting implementation were identified. Future studies should assess the impact of these characteristics on SDM implementation more thoroughly, quantify likely interactions, and assess how characteristics might operate across types of systems and areas of healthcare. Organizations that wish to support the adoption of SDM should carefully consider the role of organizational- and system-level characteristics. Implementation and organizational theory could provide useful guidance for how to address facilitators and barriers to change.
Stevens, Gregory J; Warfel, Joel W; Aden, James K; Blackwell, Scott D
2018-02-13
Endotracheal intubation is a medical procedure that is often indicated in both the perioperative and critical care environments. Cuffed endotracheal tubes (ETT) allow for safer and more efficient delivery of positive pressure ventilation, as well as create a barrier to reduce the risk of micro-aspiration and anesthetic pollution in the operating room environment. Over-inflation of the endotracheal cuff can lead to serious and harmful sequelae. This study aimed to assess if departmental education paired with ready access to a manometer to assess cuff pressure would result in an improvement in the proportion of ETT cuff pressures in the goal range. A quality improvement study was conducted at the San Antonio Military Medical Center (SAMMC; Department of Defense hospital in San Antonio, TX). The initiative was divided into three key periods: pre-implementation, implementation, and post-implementation. During the pre-implementation period, ETT cuff pressures were obtained to assess the baseline state of ETT cuff pressures for patients in the operating room; the proportion of in-range (20-30 cmH2O) pressures was calculated. During the implementation phase, operating rooms were equipped with manometers and anesthesia departmental education was performed regarding the use of the manometers. Three months later, post-implementation cuff pressures were measured in the OR, and the proportion of in-range pressures was again calculated. The pre-implementation data showed an average cuff pressure of 48.92 cmH2O and a median of 38.5 cmH2O. Of the 100 pre-implementation pressures, 20 were in the goal range. Post-implementation data had an average cuff pressure of 41.96 cmH2O and a median of 30 cmH2O. A chi-squared test of pressures in the safe range from the pre-implementation versus post-implementation values yielded a highly significant p-value of 0.0003. The data from this study clearly demonstrated a statistically significant improvement in the proportion of in-range cuff pressures following the quality improvement initiative. This study supports the use of department-wide education and the availability of manometers in each OR to yield safer cuff pressures for intubated patients. This study did not aim to determine an optimal ETT cuff pressure, but utilized data already available to determine a safe cuff pressure. Further research needs to be performed to assess whether routine monitoring of cuff pressure results in improved patient outcomes. Published by Oxford University Press on behalf of the Association of Military Surgeons of the United States 2018. This work is written by (a) US Government employee(s) and is in the public domain in the US.
Müller, Evamaria; Hahlweg, Pola; Scholl, Isabelle
2016-12-01
Shared decision making (SDM) is particularly relevant in oncology, where complex treatment options with varying side effects may lead to meaningful changes in the patient's quality of life. For several years, health policies have called for the implementation of SDM, but SDM remains poorly implemented in routine clinical practice. Implementation science has highlighted the importance of assessing stakeholders' needs to inform the development of implementation programs. Thus, the aim of the present study was to assess different stakeholders' needs regarding the implementation of SDM in routine care. A qualitative study using focus groups and interviews was conducted. Focus groups were carried out with junior physicians, senior physicians, nurses and other healthcare providers (HPCs) (e.g. psycho-oncologists, physiotherapists), patients and family members. Head physicians as well as other HPCs in management positions were interviewed. Audiotapes of focus groups and interviews were transcribed verbatim and analyzed using content analysis. Six focus groups with a total of n = 42 stakeholders as well as n = 17 interviews were conducted. Focus groups and interviews revealed five main categories of needs to be fulfilled in order to achieve a better implementation of SDM in routine cancer care: 1) changes in communication, 2) involvement of other parties, 3) a trustful patient-physician relationship, 4) culture change and 5) structural changes. Stakeholders discussed four clusters of intervention strategies that could foster the implementation of SDM in routine cancer care: 1) clinician-mediated interventions, 2) patient-mediated interventions, 3) provision of patient information material and 4) the establishment of a patient advocate. Study results show that stakeholders voiced a diversity of needs to foster implementation of SDM in routine cancer care, of which some can be directly addressed by intervention strategies. Present results can be used to develop an implementation program to foster SDM in routine cancer care.
Leung, R; Koenig, J Q; Simcox, N; van Belle, G; Fenske, R; Gilbert, S G
1997-01-01
This study examined behavioral changes in households after participation in a home environmental assessment. Home assessment visits by a trained coach, which involved a walk-through in the home with the home residents, were conducted in 36 homes. The walk-through included a list of recommended behavioral changes that the residents could make to reduce their exposures to home pollutants in areas such as dust control, moisture problems, indoor air, hazardous household products, and hobbies. Recruited households were surveyed 3 months after the home assessment to evaluate their implementation of the recommendations. Following the home visits, 31 of 36 households reported making at least one behavioral change, and 41% of the recommendations made by the volunteer coaches were implemented. In conclusion, this study found that the majority of the households who participated in the home assessment reported implementing at least one recommendation. This home health promotional method was effective in influencing behavioral changes. PMID:9349831
Hull, Louise; Arora, Sonal; Stefanidis, Dimitrios; Sevdalis, Nick
2015-11-01
Effective teamwork is critical to safety in the operating room; however, implementation of phase III of the American College of Surgeons (ACS) and Association of Program Directors in Surgery (APDS) Curriculum that focuses on team-based skills remains worryingly low. Training and assessing the complexities of teamwork is challenging. The objective of this study was to establish guidelines and recommendations for training faculty in assessing/debriefing team skills. A multistage survey-based consensus study was completed by 108 experts responsible for training and assessing surgical residents from the ACS Accredited Educational Institutes. Experts agreed that a program to teach faculty to assess team-based skills should include training in the recognition of teamwork skills, practice rating these skills, and training in the provision of feedback/debriefing. Agreement was reached that faculty responsible for conducting team-based skills assessment should be revalidated every 2 years and stringent proficiency criteria should be met. Faculty development is critical to ensure high-quality, standardized training and assessment. Training faculty to assess team-based skills has the potential to facilitate the effective implementation of phase III of the ACS and APDS Curriculum. Copyright © 2015 Elsevier Inc. All rights reserved.
Green, Carla A; Duan, Naihua; Gibbons, Robert D; Hoagwood, Kimberly E; Palinkas, Lawrence A; Wisdom, Jennifer P
2015-09-01
Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings.
Green, Carla A.; Duan, Naihua; Gibbons, Robert D.; Hoagwood, Kimberly E.; Palinkas, Lawrence A.; Wisdom, Jennifer P.
2015-01-01
Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings. PMID:24722814
Briggs, Charlotte L.; Doubleday, Alison F.
2016-01-01
Inspired by reports of successful outcomes in health profession education literature, peer learning has progressively grown to become a fundamental characteristic of health profession curricula. Many studies, however, are anecdotal or philosophical in nature, particularly when addressing the effectiveness of assessments in the context of peer learning. This commentary provides an overview of the rationale for using group assessments in the basic sciences curriculum of health profession programs and highlights the challenges associated with implementing group assessments in this context. The dearth of appropriate means for measuring group process suggests that professional collaboration competencies need to be more clearly defined. Peer learning educators are advised to enhance their understanding of social psychological research in order to implement best practices in the development of appropriate group assessments for peer learning. PMID:29349309
Briggs, Charlotte L; Doubleday, Alison F
2016-01-01
Inspired by reports of successful outcomes in health profession education literature, peer learning has progressively grown to become a fundamental characteristic of health profession curricula. Many studies, however, are anecdotal or philosophical in nature, particularly when addressing the effectiveness of assessments in the context of peer learning. This commentary provides an overview of the rationale for using group assessments in the basic sciences curriculum of health profession programs and highlights the challenges associated with implementing group assessments in this context. The dearth of appropriate means for measuring group process suggests that professional collaboration competencies need to be more clearly defined. Peer learning educators are advised to enhance their understanding of social psychological research in order to implement best practices in the development of appropriate group assessments for peer learning.
Brouwer, M; Coelho, E; das Dores Mosse, C; van Leth, F
2015-01-01
District and urban health care facilities in three provinces (Manica, Sofala, Tete) in central Mozambique. To assess the level of implementation of selected tuberculosis infection prevention and control (TB-IPC) measures. In a cross-sectional study of TB-IPC implementation in 29 health care facilities, we assessed TB clinics, laboratories, out-patient departments and medical and TB wards. Assessment included selected managerial, administrative and environmental measures and the availability and use of respiratory protective equipment (N95 respirators). Guidelines for diagnosis and treatment of (presumptive) TB patients were not present in all facilities. Staff instructed patients on sputum collection in 91%, but only 4% observed it. Using a pragmatic '20% rule', 52% of the rooms assessed had adequate ventilation. Potentially, this could be increased to 76%. Three quarters of the health care workers had N95 respirators. Only 36% knew how to use it correctly. Implementation of TB-IPC measures showed wide variations within health care facilities. Relatively simple measures to improve TB-IPC include the availability of guidelines, opening doors and windows to improve ventilation, and training and support on correct N95 respirator use. However, even relatively simple measures are challenging to implement, and require careful attention in and evaluation of the implementation process.
Kogan, Jennifer R; Conforti, Lisa N; Yamazaki, Kenji; Iobst, William; Holmboe, Eric S
2017-03-01
Faculty development for clinical faculty who assess trainees is necessary to improve assessment quality and impor tant for competency-based education. Little is known about what faculty plan to do differently after training. This study explored the changes faculty intended to make after workplace-based assessment rater training, their ability to implement change, predictors of change, and barriers encountered. In 2012, 45 outpatient internal medicine faculty preceptors (who supervised residents) from 26 institutions participated in rater training. They completed a commitment to change form listing up to five commitments and ranked (on a 1-5 scale) their motivation for and anticipated difficulty implementing each change. Three months later, participants were interviewed about their ability to implement change and barriers encountered. The authors used logistic regression to examine predictors of change. Of 191 total commitments, the most common commitments focused on what faculty would change about their own teaching (57%) and increasing direct observation (31%). Of the 183 commitments for which follow-up data were available, 39% were fully implemented, 40% were partially implemented, and 20% were not implemented. Lack of time/competing priorities was the most commonly cited barrier. Higher initial motivation (odds ratio [OR] 2.02; 95% confidence interval [CI] 1.14, 3.57) predicted change. As anticipated difficulty increased, implementation became less likely (OR 0.67; 95% CI 0.49, 0.93). While higher baseline motivation predicted change, multiple system-level barriers undermined ability to implement change. Rater-training faculty development programs should address how faculty motivation and organizational barriers interact and influence ability to change.
Communication Channels as Implementation Determinants of Performance Management Framework in Kenya
ERIC Educational Resources Information Center
Sang, Jane
2016-01-01
The purpose of this study to assess communication channels as implementation determinants of performance management framework In Kenya at Moi Teaching and Referral Hospital (MTRH). The communication theory was used to inform the study. This study adopted an explanatory design. The target sampled 510 respondents through simple random and stratified…
Teachers' Perceptions of Implementing a Positive Behavior Intervention Support Plan
ERIC Educational Resources Information Center
Ayers, Milton A., Jr.
2017-01-01
The purpose of this study was to assess teacher perceptions in implementing a Positive Behavior Intervention and Support (PBIS) plan in an elementary school. The study was mainly quantitative, using surveys, personal interviews, and observations to measure teacher perceptions. The study focused on the common areas. The rules, procedures, and…
Impact of a daily 10-minute strength and flexibility program in a manufacturing plant.
Pronk, S J; Pronk, N P; Sisco, A; Ingalls, D S; Ochoa, C
1995-01-01
In summary, employees' flexibility and mood showed modest improvements following the implementation of a plant-wide, 10-minute, daily flexibility and strength program. The initial six-week pilot study, administered prior to the plant-wide program implementation, successfully assessed program feasibility, assessed the efficiency of program implementation, identified administrative and logistical concerns, and generated pilot data needed to secure managerial support. Despite the noted significant increases in grip strength in the pilot study, no increases were observed following the six months of plant-wide implementation. This may be related to the differences in low average pretest grip strength for the pilot study compared to the higher scores for the main study population. The pilot study subjects may have received a sufficient exercise stimulus to increase grip strength over the course of six weeks. In contrast, this may not have been the case for the main study subjects due to their higher initial mean grip strength. An increased number of exercises designed to directly impact grip strength may be needed to improve this parameter.
Hadjistavropoulos, Thomas; Williams, Jaime; Kaasalainen, Sharon; Hunter, Paulette V; Savoie, Maryse L; Wickson-Griffiths, Abigail
2016-01-01
Background. Although feasible protocols for pain assessment and management in long-term care (LTC) have been developed, these have not been implemented on a large-scale basis. Objective. To implement a program of regular pain assessment in two LTC facilities, using implementation science principles, and to evaluate the process and success of doing so. Methods. The implementation protocol included a pain assessment workshop and the establishment of a nurse Pain Champion. Quality indicators were tracked before and after implementation. Focus groups and interviews with staff were also conducted. Results. The implementation effort was successful in increasing and regularizing pain assessments. This was sustained during the follow-up period. Staff members reported enthusiasm about the protocol at baseline and positive results following its implementation. Despite the success in increasing assessments, we did not identify changes in the percentages of patients reported as having moderate-to-severe pain. Discussion. It is our hope that our feasibility demonstration will encourage more facilities to improve their pain assessment/management practices. Conclusions. It is feasible to implement regular and systematic pain assessment in LTC. Future research should focus on ensuring effective clinical practices in response to assessment results, and determination of longer-term sustainability.
Rubenstein, Lisa V; Danz, Marjorie S; Crain, A Lauren; Glasgow, Russell E; Whitebird, Robin R; Solberg, Leif I
2014-12-02
Depression is a major cause of morbidity and cost in primary care patient populations. Successful depression improvement models, however, are complex. Based on organizational readiness theory, a practice's commitment to change and its capability to carry out the change are both important predictors of initiating improvement. We empirically explored the links between relative commitment (i.e., the intention to move forward within the following year) and implementation capability. The DIAMOND initiative administered organizational surveys to medical and quality improvement leaders from each of 83 primary care practices in Minnesota. Surveys preceded initiation of activities directed at implementation of a collaborative care model for improving depression care. To assess implementation capability, we developed composites of survey items for five types of organizational factors postulated to be collaborative care barriers and facilitators. To assess relative commitment for each practice, we averaged leader ratings on an identical survey question assessing practice priorities. We used multivariable regression analyses to assess the extent to which implementation capability predicted relative commitment. We explored whether relative commitment or implementation capability measures were associated with earlier initiation of DIAMOND improvements. All five implementation capability measures independently predicted practice leaders' relative commitment to improving depression care in the following year. These included the following: quality improvement culture and attitudes (p = 0.003), depression culture and attitudes (p <0.001), prior depression quality improvement activities (p <0.001), advanced access and tracking capabilities (p = 0.03), and depression collaborative care features in place (p = 0.03). Higher relative commitment (p = 0.002) and prior depression quality improvement activities appeared to be associated with earlier participation in the DIAMOND initiative. The study supports the concept of organizational readiness to improve quality of care and the use of practice leader surveys to assess it. Practice leaders' relative commitment to depression care improvement may be a useful measure of the likelihood that a practice is ready to initiate evidence-based depression care changes. A comprehensive organizational assessment of implementation capability for depression care improvement may identify specific barriers or facilitators to readiness that require targeted attention from implementers.
ERIC Educational Resources Information Center
Escartí, Amparo; Liops-Goig, Ramon; Wright, Paul M.
2018-01-01
Purpose: The Teaching Personal and Social Responsibility (TPSR) model was developed to foster responsibility and teach life skills that transfer to various settings. The purpose of this study was to assess the implementation fidelity of a school-based TPSR program in physical education and other subject areas. Method: Systematic observation was…
ERIC Educational Resources Information Center
Burçer, Sibel
2015-01-01
The aim of this paper is to study the implementation of the ERASMUS programme in Turkey from the perspective of the foreign exchange students. The author conducted a survey which included 112 respondents from 8 Turkish universities. In the survey, the respondents assessed the level of language competence, the existence or the lack of sufficient…
ERIC Educational Resources Information Center
Fenton, Ray
The Concerns Based Acceptance Model (CBAM) has been a key element in developing and assessing the implementation of science and mathematics programs over the past 20 years. CBAM provides an organized approach to assessing where people stand as they learn about, and accept, changes in organizations. This study examined the status of the adoption of…
Clark, Florence; Pyatak, Elizabeth A; Carlson, Mike; Blanche, Erna Imperatore; Vigen, Cheryl; Hay, Joel; Mallinson, Trudy; Blanchard, Jeanine; Unger, Jennifer B; Garber, Susan L; Diaz, Jesus; Florindez, Lucia I; Atkins, Michal; Rubayi, Salah; Azen, Stanley Paul
2014-04-01
Randomized trials of complex, non-pharmacologic interventions implemented in home and community settings, such as the University of Southern California (USC)-Rancho Los Amigos National Rehabilitation Center (RLANRC) Pressure Ulcer Prevention Study (PUPS), present unique challenges with respect to (1) participant recruitment and retention, (2) intervention delivery and fidelity, (3) randomization and assessment, and (4) potential inadvertent treatment effects. We describe the methods employed to address the challenges confronted in implementing PUPS. In this randomized controlled trial, we are assessing the efficacy of a complex, preventive intervention in reducing the incidence of, and costs associated with, the development of medically serious pressure ulcers in people with spinal cord injury. Individuals with spinal cord injury recruited from RLANRC were assigned to either a 12-month preventive intervention group or a standard care control group. The primary outcome is the incidence of serious pressure ulcers with secondary endpoints including ulcer-related surgeries, medical treatment costs, and quality of life. These outcomes are assessed at 12 and 24 months after randomization. Additionally, we are studying the mediating mechanisms that account for intervention outcomes. PUPS has been successfully implemented, including recruitment of the target sample size of 170 participants, assurance of the integrity of intervention protocol delivery with an average 90% treatment adherence rate, and enactment of the assessment plan. However, implementation has been replete with challenges. To meet recruitment goals, we instituted a five-pronged approach customized for an underserved, ethnically diverse population. In intervention delivery, we increased staff time to overcome economic and cultural barriers to retention and adherence. To ensure treatment fidelity and replicability, we monitored intervention protocol delivery in accordance with a rigorous plan. Finally, we have overcome unanticipated assessment and design concerns related to (1) determining pressure ulcer incidence/severity, (2) randomization imbalance, and (3) inadvertent potential control group contamination. We have addressed the most daunting challenges encountered in the recruitment, assessment, and intervention phases of PUPS. Some challenges and solutions may not apply to trials conducted in other settings. Overcoming challenges has required a multifaceted approach incorporating individualization, flexibility, and persistence, as well as the ability to implement needed mid-course corrections.
ERIC Educational Resources Information Center
Sarfo, Frederick Kwaku; Amankwah, Francis; Baafi-Frimpong, Stephen; Asomani, Joseph
2017-01-01
Research findings in the literature show that teachers' concern about change process is extremely personal and it influences the implementation of innovation. This study aimed at assessing information and communication technology teachers' stages of concern regarding the implementation of information and communication technology (ICT) curriculum…
Assessing Implementation Fidelity: Challenges as Seen through the Lens of Two Experimental Studies
ERIC Educational Resources Information Center
Vig, Rozy; Taylor, Megan W.; Star, Jon R.; Chao, Theodore
2014-01-01
The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…
Understanding the Art and Science of Implementation in the SAAF Efficacy Trial
ERIC Educational Resources Information Center
Berkel, Cady; Murry, Velma McBride; Roulston, Kathryn J.; Brody, Gene H.
2013-01-01
Purpose: The purpose of this paper is to demonstrate the importance of considering both fidelity and adaptation in assessing the implementation of evidence-based programs. Design/methodology/approach: The current study employs a multi-method strategy to understand two dimensions of implementation (fidelity and adaptation) in the Strong African…
Spacelab user implementation assessment study. Volume 4: SUIAS appendixes
NASA Technical Reports Server (NTRS)
1975-01-01
The capital investment for the integration and checkout of Spacelab payloads is assessed. Detailed data pertaining to this assessment and a computer cost model utilized in the compilation of programmatic resource requirements are delineated.
Mahl, Sukhy; Lee, Shoo K; Baker, G Ross; Cronin, Catherine M G; Stevens, Bonnie; Ye, Xiang Y
2015-01-01
Studies of adult patient populations suggest that organizational culture is associated with quality improvement (QI) implementation, as well as patient outcomes. However, very little research on organizational culture has been performed in neonatal patient populations. This combined cross-sectional survey and retrospective cohort study assessed employee perceptions of organizational culture and QI implementation within 18 Canadian neonatal intensive care units. The associations between these data and neonatal outcomes in extremely preterm infants (born at < 29 weeks' gestation) were then assessed using multivariable analyses. Perceptions of unit culture and QI implementation varied according to occupation and age. Higher hierarchical culture was associated with increased survival without major morbidities (odds ratio, 1.04; 95% confidence interval, 1.01-1.06), as were higher QI implementation scores (odds ratio range, 1.20-1.36 by culture type). Our data suggest that organizational culture, particularly hierarchical culture, and level of QI implementation may play a role in neonatal outcomes. Copyright © 2015 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.
Jones, Jannah; Wolfenden, Luke; Wyse, Rebecca; Finch, Meghan; Yoong, Sze Lin; Dodds, Pennie; Pond, Nicole; Gillham, Karen; Freund, Megan; McElduff, Patrick; Wye, Paula; Wiggers, John
2014-01-01
Introduction Childhood overweight and obesity tracks into adulthood, increasing the risk of developing future chronic disease. Implementing initiatives promoting healthy eating and physical activity in childcare settings has been identified as a priority to prevent excessive child weight gain. Despite this, few trials have been conducted to assess the effectiveness of interventions to support population-wide implementation of such initiatives. The aim of this study is to assess the effectiveness of a multicomponent intervention in increasing the implementation of healthy eating and physical activity policies and practices by centre-based childcare services. Methods and analysis The study will employ a parallel group randomised controlled trial design. A sample of 128 childcare services in the Hunter region of New South Wales, Australia, will be recruited to participate in the trial. 64 services will be randomly allocated to a 12-month implementation intervention. The remaining 64 services will be allocated to a usual care control group. The intervention will consist of a number of strategies to facilitate childcare service implementation of healthy eating and physical activity policies and practices. Intervention strategies will include implementation support staff, securing executive support, consensus processes, staff training, academic detailing visits, performance monitoring and feedback, tools and resources, and a communications strategy. The primary outcome of the trial will be the prevalence of services implementing all healthy eating and physical activity policies and practices targeted by the intervention. To assess the effectiveness of the intervention, telephone surveys with nominated supervisors and room leaders of childcare services will be conducted at baseline and immediately postintervention. Ethics and dissemination The study was approved by the Hunter New England Human Research Ethics Committee and the University of Newcastle Human Research Ethics Committee. Study findings will be disseminated widely through peer-reviewed publications and conference presentations. Trial registration number Australian Clinical Trials Registry ACTRN12612000927820. PMID:24742978
Anetoh, Maureen Ugonwa; Jibuaku, Chiamaka Henrietta; Nduka, Sunday Odunke; Uzodinma, Samuel Uchenna
2017-01-01
Tertiary Institutions' Social Health Insurance Programme (TISHIP) is an arm of the National Health Insurance Scheme (NHIS), which provides quality healthcare to students in Nigerian higher institutions. The success of this scheme depends on the students' knowledge and awareness of its existence as well as the level of its implementation by healthcare providers. This study was therefore designed to assess students' knowledge and attitude towards TISHIP and its implementation level among health workers in Nnamdi Azikiwe University Medical Centre. Using a stratified random sampling technique, 420 undergraduate students of Nnamdi Azikiwe University, Awka were assessed on their level of awareness and general assessment of TISHIP through an adapted and validated questionnaire instrument. The level of implementation of the scheme was then assessed among 50 randomly selected staff of the University Medical Center. Data collected were analyzed using Statistical Package for Social Sciences (SPSS) version 20 software. Whereas the students in general, showed a high level of TISHIP awareness, more than half of them (56.3%) have never benefited from the scheme with 52.8% showing dissatisfaction with the quality of care offered with the scheme. However, an overwhelming number of the students (87.9%) opined that the scheme should continue. On the other hand, the University Medical Centre staff responses showed a satisfactory scheme implementation. The study found satisfactory TISHIP awareness with poor attitude among Nnamdi Azikiwe University students. Furthermore, the University Medical Centre health workers showed a strong commitment to the objectives of the scheme.
Watkins, Kim; Wood, Helen; Schneider, Carl R; Clifford, Rhonda
2015-10-29
The clinical role of community pharmacists is expanding, as is the use of clinical guidelines in this setting. However, it is unclear which strategies are successful in implementing clinical guidelines and what outcomes can be achieved. The aim of this systematic review is to synthesise the literature on the implementation of clinical guidelines to community pharmacy. The objectives are to describe the implementation strategies used, describe the resulting outcomes and to assess the effectiveness of the strategies. A systematic search was performed in six electronic databases (Medline, EMBASE, CINAHL, Web of Science, Informit, Cochrane Library) for relevant articles. Studies were included if they reported on clinical guidelines implementation strategies in the community pharmacy setting. Two researchers completed the full-search strategy, data abstraction and quality assessments, independently. A third researcher acted as a moderator. Quality assessments were completed with three validated tools. A narrative synthesis was performed to analyse results. A total of 1937 articles were retrieved and the titles and abstracts were screened. Full-text screening was completed for 36 articles resulting in 19 articles (reporting on 22 studies) included for review. Implementation strategies were categorised according to a modified version of the EPOC taxonomy. Educational interventions were the most commonly utilised strategy (n = 20), and computerised decision support systems demonstrated the greatest effect (n = 4). Most studies were multifaceted and used more than one implementation strategy (n = 18). Overall outcomes were moderately positive (n = 17) but focused on process (n = 22) rather than patient (n = 3) or economic outcomes (n = 3). Most studies (n = 20) were rated as being of low methodological quality and having low or very low quality of evidence for outcomes. Studies in this review did not generally have a well thought-out rationale for the choice of implementation strategy. Most utilised educational strategies, but the greatest effect on outcomes was demonstrated using computerised clinical decision support systems. Poor methodology, in the majority of the research, provided insufficient evidence to be conclusive about the best implementation strategies or the benefit of clinical guidelines in this setting. However, the generally positive outcomes across studies and strategies indicate that implementing clinical guidelines to community pharmacy might be beneficial. Improved methodological rigour in future research is required to strengthen the evidence for this hypothesis. PROSPERO 2012: CRD42012003019 .
Marques, Cristiano Corrêa de Azevedo; Carvalheiro, José da Rocha
2017-01-01
to assess the performance of the diagnostic network in the implementation process of the Program for Viral Hepatitis Prevention and Control in São Paulo State, Brazil, from 1997 to 2012. evaluation study based on documentary research and structured interviews, combined with a historical series analysis of indicators developed to assess the implementation process of the program, using data from the Department of the Brazilian National Health System. from 1997 to 2012, the serology, biopsy and molecular biology diagnostic networks showed an increase in the coefficients of coverage of 7.4, 7.3, and 62.0 times, respectively, with an increase in cases detection and treatment access. despite the effective implementation of the diagnostic network, there is a need to review the search strategy for new cases, and access to liver biopsy, still insufficient to the program demand.
Adherence to, and outcomes of, a galactomannan screening protocol in high-risk hematology patients.
Harricharan, S; Biederman, K; Bombassaro, A M; Lazo-Langner, A; Elsayed, S; Fulford, A; Delport, J A; Xenocostas, A
2018-04-01
A twice-weekly galactomannan (gm) screening protocol was implemented in high-risk hematology inpatients. Study objectives were to determine adherence to the protocol, use of selected resources, and patient outcomes. This retrospective cohort study compared outcomes of interest before and after implementation of gm screening. Adults undergoing matched related allogeneic hematopoietic stem-cell transplantation or induction chemotherapy for acute leukemia were eligible. Patients could be enrolled more than once and were evaluated as episodes. Adherence to the gm protocol was assessed in post-implementation episodes. Use of broad-spectrum antifungals (bsafs), consultations (infectious diseases, respirology), and diagnostic procedures (computed tomography imaging, bronchoalveolar lavage) were compared between phases, as were the patient outcomes of all-cause mortality and clinical success (alive and not taking a bsaf). Of 182 episodes consecutively screened, 70 per phase were enrolled. Clinical characteristics and duration of assessment were similar for the phases. Full or partial adherence to the protocol was observed in 61 post-implementation episodes (87%), with full adherence in 40 episodes (57%). More episodes in the pre-implementation phase than in the post-implementation phase involved receipt of bsafs, consultations, and diagnostics (27% vs. 7%, p = 0.02; 46% vs. 26%, p = 0.014; and 46% vs. 31%, p = 0.083 respectively). Although mortality was similar in the two phases, clinical success at the final assessment was observed in fewer pre-implementation than post-implementation episodes (79% vs. 98%, p < 0.001). Implementation of a gm screening protocol was feasible and associated with significantly fewer episodes involving receipt of bsafs and consultations, and with significantly more episodes showing clinical success.
NASA Astrophysics Data System (ADS)
Rusijono; Khotimah, K.
2018-01-01
The purpose of this research was to investigate the effect of implementing the assessment model based on character building to improve discipline and student’s achievement. Assessment model based on character building includes three components, which are the behaviour of students, the efforts, and student’s achievement. This assessment model based on the character building is implemented in science philosophy and educational assessment courses, in Graduate Program of Educational Technology Department, Educational Faculty, Universitas Negeri Surabaya. This research used control group pre-test and post-test design. Data collection method used in this research were observation and test. The observation was used to collect the data about the disciplines of the student in the instructional process, while the test was used to collect the data about student’s achievement. Moreover, the study applied t-test to the analysis of data. The result of this research showed that assessment model based on character building improved discipline and student’s achievement.
Manzanera, R; Plana, M; Moya, D; Ortner, J; Mira, J J
2016-01-01
To describe the level of implementation of quality and safety good practice elements in a Mutual Society health centre. A Cross-sectional study was conducted to assess the level of implementation of good practices using a questionnaire. Some quality dimensions were also assessed (scale 0 to 10) by a set of 87 quality coordinators of health centres and a random sample of 54 healthcare professionals working in small centres. Seventy quality coordinators and 27 professionals replied (response rates 80% and 50%, respectively. There were no differences in the assessment of quality attributes between both groups. They identified as areas for improvement: use of practice guidelines (7.6/10), scientific and technical skills (7.5/10), and patient satisfaction (7.7/10). Availability and accessibility to clinical reports, informed consent, availability of hydro-alcoholic solution, and to record allergies, were considered of high importance to be implemented, with training and research, improvements in equipment and technology plans, adherence to clinical practice guidelines and the preparation of risk maps, being of less importance. The good practices related to equipment and resources have a higher likelihood to be implemented, meanwhile those related to quality and safety attitudes have more barriers before being implemented. The mutual has a similar behaviour than other healthcare institutions. Copyright © 2015 SECA. Published by Elsevier Espana. All rights reserved.
Ehrhart, Mark G.; Torres, Elisa M.; Finn, Natalie K.; Roesch, Scott C.
2016-01-01
There have been recent calls for pragmatic measures to assess factors that influence evidence-based practice (EBP) implementation processes and outcomes. The Implementation Leadership Scale (ILS) is a brief and efficient measure that can be used for research or organizational development purposes to assess leader behaviors and actions that actively support effective EBP implementation. The ILS was developed and validated in mental health settings. This study validates the ILS factor structure with providers in alcohol and other drug (AOD) use treatment agencies. Participants were 323 service providers working in 72 workgroups from three AOD use treatment agencies. Confirmatory factor analyses and reliability analyses were conducted to examine the psychometric properties of the ILS. Convergent and discriminant validity were also assessed. Confirmatory factor analyses demonstrated good fit to the hypothesized first and second order factor structure. Internal consistency reliability was excellent. Convergent and discriminant validity was supported. The ILS psychometric characteristics, reliability, and validity were supported in AOD use treatment agencies. The ILS is a brief and pragmatic measure that can be used for research and practice to assess leadership for EBP implementation in AOD use treatment agencies. PMID:27431044
Aarons, Gregory A; Ehrhart, Mark G; Torres, Elisa M; Finn, Natalie K; Roesch, Scott C
2016-09-01
There have been recent calls for pragmatic measures to assess factors that influence evidence-based practice (EBP) implementation processes and outcomes. The Implementation Leadership Scale (ILS) is a brief and efficient measure that can be used for research or organizational development purposes to assess leader behaviors and actions that actively support effective EBP implementation. The ILS was developed and validated in mental health settings. This study validates the ILS factor structure with providers in alcohol and other drug (AOD) use treatment agencies. Participants were 323 service providers working in 72 workgroups from three AOD use treatment agencies. Confirmatory factor analyses and reliability analyses were conducted to examine the psychometric properties of the ILS. Convergent and discriminant validity were also assessed. Confirmatory factor analyses demonstrated good fit to the hypothesized first and second order factor structure. Internal consistency reliability was excellent. Convergent and discriminant validity was supported. The ILS psychometric characteristics, reliability, and validity were supported in AOD use treatment agencies. The ILS is a brief and pragmatic measure that can be used for research and practice to assess leadership for EBP implementation in AOD use treatment agencies. Copyright © 2016 Elsevier Inc. All rights reserved.
Three Reflections on Assessing Safety Training Needs: A Case Study
ERIC Educational Resources Information Center
Sleezer, Catherine M.; Kelsey, Kathleen D.; Wood, Thomas E.
2008-01-01
Needs assessment plays an important role in training and human performance improvement efforts, but the literature contains little research on this topic. This study extended previous research on the Performance Analysis for Training (PAT) model of needs assessment by examining its implementation to determine environmental and occupational health…
ERIC Educational Resources Information Center
Valentine, Jeffrey C.; Cooper, Harris
2008-01-01
Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…
ERIC Educational Resources Information Center
Blakely, Allison Wright
2017-01-01
The purpose of this study was to examine the relation between "district capacity" as measured by the District Capacity Assessment (DCA) and the "initial, depth, scale," and "sustained" implementation of an evidence-based practice (EBP), Positive Behavior Interventions and Supports (PBIS). This exploratory analysis…
Huang, Keng-Yen; Nakigudde, Janet; Calzada, Esther; Boivin, Michael J; Ogedegbe, Gbenga; Brotman, Laurie Miller
2014-12-01
Children in Sub-Saharan Africa (SSA) are burdened by significant unmet mental health needs, but this region has limited access to mental health workers and resources to address these needs. Despite the successes of numerous school-based interventions for promoting child mental health, most evidence-based interventions are not available in SSA. This study will investigate the transportability of an evidence-based program from a developed country (United States) to a SSA country (Uganda). The approach includes task-shifting to early childhood teachers and consists of professional development (five days) to introduce strategies for effective behavior management and positive teacher-student interactions, and group-based consultation (14 sessions) to support adoption of effective practices and tailoring to meet the needs of individual students. The design of this study is guided by two implementation frameworks, the Consolidated Framework for Implementation Research and the Teacher Training Implementation Model, that consider multidimensional aspects of intervention fidelity and contextual predictors that may influence implementation and teacher outcomes. Using a cluster randomized design, 10 schools in Uganda will be randomized to either the intervention group (five schools) or the waitlist control group (five schools). A total of 80 to 100 early childhood teachers will be enrolled in the study. Teacher utilization of evidence-based strategies and practices will be assessed at baseline, immediate post-intervention (six months after baseline), and at seven months post-intervention (during a new academic year). Fidelity measures will be assessed throughout the program implementation period (during professional development and consultation sessions). Individual teacher and contextual factors will be assessed at baseline. Data will be collected from multiple sources. Linear mixed-effect modeling, adjusting for school nesting, will be applied to address study questions. The study will produce important information regarding the value of an evidence-based early intervention, and a theory-guided implementation process and tools designed for use in implementing early childhood evidence-based programs in SSA countries or resource-constrained community settings. This trial was registered with ClinicalTrials.gov (registration number: NCT097115) on 15 May 2013.
2011-01-01
Background Tobacco use adversely affects oral health. Tobacco use prevention and cessation (TUPAC) counselling guidelines recommend that healthcare providers ask about each patient's tobacco use, assess the patient's readiness and willingness to stop, document tobacco use habits, advise the patient to stop, assist and help in quitting, and arrange monitoring of progress at follow-up appointments. Adherence to such guidelines, especially among dental providers, is poor. To improve guideline implementation, it is essential to understand factors influencing it and find effective ways to influence those factors. The aim of the present study protocol is to introduce a theory-based approach to diagnose implementation difficulties of TUPAC counselling guidelines among dental providers. Methods Theories of behaviour change have been used to identify key theoretical domains relevant to the behaviours of healthcare providers involved in implementing clinical guidelines. These theoretical domains will inform the development of a questionnaire aimed at assessing the implementation of the TUPAC counselling guidelines among Finnish municipal dental providers. Specific items will be drawn from the guidelines and the literature on TUPAC studies. After identifying potential implementation difficulties, we will design two interventions using theories of behaviour change to link them with relevant behaviour change techniques aiming to improve guideline adherence. For assessing the implementation of TUPAC guidelines, the electronic dental record audit and self-reported questionnaires will be used. Discussion To improve guideline adherence, the theoretical-domains approach could provide a comprehensive basis for assessing implementation difficulties, as well as designing and evaluating interventions. After having identified implementation difficulties, we will design and test two interventions to enhance TUPAC guideline adherence. Using the cluster randomised controlled design, we aim to provide further evidence on intervention effects, as well as on the validity and feasibility of the theoretical-domain approach. The empirical data collected within this trial will be useful in testing whether this theoretical-domain approach can improve our understanding of the implementation of TUPAC guidelines among dental providers. Trial registration Current Controlled Trials ISRCTN15427433 PMID:21320312
Mokkenstorm, Jan; Franx, Gerdien; Gilissen, Renske; Kerkhof, Ad; Smit, Johannes Hendrikus
2018-05-03
In The Netherlands, on average 40% of all suicides concern patients treated by mental healthcare institutions (MHIs). Recent evidence indicates that implemented guideline recommendations significantly reduce the odds for patients to die by suicide. Implementation of the multidisciplinary guideline for diagnosis and treatment of suicidal behaviors is a main objective of the Dutch National Suicide Prevention Strategy. To this end, 24 MHIs that collectively reported 73% of patient suicides in 2015 received an educational outreach intervention offered by the national center of expertise. To investigate changes in levels of implementation of guideline recommendations; and to assess the degree of variation on suicide prevention policies and practices between MHIs. Implementation study with a prospective cohort design studying change over time on all domains of a Suicide Prevention Monitor, a guideline-based instrument assessing suicide prevention policies and practices within MHIs. Data were collected in six-month intervals between 2015 and 2017. MHIs improved significantly on four out of ten domains: the development of an organizational suicide prevention policy; monitoring and trend-analysis of suicides numbers; evaluations after suicide; and clinician training. No improvement was measured on the domains pertaining to multi-annual training policies; collaborative care with external partners; recording and evaluation of suicide attempts; routine assessment of suicidality in all patients; safety planning and involving next of kin and carers. Furthermore, marked practice variation between MHIs was found which did not decrease over time. This study shows significant improvement in the implementation of four out of ten guideline-based suicide prevention policies in 24 specialist mental healthcare institutions in The Netherlands. The implementation level of suicide prevention policies and practices still appears to vary significantly between MHIs in The Netherlands.
Franx, Gerdien; Gilissen, Renske; Kerkhof, Ad; Smit, Johannes Hendrikus
2018-01-01
In The Netherlands, on average 40% of all suicides concern patients treated by mental healthcare institutions (MHIs). Recent evidence indicates that implemented guideline recommendations significantly reduce the odds for patients to die by suicide. Implementation of the multidisciplinary guideline for diagnosis and treatment of suicidal behaviors is a main objective of the Dutch National Suicide Prevention Strategy. To this end, 24 MHIs that collectively reported 73% of patient suicides in 2015 received an educational outreach intervention offered by the national center of expertise. Aim: To investigate changes in levels of implementation of guideline recommendations; and to assess the degree of variation on suicide prevention policies and practices between MHIs. Methods: Implementation study with a prospective cohort design studying change over time on all domains of a Suicide Prevention Monitor, a guideline-based instrument assessing suicide prevention policies and practices within MHIs. Data were collected in six-month intervals between 2015 and 2017. Results: MHIs improved significantly on four out of ten domains: the development of an organizational suicide prevention policy; monitoring and trend-analysis of suicides numbers; evaluations after suicide; and clinician training. No improvement was measured on the domains pertaining to multi-annual training policies; collaborative care with external partners; recording and evaluation of suicide attempts; routine assessment of suicidality in all patients; safety planning and involving next of kin and carers. Furthermore, marked practice variation between MHIs was found which did not decrease over time. Conclusion: This study shows significant improvement in the implementation of four out of ten guideline-based suicide prevention policies in 24 specialist mental healthcare institutions in The Netherlands. The implementation level of suicide prevention policies and practices still appears to vary significantly between MHIs in The Netherlands. PMID:29751572
ERIC Educational Resources Information Center
Birenbaum, Menucha; Kimron, Helena; Shilton, Hany; Shahaf-Barzilay, Rinat
2009-01-01
The paper reports results of three studies that used a formative assessment (FA) framework to compare schools that vary in their level of functioning as professional learning communities with respect to three processes: classroom assessment (study 1), development and implementation of school-based curriculum (study 2), and pedagogical…
High-Stakes & Assessment Innovation: A Negative Correlation? Research Report.
ERIC Educational Resources Information Center
Ananda, Sri; Rabinowitz, Stanley
This paper makes the case that, as implemented so far, there has been an inverse correlation between innovation and accountability in statewide assessment systems. The higher the stakes attached to the assessment results, the more conservative the assessment methodology ultimately used. Case studies of two state assessment programs were carried…
Comparative Study of Child Assessment Practices in English and Korean Preschools
ERIC Educational Resources Information Center
Nah, Kwi-Ok
2014-01-01
Child assessment practices in English and Korean preschools were compared by analysing data from interviews with educators, examples of child assessment, and official documents from each country. Child assessment in England was systematically implemented and characterised by several methodological and procedural strengths, whereas assessment in…
ERIC Educational Resources Information Center
Areiza Restrepo, Hugo Nelson
2013-01-01
This article presents a partial report of a small qualitative research study that explored the students' views of their learning during and after the implementation of formative procedures such as self-assessment, feedback, and conferences. The article also includes their perceptions about this implementation. The research was carried out with a…
Say Cheese! A Snapshot of Elementary Teachers' Engagement and Motivation for Classroom Assessment
ERIC Educational Resources Information Center
Black, Glenda L.
2014-01-01
Assessment is a complex function requiring an understanding of student learning, assessment principles, practices, and purposes of data to implement effective classroom assessment. The purpose of this study was to add to the growing base of knowledge about teachers' engagement with assessment data and their motivation for classroom assessment.…
Developing Assessment through Lesson Study
ERIC Educational Resources Information Center
Fischman, Davida; Wasserman, Kelli
2017-01-01
Lesson study cultivates teachers' capacity for formative assessment by placing student thinking front and center throughout. Lesson study is a form of professional development in which a team of teachers determines a mathematical focus, collaboratively studies student thinking about the topic, designs a lesson about this content, implements the…
A Case Study of a National University Research Project and Its Technological Innovation
ERIC Educational Resources Information Center
Ziegel, Melina
2012-01-01
This case study examined the implementation of a major research endeavor in an institution of higher education, Trinity College, Dublin, in Ireland, with particular focus on the change process during the initiation of the project and the subsequent needs assessment and implementation of technological solutions. This study identified the stages,…
Sanchez, Alvaro; Grandes, Gonzalo; Cortada, Josep M; Pombo, Haizea; Martinez, Catalina; Corrales, Mary Helen; de la Peña, Enrique; Mugica, Justo; Gorostiza, Esther
2017-02-17
Process evaluation is recommended to improve the understanding of underlying mechanisms related to clinicians, patients, context and intervention delivery that may impact on trial or program results, feasibility and transferability to practice. The aim of this study was to assess the feasibility of the Prescribe Healthy Life (PVS from the Spanish "Prescribe Vida Saludable") implementation strategy for enhancing the adoption and implementation of an evidence-based health promotion intervention in primary health care. A descriptive study of 2-year implementation indicators for the PVS clinical intervention was conducted in four primary health care centers. A multifaceted collaborative modeling implementation strategy was developed to enhance the integration of a clinical intervention to promote healthy lifestyles into clinical practice. Process indicators were assessed for intervention reach, adoption, implementation, sustainability and their variability at center, practice, and patient levels. Mean rates of adoption by means of active collaboration among the three main professional categories (family physicians, nurses and administrative personnel) were 75% in all centers. Just over half of the patients that attended (n = 11650; 51.9%) were reached in terms of having their lifestyle habits assessed, while more than a third (33.7%; n = 7433) and almost 10% (n = 2175) received advice or a printed prescription for at least one lifestyle change, respectively. Only 3.7% of the target population received a repeat prescription. These process indicators significantly (p < 0.001) varied by center, lifestyle habit and patient characteristics. Sustainability of intervention components changed thorough the implementation period within centers. The implementation strategy used showed moderate-to-good performance on process indicators related to adoption, reach, and implementation of the evidence-based healthy lifestyle promotion intervention in the context of routine primary care. Sources of heterogeneity and instability in these indicators may improve our understanding of factors required to attain adequate program adoption and implementation through improved implementation strategies.
BNSF San Bernardino case study : positive train control risk assessment.
DOT National Transportation Integrated Search
2014-09-01
The Federal Railroad Administration funded the BNSF San Bernardino Case Study to verify its Generalized Train Movement : Simulator (GTMS) risk assessment capabilities on a planned implementation of the I-ETMS PTC system. The analysis explicitly : sim...
An assessment of implementation and evaluation phases of strategic plans in Iranian hospitals.
Sadeghifar, Jamil; Tofighi, Shahram; Roshani, Mohamad; Toulideh, Zahra; Mohsenpour, Seyedramezan; Jafari, Mehdi
2017-01-01
To assess the implementation and evaluation phases of strategic plans in selected hospitals. We conducted a cross-sectional study of implementation and evaluation of strategic plan in 24 hospitals in 2015, using a questionnaire which consisted of two separate sections for strategic implementation and strategic evaluation. Data were analyzed with SPSS version 18. Nearly one-third of hospitals claimed that they allocate their budget based on priorities and strategic goals. However, it turned out that although goals had been set, no formal announcements had been made. Most of the hospitals stated that they used measures when evaluating the plan. For hospital staff, clarifying the hospital's priorities was the most important advantage of a strategic plan. There is no clear definition for strategic management in Iranian hospitals, which results in chaotic implementation and control of strategic planning.
Moreno, Eliana M; Moriana, Juan Antonio
2016-08-09
There is now broad consensus regarding the importance of involving users in the process of implementing guidelines. Few studies, however, have addressed this issue, let alone the implementation of guidelines for common mental health disorders. The aim of this study is to compile and describe implementation strategies and resources related to common clinical mental health disorders targeted at service users. The literature was reviewed and resources for the implementation of clinical guidelines were compiled using the PRISMA model. A mixed qualitative and quantitative analysis was performed based on a series of categories developed ad hoc. A total of 263 items were included in the preliminary analysis and 64 implementation resources aimed at users were analysed in depth. A wide variety of types, sources and formats were identified, including guides (40%), websites (29%), videos and leaflets, as well as instruments for the implementation of strategies regarding information and education (64%), self-care, or users' assessment of service quality. The results reveal the need to establish clear criteria for assessing the quality of implementation materials in general and standardising systems to classify user-targeted strategies. The compilation and description of key elements of strategies and resources for users can be of interest in designing materials and specific actions for this target audience, as well as improving the implementation of clinical guidelines.
Consensus modeling to develop the farmers' market readiness assessment and decision instrument.
Lee, Eunlye; Dalton, Jarrod; Ngendahimana, David; Bebo, Pat; Davis, Ashley; Remley, Daniel; Smathers, Carol; Freedman, Darcy A
2017-09-01
Nutrition-related policy, system, and environmental (PSE) interventions such as farmers' markets have been recommended as effective strategies for promoting healthy diet for chronic disease prevention. Tools are needed to assess community readiness and capacity factors influencing successful farmers' market implementation among diverse practitioners in different community contexts. We describe a multiphase consensus modeling approach used to develop a diagnostic tool for assessing readiness and capacity to implement farmers' market interventions among public health and community nutrition practitioners working with low-income populations in diverse contexts. Modeling methods included the following: phase 1, qualitative study with community stakeholders to explore facilitators and barriers influencing successful implementation of farmers' market interventions in low-income communities; phase 2, development of indicators based on operationalization of qualitative findings; phase 3, assessment of relevance and importance of indicators and themes through consensus conference with expert panel; phase 4, refinement of indicators based on consensus conference; and phase 5, pilot test of the assessment tool. Findings illuminate a range of implementation factors influencing farmers' market PSE interventions and offer guidance for tailoring intervention delivery based on levels of community, practitioner, and organizational readiness and capacity.
Assessing Student Learning in Gender Inclusive Tertiary Mathematics and Physics Education.
ERIC Educational Resources Information Center
Wistedt, Inger
1998-01-01
The merits and limitations of an alternative assessment method implemented in an inclusive university education program are discussed based on data from a study in which 24 Swedish university students presented mathematics and physics project results. The study shows how an interdisciplinary approach to assessment can promote critical reflection…
Perceptions of Part C Coordinators on Family Assessment in Early Intervention
ERIC Educational Resources Information Center
Votava, Kristen; Chiasson, Kari
2015-01-01
The purpose of this study was to gain an understanding of six state-wide policies and procedures used in the family assessment process within early intervention services. This qualitative study examined the administrative understanding of the family assessment federal regulations, state policies and procedures, and local implementation from the…
NASA Astrophysics Data System (ADS)
Lestariani, I.; Sujadi, I.; Pramudya, I.
2018-03-01
The purpose of research to describe and know the implementation of skill assessment on the mathematics learning process with the high school mathematics teacher as the subject because it is less fully implemented. This research is the type of the descriptive qualitative method. The data was collecting observation method, interview and documentation. The result showed that on the planning stage of the implementation of skill assessment, there were many teachers who had not prepared all the completeness with various assessment techniques through performance, project and portfolio. The teacher was prepared the list of questions. On the implementation stage, there were many teachers who had not understand the stage of completing the assessment with the appropriate instrument method and development. On the reporting stage, discovered that teachers faced the difficulty on preparing scoring report with the range value. Aside from that, the teachers had not prepared the assessment instrument very well on the planning stage. It can be concluded that the implementation of skill assessment has been implemented but not maximally because educators don’t understand about the skill assessment and the number of instrument that must be prepared before the assessment.
[Assessment of user embracement with risk rating in emergency hospital services].
Versa, Gelena Lucinéia Gomes da Silva; Vituri, Dagmar Wilamowius; Buriola, Aline Aparecida; Carlos Aparecido de Oliveira; Matsuda, Laura Misue
2014-09-01
Cross-sectional and quantitative study, conducted in 2013, aiming to evaluate the implementation of User Embracement with Risk Rating (ACCR) in four Emergency Hospital Services. One hundred fifty six nurses participated and answered the questionnaire"User Embracement with Risk Rating". The data were treated through descriptive and inferential statistics, from the Kruskal-Wallis test. The implementation of ACCR was assessed as precarious, mainly due to the lack of referral of low complexity cases to the basic health system, the inadequate physical space for companions and the lack of discussion and periodic assessment of the flow of care in ACCR. The dimension Result of Implementation obtained a slightly higher score and Structure was the dimension with the lowest score. It was concluded that the negative assessments by nursing professionals of the referred dimensions in the investigated sites suggests the need for improvements, especially in the dimension Structure.
E-Laboratory Design and Implementation for Enhanced Science, Technology and Engineering Education
ERIC Educational Resources Information Center
Morton, William; Uhomoibhi, James
2011-01-01
Purpose: This paper aims to report on the design and implementation of an e-laboratory for enhanced science, technology and engineering education studies. Design/methodology/approach: The paper assesses a computer-based e-laboratory, designed for new entrants to science, technology and engineering programmes of study in further and higher…
ERIC Educational Resources Information Center
Fergusson, Lee C.; And Others
1996-01-01
A study investigated the effects on students' nonverbal intelligence of implementing an approach to higher education based on Vedic science, developed by Maharishi Mahesh Yogi and including transcendental meditation. The approach was implemented in two Cambodian universities and its effects assessed in 70 undergraduate students. An increase in…
How University Teachers Design Assessments: A Cross-Disciplinary Study
ERIC Educational Resources Information Center
Bearman, Margaret; Dawson, Phillip; Bennett, Sue; Hall, Matt; Molloy, Elizabeth; Boud, David; Joughin, Gordon
2017-01-01
There are dissonances between educators' aspirations for assessment design and actual assessment implementation in higher education. Understanding how assessment is designed "on the ground" can assist in resolving this tension. Thirty-three Australian university educators from a mix of disciplines and institutions were interviewed. A…
2011-01-01
Background Tobacco use adversely affects oral health. Clinical guidelines recommend that dental providers promote tobacco abstinence and provide patients who use tobacco with brief tobacco use cessation counselling. Research shows that these guidelines are seldom implemented, however. To improve guideline adherence and to develop effective interventions, it is essential to understand provider behaviour and challenges to implementation. This study aimed to develop a theoretically informed measure for assessing among dental providers implementation difficulties related to tobacco use prevention and cessation (TUPAC) counselling guidelines, to evaluate those difficulties among a sample of dental providers, and to investigate a possible underlying structure of applied theoretical domains. Methods A 35-item questionnaire was developed based on key theoretical domains relevant to the implementation behaviours of healthcare providers. Specific items were drawn mostly from the literature on TUPAC counselling studies of healthcare providers. The data were collected from dentists (n = 73) and dental hygienists (n = 22) in 36 dental clinics in Finland using a web-based survey. Of 95 providers, 73 participated (76.8%). We used Cronbach's alpha to ascertain the internal consistency of the questionnaire. Mean domain scores were calculated to assess different aspects of implementation difficulties and exploratory factor analysis to assess the theoretical domain structure. The authors agreed on the labels assigned to the factors on the basis of their component domains and the broader behavioural and theoretical literature. Results Internal consistency values for theoretical domains varied from 0.50 ('emotion') to 0.71 ('environmental context and resources'). The domain environmental context and resources had the lowest mean score (21.3%; 95% confidence interval [CI], 17.2 to 25.4) and was identified as a potential implementation difficulty. The domain emotion provided the highest mean score (60%; 95% CI, 55.0 to 65.0). Three factors were extracted that explain 70.8% of the variance: motivation (47.6% of variance, α = 0.86), capability (13.3% of variance, α = 0.83), and opportunity (10.0% of variance, α = 0.71). Conclusions This study demonstrated a theoretically informed approach to identifying possible implementation difficulties in TUPAC counselling among dental providers. This approach provides a method for moving from diagnosing implementation difficulties to designing and evaluating interventions. PMID:21615948
Challenges associated with the implementation of the nursing process: A systematic review.
Zamanzadeh, Vahid; Valizadeh, Leila; Tabrizi, Faranak Jabbarzadeh; Behshid, Mojghan; Lotfi, Mojghan
2015-01-01
Nursing process is a scientific approach in the provision of qualified nursing cares. However, in practice, the implementation of this process is faced with numerous challenges. With the knowledge of the challenges associated with the implementation of the nursing process, the nursing processes can be developed appropriately. Due to the lack of comprehensive information on this subject, the current study was carried out to assess the key challenges associated with the implementation of the nursing process. To achieve and review related studies on this field, databases of Iran medix, SID, Magiran, PUBMED, Google scholar, and Proquest were assessed using the main keywords of nursing process and nursing process systematic review. The articles were retrieved in three steps including searching by keywords, review of the proceedings based on inclusion criteria, and final retrieval and assessment of available full texts. Systematic assessment of the articles showed different challenges in implementation of the nursing process. Intangible understanding of the concept of nursing process, different views of the process, lack of knowledge and awareness among nurses related to the execution of process, supports of managing systems, and problems related to recording the nursing process were the main challenges that were extracted from review of literature. On systematically reviewing the literature, intangible understanding of the concept of nursing process has been identified as the main challenge in nursing process. To achieve the best strategy to minimize the challenge, in addition to preparing facilitators for implementation of nursing process, intangible understanding of the concept of nursing process, different views of the process, and forming teams of experts in nursing education are recommended for internalizing the nursing process among nurses.
Challenges associated with the implementation of the nursing process: A systematic review
Zamanzadeh, Vahid; Valizadeh, Leila; Tabrizi, Faranak Jabbarzadeh; Behshid, Mojghan; Lotfi, Mojghan
2015-01-01
Background: Nursing process is a scientific approach in the provision of qualified nursing cares. However, in practice, the implementation of this process is faced with numerous challenges. With the knowledge of the challenges associated with the implementation of the nursing process, the nursing processes can be developed appropriately. Due to the lack of comprehensive information on this subject, the current study was carried out to assess the key challenges associated with the implementation of the nursing process. Materials and Methods: To achieve and review related studies on this field, databases of Iran medix, SID, Magiran, PUBMED, Google scholar, and Proquest were assessed using the main keywords of nursing process and nursing process systematic review. The articles were retrieved in three steps including searching by keywords, review of the proceedings based on inclusion criteria, and final retrieval and assessment of available full texts. Results: Systematic assessment of the articles showed different challenges in implementation of the nursing process. Intangible understanding of the concept of nursing process, different views of the process, lack of knowledge and awareness among nurses related to the execution of process, supports of managing systems, and problems related to recording the nursing process were the main challenges that were extracted from review of literature. Conclusions: On systematically reviewing the literature, intangible understanding of the concept of nursing process has been identified as the main challenge in nursing process. To achieve the best strategy to minimize the challenge, in addition to preparing facilitators for implementation of nursing process, intangible understanding of the concept of nursing process, different views of the process, and forming teams of experts in nursing education are recommended for internalizing the nursing process among nurses. PMID:26257793
Bierman, Karen L; DeRousie, Rebecca M. Sanford; Heinrichs, Brenda; Domitrovich, Celene E.; Greenberg, Mark T.; Gill, Sukhdeep
2013-01-01
Recent research has validated the power of evidence-based preschool interventions to improve teaching quality and promote child school readiness when implemented in the context of research trials. However, very rarely are follow-up assessments conducted with teachers in order to evaluate the maintenance of improved teaching quality or sustained use of evidence-based curriculum components after the intervention trial. In the current study, we collected follow-up assessments of teachers one year after their involvement in the REDI research trial to evaluate the extent to which intervention teachers continued to implement the REDI curriculum components with high-quality, and to explore possible pre-intervention predictors of sustained implementation. In addition, we conducted classroom observations to determine whether general improvements in the teaching quality of intervention teachers (relative to control group teachers) were sustained. Results indicated sustained high-quality implementation of some curriculum components (the PATHS curriculum), but decreased implementation of other components (the language-literacy components). Sustained intervention effects were evident on most aspects of general teaching quality targeted by the intervention. Implications for practice and policy are discussed. PMID:24204101
Kirkup, Michele L; Adams, Brooke N; Meadows, Melinda L; Jackson, Richard
2016-06-01
A traditional summative grading structure, used at Indiana University School of Dentistry (IUSD) for more than 30 years, was identified by faculty as outdated for assessing students' clinical performance. In an effort to change the status quo, a feedback-driven assessment was implemented in 2012 to provide a constructive assessment tool acceptable to both faculty and students. Building on the successful non-graded clinical evaluation employed at Baylor College of Dentistry, IUSD implemented a streamlined electronic formative feedback model (FFM) to assess students' daily clinical performance. An important addition to this evaluation tool was the inclusion of routine student self-assessment opportunities. The aim of this study was to determine faculty and student response to the new assessment instrument. Following training sessions, anonymous satisfaction surveys were examined for the three user groups: clinical faculty (60% response rate), third-year (D3) students (72% response rate), and fourth-year (D4) students (57% response rate). In the results, 70% of the responding faculty members preferred the FFM over the summative model; however, 61.8% of the D4 respondents preferred the summative model, reporting insufficient assessment time and low faculty participation. The two groups of students had different responses to the self-assessment component: 70.2% of the D4 respondents appreciated clinical self-assessment compared to 46% of the D3 respondents. Overall, while some components of the FFM assessment were well received, a phased approach to implementation may have facilitated a transition more acceptable to both faculty and students. Improvements are being made in an attempt to increase overall satisfaction.
Fuller, Colin W; Junge, Astrid; Dorasami, Cadrivel; DeCelles, Jeff; Dvorak, Jiri
2011-01-01
Objectives To implement and assess Fédération Internationale de Football Association Medical Assessment and Research Centre's ‘11 for Health’ football-based health education programme for children. Design Prospective, 2-cohort study. Setting In-school groups (Mauritius); out-of-school groups (Zimbabwe). Participants Mauritius: 389 children, aged 12–15 years; Zimbabwe: 395 children, aged 10–14 years. Intervention Eleven 90-min sessions, each divided into two 45-min halves of Play Football (focusing on one football skill) and Play Fair (focusing on one health issue). Main outcome measures 30-item questionnaire implemented pre and postintervention to assess children's health knowledge; six-item questionnaire implemented postintervention to assess children's views about the ‘11 for Health’ programme. Results Mean pre and postintervention health knowledge scores were greater in Mauritius (pre: 69.3%; post: 87.1%) than Zimbabwe (pre: 57.8%; post: 76.2%) but the mean gain in health knowledge was greater in Zimbabwe (18.4%) than Mauritius (17.8%). There were few significant differences in the outcomes for boys and girls in both countries. The ‘11 for Health’ programme was received positively by the children in both countries and there were no significant differences in the views of boys and girls in either country. Conclusions The study demonstrated that it was possible to achieve significant increases in children's knowledge for all health messages by implementing the ‘11 for Health’ programme in a school-based setting in collaboration with a national Football Association and in an out-of-school setting in collaboration with a non-government organisation. Based on these positive results, the authors recommend that the programme be widely implemented in Africa in co-operation with government and non-government organisations. PMID:21504962
Fuller, Colin W; Junge, Astrid; Dorasami, Cadrivel; DeCelles, Jeff; Dvorak, Jiri
2011-06-01
To implement and assess Fédération Internationale de Football Association Medical Assessment and Research Centre's '11 for Health' football-based health education programme for children. Prospective, 2-cohort study. In-school groups (Mauritius); out-of-school groups (Zimbabwe). Mauritius: 389 children, aged 12-15 years; Zimbabwe: 395 children, aged 10-14 years. Eleven 90-min sessions, each divided into two 45-min halves of Play Football (focusing on one football skill) and Play Fair (focusing on one health issue). 30-item questionnaire implemented pre and postintervention to assess children's health knowledge; six-item questionnaire implemented postintervention to assess children's views about the '11 for Health' programme. Mean pre and postintervention health knowledge scores were greater in Mauritius (pre: 69.3%; post: 87.1%) than Zimbabwe (pre: 57.8%; post: 76.2%) but the mean gain in health knowledge was greater in Zimbabwe (18.4%) than Mauritius (17.8%). There were few significant differences in the outcomes for boys and girls in both countries. The '11 for Health' programme was received positively by the children in both countries and there were no significant differences in the views of boys and girls in either country. The study demonstrated that it was possible to achieve significant increases in children's knowledge for all health messages by implementing the '11 for Health' programme in a school-based setting in collaboration with a national Football Association and in an out-of-school setting in collaboration with a non-government organisation. Based on these positive results, the authors recommend that the programme be widely implemented in Africa in co-operation with government and non-government organisations.
ERIC Educational Resources Information Center
Ludwig, Naomi Wayne
2014-01-01
Studies have shown that teachers' beliefs influence their assessment practices. However, the overarching framework of those beliefs in relation to teachers' classroom assessment confidence has been largely unexamined. This research explored teachers' conceptions of assessment and their confidence regarding the implementation of sound classroom…
Measuring Knowledge Integration Learning of Energy Topics: A two-year longitudinal study
NASA Astrophysics Data System (ADS)
Liu, Ou Lydia; Ryoo, Kihyun; Linn, Marcia C.; Sato, Elissa; Svihla, Vanessa
2015-05-01
Although researchers call for inquiry learning in science, science assessments rarely capture the impact of inquiry instruction. This paper reports on the development and validation of assessments designed to measure middle-school students' progress in gaining integrated understanding of energy while studying an inquiry-oriented curriculum. The assessment development was guided by the knowledge integration framework. Over 2 years of implementation, more than 4,000 students from 4 schools participated in the study, including a cross-sectional and a longitudinal cohort. Results from item response modeling analyses revealed that: (a) the assessments demonstrated satisfactory psychometric properties in terms of reliability and validity; (b) both the cross-sectional and longitudinal cohorts made progress on integrating their understanding energy concepts; and (c) among many factors (e.g. gender, grade, school, and home language) associated with students' science performance, unit implementation was the strongest predictor.
ERIC Educational Resources Information Center
Stallings, Jane
The purpose of the Follow Through Classroom Observation Evaluation was to assess the implementation of seven Follow Through sponsor models included in the study and to examine the relationships between classroom instructional processes and child outcomes. The seven programs selected for study include two behavioristic models, an open school model…
The XML approach to implementing space link extension service management
NASA Technical Reports Server (NTRS)
Tai, W.; Welz, G. A.; Theis, G.; Yamada, T.
2001-01-01
A feasibility study has been conducted at JPL, ESOC, and ISAS to assess the possible applications of the eXtensible Mark-up Language (XML) capabilities to the implementation of the CCSDS Space Link Extension (SLE) Service Management function.
Hong, Bonnie; Du, Yingzhou; Mukerji, Pushkor; Roper, Jason M; Appenzeller, Laura M
2017-07-12
Regulatory-compliant rodent subchronic feeding studies are compulsory regardless of a hypothesis to test, according to recent EU legislation for the safety assessment of whole food/feed produced from genetically modified (GM) crops containing a single genetic transformation event (European Union Commission Implementing Regulation No. 503/2013). The Implementing Regulation refers to guidelines set forth by the European Food Safety Authority (EFSA) for the design, conduct, and analysis of rodent subchronic feeding studies. The set of EFSA recommendations was rigorously applied to a 90-day feeding study in Sprague-Dawley rats. After study completion, the appropriateness and applicability of these recommendations were assessed using a battery of statistical analysis approaches including both retrospective and prospective statistical power analyses as well as variance-covariance decomposition. In the interest of animal welfare considerations, alternative experimental designs were investigated and evaluated in the context of informing the health risk assessment of food/feed from GM crops.
Suman, Arnela; Dikkers, Marije F; Schaafsma, Frederieke G; van Tulder, Maurits W; Anema, Johannes R
2016-09-20
For the optimal use of clinical guidelines in daily practice, mere distribution of guidelines and materials is not enough, and active implementation is needed. This review investigated the effectiveness of multifaceted implementation strategies compared to minimal, single, or no implementation strategy for the implementation of non-specific low back and/or neck pain guidelines in health care. The following electronic databases were searched from inception to June 1, 2015: MEDLINE, Embase, PsycInfo, the Cochrane Library, and CINAHL. The search strategy was restricted to low back pain, neck pain, and implementation research. Studies were included if their design was a randomized controlled trial, reporting on patients (age ≥18 years) with non-specific low back pain or neck pain (with or without radiating pain). Trials were eligible if they reported patient outcomes, measures of healthcare professional behaviour, and/or outcomes on healthcare level. The primary outcome was professional behaviour. Guidelines that were evaluated in the studies had to be implemented in a healthcare setting. No language restrictions were applied, and studies had to be published full-text in peer-reviewed journals, thus excluding abstract only publications, conference abstracts, and dissertation articles. Two researchers independently screened titles and abstract, extracted data from included studies, and performed risk of bias assessments. After removal of duplicates, the search resulted in 4750 abstracts to be screened. Of 43 full-text articles assessed for eligibility, 12 were included in this review, reporting on 9 individual studies, and separate cost-effectiveness analyses of 3 included studies. Implementation strategies varied between studies. Meta-analyses did not reveal any differences in effect between multifaceted strategies and controls. This review showed that multifaceted strategies for the implementation of neck and/or back pain guidelines in health care do not significantly improve professional behaviour outcomes. No effects on patient outcomes or cost of care could be found. More research is necessary to determine whether multifaceted implementation strategies are conducted as planned and whether these strategies are effective in changing professional behaviour and thereby clinical practice.
NASA Technical Reports Server (NTRS)
1976-01-01
The primary objective of this study was to develop an integrated approach for the development, implementation, and utilization of all software that is required to efficiently and cost-effectively support advanced technology laboratory flight and ground operations. It was recognized that certain aspects of the operations would be mandatory computerized services; computerization of other aspects would be optional. Thus, the analyses encompassed not only alternate computer utilization and implementations but trade studies of the programmatic effects of non-computerized versus computerized approaches to the operations. A general overview of the study is presented.
ERIC Educational Resources Information Center
Fernando, Sheara
2010-01-01
The success of an implementation effort depends on the ability for a system to utilize the innovation effectively; the effective usage of an innovation can be determined by monitoring for program integrity and fidelity, and assessing the degree to which the program implementation matches the intended plan (Fixsen, Blase, Horner, & Sugai 2007). The…
ERIC Educational Resources Information Center
van Nassau, Femke; Singh, Amika S.; Hoekstra, Trynke; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J. M.
2016-01-01
This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators: recruitment, reach, dosage, fidelity, satisfaction,…
ERIC Educational Resources Information Center
Pinkelman, Sarah E.; Horner, Robert H.
2017-01-01
The success of function-based interventions depends not just on the quality of procedures but also on the extent to which procedures are implemented as planned. Too often in schools, effort is committed to functional assessment and behavior support plan design, only to be followed by weak implementation. This study used a multiple baseline across…
Online English Language Learners' Perceptions of Portfolio Assessment
ERIC Educational Resources Information Center
Baturay, Meltem Huri
2015-01-01
Portfolio assessment has been implemented in many core disciplines for quality assurance and consistent assessment of learner outcomes. For English language learning, for which varying proficiency levels of learners exist, portfolios are suggested to assess individual learners' progress. The current study was carried out in an online English…
Ritchie, Catherine L W; Miller, Linda L; Antle, David M
2017-01-01
Telehealth approaches to delivering ergonomics assessment hold great potential to improve service delivery in rural and remote settings. This case study describes a telehealth-based ergonomics service delivery process, and compares in-person and telehealth-based ergonomics approaches at an Alberta-based non-profit advocacy group. This project demonstrates that telehealth approaches to ergonomics do not lead to significantly different scoring outcomes for assessment of ergonomics issues, when compared to in-person assessments. This project also outlines the importance of live real-time video conferencing to improving communication, attaining key assessment information, and demonstrating ergonomic adjustments. However, some key considerations of bandwidth and hardware capabilities need to be taken into account. Key communication strategies are outlined to improve rapport, maintain employee confidentiality, and reduce client anxiety around telehealth ergonomics assessments. This project provides further support for telehealth approaches to office ergonomics, and outlines some key implementation strategies and barriers that should be considered.
Strehlenert, H; Richter-Sundberg, L; Nyström, M E; Hasson, H
2015-12-08
Evidence has come to play a central role in health policymaking. However, policymakers tend to use other types of information besides research evidence. Most prior studies on evidence-informed policy have focused on the policy formulation phase without a systematic analysis of its implementation. It has been suggested that in order to fully understand the policy process, the analysis should include both policy formulation and implementation. The purpose of the study was to explore and compare two policies aiming to improve health and social care in Sweden and to empirically test a new conceptual model for evidence-informed policy formulation and implementation. Two concurrent national policies were studied during the entire policy process using a longitudinal, comparative case study approach. Data was collected through interviews, observations, and documents. A Conceptual Model for Evidence-Informed Policy Formulation and Implementation was developed based on prior frameworks for evidence-informed policymaking and policy dissemination and implementation. The conceptual model was used to organize and analyze the data. The policies differed regarding the use of evidence in the policy formulation and the extent to which the policy formulation and implementation phases overlapped. Similarities between the cases were an emphasis on capacity assessment, modified activities based on the assessment, and a highly active implementation approach relying on networks of stakeholders. The Conceptual Model for Evidence-Informed Policy Formulation and Implementation was empirically useful to organize the data. The policy actors' roles and functions were found to have a great influence on the choices of strategies and collaborators in all policy phases. The Conceptual Model for Evidence-Informed Policy Formulation and Implementation was found to be useful. However, it provided insufficient guidance for analyzing actors involved in the policy process, capacity-building strategies, and overlapping policy phases. A revised version of the model that includes these aspects is suggested.
NASA Astrophysics Data System (ADS)
Budiyono; Ginandjar, P.; Saraswati, L. D.; Pangestuti, D. R.; Martini; Jati, S. P.
2018-02-01
An area of 508.28 hectares in North Semarang is flooded by tidal inundation, including Bandarharjo village, which could affect water quality in the area. People in Bandarharjo use safe water from deep groundwater, without disinfection process. More than 90% of water samples in the Bandaharjo village had poor bacteriological quality. The aimed of the research was to describe the implementation of Water Safety Plans (WSPs) program in Bandarharjo village. This was a descriptive study with steps for implementations adopted the guidelines and tools of the World Health Organization. The steps consist of introducing WSPs program, team building, training the team, examination of water safety before risk assessment, risk assessment, minor repair I, examination of water safety risk, minor repair II (after monitoring). Data were analyzed using descriptive methods. WSPs program has been introduced and formed WSPs team, and the training of the team has been conducted. The team was able to conduct risks assessment, planned the activities, examined water quality, conduct minor repair and monitoring at the source, distribution, and households connection. The WSPs program could be implemented in the coastal area in Semarang, however regularly supervision and some adjustment are needed.
Costs and benefits of health information technology.
Shekelle, Paul G; Morton, Sally C; Keeler, Emmett B
2006-04-01
An evidence report was prepared to assess the evidence base regarding benefits and costs of health information technology (HIT) systems, that is, the value of discrete HIT functions and systems in various healthcare settings, particularly those providing pediatric care. PubMed, the Cochrane Controlled Clinical Trials Register, and the Cochrane Database of Reviews of Effectiveness (DARE) were electronically searched for articles published since 1995. Several reports prepared by private industry were also reviewed. Of 855 studies screened, 256 were included in the final analyses. These included systematic reviews, meta-analyses, studies that tested a hypothesis, and predictive analyses. Each article was reviewed independently by two reviewers; disagreement was resolved by consensus. Of the 256 studies, 156 concerned decision support, 84 assessed the electronic medical record, and 30 were about computerized physician order entry (categories are not mutually exclusive). One hundred twenty four of the studies assessed the effect of the HIT system in the outpatient or ambulatory setting; 82 assessed its use in the hospital or inpatient setting. Ninety-seven studies used a randomized design. There were 11 other controlled clinical trials, 33 studies using a pre-post design, and 20 studies using a time series. Another 17 were case studies with a concurrent control. Of the 211 hypothesis-testing studies, 82 contained at least some cost data. We identified no study or collection of studies, outside of those from a handful of HIT leaders, that would allow a reader to make a determination about the generalizable knowledge of the study's reported benefit. Beside these studies from HIT leaders, no other research assessed HIT systems that had comprehensive functionality and included data on costs, relevant information on organizational context and process change, and data on implementation. A small body of literature supports a role for HIT in improving the quality of pediatric care. Insufficient data were available on the costs or cost-effectiveness of implementing such systems. The ability of Electronic Health Records (EHRs) to improve the quality of care in ambulatory care settings was demonstrated in a small series of studies conducted at four sites (three U.S. medical centers and one in the Netherlands). The studies demonstrated improvements in provider performance when clinical information management and decision support tools were made available within an EHR system, particularly when the EHRs had the capacity to store data with high fidelity, to make those data readily accessible, and to help translate them into context-specific information that can empower providers in their work. Despite the heterogeneity in the analytic methods used, all cost-benefit analyses predicted substantial savings from EHR (and health care information exchange and interoperability) implementation: The quantifiable benefits are projected to outweigh the investment costs. However, the predicted time needed to break even varied from three to as many as 13 years. HIT has the potential to enable a dramatic transformation in the delivery of health care, making it safer, more effective, and more efficient. Some organizations have already realized major gains through the implementation of multifunctional, interoperable HIT systems built around an EHR. However, widespread implementation of HIT has been limited by a lack of generalizable knowledge about what types of HIT and implementation methods will improve care and manage costs for specific health organizations. The reporting of HIT development and implementation requires fuller descriptions of both the intervention and the organizational/economic environment in which it is implemented.
College Students' Attitude towards Computer Technology
ERIC Educational Resources Information Center
Njagi, K. O.; Havice, W. L.
2011-01-01
Recent advances in the contemporary world, especially in the area of computer technology, have heralded the development and implementation of new and innovative teaching strategies and particularly with the Internet revolution. This study assessed students' attitude towards computer technology. Specifically, the study assessed differences in…
Design and implementation of a cross-sectional nutritional phenotyping study of healthy US adults
USDA-ARS?s Scientific Manuscript database
Metabolic imbalance is a key determinant of risk of chronic diseases. Metabolic health cannot be assessed solely by body mass calculations or by static, fasted state biochemical readouts. Although previous studies have described temporal responses to dietary challenges, these studies fail to assess ...
Implementation Intentions on the Effect of Salt Intake among Hypertensive Women: A Pilot Study
Cornélio, Marilia Estevam; Rodrigues, Roberta Cunha Matheus; Gallani, Maria-Cecilia
2014-01-01
This experimental study was aimed at assessing the potential effect of a theory-driven intervention—implementation intentions—on reducing salt intake among hypertensive Brazilian women. Ninety-eight participants were randomly assigned to participate in an implementation intentions intervention aimed at promoting lower salt intake through decreased addition of salt and salty spices to meals (intervention group, n = 49; group, n = 49). Endpoints were assessed at baseline and at the 2-month follow-up. Primary endpoints were a self-reporting measure of salt intake given by salt addition to meals (discretionary salt + salty spices = total added salt) and the 24 h urinary-sodium excretion. Secondary endpoints included intention, self-efficacy, and habit related to adding salt to meals. Patients in the intervention group showed a significant reduction in salt intake as assessed by 24 h urinary-sodium excretion. A significant reduction in the measure of habit was observed for both groups. No differences were observed for intention and self-efficacy. The results of this pilot study suggest the efficacy of planning strategies to help hypertensive women reduce their salt intake. PMID:25243084
An assessment of implementation and evaluation phases of strategic plans in Iranian hospitals
Sadeghifar, Jamil; Tofighi, Shahram; Roshani, Mohamad; Toulideh, Zahra; Mohsenpour, Seyedramezan; Jafari, Mehdi
2017-01-01
Objectives: To assess the implementation and evaluation phases of strategic plans in selected hospitals. Methods: We conducted a cross-sectional study of implementation and evaluation of strategic plan in 24 hospitals in 2015, using a questionnaire which consisted of two separate sections for strategic implementation and strategic evaluation. Data were analyzed with SPSS version 18. Results: Nearly one-third of hospitals claimed that they allocate their budget based on priorities and strategic goals. However, it turned out that although goals had been set, no formal announcements had been made. Most of the hospitals stated that they used measures when evaluating the plan. For hospital staff, clarifying the hospital’s priorities was the most important advantage of a strategic plan. Conclusion: There is no clear definition for strategic management in Iranian hospitals, which results in chaotic implementation and control of strategic planning. PMID:29085637
Tobacco control laws in Pakistan and their implementation: A pilot study in Karachi.
Khan, Javaid Ahmed; Amir Humza Sohail, Abdul Malik; Arif Maan, Muhammad Arslan
2016-07-01
In order to limit the high prevalence of tobacco use in Pakistan various tobacco control laws have been implemented. The objective of this study is to serve as a pilot study to assess the implementation of these laws in the largest city of Pakistan, Karachi. A cross-sectional study was conducted in Karachi. The implementation of tobacco control laws in 'smoke-free' places, the adherence of tobacco companies to these laws, the regulation of cigarette sale, and the awareness and views of the general public regarding tobacco control laws were assessed via direct observation by visits and through self-administered questionnaires. The implementation of tobacco control laws in 'smoke-free' public places was found to be poor. Out of 37, only 23(62%) brands displayed pictorial warnings on their packs. 3(8%) of the brands were available in two different kinds of packs, both with and without pictorial warnings. Cigarette sale to minors was taking place at 80(85%) of the visited cigarette outlets. 50(53%) of the outlets displayed cigarette advertisements in the form of posters. 46(40%) of the persons questioned had awareness regarding the existence of ban on smoking in public places and 126(90%) of these were in favour of it. The implementation of tobacco control law in Pakistan is poor. Non adherence to the law in public places was alarmingly high. Also, the study demonstrates the poor compliance to the tobacco control laws by tobacco companies. The sale of cigarettes is almost unregulated.
Andersen, Melvin E.; Clewell, Harvey J.; Carmichael, Paul L.; Boekelheide, Kim
2013-01-01
The 2007 report “Toxicity Testing in the 21st Century: A Vision and A Strategy” argued for a change in toxicity testing for environmental agents and discussed federal funding mechanisms that could be used to support this transformation within the USA. The new approach would test for in vitro perturbations of toxicity pathways using human cells with high throughput testing platforms. The NRC report proposed a deliberate timeline, spanning about 20 years, to implement a wholesale replacement of current in-life toxicity test approaches focused on apical responses with in vitro assays. One approach to accelerating implementation is to focus on well-studied prototype compounds with known toxicity pathway targets. Through a series of carefully executed case studies with four or five pathway prototypes, the various steps required for implementation of an in vitro toxicity pathway approach to risk assessment could be developed and refined. In this article, we discuss alternative approaches for implementation and also outline advantages of a case study approach and the manner in which the cases studies could be pursued using current methodologies. A case study approach would be complementary to recently proposed efforts to map the human toxome, while representing a significant extension toward more formal risk assessment compared to the profiling and prioritization approaches offered by programs such as the EPA’s ToxCast effort. PMID:21993955
Clinician perceptions of virtual reality to assess and treat returning veterans.
Kramer, Teresa L; Pyne, Jeffrey M; Kimbrell, Timothy A; Savary, Patricia E; Smith, Jeffrey L; Jegley, Susan M
2010-11-01
Implementation of evidence-based, innovative treatments is necessary to address posttraumatic stress disorder (PTSD) and related mental health problems of Operation Enduring Freedom and Operation Iraqi Freedom (OEF-OIF) military service personnel. The purpose of this study was to characterize mental health clinicians' perceptions of virtual reality as an assessment tool or adjunct to exposure therapy. Focus groups were conducted with 18 prescribing and nonprescribing mental health clinicians within the Veterans Health Administration. Group discussion was digitally recorded, downloaded into Ethnograph software, and coded to arrive at primary, secondary, and tertiary themes. Most frequently mentioned barriers pertained to aspects of virtual reality, followed by veteran characteristics. Organizational barriers were more relevant when implementing virtual reality as a treatment adjunct. Although the study demonstrated that use of virtual reality as a therapy was feasible and acceptable to clinicians, successful implementation of the technology as an assessment and treatment tool will depend on consideration of the facilitators and barriers that were identified.
Valla, Frederic V; Ford-Chessel, Carole; Meyer, Rosan; Berthiller, Julien; Dupenloup, Christine; Follin-Arbelet, Nathalie; Hubert, Anna; Javouhey, Etienne; Peretti, Noel
2015-03-01
The cornerstone of an optimal nutrition approach in PICUs is to evaluate the nutritional status of any patient. Anthropometric measurements and nutritional indices calculation allow for nutritional status assessment, which is not often part of routine management, as it is considered difficult to perform in this setting. We designed a study to evaluate the impact of a training program by the PICU nutritional support team on the implementation of routine anthropometric measurements on our PICU. A prospective study was performed over a 2-year period, which included: a baseline evaluation of nutritional assessment, knowledge, anthropometric measurements (weight, height, and head and mid upper arm circumferences), and nutritional indices calculation in patient files. This was followed by a training program to implement the newly developed nutrition assessment guidelines, which included anthropometrical measurements and also the interpretation of these. The impact of this nutritional assessment program was reviewed annually for 2 years after the implementation. PICU--Lyon, France. PICU nursing and medical staff, and patients admitted in February 2011, 2012, and 2013. Training program. Ninety-nine percent of staff (n = 145) attended the individual teaching. We found significant progress in nutritional awareness and confidence about nutritional assessment following the teaching program. In addition, an improvement in staff knowledge about undernutrition and its consequences were found. We enrolled 41, 55, and 91 patients in 2011, 2012, and 2013, respectively. There was a significant increase in anthropometric measurements during this time: 32%, 65% (p = 0.002), and 96% in 2013 (p < 0.001). Nutritional indices were calculated in 20%, 74% (p < 0.001), and 96% (p < 0.001) of cases. This is the first study, showing that a targeted nutritional assessment teaching program that highlights both the importance and techniques of anthropometrical measurements has successfully been implemented in a PICU. It managed to improve staff knowledge and nutritional practice.
Clark, Florence; Pyatak, Elizabeth A.; Carlson, Mike; Blanche, Erna Imperatore; Vigen, Cheryl; Hay, Joel; Mallinson, Trudy; Blanchard, Jeanine; Unger, Jennifer B.; Garber, Susan L.; Diaz, Jesus; Florindez, Lucia I.; Atkins, Michal; Rubayi, Salah; Azen, Stanley Paul
2014-01-01
Background Randomized trials of complex, non-pharmacologic interventions implemented in home and community settings, such as the University of Southern California (USC)–Rancho Los Amigos National Rehabilitation Center (RLANRC) Pressure Ulcer Prevention Study (PUPS), present unique challenges with respect to: (a) participant recruitment and retention, (b) intervention delivery and fidelity, (c) randomization and assessment, and (d) potential inadvertent treatment effects. Purpose We describe the methods employed to address the challenges confronted in implementing PUPS. In this randomized controlled trial, we are assessing the efficacy of a complex, preventive intervention in reducing the incidence of, and costs associated with, the development of medically serious pressure ulcers in people with spinal cord injury. Method Individuals with spinal cord injury recruited from RLANRC were assigned to either a 12-month preventive intervention group or a standard care control group. The primary outcome is the incidence of serious pressure ulcers with secondary endpoints including ulcer-related surgeries, medical treatment costs, and quality of life. These outcomes are assessed at 12 and 24 months after randomization. Additionally, we are studying the mediating mechanisms that account for intervention outcomes. Results PUPS has been successfully implemented, including recruitment of the target sample size of 170 participants, assurance of the integrity of intervention protocol delivery with an average 90% treatment adherence rate, and enactment of the assessment plan. However, implementation has been replete with challenges. To meet recruitment goals, we instituted a five-pronged approach customized for an underserved, ethnically diverse population. In intervention delivery, we increased staff time to overcome economic and cultural barriers to retention and adherence. To ensure treatment fidelity and replicability, we monitored intervention protocol delivery in accord with a rigorous plan. Finally, we have overcome unanticipated assessment and design concerns related to: (a) determining pressure ulcer incidence/severity, (b) randomization imbalance, and (c) inadvertent potential control group contamination. Limitations We have addressed the most daunting challenges encountered in the recruitment, assessment, and intervention phases of PUPS. Some challenges and solutions may not apply to trials conducted in other settings. Conclusions Overcoming challenges has required a multifaceted approach incorporating individualization, flexibility, and persistence as well as the ability to implement needed mid-course corrections. PMID:24577972
Group Peer Assessment for Summative Evaluation in a Graduate-Level Statistics Course for Ecologists
ERIC Educational Resources Information Center
ArchMiller, Althea; Fieberg, John; Walker, J.D.; Holm, Noah
2017-01-01
Peer assessment is often used for formative learning, but few studies have examined the validity of group-based peer assessment for the summative evaluation of course assignments. The present study contributes to the literature by using online technology (the course management system Moodle™) to implement structured, summative peer review based on…
ERIC Educational Resources Information Center
Chen, Chang-Hua
2012-01-01
This study implements a teacher professional development program with an aim toward developing mathematics teachers' discourse-based assessment practice (DAP) and exploring its possible impact on teacher discourse in sessions and in DAP in the classroom. DAP is a type of formative assessment practice which consists of questioning and feedback.…
Microprocessor based implementation of attitude and shape control of large space structures
NASA Technical Reports Server (NTRS)
Reddy, A. S. S. R.
1984-01-01
The feasibility of off the shelf eight bit and 16 bit microprocessors to implement linear state variable feedback control laws and assessing the real time response to spacecraft dynamics is studied. The complexity of the dynamic model is described along with the appropriate software. An experimental setup of a beam, microprocessor system for implementing the control laws and the needed generalized software to implement any state variable feedback control system is included.
Ramsey, Alex T; Maki, Julia; Prusaczyk, Beth; Yan, Yan; Wang, Jean; Lobb, Rebecca
2015-06-07
While there is convincing evidence on interventions to improve bowel preparation for patients, the evidence on how to implement these evidence-based practices (EBPs) in outpatient colonoscopy settings is less certain. The Strategies to Improve Colonoscopy (STIC) study compares the effect of two implementation strategies, physician education alone versus physician education plus an implementation toolkit for staff, on adoption of three EBPs (split-dosing of bowel preparation, low-literacy education, teach-back) to improve pre-procedure and intra-procedure quality measures. The implementation toolkit contains a staff education module, website containing tools to support staff in delivering EBPs, tailored patient education materials, and brief consultation with staff to determine how the EBPs can be integrated into the existing workflow. Given adaptations to the implementation plan and intentional flexibility in the delivery of the EBPs, we utilize a pragmatic study to balance external validity with demonstrating effectiveness of the implementation strategies. Participants will include all outpatient colonoscopy physicians, staff, and patients from a convenience sample of six endoscopy settings. Aim #1 will explore the relative effect of two strategies to implement patient-level EBPs on adoption and clinical quality outcomes. We will assess the change in level and trends of clinical quality outcomes (i.e., adequacy of bowel preparation, adenoma detection) using segmented regression analysis of interrupted time series data with two groups (intervention and delayed start). Aim #2 will examine the influence of organizational readiness to change on EBP implementation. We use a PRECIS diagram to reflect the extent to which each indicator of the study was pragmatic versus explanatory, revealing a largely pragmatic study. Implementation challenges have already motivated several adaptations to the original plan, reflecting the nature of implementation in real-world healthcare settings. The pragmatic study responds to the evolving needs of its healthcare partners and allows for flexibility in intervention delivery, thereby informing clinical decision-making in real-world settings. The current study will provide information about what works (intervention effectiveness), for whom it works (influence of Medicaid versus other insurance), in which contexts it works (setting characteristics that influence implementation), and how it works best (comparison of implementation strategies).
Stark, James R.; Fallon, J.D.; Fong, A.L.; Goldstein, R.M.; Hanson, P.E.; Kroening, S.E.; Lee, K.E.
1999-01-01
This report describes the design, site-selection, and implementation of the study. Methods used to collect, process, and analyze samples; characterize sites; and assess habitat are described. A comprehensive list of sample sites is provided. Sample analyses for water-quality studies included chlorophyll a, major inorganic constituents, nutrients, trace elements, tritium, radon, environmental isotopes, organic carbon, pesticides, volatile organic compounds, and other synthetic and naturallyoccurring organic compounds. Aquatic-biological samples included fish, benthic macroinvertebrates, and algal enumeration and identification, as well as synthetic-organic compounds and trace elements in fish tissue.
Augustsson, Hanna; von Thiele Schwarz, Ulrica; Stenfors-Hayes, Terese; Hasson, Henna
2015-06-01
The workplace has been suggested as an important arena for health promotion, but little is known about how the organizational setting influences the implementation of interventions. The aims of this study are to evaluate implementation fidelity in an organizational-level occupational health intervention and to investigate possible explanations for variations in fidelity between intervention units. The intervention consisted of an integration of health promotion, occupational health and safety, and a system for continuous improvements (Kaizen) and was conducted in a quasi-experimental design at a Swedish hospital. Implementation fidelity was evaluated with the Conceptual Framework for Implementation Fidelity and implementation factors used to investigate variations in fidelity with the Framework for Evaluating Organizational-level Interventions. A multi-method approach including interviews, Kaizen notes, and questionnaires was applied. Implementation fidelity differed between units even though the intervention was introduced and supported in the same way. Important differences in all elements proposed in the model for evaluating organizational-level interventions, i.e., context, intervention, and mental models, were found to explain the differences in fidelity. Implementation strategies may need to be adapted depending on the local context. Implementation fidelity, as well as pre-intervention implementation elements, is likely to affect the implementation success and needs to be assessed in intervention research. The high variation in fidelity across the units indicates the need for adjustments to the type of designs used to assess the effects of interventions. Thus, rather than using designs that aim to control variation, it may be necessary to use those that aim at exploring and explaining variation, such as adapted study designs.
Schelvis, Roosmarijn M C; Wiezer, Noortje M; Blatter, Birgitte M; van Genabeek, Joost A G M; Oude Hengel, Karen M; Bohlmeijer, Ernst T; van der Beek, Allard J
2016-12-01
The importance of process evaluations in examining how and why interventions are (un) successful is increasingly recognized. Process evaluations mainly studied the implementation process and the quality of the implementation (fidelity). However, in adopting this approach for participatory organizational level occupational health interventions, important aspects such as context and participants perceptions are missing. Our objective was to systematically describe the implementation process of a participatory organizational level occupational health intervention aimed at reducing work stress and increasing vitality in two schools by applying a framework that covers aspects of the intervention and its implementation as well as the context and participants perceptions. A program theory was developed, describing the requirements for successful implementation. Each requirement was operationalized by making use of the framework, covering: initiation, communication, participation, fidelity, reach, communication, satisfaction, management support, targeting, delivery, exposure, culture, conditions, readiness for change and perceptions. The requirements were assessed by quantitative and qualitative data, collected at 12 and 24 months after baseline in both schools (questionnaire and interviews) or continuously (logbooks). The intervention consisted of a needs assessment phase and a phase of implementing intervention activities. The needs assessment phase was implemented successfully in school A, but not in school B where participation and readiness for change were insufficient. In the second phase, several intervention activities were implemented at school A, whereas this was only partly the case in school B (delivery). In both schools, however, participants felt not involved in the choice of intervention activities (targeting, participation, support), resulting in a negative perception of and only partial exposure to the intervention activities. Conditions, culture and events hindered the implementation of intervention activities in both schools. The framework helped us to understand why the implementation process was not successful. It is therefore considered of added value for the evaluation of implementation processes in participatory organizational level interventions, foremost because of the context and mental models dimensions. However, less demanding methods for doing detailed process evaluations need to be developed. This can only be done if we know more about the most important process components and this study contributes to that knowledge base. Netherlands Trial Register NTR3284 .
Application of competency-based education in laparoscopic training.
Xue, Dongbo; Bo, Hong; Zhang, Weihui; Zhao, Song; Meng, Xianzhi; Zhang, Donghua
2015-01-01
To induce competency-based education/developing a curriculum in the training of postgraduate students in laparoscopic surgery. This study selected postgraduate students before the implementation of competency-based education (n = 16) or after the implementation of competency-based education (n = 17). On the basis of the 5 competencies of patient care, medical knowledge, practice-based learning and improvement, interpersonal and communication skills, and professionalism, the research team created a developing a curriculum chart and specific improvement measures that were implemented in the competency-based education group. On the basis of the developing a curriculum chart, the assessment of the 5 comprehensive competencies using the 360° assessment method indicated that the competency-based education group's competencies were significantly improved compared with those of the traditional group (P < .05). The improvement in the comprehensive assessment was also significant compared with the traditional group (P < .05). The implementation of competency-based education/developing a curriculum teaching helps to improve the comprehensive competencies of postgraduate students and enables them to become qualified clinicians equipped to meet society's needs.
The development of an online decision support tool for organizational readiness for change.
Khan, Sobia; Timmings, Caitlyn; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Gheihman, Galina; Straus, Sharon E
2014-05-10
Much importance has been placed on assessing readiness for change as one of the earliest steps of implementation, but measuring it can be a complex and daunting task. Organizations and individuals struggle with how to reliably and accurately measure readiness for change. Several measures have been developed to help organizations assess readiness, but these are often underused due to the difficulty of selecting the right measure. In response to this challenge, we will develop and test a prototype of a decision support tool that is designed to guide individuals interested in implementation in the selection of an appropriate readiness assessment measure for their setting. A multi-phase approach will be used to develop the decision support tool. First, we will identify key measures for assessing organizational readiness for change from a recently completed systematic review. Included measures will be those developed for healthcare settings (e.g., acute care, public health, mental health) and that have been deemed valid and reliable. Second, study investigators and field experts will engage in a mapping exercise to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a stakeholder panel will be recruited and consulted to determine the feasibility and relevance of the selected measures using a modified Delphi process. Fourth, findings from the mapping exercise and stakeholder consultation will inform the development of a decision support tool that will guide users in appropriately selecting change readiness measures. Fifth, the tool will undergo usability testing. Our proposed decision support tool will address current challenges in the field of organizational change readiness by aiding individuals in selecting a valid and reliable assessment measure that is relevant to user needs and practice settings. We anticipate that implementers and researchers who use our tool will be more likely to conduct readiness for change assessments in their settings when planning for implementation. This, in turn, may contribute to more successful implementation outcomes. We will test this tool in a future study to determine its efficacy and impact on implementation processes.
ERIC Educational Resources Information Center
Fettig, Angel; Barton, Erin E.
2014-01-01
The purpose of this literature review was to analyze the research on parent-implemented functional assessment (FA)-based interventions for reducing children's challenging behaviors. Thirteen studies met the review inclusion criteria. These studies were analyzed across independent variables, types of parent coaching and support provided,…
Feasibility of Cloud Computing Implementation for eLearning in Secondary Schools in Tanzania
ERIC Educational Resources Information Center
Mwakisole, Kennedy F.; Kissaka, Mussa M.; Mtebe, Joel S.
2018-01-01
This article assessed the feasibility of implementing eLearning systems in a cloud-based infrastructure for secondary schools in Tanzania. The study adopted questionnaire and document reviews as data collection tools. A total of 820 students successfully returned the questionnaire from seven secondary schools in Tanzania. The study found that 11%…
Total Quality Management in Logistics: A Case Study from the Trucking Industry
1992-06-01
Quality Management (TQM) movement on the logistics industry as a whole, and, more specifically, its impact within the trucking industry. Its focus then narrows to study the practical aspects of implementing a W. Edwards Deming-based quality program within a particular trucking company, Mason Transporters, Inc. The effectiveness of the company’s implementation effort is assessed using data collected from a survey questionnaire, formal interviews, and personal observations during an on- site visit. Successes and shortcomings of the implementation process are highlighted
2013-01-01
Background Venous thromboembolism (VTE) is a major cause of morbidity and mortality in hospitalised patients. VTE prevention has been identified as a major health need internationally to improve patient safety. A National Institute for Health and Clinical Excellence (NICE) guideline was issued in February 2010. Its key priorities were to assess patients for risk of VTE on admission to hospital, assess patients for bleeding risk and evaluate the risks and benefits of prescribing VTE prophylaxis. The aim of this study was to evaluate the implementation of NICE guidance and its impact on patient safety. Methods A before-after observational design was used to investigate changes in VTE risk assessment documentation and inappropriate prescribing of prophylaxis between the year prior to (2009) and the year following (2010) the implementation of NICE guidance, using data from a 3-week period during each year. A total of 408 patients were sampled in each year across four hospitals in the NHS South region. Results Implementation strategies such as audit, education and training were used. The percentage of patients for whom a VTE risk assessment was documented increased from 51.5% (210/408) in 2009 to 79.2% (323/408) in 2010; difference 27.7% (95% CI: 21.4% to 33.9%; p < 0.001). There was little evidence of change in the percentage who were prescribed prophylaxis amongst patients without a risk assessment (71.7% (142/198) in 2009 and 68.2% (58/85) in 2010; difference −3.5% (95% CI: -15.2% to 8.2%; p =0.56) nor the percentage who were prescribed low molecular weight heparin amongst patients with a contraindication (14% (4/28) in 2009 and 15% (6/41) in 2010; RD = 0.3% (95% CI: -16.5% to 17.2%; p =0.97). Conclusions The documentation of risk assessment improved following the implementation of NICE guidance; it is questionable, however, whether this led to improved patient safety with respect to prescribing appropriate prophylaxis. PMID:23734903
Cornwell, Brittany L; Brockmann, Laurie M; Lasky, Elaine C; Mach, Jennifer; McCarthy, John F
2018-06-01
The Veterans Health Administration (VHA) has achieved substantial national implementation of primary care-mental health integration (PC-MHI) services. However, little is known regarding program characteristics, variation in characteristics across settings, or associations between program fidelity and performance. This study identified core elements of PC-MHI services and evaluated their associations with program characteristics and performance. A principal-components analysis (PCA) of reports from 349 sites identified factors associated with PC-MHI fidelity. Analyses assessed the correlation among factors and between each factor and facility type (medical center or community-based outpatient clinic), primary care population size, and performance indicators (receipt of PC-MHI services, same-day access to mental health and primary care services, and extended duration of services). PCA identified seven factors: core implementation, care management (CM) assessments and supervision, CM supervision receipt, colocated collaborative care (CCC) by prescribing providers, CCC by behavioral health providers, participation in patient aligned care teams (PACTs) for special populations, and treatment of complex mental health conditions. Sites serving larger populations had greater core implementation scores. Medical centers and sites serving larger populations had greater scores for CCC by prescribing providers, CM assessments and supervision, and participation in PACTs. Greater core implementation scores were associated with greater same-day access. Sites with greater scores for CM assessments and supervision had lower scores for treatment of complex conditions. Outpatient clinics and sites serving smaller populations experienced challenges in integrated care implementation. To enhance same-day access, VHA should continue to prioritize PC-MHI implementation. Providing brief, problem-focused care may enhance CM implementation.
ERIC Educational Resources Information Center
Akom, George Viche
2010-01-01
Formative assessment, as a strategy used to improve student learning, encounters several obstacles in its implementation. This study explores changes in teachers' views and practices as they are introduced to formative assessment in a high stakes testing and limited resource environment. The study examines the extent to which teachers use the…
Chan, Camelina; Moy, Foong Ming; Lim, Jennifer N W; Dahlui, Maznah
2018-03-01
To assess the awareness, facilitators, and barriers to policy implementation related to obesity prevention for primary school children. A cross-sectional study administered using an online questionnaire. Conducted in 447 primary schools in a state in Malaysia. One school administrator from each school served as a participant. The questionnaires consisted of 32 items on awareness, policy implementation, and facilitators and barriers to policy implementation. Descriptive analysis was used to describe the awareness, facilitators, and barriers of policies implementation. Association between schools' characteristics and policy implementation was assessed using logistic regression. The majority (90%) of school administrators were aware of the policies. However, only 50% to 70% of schools had implemented the policies fully. Reported barriers were lack of equipment, insufficient training, and limited time to complete implementation. Facilitators of policy implementation were commitment from the schools, staff members, students, and canteen operators. Policy implementation was comparable in all school types and locality; except the policy on "Food and Drinks sold at the school canteens" was implemented by more rural schools compared to urban schools (odds ratio: 1.74, 95% confidence interval: 1.13-2.69). Majority of the school administrators were aware of the existing policies; however, the implementation was only satisfactory. The identified barriers to policy implementation were modifiable and thus, the stakeholders should consider restrategizing plans in overcoming them.
Davies, James; Pucher, Philip H; Ibrahim, Heba; Stubbs, Ben
2017-05-15
Electronic prescribing (EP) systems are online technology platforms by which medicines can be prescribed, administered, and stock controlled. The actual impact of EP on patient safety is not truly understood. This study seeks to assess the impact of the implementation of an EP system on safety culture, as well as assessing differences between clinical respondent groups and considering their implications. Staff completed a modified Safety Attitudes Questionnaire survey, 6 weeks following the introduction of EP across surgical services in a hospital in Dorset, England. Responses were assessed and differences between respondent groups compared. Rates of self-reported adverse events were compared before and after implementation. Overall response rate was 34.5%. There was no significant difference between usage patterns and previous experience with EP between user groups. Overall safety was felt to have been reduced by the introduction of EP. Significant differences between clinician and nonclinicians were seen in ability to discuss errors (3.23 ± 0.5 versus 2.8 ± 0.69, P = 0.004), drug chart access, and ease of medication prescribing. Regression analysis did not identify any confounding factors. Despite a significant reduction in the adverse event rate in other divisions of the hospital that did not implement EP at the same time, this same reduction was not seen in the surgical department. This is the first study to assess the impact of EP on safety culture using a validated assessment tool (Safety Attitudes Questionnaire). Overall safety culture deteriorated following introduction of EP. Problems with system usability/intuitiveness, nonstandardized implementation, and competence assessment strategies may have all contributed to this result. Centers seeking to implement EP in future must consider these factors to ensure a positive impact on patient safety and outcomes. Copyright © 2017 Elsevier Inc. All rights reserved.
Assessing corporate project impacts in changeable contexts: A human rights perspective
DOE Office of Scientific and Technical Information (OSTI.GOV)
Salcito, Kendyl, E-mail: kendyl.salcito@unibas.ch; University of Basel, P.O. Box, CH-4003 Basel; NomoGaia, 1900 Wazee Street, Suite 303, Denver, CO 80202
Project-level impact assessment was originally conceived as a snapshot taken in advance of project implementation, contrasting current conditions with a likely future scenario involving a variety of predicted impacts. Current best practice guidance has encouraged a shift towards longitudinal assessments from the pre-project stage through the implementation and operating phases. Experience and study show, however, that assessment of infrastructure-intensive projects rarely endures past the project's construction phase. Negative consequences for environmental, social and health outcomes have been documented. Such consequences clarify the pressing need for longitudinal assessment in each of these domains, with human rights impact assessment (HRIA) as anmore » umbrella over, and critical augmentation of, environmental, social and health assessments. Project impacts on human rights are more closely linked to political, economic and other factors beyond immediate effects of a company's policy and action throughout the project lifecycle. Delineating these processes requires an adequate framework, with strategies for collecting longitudinal data, protocols that provide core information for impact assessment and guidance for adaptive mitigation strategies as project-related effects change over time. This article presents general principles for the design and implementation of sustained, longitudinal HRIA, based on experience assessing and responding to human rights impact in a uranium mining project in Malawi. The case study demonstrates the value of longitudinal assessment both for limiting corporate risk and improving human welfare. - Graphical abstract: Assessing changes in human rights condition as affected by both project and context, over time. - Highlights: • Corporate capital projects affect human rights in myriad ways. • Ongoing, longitudinal impact assessment techniques are needed. • We present an approach for conducting longitudinal human rights impact assessment. • Our methodology allows distinguishing corporate impacts from contextual changes. • Promptly observing context changes and impacts enables companies to react nimbly.« less
Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment
NASA Astrophysics Data System (ADS)
Kurnia, Feni; Rosana, Dadan; Supahar
2017-08-01
This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.
ERIC Educational Resources Information Center
Hudson, Mark E.
2017-01-01
The study examined the self-reported understandings of selected 3rd to 12th grade teachers had of assessment and the assessment practices they reported implementing in their classrooms along with evidence extracted from written lesson plans. The literature on classroom assessment supports the idea that teachers who create meaningful assessments,…
ERIC Educational Resources Information Center
Lyon, Edward G.
2011-01-01
This paper describes the Assessment Practices Framework and how I used it to study a high school Chemistry teacher as she designed, implemented, and learned from a chemistry lab report. The framework consists of exploring three teacher-centered components of classroom assessment (assessment beliefs, practices, and reflection) and analyzing…
Barker, Anna; Ngam, Caitlyn; Musuuza, Jackson; Vaughn, Valerie M.; Safdar, Nasia
2017-01-01
Background Clostridium difficile infection (CDI) is the most common infectious cause of nosocomial diarrhea and its prevention is an urgent public health priority. However, reduction of CDI is challenging, because of its complex pathogenesis, large reservoirs of colonized patients, and persistence of infectious spores. The literature lacks high quality evidence for evaluating interventions, and many hospitals have implemented bundled interventions to reduce CDI with variable results. Thus, we conducted a systematic review to examine the components of CDI bundles, their implementation processes, and their impact on CDI rates. Methods We conducted a comprehensive literature search of multiple computerized databases from their date of inception through April 30, 2016. The protocol was registered in PROSPERO. Bundle effectiveness, adherence, and study quality was assessed for each study meeting criteria for inclusion. Results In the 26 studies that met inclusion criteria for this review, we found that implementation and adherence factors to interventions were variably and incompletely reported, making study reproducibility and replicability challenging. Despite contextual differences and the variety of bundle components utilized, all 26 studies reported an improvement in CDI rates. However, given the lack of randomized controlled trials in the literature, assessing a causal relationship between bundled interventions and CDI rates is currently impossible. Conclusions Cluster randomized trials that include a rigorous assessment of the implementation of bundled interventions are urgently needed to causally test the effect of intervention bundles on CDI rates. PMID:28343455
STEM-based science learning implementation to identify student’s personal intelligences profiles
NASA Astrophysics Data System (ADS)
Wiguna, B. J. P. K.; Suwarma, I. R.; Liliawati, W.
2018-05-01
Science and technology are rapidly developing needs to be balanced with the human resources that have the qualified ability. Not only cognitive ability, but also have the soft skills that support 21st century skills. Science, Technology, Engineering, and Mathematics (STEM) Education is a solution to improve the quality of learning and prepare students may be able to trained 21st century skills. This study aims to analyse the implementation of STEM-based science learning on Newton’s law of motion by identifying the personal intelligences profile junior high school students. The method used in this research is pre experiment with the design of the study one group pre-test post-test. Samples in this study were 26 junior high school students taken using Convenience Sampling. Students personal intelligences profile after learning STEM-based science uses two instruments, self-assessment and peer assessment. Intrapersonal intelligence profile based self-assessment and peer assessment are respectively 69.38; and 64.08. As for interpersonal intelligence for self-assessment instrument is 73 and the peer assessment is 60.23.
Moore, Jennifer L; Carpenter, Julia; Doyle, Anne Marie; Doyle, Laura; Hansen, Piper; Hahn, Bridget; Hornby, T George; Roth, Heidi R; Spoeri, Susan; Tappan, Rachel; Van Der Laan, Krista
2018-01-01
To examine the use and effect of the Battery of Rehabilitation Assessments and Interventions on evidence-based practice (EBP) over 6 years. Successive independent samples study. Large rehabilitation system. Successive samples of allied health clinicians (N=372) in 2009 (n=136), 2012 (n=115), and 2015 (n=121). The Battery of Rehabilitation Assessments and Interventions includes 2 components: (1) a process to synthesize, adapt, and make recommendations about the application of evidence; and (2) a process to implement the recommended practices in 3 levels of care. To assess the effect of the project, surveys on EBP perspectives, use, and barriers were conducted before Battery of Rehabilitation Assessments and Interventions implementation and 3 and 6 years after implementation. Questions about effect of the project on clinical practice were included 3 and 6 years postimplementation. Survey data indicate the Battery of Rehabilitation Assessments and Interventions resulted in a significant increase in use of EBPs to make clinical decisions and justify care. As a result of the project, survey participants reported a substantial increase in use of outcome measures in 2012 (74%) and 2015 (91%) and evidence-based interventions in 2012 (62%) and 2015 (82%). In 2012, significant differences (P≤.01) in effect of the Battery of Rehabilitation Assessments and Interventions on practice were identified between therapists who were directly involved in the project and Interventions compared with uninvolved therapists. In 2015, no significant differences existed between involved and uninvolved therapists. After 6 years of sustained implementation efforts, the Battery of Rehabilitation Assessments and Interventions expedited the adoption of EBPs throughout a large system of care in rehabilitation. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.
Lau, Erica Y; Saunders, Ruth P; Pate, Russell R
2016-11-01
The Environmental Intervention in Children's Homes (ENRICH) study was the first published physical activity intervention undertaken in residential children's homes (RCHs). The study revealed differences in implementation across the homes, which may be a key factor that affects program effectiveness. The purpose of this study was to examine the direct and indirect effects of organizational capacity, provider characteristics, and quality of prevention support system on level of implementation of the ENRICH intervention. This study analyzed the ENRICH process evaluation data collected from 24 RCHs. Bayesian Path analysis was used to examine the direct and indirect effects of organizational capacity, provider characteristics, and quality of prevention support system on level of implementation. Level of implementation across RCHs was variable, ranging from 38 to 97 % (M = 68.3, SD = 14.45). Results revealed that organizational capacity and provider characteristics had significant direct associations with level of implementation. Neither direct nor indirect associations between quality of prevention support system and level of implementation reached statistical significance. Conducting formative assessments on organizational capacity and provider characteristics and incorporating such information in implementation planning may increase the likelihood of achieving higher levels of implementation in future studies.
40 CFR 6.403 - Environmental review and assessment requirements.
Code of Federal Regulations, 2010 CFR
2010-07-01
... FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.403 Environmental review... study. EPA shall afford the affected foreign nation or international body or organization an opportunity...
40 CFR 6.403 - Environmental review and assessment requirements.
Code of Federal Regulations, 2014 CFR
2014-07-01
... FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.403 Environmental review... study. EPA shall afford the affected foreign nation or international body or organization an opportunity...
40 CFR 6.403 - Environmental review and assessment requirements.
Code of Federal Regulations, 2012 CFR
2012-07-01
... FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.403 Environmental review... study. EPA shall afford the affected foreign nation or international body or organization an opportunity...
40 CFR 6.403 - Environmental review and assessment requirements.
Code of Federal Regulations, 2013 CFR
2013-07-01
... FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.403 Environmental review... study. EPA shall afford the affected foreign nation or international body or organization an opportunity...
40 CFR 6.403 - Environmental review and assessment requirements.
Code of Federal Regulations, 2011 CFR
2011-07-01
... FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.403 Environmental review... study. EPA shall afford the affected foreign nation or international body or organization an opportunity...
NASA Astrophysics Data System (ADS)
Hindrayani, Aniek; Purwanto
2018-02-01
The failure in community involvement during the environmental documents planning may result in the failure of the planned project implementation. This study aims to determine the gap between practices and regulations that apply to the process of community involvement in the environmental documents planning, and find out inconsistency of implementation on each stakeholder in the planning of the Environmental Impact Assessment (EIA) and the environmental permit. The method used was qualitative through interview and literature study which is analyzed using triangulation model and presented in the form of concept map. The results of the study indicate that 1) the determination of community representatives based on the criteria of the impacted communities is not clearly described, 3) suggestions, opinions, and responses to the environmental impact management are not well implemented by the project proponent, 3) implementation of the environmental management of other licensed activities affecting the behavior (4) stakeholders (project proponent, EIA consultants, and EIA appraisal committee) do not play their role as mandated in applicable legislation.
ERIC Educational Resources Information Center
Palmer, Porter W.
2009-01-01
Since Federal regulations have given states the option to implement alternate assessments based on modified academic achievement standards (AA-MAS) as part of their accountability systems for a small group of students with disabilities, a number of states have made decisions about whether or not to develop and implement such an assessment.…
Paton, Fiona; Chambers, Duncan; Wilson, Paul; Eastwood, Alison; Craig, Dawn; Fox, Dave; Jayne, David; McGinnes, Erika
2014-07-22
To assess the evidence on the impact of enhanced recovery programmes for patients undergoing elective surgery in acute hospital settings in the UK. Rapid evidence synthesis. Eight databases were searched from 1990 to March 2013 without language restrictions. Relevant reports and guidelines, websites and reference lists of retrieved articles were scanned to identify additional studies. Systematic reviews, RCTs not included in the systematic reviews, economic evaluations and UK NHS cost analysis, implementation case studies and surveys of patient experience in a UK setting were eligible for inclusion. We assessed the impact of enhanced recovery programmes on health or cost-related outcomes, and assessed implementation case studies and patient experience in UK settings. Studies were quality assessed where appropriate using the Centre for Reviews and Dissemination Database of Abstracts of Reviews of Effects critical appraisal process. 17 systematic reviews and 12 additional RCTs were included. Ten relevant economic evaluations were included. No cost analysis studies were identified. Most of the evidence focused on colorectal surgery. 14 innovation case studies and 15 implementation case studies undertaken in National Health Service settings described factors critical to the success of an enhanced recovery programme. Evidence for colorectal surgery suggests that enhanced recovery programmes may reduce hospital stays by 0.5-3.5 days compared with conventional care. There were no significant differences in reported readmission rates. Other surgical specialties showed greater variation in reductions in length of stay reflecting the limited evidence identified. Findings relating to other outcomes were hampered by a lack of robust evidence and poor reporting. There is consistent, albeit limited, evidence that enhanced recovery programmes can reduce length of patient hospital stay without increasing readmission rates. The extent to which managers and clinicians considering implementing enhanced recovery programmes in UK settings can realise savings will depend on length of stay achieved under their existing care pathway. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Bridge scour countermeasure assessments at select bridges in the United States, 2014–16
Dudunake, Taylor J.; Huizinga, Richard J.; Fosness, Ryan L.
2017-05-23
In 2009, the Federal Highway Administration published Hydraulic Engineering Circular No. 23 (HEC-23) to provide specific design and implementation guidelines for bridge scour and stream instability countermeasures. However, the effectiveness of countermeasures implemented over the past decade following those guidelines has not been evaluated. Therefore, in 2013, the U.S. Geological Survey, in cooperation with the Federal Highway Administration, began a study to assess the current condition of bridge-scour countermeasures at selected sites to evaluate their effectiveness. Bridge-scour countermeasures were assessed during 2014-2016. Site assessments included reviewing countermeasure design plans, summarizing the peak and daily streamflow history, and assessments at each site. Each site survey included a photo log summary, field form, and topographic and bathymetric geospatial data and metadata. This report documents the study area and site-selection criteria, explains the survey methods used to evaluate the condition of countermeasures, and presents the complete documentation for each countermeasure assessment.
Damschroder, Laura J; Reardon, Caitlin M; Sperber, Nina; Robinson, Claire H; Fickel, Jacqueline J; Oddone, Eugene Z
2017-06-01
The Telephone Lifestyle Coaching (TLC) program provided telephone-based coaching for six lifestyle behaviors to 5321 Veterans at 24 Veterans Health Administration (VHA) medical facilities. The purpose of the study was to conduct an evaluation of the TLC program to identify factors associated with successful implementation. A mixed-methods study design was used. Quantitative measures of organizational readiness for implementation and facility complexity were used to purposively select a subset of facilities for in-depth evaluation. Context assessments were conducted using interview transcripts. The Consolidated Framework for Implementation Research (CFIR) was used to guide qualitative data collection and analysis. Factors most strongly correlated with referral rates included having a skilled implementation leader who used effective multi-component strategies to engage primary care clinicians as well as general clinic structures that supported implementation. Evaluation findings pointed to recommendations for local and national leaders to help anticipate and mitigate potential barriers to successful implementation.
Enhancing Credibility of Chemical Safety Studies: Emerging Consensus on Key Assessment Criteria
Conrad, James W.; Becker, Richard A.
2011-01-01
Objectives We examined the extent to which consensus exists on the criteria that should be used for assessing the credibility of a scientific work, regardless of its funding source, and explored how these criteria might be implemented. Data sources Three publications, all presented at a session of the 2009 annual meeting of the Society for Risk Analysis, have proposed a range of criteria for evaluating the credibility of scientific studies. At least two other similar sets of criteria have recently been proposed elsewhere. Data extraction/synthesis In this article we review these criteria, highlight the commonalities among them, and integrate them into a list of 10 criteria. We also discuss issues inherent in any attempt to implement the criteria systematically. Conclusions Recommendations by many scientists and policy experts converge on a finite list of criteria for assessing the credibility of a scientific study without regard to funding source. These criteria should be formalized through a consensus process or a governmental initiative that includes discussion and pilot application of a system for reproducibly implementing them. Formal establishment of such a system should enable the debate regarding chemical studies to move beyond funding issues and focus on scientific merit. PMID:21163723
Biology in Bloom: Implementing Bloom's Taxonomy to Enhance Student Learning in Biology
Dirks, Clarissa; Wenderoth, Mary Pat
2008-01-01
We developed the Blooming Biology Tool (BBT), an assessment tool based on Bloom's Taxonomy, to assist science faculty in better aligning their assessments with their teaching activities and to help students enhance their study skills and metacognition. The work presented here shows how assessment tools, such as the BBT, can be used to guide and enhance teaching and student learning in a discipline-specific manner in postsecondary education. The BBT was first designed and extensively tested for a study in which we ranked almost 600 science questions from college life science exams and standardized tests. The BBT was then implemented in three different collegiate settings. Implementation of the BBT helped us to adjust our teaching to better enhance our students' current mastery of the material, design questions at higher cognitive skills levels, and assist students in studying for college-level exams and in writing study questions at higher levels of Bloom's Taxonomy. From this work we also created a suite of complementary tools that can assist biology faculty in creating classroom materials and exams at the appropriate level of Bloom's Taxonomy and students to successfully develop and answer questions that require higher-order cognitive skills. PMID:19047424
Process Evaluation of an Effective Church-Based Diet Intervention: Body & Soul
ERIC Educational Resources Information Center
Campbell, Marci Kramish; Resnicow, Ken; Carr, Carol; Wang, Terry; Williams, Alexis
2007-01-01
Body & Soul has demonstrated effectiveness as a dietary intervention among African American church members. The process evaluation assessed relationships between program exposure and implementation factors and study outcomes and characterized factors important for adoption, implementation, and maintenance. Data sources included participant surveys…
Scott, Robin A; Oman, Kathleen S; Flarity, Kathleen; Comer, Jennifer L
2018-03-06
Patient falls are a significant issue in hospitalized patients and financially costly to hospitals. The Joint Commission requires that patients be assessed for fall risk and interventions in place to mitigate the risk of falls. It is imperative to have a patient population/setting specific fall risk assessment tool to identify patients at risk for falling. The purpose of this study was to evaluate the reliability and validity of the 2013 Memorial ED Fall Risk Assessment tool (MEDFRAT) specifically designed for the ED population. A two-phase prospective design was used for this study. Phase one determined the interrater reliability of the MEDFRAT. Phase two assessed the validity of the MEDFRAT in an emergency department (ED) within a 600-bed academic/teaching institution; Level II Trauma Center with >100,000 annual patient visits. The Memorial ED Fall Risk Assessment Tool was validated in this ED setting. The tool demonstrated positive interrater reliability (k=0.701) and when implemented with a falls prevention strategy and staff education demonstrated a 48% decrease in ED fall rate (0.57 falls/1000 patient visits) post implementation during the study period. The MEDFRAT, an evidenced based ED-specific fall risk tool was implemented on the basis of the risk factors consistently identified in the literature: prior fall history, impaired mobility, altered mental status, altered elimination, and the use of sedative medication. The Memorial ED Fall Risk Assessment Tool demonstrated to be a valid tool for this hospital system. Copyright © 2018 Emergency Nurses Association. Published by Elsevier Inc. All rights reserved.
Lewis, Cara C; Fischer, Sarah; Weiner, Bryan J; Stanick, Cameo; Kim, Mimi; Martinez, Ruben G
2015-11-04
High-quality measurement is critical to advancing knowledge in any field. New fields, such as implementation science, are often beset with measurement gaps and poor quality instruments, a weakness that can be more easily addressed in light of systematic review findings. Although several reviews of quantitative instruments used in implementation science have been published, no studies have focused on instruments that measure implementation outcomes. Proctor and colleagues established a core set of implementation outcomes including: acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, sustainability (Adm Policy Ment Health Ment Health Serv Res 36:24-34, 2009). The Society for Implementation Research Collaboration (SIRC) Instrument Review Project employed an enhanced systematic review methodology (Implement Sci 2: 2015) to identify quantitative instruments of implementation outcomes relevant to mental or behavioral health settings. Full details of the enhanced systematic review methodology are available (Implement Sci 2: 2015). To increase the feasibility of the review, and consistent with the scope of SIRC, only instruments that were applicable to mental or behavioral health were included. The review, synthesis, and evaluation included the following: (1) a search protocol for the literature review of constructs; (2) the literature review of instruments using Web of Science and PsycINFO; and (3) data extraction and instrument quality ratings to inform knowledge synthesis. Our evidence-based assessment rating criteria quantified fundamental psychometric properties as well as a crude measure of usability. Two independent raters applied the evidence-based assessment rating criteria to each instrument to generate a quality profile. We identified 104 instruments across eight constructs, with nearly half (n = 50) assessing acceptability and 19 identified for adoption, with all other implementation outcomes revealing fewer than 10 instruments. Only one instrument demonstrated at least minimal evidence for psychometric strength on all six of the evidence-based assessment criteria. The majority of instruments had no information regarding responsiveness or predictive validity. Implementation outcomes instrumentation is underdeveloped with respect to both the sheer number of available instruments and the psychometric quality of existing instruments. Until psychometric strength is established, the field will struggle to identify which implementation strategies work best, for which organizations, and under what conditions.
Wu, R Ryanne; Myers, Rachel A; Sperber, Nina; Voils, Corrine I; Neuner, Joan; McCarty, Catherine A; Haller, Irina V; Harry, Melissa; Fulda, Kimberly G; Cross, Deanna; Dimmock, David; Rakhra-Burris, Teji; Buchanan, Adam H; Ginsburg, Geoffrey S; Orlando, Lori A
2018-06-06
This paper describes the implementation outcomes associated with integrating a family health history-based risk assessment and clinical decision support platform within primary care clinics at four diverse healthcare systems. A type III hybrid implementation-effectiveness trial. Uptake and implementation processes were evaluated using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. One hundred (58%) primary care providers and 2514 (7.8%) adult patients enrolled. Enrolled patients were 69% female, 22% minority, and 32% Medicare/Medicaid. Compared with their respective clinic's population, patient-participants were more likely to be female (69 vs. 59%), older (mean age 57 vs. 49), and Caucasian (88 vs. 69%) (all p values <0.001). Female (81.3% of females vs. 78.5% of males, p value = 0.018) and Caucasian (Caucasians 90.4% vs. minority 84.1%, p value = 0.02) patient-participants were more likely to complete the study once enrolled. Patient-participant survey responses indicated MeTree was easy to use (95%), and patient-participants would recommend it to family/friends (91%). Minorities and those with less education reported greatest benefit. Enrolled providers reflected demographics of underlying provider population. Family health history-based risk assessment can be effectively implemented in diverse primary care settings and can effectively engage patients and providers. Future research should focus on finding better ways to engage young adults, males, and minorities in preventive healthcare.
A Case Study of Teachers' Practices Using Formative Assessment for Fifth Grade Mathematics Students
ERIC Educational Resources Information Center
Veon, Kenneth E.
2016-01-01
Formative assessment is a classroom learning process that consists of clear goals and objectives, assessing students' knowledge, providing feedback and adjusting instruction based upon the data within a socially interactive process. Because of inconsistent implementation of the formative assessment process within classrooms, the efficacy of the…
Impact of Portfolio Assessment on Physics Students' Outcomes: Examination of Learning and Attitude
ERIC Educational Resources Information Center
Gunay, Abdulkadir; Ogan-Bekiroglu, Feral
2014-01-01
In spite of the commendations for the use of portfolio assessment, there is still little evidence indicating that such assessment actually supports and encourages student learning. Hence, this research study aimed to empirically identify the effects of implementation of portfolio assessment on student learning and attitudes. True-experimental…
Student Perceptions of Formative Assessment in the Chemistry Classroom
ERIC Educational Resources Information Center
Haroldson, Rachelle Ann
2012-01-01
Research on formative assessment has focused on the ways teachers implement and use formative assessment to check student understanding in order to guide their instruction. This study shifted emphasis away from teachers to look at how students use and perceive formative assessment in the science classroom. Four key strategies of formative…
ERIC Educational Resources Information Center
Sick, Paul; Shapiro, Joan Poliner
Participatory evaluation is an assessment approach that involves the participants of a study from beginning to end. The evaluation strategy was implemented in a public school district to assess teacher involvement in decisionmaking, determine whether teachers desire more participation, and evaluate the assessment strategy itself. Data were…
Boersma, Petra; van Weert, Julia C M; Lissenberg-Witte, Birgit I; van Meijel, Berno; Dröes, Rose-Marie
2018-01-08
There is a lack of research on implementation of person-centered care in nursing home care. The purpose of this study was to assess the implementation of the Veder contact method (VCM), a new person-centered method using theatrical, poetic and musical communication for application in 24-hr care. Caregivers (n = 136) and residents (n = 141) participated in a 1-year quasi-experimental study. Foundation Theater Veder implemented VCM on six experimental wards and rated implementation quality. Six control wards delivered care-as-usual. Before and after implementation, caregiver behavior was assessed during observations using the Veder-observation list and Quality of Caregivers' Behavior-list. Caregiver attitude was rated with the Approaches to Dementia Questionnaire. Quality of life, behavior, and mood of the residents were measured with QUALIDEM, INTERACT and FACE. Residents' care plans were examined for person-centered background information. Significant improvements in caregivers' communicative behavior (i.e., the ability to apply VCM, establishing positive interactions) and some aspects of residents' behavior and quality of life (i.e., positive affect, social relations) were found on the experimental wards with a high implementation score, as compared to the experimental wards with a low implementation score, and the control wards. No significant differences were found between the groups in caregivers' attitudes, residents' care plans, or mood. The positive changes in caregivers' behavior and residents' well-being on the high implementation score wards confirm the partly successful VCM implementation. Distinguishing between wards with a high and low implementation score provided insight into factors which are crucial for successful implementation. © The Author(s) 2018. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Assessment and measurement of patient-centered medical home implementation: the BCBSM experience.
Alexander, Jeffrey A; Paustian, Michael; Wise, Christopher G; Green, Lee A; Fetters, Michael D; Mason, Margaret; El Reda, Darline K
2013-01-01
Our goal was to describe an approach to patient-centered medical home (PCMH) measurement based on delineating the desired properties of the measurement relative to assumptions about the PCMH and the uses of the measure by Blue Cross Blue Shield of Michigan (BCBSM) and health services researchers. We developed and validated an approach to assess 13 functional domains of PCMHs and 128 capabilities within those domains. A measure of PCMH implementation was constructed using data from the validated self-assessment and then tested on a large sample of primary care practices in Michigan. Our results suggest that the measure adequately addresses the specific requirements and assumptions underlying the BCBSM PCMH program-ability to assess change in level of implementation; ability to compare across practices regardless of size, affiliation, or payer mix; and ability to assess implementation of the PCMH through different sequencing of capabilities and domains. Our experience illustrates that approaches to measuring PCMH should be driven by the measures' intended use(s) and users, and that a one-size-fits-all approach may not be appropriate. Rather than promoting the BCBSM PCMH measure as the gold standard, our study highlights the challenges, strengths, and limitations of developing a standardized approach to PCMH measurement.
Wu, R Ryanne; Myers, Rachel A; McCarty, Catherine A; Dimmock, David; Farrell, Michael; Cross, Deanna; Chinevere, Troy D; Ginsburg, Geoffrey S; Orlando, Lori A
2015-11-24
Risk assessment with a thorough family health history is recommended by numerous organizations and is now a required component of the annual physical for Medicare beneficiaries under the Affordable Care Act. However, there are several barriers to incorporating robust risk assessments into routine care. MeTree, a web-based patient-facing health risk assessment tool, was developed with the aim of overcoming these barriers. In order to better understand what factors will be instrumental for broader adoption of risk assessment programs like MeTree in clinical settings, we obtained funding to perform a type III hybrid implementation-effectiveness study in primary care clinics at five diverse healthcare systems. Here, we describe the study's protocol. MeTree collects personal medical information and a three-generation family health history from patients on 98 conditions. Using algorithms built entirely from current clinical guidelines, it provides clinical decision support to providers and patients on 30 conditions. All adult patients with an upcoming well-visit appointment at one of the 20 intervention clinics are eligible to participate. Patient-oriented risk reports are provided in real time. Provider-oriented risk reports are uploaded to the electronic medical record for review at the time of the appointment. Implementation outcomes are enrollment rate of clinics, providers, and patients (enrolled vs approached) and their representativeness compared to the underlying population. Primary effectiveness outcomes are the percent of participants newly identified as being at increased risk for one of the clinical decision support conditions and the percent with appropriate risk-based screening. Secondary outcomes include percent change in those meeting goals for a healthy lifestyle (diet, exercise, and smoking). Outcomes are measured through electronic medical record data abstraction, patient surveys, and surveys/qualitative interviews of clinical staff. This study evaluates factors that are critical to successful implementation of a web-based risk assessment tool into routine clinical care in a variety of healthcare settings. The result will identify resource needs and potential barriers and solutions to implementation in each setting as well as an understanding potential effectiveness. NCT01956773.
Implementation of treatment guidelines for specialist mental health care.
Bighelli, Irene; Ostuzzi, Giovanni; Girlanda, Francesca; Cipriani, Andrea; Becker, Thomas; Koesters, Markus; Barbui, Corrado
2016-12-15
A huge gap exists between the production of evidence and its uptake in clinical practice settings. To fill this gap, treatment guidelines, based on explicit assessments of the evidence base, are commonly used in several fields of psychiatry, including schizophrenia and related psychotic disorders. However, it remains unclear whether treatment guidelines have any material impact on provider performance and patient outcomes, and how implementation should be conducted to maximise benefit. The primary objective of this review was to examine the efficacy of guideline implementation strategies in improving process outcomes (performance of healthcare providers) and patient outcomes. We also explored which components of different guideline implementation strategies could influence them. We searched the Cochrane Schizophrenia Group Register (March 2012 and August 2015), as well as references of included studies. Studies that examined schizophrenia-spectrum disorders to compare guideline implementation strategies with usual care or to assess the comparative efficacy of different guideline implementation strategies. Review authors worked independently and in duplicate to critically appraise records from 990 studies; six individual studies met the inclusion criteria. Among the six included studies, significant heterogeneity was found in the focus of the guideline, target of the intervention, implementation strategy, and outcome measures, so meta-analysis was carried out for antipsychotic co-prescribing only. This review now includes six studies, with a total of 1727 participants. Of the six included studies, practitioner impact was assessed in four. Overall, risk of bias was rated as low or unclear, and all evidence in the 'Summary of findings' tables was graded as low or very low quality. Meta-analysis revealed that a combination of several guideline dissemination and implementation strategies targeting healthcare professionals did not reduce antipsychotic co-prescribing in schizophrenia outpatients (2 RCTs, N = 1082, RR 1.10 CI 0.99 to 1.23; corrected for cluster design: N = 310, RR 0.97, CI 0.75 to 1.25, very low-quality evidence). One trial, which studied a nurse-led intervention aimed at promoting cardiovascular disease screening, found a significant effect in the proportion of people receiving screening (Framingham score: N = 110, RR 0.69, 95% CI 0.55 to 0.87), although in the analysis corrected for cluster design, the effect was no longer statistically significant (N = 38, RR 0.71, 95% CI 0.48 to 1.03, very low-quality evidence).One trial reported the patient outcomes of global state, satisfaction with care, treatment adherence, and drug attitude; no effect between treatments was seen. Quality of life was not reported by any of the studies.One trial, which studied the use of re-written guideline text compared to original text, did not find a significant effect on staff receiving training (N = 68, RR 1.03, 95% CI 0.87 to 1.21, low-quality evidence), staff receiving supervision (N = 68, RR 0.86, 95% CI 0.64 to 1.17, low-quality evidence), or staff providing psychological interventions (N = 68, RR 0.86, 95% CI 0.62 to 1.18, low-quality evidence).Regarding participant outcomes, only one trial assessed the efficacy of a shared decision-making implementation strategy and found no impact on psychopathology, satisfaction with care, or drug attitude. Another single trial studied a multifaceted intervention to promote medication adherence and found no effect on adherence rates. Considering the available evidence, it is not possible to arrive at definitive conclusions. The preliminary pattern of evidence suggests that uncertainty remains about clinically meaningful and sustainable effects of treatment guidelines on patient outcomes and how best to implement such guidelines for maximal benefit.
Effectively teaching self-assessment: preparing the dental hygiene student to provide quality care.
Jackson, Sarah C; Murff, Elizabeth J Tipton
2011-02-01
Literature on self-assessment presents substantial evidence regarding the impact of self-assessment on dental practitioners and quality of care. Related dental hygiene research documents a need to enhance self-assessment curricula; however, no published curriculum module exists to effectively teach self-assessment. The purpose of this study was to explore the impact of a self-assessment educational module for dental hygiene curricula designed using adult learning principles. This module was implemented with thirty-three dental hygiene students in their junior year using a one-group, pretest-posttest design. Results analyzed using matched pairs Wilcoxon signed-rank test indicated the self-assessment module was effective (p<0.01 corresponding to a Bonferroni FWER of 0.20) in improving some aspects of the students' perceptions and voluntary clinical application of self-assessment. No statistically significant relationship was found between the students' perceptions and their application of self-assessment using Pearson's correlation. The quality of self-assessment comments on the students' daily clinical evaluation forms was also enhanced after module implementation (p<0.05). This change in quality after module implementation was demonstrated by a quantitative analysis using a self-designed rubric and a qualitative thematic analysis of student comments to identify predominant themes. Students also were surveyed to determine which module components were most effective. Findings indicate a self-assessment educational module enhanced these dental hygiene students' self-assessment perceptions and skills.
Pereira, Alexandre C; Bensenor, Isabela M; Fedeli, Ligia M; Castilhos, Cristina; Vidigal, Pedro G; Maniero, Viviane; Leite, Claudia M; Pimentel, Robercia A; Duncan, Bruce B; Mill, Jose Geraldo; Lotufo, Paulo A
2013-06-01
The Brazilian Longitudinal Study for Adult Health (ELSA-Brasil) is a multicenter prospective cohort of civil servants designed to assess the determinants of chronic diseases, especially cardiovascular diseases and type 2 diabetes. The present article describes the main design and implementation points of the ELSA-Brasil biobank project. Economic, political, logistical and technological aspects of this study are characterized. Additionally, it discusses the final biorepository protocol and the facilities implemented to achieve this objective. The design and implementation process of the ELSA-Brasil biobank took three years to be performed. Both the central and local biobanks were built according to the best biorepository techniques, using different technological solutions for the distinct needs expected in this study.
Knight, Andrew T; Driver, Amanda; Cowling, Richard M; Maze, Kristal; Desmet, Philip G; Lombard, Amanda T; Rouget, Mathieu; Botha, Mark A; Boshoff, Andre F; Castley, J Guy; Goodman, Peter S; Mackinnon, Kathy; Pierce, Shirley M; Sims-Castley, Rebecca; Stewart, Warrick I; von Hase, Amrei
2006-06-01
Systematic conservation assessment and conservation planning are two distinct fields of conservation science often confused as one and the same. Systematic conservation assessment is the technical, often computer-based, identification of priority areas for conservation. Conservation planning is composed of a systematic conservation assessment coupled with processes for development of an implementation strategy and stakeholder collaboration. The peer-reviewed conservation biology literature abounds with studies analyzing the performance of assessments (e.g., area-selection techniques). This information alone, however can never deliver effective conservation action; it informs conservation planning. Examples of how to translate systematic assessment outputs into knowledge and then use them for "doing" conservation are rare. South Africa has received generous international and domestic funding for regional conservation planning since the mid-1990s. We reviewed eight South African conservation planning processes and identified key ingredients of best practice for undertaking systematic conservation assessments in a way that facilitates implementing conservation action. These key ingredients include the design of conservation planning processes, skills for conservation assessment teams, collaboration with stakeholders, and interpretation and mainstreaming of products (e.g., maps) for stakeholders. Social learning institutions are critical to the successful operationalization of assessments within broader conservation planning processes and should include not only conservation planners but also diverse interest groups, including rural landowners, politicians, and government employees.
Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Booth, Andrew; Harden, Angela; Hannes, Karin; Thomas, James; Flemming, Kate; Garside, Ruth; Noyes, Jane
2018-05-01
This article provides reviewers with guidance on methods for identifying and processing evidence to understand intervention implementation. Strategies, tools, and methods are applied to the systematic review process to illustrate how process and implementation can be addressed using quantitative, qualitative, and other sources of evidence (i.e., descriptive textual and nonempirical). Reviewers can take steps to navigate the heterogeneity and level of uncertainty present in the concepts, measures, and methods used to assess implementation. Activities can be undertaken in advance of a Cochrane quantitative review to develop program theory and logic models that situate implementation in the causal chain. Four search strategies are offered to retrieve process and implementation evidence. Recommendations are made for addressing rigor or risk of bias in process evaluation or implementation evidence. Strategies are recommended for locating and extracting data from primary studies. The basic logic is presented to assist reviewers to make initial review-level judgments about implementation failure and theory failure. Although strategies, tools, and methods can assist reviewers to address process and implementation using quantitative, qualitative, and other forms of evidence, few exemplar reviews exist. There is a need for further methodological development and trialing of proposed approaches. Copyright © 2017 Elsevier Inc. All rights reserved.
French, Simon D; Green, Sally E; Francis, Jill J; Buchbinder, Rachelle; O'Connor, Denise A; Grimshaw, Jeremy M; Michie, Susan
2015-01-01
Objectives Implementation intervention effects can only be fully realised and understood if they are faithfully delivered. However the evaluation of implementation intervention fidelity is not commonly undertaken. The IMPLEMENT intervention was designed to improve the management of low back pain by general medical practitioners. It consisted of a two-session interactive workshop, including didactic presentations and small group discussions by trained facilitators. This study aimed to evaluate the fidelity of the IMPLEMENT intervention by assessing: (1) observed facilitator adherence to planned behaviour change techniques (BCTs); (2) comparison of observed and self-reported adherence to planned BCTs and (3) variation across different facilitators and different BCTs. Design The study compared planned and actual, and observed versus self-assessed delivery of BCTs during the IMPLEMENT workshops. Method Workshop sessions were audiorecorded and transcribed verbatim. Observed adherence of facilitators to the planned intervention was assessed by analysing the workshop transcripts in terms of BCTs delivered. Self-reported adherence was measured using a checklist completed at the end of each workshop session and was compared with the ‘gold standard’ of observed adherence using sensitivity and specificity analyses. Results The overall observed adherence to planned BCTs was 79%, representing moderate-to-high intervention fidelity. There was no significant difference in adherence to BCTs between the facilitators. Sensitivity of self-reported adherence was 95% (95% CI 88 to 98) and specificity was 30% (95% CI 11 to 60). Conclusions The findings suggest that the IMPLEMENT intervention was delivered with high levels of adherence to the planned intervention protocol. Trial registration number The IMPLEMENT trial was registered in the Australian New Zealand Clinical Trials Registry, ACTRN012606000098538 (http://www.anzctr.org.au/trial_view.aspx?ID=1162). PMID:26155819
Dilu, Eyilachew; Gebreslassie, Measho; Kebede, Mihiretu
2017-12-20
Health workforce information systems in low-income countries tend to be defective with poor relationship to information sources. Human Resource Information System (HRIS) is currently in a pilot implementation phase in the Federal Ministry of Health and Regional Health Bureaus of Ethiopia. Before scaling up the implementation, it is important to understand the implementation readiness of hospitals and health departments. The aims of this study were to assess the readiness for HRIS implementation, identify associated factors, and explore the implementation challenges in public hospitals and health departments of the Amhara National Regional State, Ethiopia. An institution-based cross-sectional study supplemented with a qualitative study was conducted from the 15th of February to the 30th of March 2016 in 19 public hospitals and health departments of the Amhara National Regional State, Ethiopia. A self-administered questionnaire was used to collect the data. The questionnaire includes items on socio-demographic characteristics and questions measuring technical, personal, and organizational factors adapted from the 32-item questionnaire of the Management Science for Health (MSH) HRIS readiness assessment tool. The data were entered and analyzed with statistical software. Descriptive statistics and bivariate and multivariable logistic regression analyses were performed. Odds ratios with 95% confidence interval were computed to identify the factors statistically associated with readiness of HRIS implementation. In-depth interviews and observation checklists were used to collect qualitative data. Thematic content analysis was used to analyze the qualitative data. A total of 246 human resource (HR) employees and 16 key informants have been included in the study. The HR employee's level of readiness for HRIS implementation in this study was 35.8%. Employee's Internet access (AOR = 2.59, 95%CI = 1.19, 5.62), availability of separate HR section (AOR = 8.08, 95%CI = 3.69, 17.70), basic computer skills (AOR = 6.74, 95%CI = 2.75, 16.56), and fear of unemployment (AOR = 2.83, 95%CI = 1.27, 6.32) were associated with readiness of HRIS implementation. Poor logistic supply, lack of competency, poor commitment, and shortage of finance were the challenges of HRIS implementation. In this study, readiness of HRIS implementation was low. Strategies targeting to improve skills, awareness, and attitude of HR employees would facilitate the implementation process.
Implementing Curriculum-Embedded Formative Assessment in Primary School Science Classrooms
ERIC Educational Resources Information Center
Hondrich, Annika Lena; Hertel, Silke; Adl-Amini, Katja; Klieme, Eckhard
2016-01-01
The implementation of formative assessment strategies is challenging for teachers. We evaluated teachers' implementation fidelity of a curriculum-embedded formative assessment programme for primary school science education, investigating both material-supported, direct application and subsequent transfer. Furthermore, the relationship between…
NASA Astrophysics Data System (ADS)
Tran, Manh Thang
This study compares ICT policy and curriculum and assessment practices between Australian and Vietnamese secondary schools, and investigates differences between these two school systems. Document analyses and case studies were used to examine the key differences in ICT curriculum and policy and assessment practices between Australian and Vietnamese secondary schools. The document analyses focused on the intended ICT policy and curriculum and assessment, as presented in official documents in both countries. Using a case study approach for in-depth examination, two secondary schools were selected (one from Yenbai province, Vietnam and one from Sydney, New South Wales, Australia). Two principals and three teachers were interviewed. Classroom teaching and assessment practices were observed, and principals and teachers' views were obtained through semi-structured interviews and extensive discussions. Findings from the two case studies were compared with the findings from the document analysis. This study explored and analysed differences in ICT teaching, learning, assessment, and achievement between Vietnamese and Australian secondary students. It was found that that Australian ICT school curricula and assessment differed markedly from the Vietnamese system. Student ICT achievement in these Australian and Vietnamese schools could not only be attributed to higher standards of intended ICT curricula and assessment, or teacher knowledge or classroom practices. These differences are better explained by economic and cultural factors, ICT policies and their degrees of implementation, and extra ICT curricula. In order to bridge the gap and implement adequate ICT curricula and policies, rigorous professional training in teaching and assessment is essential for both Australian and Vietnamese teachers. In order to improve Australian students' ICT achievement, achievement motivation must be addressed. Many challenging aspects were found in ICT policies and classrooms in the Vietnamese educational system that calls for immediate change and improvement. In order to implement reforms in Vietnamese education, the impact of cultural influence must be considered more seriously. In particular, this study highlights the need to integrate case study with large-scale study in international comparative studies.
Professional Learning Communities and Their Impact on Student Achievement
ERIC Educational Resources Information Center
Story, Zenobia N.
2012-01-01
The purpose of the study was to assess the impact that professional learning communities (PLCs) have on student achievement. Through this study, the statewide performance results of a school district that implemented PLCs were examined. This study of an Illinois school district's statewide assessment results served as a foundation for further…
Using a Multiple Intelligences Assessment To Facilitate Teacher Development.
ERIC Educational Resources Information Center
Shearer, C. Branton
In phase 1 of this study, development and validation studies of a new assessment for the multiple intelligences were conducted. The second phase of the study was a pilot implementation project during a single academic year in collaboration with several public school teachers. Phase 1 involved a series of activities including initial instrument…
Ray-Barruel, Gillian; Cooke, Marie; Mitchell, Marion; Chopra, Vineet; Rickard, Claire M
2018-06-04
Millions of acute care hospital patients need a peripheral intravenous catheter (PIVC) each year. However, up to half of PIVCs remain in situ when not being used, and 30%-50% of intravenous (IV) catheters develop complications or stop working before treatment is finished, requiring the insertion of a new device. Improved assessment could prompt timely removal of redundant catheters and prevent IV complications. This study aims to validate an evidence-based PIVC assessment and decision-making tool called I-DECIDED and evaluate the effect of implementing this tool into acute hospital clinical practice. The protocol outlines a prospective, multicentre, mixed-methods study using an interrupted time-series (multiple measures preintervention and postintervention) implementation at three Australian hospitals between August 2017 and July 2018. The study will examine the effectiveness of the I-DECIDED assessment and decision-making tool in clinical practice on prompting timely PIVC removal and early detection of complications. Primary outcomes are prevalence of redundant PIVCs (defined as device in situ without a clear purpose), IV complications (occlusion, dislodgement, infiltration, extravasation and phlebitis) and substandard dressings (loose, lifting, moist or soiled); device utilisation ratios; and primary bloodstream infection rates. Secondary outcomes including staff barriers and enablers to PIVC assessment and removal, patient participation, documentation of PIVC assessment and decisions taken to continue or remove the PIVC will be recorded. Using the Promoting Action on Research Implementation in Health Services framework, we will undertake staff focus groups, bedside patient interviews and PIVC assessments and chart audits. Patients aged 18 years or more with a PIVC will be eligible for inclusion. Ethical approval from Queensland Health (HREC/17/QPCH/47), Griffith University (Ref No. 2017/152) and St Vincent's Health and Aged Care Human Research and Ethics Committee (Ref No. 17/28). Results will be published. ANZCTR: 12617000067370; Pre-results. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
ERIC Educational Resources Information Center
Tesfay, Hailay
2017-01-01
This study aims to investigate Ethiopian higher education Amharic language writing skills instructors' practices of Assessment Methods in writing skill context. It was also intended to look for their viewpoints about the practicality of implementing Assessment Methods in Amharic writing courses. In order to achieve the goals of this study,…
ERIC Educational Resources Information Center
Shirley, Debra J.
2012-01-01
The purpose of this study is to identify the self-reported research-based instructional and assessment practices used by third through fifth grade teachers among rural school environments in Western Pennsylvania which have attained Adequate Yearly Progress (AYP) pursuant to statewide assessments. Specifically, this study examines the…
ERIC Educational Resources Information Center
Patry, Marc W.; Magaletta, Philip R.; Diamond, Pamela M.; Weinman, Beth A.
2011-01-01
Although not originally designed for implementation in correctional settings, researchers and clinicians have begun to use the Personality Assessment Inventory (PAI) to assess offenders. A relatively small number of studies have made attempts to validate the alcohol and drug abuse scales of the PAI, and only a very few studies have validated those…
ERIC Educational Resources Information Center
Shooshtari, Shahin; Temple, Beverley; Waldman, Celeste; Abraham, Sneha; Ouellette-Kuntz, Héléne; Lennox, Nicholas
2017-01-01
Background: No standardized tool is used in Canada for comprehensive health assessments of adults with intellectual disabilities. This study was conducted to determine the feasibility of implementing the Comprehensive Health Assessment Program (CHAP) in Manitoba, Canada. Method: This was a qualitative study using a purposive sample of physicians,…
NASA Astrophysics Data System (ADS)
Aydogan Yenmez, Arzu; Erbas, Ayhan Kursat; Cakiroglu, Erdinc; Alacaci, Cengiz; Cetinkaya, Bulent
2017-08-01
Applications and modelling have gained a prominent role in mathematics education reform documents and curricula. Thus, there is a growing need for studies focusing on the effective use of mathematical modelling in classrooms. Assessment is an integral part of using modelling activities in classrooms, since it allows teachers to identify and manage problems that arise in various stages of the modelling process. However, teachers' difficulties in assessing student modelling work are a challenge to be considered when implementing modelling in the classroom. Thus, the purpose of this study was to investigate how teachers' knowledge on generating assessment criteria for assessing student competence in mathematical modelling evolved through a professional development programme, which is based on a lesson study approach and modelling perspective. The data was collected with four teachers from two public high schools over a five-month period. The professional development programme included a cyclical process, with each cycle consisting of an introductory meeting, the implementation of a model-eliciting activity with students, and a follow-up meeting. The results showed that the professional development programme contributed to teachers' knowledge for generating assessment criteria on the products, and the observable actions that affect the modelling cycle.
Ikeda, Chiseko; Saeki, Kazuko; Hirano, Michiyo
2016-06-21
Stress assessments are due to be conducted in December 2015. It is expected that there will be an increase in the number of private health agencies that provide stress assessment services and mental health care. This study aimed to clarify the current situation of and the factors related to stress assessments conducted by nurses in occupational health agencies. Nurses working full time were randomly selected from 60 organizations that were members of the National Federation of Industrial Health Organization. Self-administered questionnaires were sent out between November 2013 and January 2014. The questionnaire included the personal attributes of the participants, training programs, job contents, and how practical mental health care, including stress assessment, is. The study was approved by the ethics committees in the respective organizations. Out of the 162 questionnaires that were distributed, 89 (54.9%) were returned and 85 (53.1%) were valid for analysis. Stress assessments were conducted by 38.8% of the participants. With reference to their confidence in conducting stress assessments, "confidence and" 70.6%, respectively. The groups that conducted and did not conduct the stress assessments did not show any differences in the findings or other attributes. Further, the implementation of stress assessment was not associated with occupational health nurse (OHN) training, education, position, age, years of experience, attendance of lectures on mental health, etc. However, the confidence in conducting the assessment was related to age when dealing with cases on confidence stress assessment consultation in follow-up to the implementation of screening, such as stress, persons at high risk, and so on. Approximately 40% of the nurses were already conducting stress assessments, but most of them conducted such assessments about once a year and were not deeply involved in them. Approximately 70% of the nurses were confident in implementing stress assessments. Further, they reported that they were confident to do so even if OHNs were not involved. We found that to encourage OHNs in occupational health agencies to provide mental health care and stress assessments, practical training programs are required. Such programs should include a series of stress assessments and help foster cooperation with superiors, colleagues, and occupational health staff such that the OHNs obtain experience and confidence.
Ory, Marcia G; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee
2014-01-01
Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance.
The Workshop Program on Authentic Assessment for Science Teachers
NASA Astrophysics Data System (ADS)
Rustaman, N. Y.; Rusdiana, D.; Efendi, R.; Liliawati, W.
2017-02-01
A study on implementing authentic assessment program through workshop was conducted to investigate the improvement of the competence of science teachers in designing performance assessment in real life situation at school level context. A number of junior high school science teachers and students as participants were involved in this study. Data was collected through questionnaire, observation sheets, and pre-and post-test during 4 day workshop. This workshop had facilitated them direct experience with seventh grade junior high school students during try out. Science teachers worked in group of four and communicated each other by think-pair share in cooperative learning approach. Research findings show that generally the science teachers’ involvement and their competence in authentic assessment improved. Their knowledge about the nature of assessment in relation to the nature of science and its instruction was improved, but still have problem in integrating their design performance assessment to be implemented in their lesson plan. The 7th grade students enjoyed participating in the science activities, and performed well the scientific processes planned by group of science teachers. The response of science teachers towards the workshop was positive. They could design the task and rubrics for science activities, and revised them after the implementation towards the students. By participating in this workshop they have direct experience in designing and trying out their ability within their professional community in real situation towards their real students in junior high school.
Using Classroom Assessment To Change Both Teaching and Learning.
ERIC Educational Resources Information Center
Steadman, Mimi
1998-01-01
Summarizes results of a study on implementation and impact of classroom assessment techniques (CATs) in community colleges, examining how classroom assessment has been applied by teachers, documenting changes in teaching behaviors, and considering costs and benefits. Also examines students' experiences and satisfaction with courses taught using…
Using the CAS Standards in Assessment Projects
ERIC Educational Resources Information Center
Dean, Laura A.
2013-01-01
This chapter provides an overview of the use of professional standards of practice in assessment and of the Council for the Advancement of Standards in Higher Education (CAS). It outlines a model for conducting program self-studies and discusses the importance of implementing change based on assessment results.
Programmatic assessment of competency-based workplace learning: when theory meets practice
2013-01-01
Background In competency-based medical education emphasis has shifted towards outcomes, capabilities, and learner-centeredness. Together with a focus on sustained evidence of professional competence this calls for new methods of teaching and assessment. Recently, medical educators advocated the use of a holistic, programmatic approach towards assessment. Besides maximum facilitation of learning it should improve the validity and reliability of measurements and documentation of competence development. We explored how, in a competency-based curriculum, current theories on programmatic assessment interacted with educational practice. Methods In a development study including evaluation, we investigated the implementation of a theory-based programme of assessment. Between April 2011 and May 2012 quantitative evaluation data were collected and used to guide group interviews that explored the experiences of students and clinical supervisors with the assessment programme. We coded the transcripts and emerging topics were organised into a list of lessons learned. Results The programme mainly focuses on the integration of learning and assessment by motivating and supporting students to seek and accumulate feedback. The assessment instruments were aligned to cover predefined competencies to enable aggregation of information in a structured and meaningful way. Assessments that were designed as formative learning experiences were increasingly perceived as summative by students. Peer feedback was experienced as a valuable method for formative feedback. Social interaction and external guidance seemed to be of crucial importance to scaffold self-directed learning. Aggregating data from individual assessments into a holistic portfolio judgement required expertise and extensive training and supervision of judges. Conclusions A programme of assessment with low-stakes assessments providing simultaneously formative feedback and input for summative decisions proved not easy to implement. Careful preparation and guidance of the implementation process was crucial. Assessment for learning requires meaningful feedback with each assessment. Special attention should be paid to the quality of feedback at individual assessment moments. Comprehensive attention for faculty development and training for students is essential for the successful implementation of an assessment programme. PMID:24020944
Geiger, Ben Baumberg; Garthwaite, Kayleigh; Warren, Jon; Bambra, Clare
2017-08-25
It has been argued that social security disability assessments should directly assess claimants' work capacity, rather than relying on proxies such as on functioning. However, there is little academic discussion of how such assessments could be conducted. The article presents an account of different models of direct disability assessments based on case studies of the Netherlands, Germany, Denmark, Norway, the United States of America, Canada, Australia, and New Zealand, utilising over 150 documents and 40 expert interviews. Three models of direct work disability assessments can be observed: (i) structured assessment, which measures the functional demands of jobs across the national economy and compares these to claimants' functional capacities; (ii) demonstrated assessment, which looks at claimants' actual experiences in the labour market and infers a lack of work capacity from the failure of a concerned rehabilitation attempt; and (iii) expert assessment, based on the judgement of skilled professionals. Direct disability assessment within social security is not just theoretically desirable, but can be implemented in practice. We have shown that there are three distinct ways that this can be done, each with different strengths and weaknesses. Further research is needed to clarify the costs, validity/legitimacy, and consequences of these different models. Implications for rehabilitation It has recently been argued that social security disability assessments should directly assess work capacity rather than simply assessing functioning - but we have no understanding about how this can be done in practice. Based on case studies of nine countries, we show that direct disability assessment can be implemented, and argue that there are three different ways of doing it. These are "demonstrated assessment" (using claimants' experiences in the labour market), "structured assessment" (matching functional requirements to workplace demands), and "expert assessment" (the judgement of skilled professionals). While it is possible to implement a direct assessment of work capacity for social security benefits, further research is necessary to understand how best to maximise validity, legitimacy, and cost-effectiveness.
ERIC Educational Resources Information Center
Türk, Cumhur; Kalkan, Hüseyin; Iskeleli', Nazan Ocak; Kiroglu, Kasim
2016-01-01
The purpose of this study is to examine the effects of an astronomy summer project implemented in different learning activities on elementary school students, pre-service elementary teachers and in-service teachers' astronomy achievement and their attitudes to astronomy field. This study is the result of a five-day, three-stage, science school,…
ERIC Educational Resources Information Center
Wilson, Kristina; Hahn, Laura; Gonzalez, Patricia; Henry, Kimberly; Cerbana, Christine
2011-01-01
The study reported here evaluated the efficacy of Partners in Parenting (PIP), which, in collaboration with Colorado State University Extension, was implemented in seven counties across Colorado. A total of 54 parents took part in the study. A pretest/posttest design was used to assess short-term changes in parenting practices, parental attitudes,…
ERIC Educational Resources Information Center
Abdullah, Abdul Halim; Mokhtar, Mahani; Halim, Noor Dayana Abd; Ali, Dayana Farzeeha; Tahir, Lokman Mohd; Kohar, Umar Haiyat Abdul
2017-01-01
This study aims to identify the level of knowledge and practice on the implementation of higher-order thinking skills (HOTS) among mathematics teachers at a secondary school in the district of Terengganu. The study focused on the aspects of curriculum, pedagogy and assessment and compared them with demographic factors of the respondents. It used…
Spacelab Mission Implementation Cost Assessment (SMICA)
NASA Technical Reports Server (NTRS)
Guynes, B. V.
1984-01-01
A total savings of approximately 20 percent is attainable if: (1) mission management and ground processing schedules are compressed; (2) the equipping, staffing, and operating of the Payload Operations Control Center is revised, and (3) methods of working with experiment developers are changed. The development of a new mission implementation technique, which includes mission definition, experiment development, and mission integration/operations, is examined. The Payload Operations Control Center is to relocate and utilize new computer equipment to produce cost savings. Methods of reducing costs by minimizing the Spacelab and payload processing time during pre- and post-mission operation at KSC are analyzed. The changes required to reduce costs in the analytical integration process are studied. The influence of time, requirements accountability, and risk on costs is discussed. Recommendation for cost reductions developed by the Spacelab Mission Implementation Cost Assessment study are listed.
Cacko, Joachim Aimé; Cissé, Kadari; Pambè, Madeleine Wayack; Compaoré, Rachidatou; Kouanda, Seni
2016-11-01
To assess the implementation and effects of the strategy, introduced in June 2011, of making obstetric kits readily available in health facilities in the Adamaoua region of Cameroon. We conducted a quasi-experimental study using an interrupted time series to assess the effects of the strategy, and a case study to evaluate its implementation. The reviewed data were gathered from 13 health facilities over a period from January 2008 to December 2014. Qualitative data were collected from in-depth interviews. The provision of obstetric kits was effective in the intervention health facilities, although some challenges existed and included lack of staff motivation and rampant illegal practices. The number of deliveries and cesareans increased. There is a need to rethink this strategy, given its gaps and shortcomings. Copyright © 2016. Published by Elsevier Ireland Ltd.
Implementing Learner-Centered Educational Strategies: The Bloomington Project School
ERIC Educational Resources Information Center
Dutta, Pratima
2014-01-01
The Bloomington Project School (BPS) is a charter school that has successfully adopted and implemented several learner-centered educational strategies. This case study offers a glimpse into its student-centered, collaborative, and interdisciplinary learning and teaching processes; its mastery-based assessment process; and its successful technology…
Missing the Forest for the Trees
ERIC Educational Resources Information Center
Amaral, Olga Maia; Garrison, Leslie
2007-01-01
This case study examines the alignment between the Intended Curriculum, Implemented Curriculum and Achieved Curriculum of a fourth grade inquiry based unit, "Food Chains and Webs." Specifically addressed are how the curriculum was modified to meet state standards, how teachers were trained, and how assessment of curricular implementation was…
Teaching Paraprofessionals to Implement Function-Based Interventions
ERIC Educational Resources Information Center
Walker, Virginia L.; Snell, Martha E.
2017-01-01
The purpose of this study was to evaluate the effects of workshops and coaching on paraprofessional implementation of function-based interventions. The results of indirect and direct functional behavior assessment guided the development of intervention strategies for three students with autism and intellectual disability. Following intervention,…
Kingsland, Melanie; Wolfenden, Luke; Tindall, Jennifer; Rowland, Bosco; Sidey, Maree; McElduff, Patrick; Wiggers, John H
2015-07-01
Despite an increased prevalence of risky alcohol consumption and alcohol-related harm among members of sporting groups and at sporting venues, sporting clubs frequently fail to implement alcohol management practices consistent with liquor legislation and best practice guidelines. The aim of this study was to assess the impact of a multi-strategy intervention in improving the implementation of responsible alcohol management practices by sports clubs. A randomised controlled trial was conducted with 87 football clubs, with half randomised to receive a multi-strategy intervention to support clubs to implement responsible alcohol management practices. The 2-year intervention, which was based on implementation and capacity building theory and frameworks, included project officer support, funding, accreditation rewards, printed resources, observational audit feedback, newsletters, training and support from state sporting organisations. Interviews were undertaken with club presidents at baseline and post-intervention to assess alcohol management practice implementation. Post-intervention, 88% of intervention clubs reported implementing '13 or more' of 16 responsible alcohol management practices, which was significantly greater than the proportion of control groups reporting this level of implementation (65%) [odds ratio: 3.7 (95% confidence interval: 1.1-13.2); P = 0.04]. All intervention components were considered highly useful and three-quarters or more of clubs rated the amount of implementation support to be sufficient. The multi-strategy intervention was successful in improving alcohol management practices in community sports clubs. Further research is required to better understand implementation barriers and to assess the long-term sustainability of the change in club alcohol management practices. © 2015 Australasian Professional Society on Alcohol and other Drugs.
Marshall, Christy L.; Petersen, Nancy J.; Naik, Aanand D.; Velde, Nancy Vander; Artinyan, Avo; Albo, Daniel; Berger, David H.
2014-01-01
Abstract Background: Tumor board (TB) conferences facilitate multidisciplinary cancer care and are associated with overall improved outcomes. Because of shortages of the oncology workforce and limited access to TB conferences, multidisciplinary care is not available at every institution. This pilot study assessed the feasibility and acceptance of using telemedicine to implement a virtual TB (VTB) program within a regional healthcare network. Materials and Methods: The VTB program was implemented through videoconference technology and electronic medical records between the Houston (TX) Veterans Affairs Medical Center (VAMC) (referral center) and the New Orleans (LA) VAMC (referring center). Feasibility was assessed as the proportion of completed VTB encounters, rate of technological failures/mishaps, and presentation duration. Validated surveys for confidence and satisfaction were administered to 36 TB participants to assess acceptance (1–5 point Likert scale). Secondary outcomes included preliminary data on VTB utilization and its effectiveness in providing access to quality cancer care within the region. Results: Ninety TB case presentations occurred during the study period, of which 14 (15%) were VTB cases. Although one VTB encounter had a technical mishap during presentation, all scheduled encounters were completed (100% completion rate). Case presentations took longer for VTB than for regular TB cases (p=0.0004). However, VTB was highly accepted with mean scores for satisfaction and confidence of 4.6. Utilization rate of VTB was 75%, and its effectiveness was equivalent to that observed for non-VTB cases. Conclusions: Implementation of VTB is feasible and highly accepted by its participants. Future studies should focus on widespread implementation and validating the effectiveness of this model. PMID:24845366
Robertson, Dale M.; Saad, D.A.
1996-01-01
To fulfill the goals of the NAWQA program, the USGS plans to examine 60 areas (study units) across the United States during full implementation of the program. In 1991, the NAWQA program went into full implementation with the intensive investigation of 20 of these study units; one of these study units is the Western Lake Michigan Drainages (WMIC) study unit.
Walker, Sarah Cusworth; Hurvitz, Philip M; Leith, Jessica; Rodriguez, Felix I; Endler, Gregory C
2016-11-01
The long term effects of untreated mental health need for individuals, families and society has prompted a number of federal policy statements encouraging the use of evidence-based programs (EBP) in children's healthcare. However, among other challenges of evidence-based practice implementation, states often do not know where to make investments based on population need. In this paper we present the use of a Geographic Information System approach to undertake a mental health needs assessment for Washington State. Our study found that this technology can be beneficially applied to conducting needs assessment for EBP implementation, and we provide recommendations for future applications.
Rieckmann, Traci; Abraham, Amanda; Zwick, Janet; Rasplica, Caitlin; McCarty, Dennis
2015-08-01
To profile state agency efforts to promote implementation of three evidence-based practices (EBPs): screening and brief intervention (SBIRT), psychosocial interventions, and medication-assisted treatment (MAT). Primary data collected from representatives of 50 states and the District of Columbia's Single State Authorities from 2007 to 2009. The study used mixed methods, in-depth, semistructured interviews and quantitative surveys. Interviews assessed state and provider strategies to accelerate implementation of EBPs. Statewide implementation of psychosocial interventions and MAT increased significantly over 3 years. In the first two assessments, states that contracted directly with providers were more likely to link use of EBPs to reimbursement, and states with indirect contract, through counties and other entities, increased recommendations, and some requirements for provision of specific EBPs. The number of states using legislation as a policy lever to promote EBPs was unchanged. Health care reform and implementation of parity in coverage increases access to treatment for alcohol and drug use. Science-based substance abuse treatment will become even more crucial as payers seek consistent quality of care. This study provides baseline data on service delivery, contracting, and financing as state agencies and treatment providers prepare for implementation of the Affordable Care Act. © Health Research and Educational Trust.
Ogourtsova, Tatiana; Archambault, Philippe S; Lamontagne, Anouk
2017-11-07
Hemineglect, defined as a failure to attend to the contralesional side of space, is a prevalent and disabling post-stroke deficit. Conventional hemineglect assessments lack sensitivity as they contain mainly non-functional tasks performed in near-extrapersonal space, using static, two-dimensional methods. This is of concern given that hemineglect is a strong predictor for functional deterioration, limited post-stroke recovery, and difficulty in community reintegration. With the emerging field of virtual reality, several virtual tools have been proposed and have reported better sensitivity in neglect-related deficits detection than conventional methods. However, these and future virtual reality-based tools are yet to be implemented in clinical practice. The present study aimed to explore the barriers/facilitators perceived by clinicians in the use of virtual reality for hemineglect assessment; and to identify features of an optimal virtual assessment. A qualitative descriptive process, in the form of focus groups, self-administered questionnaire and individual interviews was used. Two focus groups (n = 11 clinicians) were conducted and experts in the field (n = 3) were individually interviewed. Several barriers and facilitators, including personal, institutional, client suitability, and equipment factors, were identified. Clinicians and experts in the field reported numerous features for the virtual tool optimization. Factors identified through this study lay the foundation for the development of a knowledge translation initiative towards an implementation of a virtual assessment for hemineglect. Addressing the identified barriers/facilitators during implementation and incorporating the optimal features in the design of the virtual assessment could assist and promote its eventual adoption in clinical settings. Implications for rehabilitation A multimodal and active knowledge translation intervention built on the presently identified modifiable factors is suggested to be implemented to support the clinical integration of a virtual reality-based assessment for post-stroke hemineglect. To amplify application and usefulness of a virtual-reality based tool in the assessment of post-stroke hemineglect, optimal features identified in the present study should be incorporated in the design of such technology.
A Story of a Journey in Implementing an E-Assessment System at a South African University
ERIC Educational Resources Information Center
Singh, U. G.; Wassermann, J. M.
2016-01-01
Following the challenges faced in the selection and implementation of e-assessment tools for student assessment, I undertook a journey of implementing an e-assessment system within the University of KwaZulu-Natal (UKZN). This article describes the path traversed and highlights the potholes and expressways on this road towards e-assessment…
2010-01-01
Background The Organizational Readiness to Change Assessment (ORCA) is a measure of organizational readiness for implementing practice change in healthcare settings that is organized based on the core elements and sub-elements of the Promoting Action on Research Implementation in Health Services (PARIHS) framework. General support for the reliability and factor structure of the ORCA has been reported. However, no published study has examined the utility of the ORCA in a clinical setting. The purpose of the current study was to examine the relationship between baseline ORCA scores and implementation of hepatitis prevention services in substance use disorders (SUD) clinics. Methods Nine clinic teams from Veterans Health Administration SUD clinics across the United States participated in a six-month training program to promote evidence-based practices for hepatitis prevention. A representative from each team completed the ORCA evidence and context subscales at baseline. Results Eight of nine clinics reported implementation of at least one new hepatitis prevention practice after completing the six-month training program. Clinic teams were categorized by level of implementation-high (n = 4) versus low (n = 5)-based on how many hepatitis prevention practices were integrated into their clinics after completing the training program. High implementation teams had significantly higher scores on the patient experience and leadership culture subscales of the ORCA compared to low implementation teams. While not reaching significance in this small sample, high implementation clinics also had higher scores on the research, clinical experience, staff culture, leadership behavior, and measurement subscales as compared to low implementation clinics. Conclusions The results of this study suggest that the ORCA was able to measure differences in organizational factors at baseline between clinics that reported high and low implementation of practice recommendations at follow-up. This supports the use of the ORCA to describe factors related to implementing practice recommendations in clinical settings. Future research utilizing larger sample sizes will be essential to support these preliminary findings. PMID:20546584
Policy to implementation: evidence-based practice in community mental health – study protocol
2013-01-01
Background Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate. Methods/design Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study. Discussion Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector. PMID:23522556
Policy to implementation: evidence-based practice in community mental health--study protocol.
Beidas, Rinad S; Aarons, Gregory; Barg, Frances; Evans, Arthur; Hadley, Trevor; Hoagwood, Kimberly; Marcus, Steven; Schoenwald, Sonja; Walsh, Lucia; Mandell, David S
2013-03-24
Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate. Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study. Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector.
Candidate Technologies for the Integrated Health Management Program
NASA Technical Reports Server (NTRS)
Johnson, Neal F., Jr.; Martin, Fred H.
1993-01-01
The purpose of this report is to assess Vehicle Health Management (VHM) technologies for implementation as a demonstration. Extensive studies have been performed to determine technologies which could be implemented on the Atlas and Centaur vehicles as part of a bridging program. This paper discusses areas today where VHM can be implemented for benefits in reliability, performance, and cost reduction. VHM Options are identified and one demonstration is recommended for execution.
Formative Assessment in Primary Science
ERIC Educational Resources Information Center
Loughland, Tony; Kilpatrick, Laetitia
2015-01-01
This action learning study in a year three classroom explored the implementation of five formative assessment principles to assist students' understandings of the scientific topic of liquids and solids. These principles were employed to give students a greater opportunity to express their understanding of the concepts. The study found that the…
Assessment and Treatment of Tic Behavior: A Review and Case Study.
ERIC Educational Resources Information Center
Pray, Bruce, Jr.; And Others
1986-01-01
A discussion of the classification, differential diagnosis, etiology, assessment, and treatment of tic disorders is presented. A case study is included in which a school psychologist utilized behavioral consultation to assist a 9-year-old girl's parent and teacher in implementing a habit reversal program. (Author/LMO)
Public Opinion toward Sexuality Education: Findings among One South Florida County
ERIC Educational Resources Information Center
Howard-Barr, Elissa; Moore, Michele Johnson; Weiss, Josie A.; Jobli, Edessa
2011-01-01
As part of a community plan to implement abstinence-based sexuality education, this study assessed opinions toward sexuality education among residents. Respondents (N = 1,090) were selected by random digit dialing. The survey, adopted from previous national studies, assessed attitudes towards sexuality education. Chi-square tests of significance…
ERIC Educational Resources Information Center
Peterson, Rick L.; Grenwelge, Cheryl; Benz, Michael R.; Zhang, Dalun; Resch, J. Aaron; Mireles, Gerardo; Mahadevan, Lakshmi
2012-01-01
This article reports on a qualitative study to assess Texas Family Consumer Science (FCS) Extension professionals' experiences working with individuals with disabilities and their perceived skills in promoting and delivering inclusive educational programming for this audience. Study results indicate that overall Extension educators viewed…
75 FR 72705 - Approval and Promulgation of Implementation Plans; Idaho
Federal Register 2010, 2011, 2012, 2013, 2014
2010-11-26
... other states, WG relied on an additional study entitled the ``Uinta Basin Air Quality Study (UBAQS... of a modeling analysis to assess ozone impacts prior to authorizing oil and gas development projects... Agencies on assessing impacts of oil and gas development projects.\\18\\ WG questioned why EPA's...
Tereno, Susana; Guedeney, Nicole; Dugravier, Romain; Greacen, Tim; Saïas, Thomas; Tubach, Florence; Guédeney, Antoine
2013-06-01
Attachment is a long-term emotional link between infants and their mothers. Attachment quality influences subsequent psychosocial relationships, the ability to manage stress and, consequently, later mental health. Home intervention programmes targeting infant attachment have been implemented in several contexts with varying degrees of efficacy. Within the CAPEDP study (Parental Skills and Attachment in Early Childhood: reduction of risks linked to mental health problems and promotion of resilience), a subsample of 120 families were recruited with the objective of assessing the impact of this home-visiting programme on infant attachment organisation using the Strange Situation Procedure. The present paper describes the methodology used in this ancillary study.
2014-01-01
Background Healthcare reform in the United States is encouraging Federally Qualified Health Centers and other primary-care practices to integrate treatment for addiction and other behavioral health conditions into their practices. The potential of mobile health technologies to manage addiction and comorbidities such as HIV in these settings is substantial but largely untested. This paper describes a protocol to evaluate the implementation of an E-Health integrated communication technology delivered via mobile phones, called Seva, into primary-care settings. Seva is an evidence-based system of addiction treatment and recovery support for patients and real-time caseload monitoring for clinicians. Methods/Design Our implementation strategy uses three models of organizational change: the Program Planning Model to promote acceptance and sustainability, the NIATx quality improvement model to create a welcoming environment for change, and Rogers’s diffusion of innovations research, which facilitates adaptations of innovations to maximize their adoption potential. We will implement Seva and conduct an intensive, mixed-methods assessment at three diverse Federally Qualified Healthcare Centers in the United States. Our non-concurrent multiple-baseline design includes three periods — pretest (ending in four months of implementation preparation), active Seva implementation, and maintenance — with implementation staggered at six-month intervals across sites. The first site will serve as a pilot clinic. We will track the timing of intervention elements and assess study outcomes within each dimension of the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework, including effects on clinicians, patients, and practices. Our mixed-methods approach will include quantitative (e.g., interrupted time-series analysis of treatment attendance, with clinics as the unit of analysis) and qualitative (e.g., staff interviews regarding adaptations to implementation protocol) methods, and assessment of implementation costs. Discussion If implementation is successful, the field will have a proven technology that helps Federally Qualified Health Centers and affiliated organizations provide addiction treatment and recovery support, as well as a proven strategy for implementing the technology. Seva also has the potential to improve core elements of addiction treatment, such as referral and treatment processes. A mobile technology for addiction treatment and accompanying implementation model could provide a cost-effective means to improve the lives of patients with drug and alcohol problems. Trial registration ClinicalTrials.gov (NCT01963234). PMID:24884976
Quanbeck, Andrew R; Gustafson, David H; Marsch, Lisa A; McTavish, Fiona; Brown, Randall T; Mares, Marie-Louise; Johnson, Roberta; Glass, Joseph E; Atwood, Amy K; McDowell, Helene
2014-05-29
Healthcare reform in the United States is encouraging Federally Qualified Health Centers and other primary-care practices to integrate treatment for addiction and other behavioral health conditions into their practices. The potential of mobile health technologies to manage addiction and comorbidities such as HIV in these settings is substantial but largely untested. This paper describes a protocol to evaluate the implementation of an E-Health integrated communication technology delivered via mobile phones, called Seva, into primary-care settings. Seva is an evidence-based system of addiction treatment and recovery support for patients and real-time caseload monitoring for clinicians. Our implementation strategy uses three models of organizational change: the Program Planning Model to promote acceptance and sustainability, the NIATx quality improvement model to create a welcoming environment for change, and Rogers's diffusion of innovations research, which facilitates adaptations of innovations to maximize their adoption potential. We will implement Seva and conduct an intensive, mixed-methods assessment at three diverse Federally Qualified Healthcare Centers in the United States. Our non-concurrent multiple-baseline design includes three periods - pretest (ending in four months of implementation preparation), active Seva implementation, and maintenance - with implementation staggered at six-month intervals across sites. The first site will serve as a pilot clinic. We will track the timing of intervention elements and assess study outcomes within each dimension of the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework, including effects on clinicians, patients, and practices. Our mixed-methods approach will include quantitative (e.g., interrupted time-series analysis of treatment attendance, with clinics as the unit of analysis) and qualitative (e.g., staff interviews regarding adaptations to implementation protocol) methods, and assessment of implementation costs. If implementation is successful, the field will have a proven technology that helps Federally Qualified Health Centers and affiliated organizations provide addiction treatment and recovery support, as well as a proven strategy for implementing the technology. Seva also has the potential to improve core elements of addiction treatment, such as referral and treatment processes. A mobile technology for addiction treatment and accompanying implementation model could provide a cost-effective means to improve the lives of patients with drug and alcohol problems. ClinicalTrials.gov (NCT01963234).
Khanassov, Vladimir; Vedel, Isabelle; Pluye, Pierre
2014-01-01
PURPOSE Results of case management designed for patients with dementia and their caregivers in community-based primary health care (CBPHC) were inconsistent. Our objective was to identify the relationships between key outcomes of case management and barriers to implementation. METHODS We conducted a systematic mixed studies review (including quantitative and qualitative studies). Literature search was performed in MEDLINE, PsycINFO, Embase, and Cochrane Library (1995 up to August 2012). Case management intervention studies were used to assess clinical outcomes for patients, service use, caregiver outcomes, satisfaction, and cost-effectiveness. Qualitative studies were used to examine barriers to case management implementation. Patterns in the relationships between barriers to implementation and outcomes were identified using the configurational comparative method. The quality of studies was assessed using the Mixed Methods Appraisal Tool. RESULTS Forty-three studies were selected (31 quantitative and 12 qualitative). Case management had a limited positive effect on behavioral symptoms of dementia and length of hospital stay for patients and on burden and depression for informal caregivers. Interventions that addressed a greater number of barriers to implementation resulted in increased number of positive outcomes. Results suggested that high-intensity case management was necessary and sufficient to produce positive clinical outcomes for patients and to optimize service use. Effective communication within the CBPHC team was necessary and sufficient for positive outcomes for caregivers. CONCLUSIONS Clinicians and managers who implement case management in CBPHC should take into account high-intensity case management (small caseload, regular proactive patient follow-up, regular contact between case managers and family physicians) and effective communication between case managers and other CBPHC professionals and services. PMID:25354410
Khanassov, Vladimir; Vedel, Isabelle; Pluye, Pierre
2014-01-01
Results of case management designed for patients with dementia and their caregivers in community-based primary health care (CBPHC) were inconsistent. Our objective was to identify the relationships between key outcomes of case management and barriers to implementation. We conducted a systematic mixed studies review (including quantitative and qualitative studies). Literature search was performed in MEDLINE, PsycINFO, Embase, and Cochrane Library (1995 up to August 2012). Case management intervention studies were used to assess clinical outcomes for patients, service use, caregiver outcomes, satisfaction, and cost-effectiveness. Qualitative studies were used to examine barriers to case management implementation. Patterns in the relationships between barriers to implementation and outcomes were identified using the configurational comparative method. The quality of studies was assessed using the Mixed Methods Appraisal Tool. Forty-three studies were selected (31 quantitative and 12 qualitative). Case management had a limited positive effect on behavioral symptoms of dementia and length of hospital stay for patients and on burden and depression for informal caregivers. Interventions that addressed a greater number of barriers to implementation resulted in increased number of positive outcomes. Results suggested that high-intensity case management was necessary and sufficient to produce positive clinical outcomes for patients and to optimize service use. Effective communication within the CBPHC team was necessary and sufficient for positive outcomes for caregivers. Clinicians and managers who implement case management in CBPHC should take into account high-intensity case management (small caseload, regular proactive patient follow-up, regular contact between case managers and family physicians) and effective communication between case managers and other CBPHC professionals and services. © 2014 Annals of Family Medicine, Inc.
Durability assessment of prefabricated bridge elements and systems.
DOT National Transportation Integrated Search
2015-02-01
This study aims to address some of the concerns related to implementation of prefabricated bridge elements and systems (PBES) : and accelerated bridge construction (ABC) in Maryland, where some barriers included assessment of the quality and durabili...
Students' Perceptions of E-Assessment at Saudi Electronic University
ERIC Educational Resources Information Center
Alsadoon, Hamadah
2017-01-01
This study explored students' perceptions of E-assessment at Saudi Electronic University. The university recently implemented this mode of assessment in the learning management system it uses. Therefore it is important to examine the students' perceptions of this mode at the university level. The results were encouraging. Students had positive…
The Use of Assessment for Institutional Sensemaking by Top Administrative Officials
ERIC Educational Resources Information Center
Hegeman, Johnston Niven
2010-01-01
This study explored the relationship between the degree to which top administrators of four-year colleges and universities that have been effective in implementing and sustaining assessment view the use of assessment and seven components of institutional sensemaking at their institutions. The underlying premise is that outcomes assessment…
Assessing the Quality of Teachers' Teaching Practices
ERIC Educational Resources Information Center
Chen, Weiyun; Mason, Stephen; Staniszewski, Christina; Upton, Ashley; Valley, Megan
2012-01-01
This study assessed the extent to which nine elementary physical education teachers implemented the quality of teaching practices. Thirty physical education lessons taught by the nine teachers to their students in grades K-5 were videotaped. Four investigators coded the taped lessons using the Assessing Quality Teaching Rubric (AQTR) designed and…
Poster Sessions in Marketing Education: An Empirical Examination
ERIC Educational Resources Information Center
Stegemann, Nicole; Sutton-Brady, Catherine
2009-01-01
Poster sessions provide a creative and stimulating alternative to traditional assessment methods in marketing. Poster sessions, as a means of assessment, have long been used in science fields. This article presents the successful implementation of poster sessions as a means of assessment in a postgraduate unit of study. Poster sessions in…
Innovative Approaches to Assessment of Results of Higher School Students Training
ERIC Educational Resources Information Center
Vaganova, Olga I.; Medvedeva, Tatiana Yu.; Kirdyanova, Elena R.; Kazantseva, Galina A.; Karpukova, Albina A.
2016-01-01
The basis of assessment tools selection for performance of control and evaluation of training results subject to requirements of modular-competence approach has been disclosed. The experience in implementation of assessment tools during "General and professional pedagogy" course has been observed. The objective of the study is rationale…
Multi-site p-loss assessment from privately owned cropland in Northeast Missouri
USDA-ARS?s Scientific Manuscript database
Phosphorus exported from watersheds can accelerate eutrophication and is identified as one of the main causes of water impairment. Accurate phosphorus (P) loss assessment has become vital for effective implementation of conservation measures. The study objective was to assess the validity of a cla...
ERIC Educational Resources Information Center
Zeleke, Aytaged Sisay
2013-01-01
This paper aims to explore the practice of continuous assessment at Unity University College and Addis Ababa University. It has also investigated constraints instructors say they have been facing in implementing continuous assessment. Students' attitudes about the practice of this assessment mode towards their course achievements were explored.…
ERIC Educational Resources Information Center
Johnson, Will L.
2011-01-01
Objective: Analysis of the validity and implementation of a child maltreatment actuarial risk assessment model, the California Family Risk Assessment (CFRA). Questions addressed: (1) Is there evidence of the validity of the CFRA under field operating conditions? (2) Do actuarial risk assessment results influence child welfare workers' service…
ERIC Educational Resources Information Center
Ali, Anthony; Akubue, Augustine
1988-01-01
A study involving 1,800 teachers and 180 headmasters assessed the nature and scope of activities and problems associated with implementing federally mandated continuous educational assessment activities at the primary school level in Nigeria. Findings indicate that continuous assessment is preferred to the narrower one-shot evaluation. (TJH)
Miiro, George; DeCelles, Jeff; Rutakumwa, Rwamahe; Nakiyingi-Miiro, Jessica; Muzira, Philip; Ssembajjwe, Wilber; Musoke, Saidat; Gibson, Lorna J; Hershow, Rebecca B; Francis, Suzanna; Torondel, Belen; Ross, David A; Weiss, Helen A
2017-01-01
The Ugandan government is committed to scaling-up proven HIV prevention strategies including safe male circumcision, and innovative strategies are needed to increase circumcision uptake. The aim of this study was to assess the acceptability and feasibility of implementing a soccer-based intervention ("Make The Cut") among schoolboys in a peri-urban district of Uganda. The intervention was led by trained, recently circumcised "coaches" who facilitated a 60-minute session delivered in schools, including an interactive penalty shoot-out game using metaphors for HIV prevention, sharing of the coaches' circumcision story, group discussion and ongoing engagement from the coach to facilitate linkage to male circumcision. The study took place in four secondary schools in Entebbe sub-district, Uganda. Acceptability of safe male circumcision was assessed through a cross-sectional quantitative survey. The feasibility of implementing the intervention was assessed by piloting the intervention in one school, modifying it, and implementing the modified version in a second school. Perceptions of the intervention were assessed with in-depth interviews with participants. Of the 210 boys in the cross-sectional survey, 59% reported being circumcised. Findings showed high levels of knowledge and generally favourable perceptions of circumcision. The initial implementation of Make The Cut resulted in 6/58 uncircumcised boys (10.3%) becoming circumcised. Changes made included increasing engagement with parents and improved liaison with schools regarding the timing of the intervention. Following this, uptake improved to 18/69 (26.1%) in the second school. In-depth interviews highlighted the important role of family and peer support and the coach in facilitating the decision to circumcise. This study showed that the modified Make The Cut intervention may be effective to increase uptake of safe male circumcision in this population. However, the intervention is time-intensive, and further work is needed to assess the cost-effectiveness of the intervention conducted at scale.
DeCelles, Jeff; Rutakumwa, Rwamahe; Nakiyingi-Miiro, Jessica; Muzira, Philip; Ssembajjwe, Wilber; Musoke, Saidat; Gibson, Lorna J.; Hershow, Rebecca B.; Francis, Suzanna; Torondel, Belen; Ross, David A.
2017-01-01
The Ugandan government is committed to scaling-up proven HIV prevention strategies including safe male circumcision, and innovative strategies are needed to increase circumcision uptake. The aim of this study was to assess the acceptability and feasibility of implementing a soccer-based intervention (“Make The Cut”) among schoolboys in a peri-urban district of Uganda. The intervention was led by trained, recently circumcised “coaches” who facilitated a 60-minute session delivered in schools, including an interactive penalty shoot-out game using metaphors for HIV prevention, sharing of the coaches’ circumcision story, group discussion and ongoing engagement from the coach to facilitate linkage to male circumcision. The study took place in four secondary schools in Entebbe sub-district, Uganda. Acceptability of safe male circumcision was assessed through a cross-sectional quantitative survey. The feasibility of implementing the intervention was assessed by piloting the intervention in one school, modifying it, and implementing the modified version in a second school. Perceptions of the intervention were assessed with in-depth interviews with participants. Of the 210 boys in the cross-sectional survey, 59% reported being circumcised. Findings showed high levels of knowledge and generally favourable perceptions of circumcision. The initial implementation of Make The Cut resulted in 6/58 uncircumcised boys (10.3%) becoming circumcised. Changes made included increasing engagement with parents and improved liaison with schools regarding the timing of the intervention. Following this, uptake improved to 18/69 (26.1%) in the second school. In-depth interviews highlighted the important role of family and peer support and the coach in facilitating the decision to circumcise. This study showed that the modified Make The Cut intervention may be effective to increase uptake of safe male circumcision in this population. However, the intervention is time-intensive, and further work is needed to assess the cost-effectiveness of the intervention conducted at scale. PMID:29016651
Assessing the Role of Online Technologies in Project-Based Learning
ERIC Educational Resources Information Center
Ravitz, Jason; Blazevski, Juliane
2014-01-01
This study examines the relationships between teacher-reported use of online resources, and preparedness, implementation challenges, and time spent implementing project- or problem-based learning, or approaches that are similar to what we call "PBL" in general. Variables were measured using self-reports from those who teach in reform…
Process evaluation results from the HEALTHY physical education intervention
USDA-ARS?s Scientific Manuscript database
Process evaluation is an assessment of the implementation of an intervention. A process evaluation component was embedded in the HEALTHY study, a primary prevention trial for Type 2 diabetes implemented over 3 years in 21 middle schools across the United States. The HEALTHY physical education (PE) i...
Politicising Curriculum Implementation: The Case of Primary Schools
ERIC Educational Resources Information Center
Molapo, Moyahabo Rodgers; Pillay, Venitha
2018-01-01
Since 2012, the Curriculum Assessment Policy Statements (CAPS) comprise the new National Curriculum Statement currently implemented in South African schools. CAPS encapsulates a series of radical curriculum changes since the dawn of a new democratic dispensation in 1994. This study aims to understand how Grade Three educators in Limpopo, South…
ERIC Educational Resources Information Center
Manase, Joseph
2016-01-01
In order for the community to bring meaningful and sustainable environmental conservation and change, it must take action in implementing environmental education values acquired from environmental learning programmes and organizations. This study therefore aimed at assessing factors conditioning community implementation of environmental education…
Rasch Analysis of the Routines-Based Interview Implementation Checklist
ERIC Educational Resources Information Center
Boavida, Tânia; Akers, Kate; McWilliam, R. A.; Jung, Lee Ann
2015-01-01
The Routines-Based Interview (RBI) is useful for developing functional outcomes/goals, for establishing strong relationships with families, and for assessing the family's true needs. In this study, the authors investigated the psychometric properties of the RBI Implementation Checklist, conducted by 120 early intervention professionals,…
Implementation of School-Based Management in Indonesia. Monograph
ERIC Educational Resources Information Center
Vernez, Georges; Karam, Rita; Marshall, Jeffery H.
2012-01-01
This study provides a quantitative and qualitative status report on the implementation of school-based management (SBM) in Indonesia, identifies factors associated with the successful practices of SBM, and assesses SBM effects on student achievement eight years after its inception. The authors' findings are based on face-to-face surveys of…
78 FR 37226 - Submission for OMB Review; Comment Request
Federal Register 2010, 2011, 2012, 2013, 2014
2013-06-20
... Implementation Study. OMB No.: 0970-0398. Description: The Office of Data Analysis, Research, and Evaluation (HHS... Planning, Research, and Evaluation (HHS/ACF/OPRE) in the Administration for Children and Families (ACF... designed and implemented in the field, collect performance measure data for PREP programs, and assess the...
Large-Scale Implementation of Formative Assessment Practices in an Examination-Oriented Culture
ERIC Educational Resources Information Center
Ratnam-Lim, Christina Tong Li; Tan, Kelvin Heng Kiat
2015-01-01
Singapore's education system has often been characterised as exam-oriented. This paper describes efforts ("windmills") made by the Government to constructively respond to the "winds of change" in the education system. A committee called the Primary Education Review and Implementation (PERI) Committee was appointed to study and…
Salminen, Leena; Metsämäki, Riikka; Numminen, Olivia H; Leino-Kilpi, Helena
2013-02-01
This study describes nurse educators' knowledge of the ethical principles of professional codes of ethics and educators' assessment of the implementation of principles of fairness and human respect. Data for this study was collected from nurse educators in Finland. The data was analyzed by SPSS (15.0) for Windows. A total of 342 nurse educators participated. The response rate was 46%. Nurse educators knew well the ethical principles of professional codes governing their work. Older and more experienced educators knew the principles better than younger and less experienced. According to the educators the principle of fairness was implemented the best whereas fair treatment of nurse educators and respect for educators' opinions in the society were implemented the weakest. Educators who knew the principles well assessed themselves to act in a fairer way and to respect other persons' opinions in a better way than educators who knew these principles less well. They also felt themselves to be better treated than educators having less knowledge of the principles. These findings can be utilized to develop nurse educators' ethics education. Further research should focus on students', colleagues' and superiors' assessments of nurse educators' ethical knowledge base to gain comparative data on the phenomenon. Copyright © 2011 Elsevier Ltd. All rights reserved.
Mind the gap: implementation challenges break the link between HIV/AIDS research and practice.
MacCarthy, Sarah; Reisner, Sari; Hoffmann, Michael; Perez-Brumer, Amaya; Silva-Santisteban, Alfonso; Nunn, Amy; Bastos, Leonardo; Vasconcellos, Mauricio Teixeira Leite de; Kerr, Ligia; Bastos, Francisco Inácio; Dourado, Inês
2016-11-03
Sampling strategies such as respondent-driven sampling (RDS) and time-location sampling (TLS) offer unique opportunities to access key populations such as men who have sex with men (MSM) and transgender women. Limited work has assessed implementation challenges of these methods. Overcoming implementation challenges can improve research quality and increase uptake of HIV services among key populations. Drawing from studies using RDS in Brazil and TLS in Peru, we summarize challenges encountered in the field and potential strategies to address them. In Brazil, study site selection, cash incentives, and seed selection challenged RDS implementation with MSM. In Peru, expansive geography, safety concerns, and time required for study participation complicated TLS implementation with MSM and transgender women. Formative research, meaningful participation of key populations across stages of research, and transparency in study design are needed to link HIV/AIDS research and practice. Addressing implementation challenges can close gaps in accessing services among those most burdened by the epidemic.
Mind the gap: implementation challenges break the link between HIV/AIDS research and practice
MacCarthy, Sarah; Reisner, Sari; Hoffmann, Michael; Perez-Brumer, Amaya; Silva-Santisteban, Alfonso; Nunn, Amy; Bastos, Leonardo; de Vasconcellos, Mauricio Teixeira Leite; Kerr, Ligia; Bastos, Francisco Inácio; Dourado, Inês
2018-01-01
Sampling strategies such as respondent-driven sampling (RDS) and time-location sampling (TLS) offer unique opportunities to access key populations such as men who have sex with men (MSM) and transgender women. Limited work has assessed implementation challenges of these methods. Overcoming implementation challenges can improve research quality and increase uptake of HIV services among key populations. Drawing from studies using RDS in Brazil and TLS in Peru, we summarize challenges encountered in the field and potential strategies to address them. In Brazil, study site selection, cash incentives, and seed selection challenged RDS implementation with MSM. In Peru, expansive geography, safety concerns, and time required for study participation complicated TLS implementation with MSM and transgender women. Formative research, meaningful participation of key populations across stages of research, and transparency in study design are needed to link HIV/AIDS research and practice. Addressing implementation challenges can close gaps in accessing services among those most burdened by the epidemic. PMID:27828609
NASA Astrophysics Data System (ADS)
Sutrisno, Dardiri, Ahmad; Sugandi, R. Machmud
2017-09-01
This study aimed to address the procedure, effectiveness, and problems in the implementation of learning model for Building Engineering Apprenticeship Training Programme. This study was carried out through survey method and experiment. The data were collected using questionnaire, test, and assessment sheet. The collected data were examined through description, t-test, and covariance analysis. The results of the study showed that (1) the model's procedure covered preparation course, readiness assessment, assignment distribution, handing over students to apprenticeship instructors, task completion, assisting, field assessment, report writing, and follow-up examination, (2) the Learning Community model could significantly improve students' active learning, but not improve students' hard skills and soft skills, and (3) the problems emerging in the implementation of the model were (1) students' difficulties in finding apprenticeship places and qualified instructors, and asking for relevant tasks, (2) teachers' difficulties in determining relevant tasks and monitoring students, and (3) apprenticeship instructors' difficulties in assigning, monitoring, and assessing students.
Bennett, Michael I; Hughes, Nicola; Johnson, Mark I
2011-06-01
The benefits of transcutaneous electrical nerve stimulation (TENS) for pain relief have not been reliably established, as most systematic reviews find poor methodological quality in many studies. The paradox within the evidence base for TENS is that despite identified sources of bias that may lead to an overestimation of treatment effects, no benefits for TENS can be clearly demonstrated. Conventional assessments of quality assume a single direction of bias, and little work has been undertaken examining other directions of bias. Our hypothesis was that low fidelity in studies (bias leading to an underestimation of treatment effects) may account for inconclusive findings. We included 38 studies from 3 recently published Cochrane systematic reviews that examined TENS for acute, chronic, and cancer pain. We extracted data relating to treatment allocation, application of TENS and to the assessment of outcomes. We quantified these data and judged this against standardised assessment criteria using a "traffic light" approach based on the number of studies reaching the standard. We identified significant sources of potential bias in both directions in relation to study design and implementation fidelity that have not been quantified previously. Suboptimal dosing of TENS and inappropriate outcome assessment were particularly prevalent weaknesses indicating low fidelity. We propose criteria for judging directions of bias in future studies of TENS that may be adapted to assess other trials in which implementation fidelity is important, such as other nonpharmacological interventions for pain. Poor implementation fidelity was identified as a significant source of bias in systematic reviews of TENS studies and might explain lack of consistent treatment effects of TENS in pain. Here, criteria for assessing methodology are proposed for use in designing future clinical trials of TENS. Copyright © 2010 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.
Hospital implementation of health information technology and quality of care: are they related?
Restuccia, Joseph D; Cohen, Alan B; Horwitt, Jedediah N; Shwartz, Michael
2012-09-27
Recently, there has been considerable effort to promote the use of health information technology (HIT) in order to improve health care quality. However, relatively little is known about the extent to which HIT implementation is associated with hospital patient care quality. We undertook this study to determine the association of various HITs with: hospital quality improvement (QI) practices and strategies; adherence to process of care measures; risk-adjusted inpatient mortality; patient satisfaction; and assessment of patient care quality by hospital quality managers and front-line clinicians. We conducted surveys of quality managers and front-line clinicians (physicians and nurses) in 470 short-term, general hospitals to obtain data on hospitals' extent of HIT implementation, QI practices and strategies, assessments of quality performance, commitment to quality, and sufficiency of resources for QI. Of the 470 hospitals, 401 submitted complete data necessary for analysis. We also developed measures of hospital performance from several publicly data available sources: Hospital Compare adherence to process of care measures; Medicare Provider Analysis and Review (MEDPAR) file; and Hospital Consumer Assessment of Healthcare Providers and Systems HCAHPS® survey. We used Poisson regression analysis to examine the association between HIT implementation and QI practices and strategies, and general linear models to examine the relationship between HIT implementation and hospital performance measures. Controlling for potential confounders, we found that hospitals with high levels of HIT implementation engaged in a statistically significant greater number of QI practices and strategies, and had significantly better performance on mortality rates, patient satisfaction measures, and assessments of patient care quality by hospital quality managers; there was weaker evidence of higher assessments of patient care quality by front-line clinicians. Hospital implementation of HIT was positively associated with activities intended to improve patient care quality and with higher performance on four of six performance measures.
Peterson, Anna; Carlfjord, Siw; Schaller, Anne; Gerdle, Björn; Larsson, Britt
2017-07-01
Systematic and regular pain assessment has been shown to improve pain management. Well-functioning pain assessments require using strategies informed by well-established theory. This study evaluates documented pain assessments reported in medical records and by patients, including reassessment using a Numeric Rating Scale (NRS) after patients receive rescue medication. Documentation surveys (DS) and patient surveys (PS) were performed at baseline (BL), after six months, and after 12 months in 44 in-patient wards at the three hospitals in Östergötland County, Sweden. Nurses and nurse assistants received training on pain assessment and support. The Knowledge to Action Framework guided the implementation of new routines. According to DS pain assessment using NRS, pain assessment increased significantly: from 7% at baseline to 36% at 12 months (p<0.001). For PS, corresponding numbers were 33% and 50% (p<0.001). According to the PS, the proportion of patients who received rescue medication and who had been reassessed increased from 73% to 86% (p=0.003). The use of NRS to document pain assessment after patients received rescue medication increased significantly (4% vs. 17%; p<0.001). After implementing education and support strategies, systematic pain assessment increased, an encouraging finding considering the complex contexts of in-patient facilities. However, the achieved assessment levels and especially reassessments related to rescue medication were clinically unsatisfactory. Future studies should include nursing staff and physicians and increase interactivity such as providing online education support. A discrepancy between documented and reported reassessment in association with given rescue medication might indicate that nurses need better ways to provide pain relief. The fairly low level of patient-reported pain via NRS and documented use of NRS before and 12 months after the educational programme stresses the need for education on pain management in nursing education. Implementations differing from traditional educational attempts such as interactive implementations might complement educational programmes given at the work place. Standardized routines for pain management that include the possibility for nurses to deliver pain medication within well-defined margins might improve pain management and increase the use of pain assessments. Further research is needed that examines the large discrepancy between patient-reported pain management and documentation in the medical recording system of transient pain. Copyright © 2017 Scandinavian Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.
Marrinan, Jaclyn E.; Sesay, Foday R.; Ervin, Elizabeth; Thorson, Anna E.; Xu, Wenbo; Ströher, Ute; Ongpin, Patricia; Abad, Neetu; Ariyarajah, Archchun; Malik, Tasneem; Liu, Hongtu; Ross, Christine; Durski, Kara N.; Gaillard, Philippe; Morgan, Oliver; Formenty, Pierre; Knust, Barbara; Broutet, Nathalie; Sahr, Foday
2017-01-01
Background The 2013–2016 West African Ebola virus disease epidemic was unprecedented in terms of the number of cases and survivors. Prior to this epidemic there was limited data available on the persistence of Ebola virus in survivors’ body fluids and the potential risk of transmission, including sexual transmission. Methodology/Principal findings Given the urgent need to determine the persistence of Ebola virus in survivors’ body fluids, an observational cohort study was designed and implemented during the epidemic response operation in Sierra Leone. This publication describes study implementation methodology and the key lessons learned. Challenges encountered during implementation included unforeseen duration of follow-up, complexity of interpreting and communicating laboratory results to survivors, and the urgency of translating research findings into public health practice. Strong community engagement helped rapidly implement the study during the epidemic. The study was conducted in two phases. The first phase was initiated within five months of initial protocol discussions and assessed persistence of Ebola virus in semen of 100 adult men. The second phase assessed the persistence of virus in multiple body fluids (semen or vaginal fluid, menstrual blood, breast milk, and urine, rectal fluid, sweat, saliva, tears), of 120 men and 120 women. Conclusion/Significance Data from this study informed national and global guidelines in real time and demonstrated the need to implement semen testing programs among Ebola virus disease survivors. The lessons learned and study tools developed accelerated the implementation of such programs in Ebola virus disease affected countries, and also informed studies examining persistence of Zika virus. Research is a vital component of the public health response to an epidemic of a poorly characterized disease. Adequate resources should be rapidly made available to answer critical research questions, in order to better inform response efforts. PMID:28892501
Deen, Gibrilla Fadlu; McDonald, Suzanna L R; Marrinan, Jaclyn E; Sesay, Foday R; Ervin, Elizabeth; Thorson, Anna E; Xu, Wenbo; Ströher, Ute; Ongpin, Patricia; Abad, Neetu; Ariyarajah, Archchun; Malik, Tasneem; Liu, Hongtu; Ross, Christine; Durski, Kara N; Gaillard, Philippe; Morgan, Oliver; Formenty, Pierre; Knust, Barbara; Broutet, Nathalie; Sahr, Foday
2017-09-01
The 2013-2016 West African Ebola virus disease epidemic was unprecedented in terms of the number of cases and survivors. Prior to this epidemic there was limited data available on the persistence of Ebola virus in survivors' body fluids and the potential risk of transmission, including sexual transmission. Given the urgent need to determine the persistence of Ebola virus in survivors' body fluids, an observational cohort study was designed and implemented during the epidemic response operation in Sierra Leone. This publication describes study implementation methodology and the key lessons learned. Challenges encountered during implementation included unforeseen duration of follow-up, complexity of interpreting and communicating laboratory results to survivors, and the urgency of translating research findings into public health practice. Strong community engagement helped rapidly implement the study during the epidemic. The study was conducted in two phases. The first phase was initiated within five months of initial protocol discussions and assessed persistence of Ebola virus in semen of 100 adult men. The second phase assessed the persistence of virus in multiple body fluids (semen or vaginal fluid, menstrual blood, breast milk, and urine, rectal fluid, sweat, saliva, tears), of 120 men and 120 women. Data from this study informed national and global guidelines in real time and demonstrated the need to implement semen testing programs among Ebola virus disease survivors. The lessons learned and study tools developed accelerated the implementation of such programs in Ebola virus disease affected countries, and also informed studies examining persistence of Zika virus. Research is a vital component of the public health response to an epidemic of a poorly characterized disease. Adequate resources should be rapidly made available to answer critical research questions, in order to better inform response efforts.
Evaluation of technology to identify and assess overweight children and adolescents.
Gance-Cleveland, Bonnie; Gilbert, Lynn H; Kopanos, Taynin; Gilbert, Kevin C
2010-01-01
The current obesity epidemic has produced a generation of children that may be the first to have a life expectancy shorter than their parents. To address the obesity epidemic, experts have published recommendations for providers. Research suggests the publication of guidelines may not change provider behavior. This study evaluates computer assistance for implementing obesity guidelines in school-based health centers. Significant improvements in identification and assessment of obesity in children with technology support were noted. Computer decision support shows promise for promoting the implementation of current recommendations by supporting providers in identifying, assessing, and providing tailored recommendations for children at risk of obesity.
Wagner, C; Groene, O; Dersarkissian, M; Thompson, C A; Klazinga, N S; Arah, O A; Suñol, R
2014-04-01
Stakeholders of hospitals often lack standardized tools to assess compliance with quality management strategies and the implementation of clinical quality activities in hospitals. Such assessment tools, if easy to use, could be helpful to hospitals, health-care purchasers and health-care inspectorates. The aim of our study was to determine the psychometric properties of two newly developed tools for measuring compliance with process-oriented quality management strategies and the extent of implementation of clinical quality strategies at the hospital level. We developed and tested two measurement instruments that could be used during on-site visits by trained external surveyors to calculate a Quality Management Compliance Index (QMCI) and a Clinical Quality Implementation Index (CQII). We used psychometric methods and the cross-sectional data to explore the factor structure, reliability and validity of each of these instruments. The sample consisted of 74 acute care hospitals selected at random from each of 7 European countries. The psychometric properties of the two indices (QMCI and CQII). Overall, the indices demonstrated favourable psychometric performance based on factor analysis, item correlations, internal consistency and hypothesis testing. Cronbach's alpha was acceptable for the scales of the QMCI (α: 0.74-0.78) and the CQII (α: 0.82-0.93). Inter-scale correlations revealed that the scales were positively correlated, but distinct. All scales added sufficient new information to each main index to be retained. This study has produced two reliable instruments that can be used during on-site visits to assess compliance with quality management strategies and implementation of quality management activities by hospitals in Europe and perhaps other jurisdictions.
Almuneef, Maha A; Qayad, Mohamed; Noor, Ismail K; Al-Eissa, Majid A; Albuhairan, Fadia S; Inam, Sarah; Mikton, Christopher
2014-03-01
There has been increased awareness of child maltreatment in Saudi Arabia recently. This study assessed the readiness for implementing large-scale evidence-based child maltreatment prevention programs in Saudi Arabia. Key informants, who were key decision makers and senior managers in the field of child maltreatment, were invited to participate in the study. A multidimensional tool, developed by WHO and collaborators from several middle and low income countries, was used to assess 10 dimensions of readiness. A group of experts also gave an objective assessment of the 10 dimensions and key informants' and experts' scores were compared. On a scale of 100, the key informants gave a readiness score of 43% for Saudi Arabia to implement large-scale, evidence-based CM prevention programs, and experts gave an overall readiness score of 40%. Both the key informants and experts agreed that 4 of the dimensions (attitudes toward child maltreatment prevention, institutional links and resources, material resources, and human and technical resources) had low readiness scores (<5) each and three dimensions (knowledge of child maltreatment prevention, scientific data on child maltreatment prevention, and will to address child maltreatment problem) had high readiness scores (≥5) each. There was significant disagreement between key informants and experts on the remaining 3 dimensions. Overall, Saudi Arabia has a moderate/fair readiness to implement large-scale child maltreatment prevention programs. Capacity building; strengthening of material resources; and improving institutional links, collaborations, and attitudes toward the child maltreatment problem are required to improve the country's readiness to implement such programs. Copyright © 2013 Elsevier Ltd. All rights reserved.
Israel, Michel
2015-09-01
The exposure and risk evaluation process in Bulgaria concerning non-ionizing radiation health and safety started in the early 1970s. Then, the first research laboratory "Electromagnetic fields in the working environment" was founded in the framework of the Centre of Hygiene, belonging to the Medical Academy, Sofia. The main activities were connected with developing legislation, new equipment for measurement of electromagnetic fields, new methods for measurement and exposure assessment, in vivo and human studies for developing methods, studying the effect of non-ionizing radiation on human body, developing exposure limits. Most of the occupations as metal industry, plastic welding, energetics, physiotherapy, broadcasting, telephone stations, computer industry, etc., have been covered by epidemiological investigations and risk evaluation. In 1986, the ANSI standard for safe use of lasers has been implemented as national legislation that gave the start for studies in the field of risk assessment concerning the use of lasers in industry and medicine. The environmental exposure studies started in 1991 following the very fast implementation of the telecommunication technologies. Now, funds for research are very insignificant, and studies in the field of risk assessment are very few. Nevertheless, Bulgaria has been an active member of the WHO International EMF Project, since 1997, and that gives good opportunity for collaboration with other Member states, and for implementation of new approach in the EMF policy for workers and people's protection against non-ionizing radiation exposure.
NASA Astrophysics Data System (ADS)
Susilaningsih, E.; Khotimah, K.; Nurhayati, S.
2018-04-01
The assessment of laboratory skill in general hasn’t specific guideline in assessment, while the individual assessment of students during a performance and skill in performing laboratory is still not been observed and measured properly. Alternative assessment that can be used to measure student laboratory skill is use performance assessment. The purpose of this study was to determine whether the performance assessment instrument that the result of research can be used to assess basic skills student laboratory. This research was conducted by the Research and Development. The result of the data analysis performance assessment instruments developed feasible to implement and validation result 62.5 with very good categories for observation sheets laboratory skills and all of the components with the very good category. The procedure is the preliminary stages of research and development stages. Preliminary stages are divided in two, namely the field studies and literature studies. The development stages are divided into several parts, namely 1) development of the type instrument, 2) validation by an expert, 3) a limited scale trial, 4) large-scale trials and 5) implementation of the product. The instrument included in the category of effective because 26 from 29 students have very high laboratory skill and high laboratory skill. The research of performance assessment instrument is standard and can be used to assess basic skill student laboratory.
Effect of implementation intentions to change behaviour: moderation by intention stability.
Godin, Gaston; Bélanger-Gravel, Ariane; Amireault, Steve; Gallani, Maria-Cecilia B J; Vohl, Marie-Claude; Pérusse, Louis
2010-02-01
The aim of this study was to assess the effects of implementation intentions on leisure-time physical activity, taking into account the stability of intention. At baseline (T0), 349 participants completed a psychosocial questionnaire and were randomly assigned to implementation intention or control condition. Three months after baseline assessment (T1), participants in the experimental group were asked to plan where, when, and how they would exercise. Leisure-time physical activity was assessed 3 mo. later (i.e., at 6-mo. follow-up; T2). The intervention had no significant effect on physical activity at 6-mo. follow-up. However, a significant interaction of group and intention stability was observed, with the effect of the intervention on behaviour statistically significant only among those with unstable intention. Intention stability thus moderated the effect of the intervention, i.e., the intervention was more successful among individuals who needed support to change (unstable intenders).
Evolution of an Implementation-Ready Interprofessional Pain Assessment Reference Model
Collins, Sarah A; Bavuso, Karen; Swenson, Mary; Suchecki, Christine; Mar, Perry; Rocha, Roberto A.
2017-01-01
Standards to increase consistency of comprehensive pain assessments are important for safety, quality, and analytics activities, including meeting Joint Commission requirements and learning the best management strategies and interventions for the current prescription Opioid epidemic. In this study we describe the development and validation of a Pain Assessment Reference Model ready for implementation on EHR forms and flowsheets. Our process resulted in 5 successive revisions of the reference model, which more than doubled the number of data elements to 47. The organization of the model evolved during validation sessions with panels totaling 48 subject matter experts (SMEs) to include 9 sets of data elements, with one set recommended as a minimal data set. The reference model also evolved when implemented into EHR forms and flowsheets, indicating specifications such as cascading logic that are important to inform secondary use of data. PMID:29854125
A Descriptive Study of Teachers' Instructional Use of Student Assessment Data
ERIC Educational Resources Information Center
Hoover, Nancy R.
2009-01-01
The overarching question for this study is: to what extent are teachers using summative assessment data in a formative way? A survey research design study was implemented to address this question. A web-based survey was administered to elementary, middle, and high school teachers in a large, suburban school division in central Virginia. The survey…
Weir, C. R.; Crockett, R.; Gohlinghorst, S.; McCarthy, C.
2000-01-01
User satisfaction is commonly assessed in evaluations of information systems as a proxy for user adoption. However few studies actually report directly assessing the relationship between the two constructs. In this study the relationship between four user satisfaction measures and five adoption behaviors were explored in the context of the implementation of the Veteran's Health Administration Computerized Patient Record System 1.0. Findings suggest that the relationship is modest and depends on the measurement system used. Specifically, direct reports of affect and judgements of specific task efficacy related to behavior more often than usability and a general user satisfaction instrument. PMID:11080017
Stress Reduction Through a Brief Writing Intervention With Women in Jail.
Pankey, Tyson; Kelly, Patricia J; Ramaswamy, Megha
2016-07-01
To assess the feasibility/acceptability of writing as a stress reduction strategy with incarcerated women. The authors implemented a writing intervention in which six women wrote on topics of their choosing for 20 minutes on 5 consecutive days. Feasibility was assessed with investigator field notes; daily post-writing evaluations assessed intervention acceptability. The study also assessed the continuation of writing at 1-month postintervention and acceptability of instruments for evaluation of future interventions. Implementation barriers were minimal; participants voiced enthusiasm about the program and continued to write 3 to 4 days per week in the month postintervention. No problems were encountered in the completion of evaluation instruments. Writing is a feasible, reproducible stress relief intervention for incarcerated women. © The Author(s) 2016.
Alfredsson, Jayne; Plichart, Patrick; Zary, Nabil
2012-01-01
Research on computer supported scoring of assessments in health care education has mainly focused on automated scoring. Little attention has been given to how informatics can support the currently predominant human-based grading approach. This paper reports steps taken to develop a model for a computer supported scoring process that focuses on optimizing a task that was previously undertaken without computer support. The model was also implemented in the open source assessment platform TAO in order to study its benefits. Ability to score test takers anonymously, analytics on the graders reliability and a more time efficient process are example of observed benefits. A computer supported scoring will increase the quality of the assessment results.
Dedios, Maria Cecilia; Esperato, Alexo; De-Regil, Luz Maria; Peña-Rosas, Juan Pablo; Norris, Susan L
2017-03-21
Over the past decade, the World Health Organization (WHO) has implemented a standardized, evidence-informed guideline development process to assure technically sound and policy-relevant guidelines. This study is an independent evaluation of the adaptability of the guidelines produced by the Evidence and Programme Guidance unit, at the Department of Nutrition for Health and Development (NHD). The study systematizes the lessons learned by the NHD group at WHO. We used a mixed methods approach to determine the adaptability of the nutrition guidelines. Adaptability was defined as having two components; methodological quality and implementability of guidelines. Additionally, we gathered recommendations to improve future guideline development in nutrition actions for health and development. Data sources for this evaluation were official documentation and feedback (both qualitative and quantitative) from key stakeholders involved in the development of nutrition guidelines. The qualitative data was collected through a desk review and two waves of semi-structured interviews (n = 12) and was analyzed through axial coding. Guideline adaptability was assessed quantitatively using two standardized instruments completed by key stakeholders. The Appraisal Guideline for Research and Evaluation questionnaire, version II was used to assess guideline quality (n = 6), while implementability was assessed with the electronic version of the GuideLine Implementability Appraisal (n = 7). The nutrition evidence-informed guideline development process has several strengths, among them are the appropriate management of conflicts of interest of guideline developers and the systematic use of high-quality evidence to inform the recommendations. These features contribute to increase the methodological quality of the guidelines. The key areas for improvement are the limited implementability of the recommendations, the lack of explicit and precise implementation advice in the guidelines and challenges related to collaborative work within interdisciplinary groups. Overall, our study found that the nutrition evidence-informed guidelines are of good methodological quality but that the implementability requires improvement. The recommendations to improve guideline adaptability address the guideline content, the dynamics shaping interdisciplinary work, and actions for implementation feasibility. As WHO relies heavily on a standardized procedure to develop guidelines, the lessons learned may be applicable to guideline development across the organization and to other groups developing guidelines.
Implementing Health Impact Assessment at National Level: An Experience in Iran.
Damari, Behzad; Vosoogh-Moghaddam, Abbas; Riazi-Isfahani, Sahand
2018-02-01
According to the general health policies issued in 2014, Health Impact Assessment (HIA) or Health Annex should be implemented in Iran. The present study provided a model for executing HIA in the Iranian context as a developing country. This is a system design study with the qualitative approach. The data on the system components were gathered via reviews of the literature, in-depth interviews and focused group discussions (FGDs) with experts. The information were contently analyzed in order to draft the model and a consensus was reached on by the steering committee. Fifteen in-depth interviews and six FGD meeting were conducted. The equity-based approach in assessing the health impacts of policies, programs and projects were chosen as the most practical tool. Experts believe that for the next five years, HIA should be used just for the "national projects" so that the ministries and national agencies could be empowered. Components of the model including structure, procedures, and standards, management style, mission and resources were prepared. The national regulations and protocols were sent to the SCHFS Secretariat for final revision and the council approval. The hasty implementation of HIA will face serious resistances as the health-oriented attitude and behavior in both government and non-governmental sectors will gradually form. Also, the overlapping of the contents of HIA with other tools such as Environmental, Cultural and Social Impact Assessments, currently used by other sectors, causes difficulties in implementing the HIA by the Ministry of Health and Medical Education.
ERIC Educational Resources Information Center
Emmett, Joshua; McGee, Dean
2013-01-01
The purpose of this case study was to discover the critical attributes of a student achievement program, known as "Think Gold," implemented at one urban comprehensive high school as part of the improvement process. Student achievement on state assessments improved during the period under study. The study draws upon perspectives on…
Hannon, Peggy A; Helfrich, Christian D; Chan, K Gary; Allen, Claire L; Hammerback, Kristen; Kohn, Marlana J; Parrish, Amanda T; Weiner, Bryan J; Harris, Jeffrey R
2017-01-01
To develop a theory-based questionnaire to assess readiness for change in small workplaces adopting wellness programs. In developing our scale, we first tested items via "think-aloud" interviews. We tested the revised items in a cross-sectional quantitative telephone survey. The study setting comprised small workplaces (20-250 employees) in low-wage industries. Decision-makers representing small workplaces in King County, Washington (think-aloud interviews, n = 9), and the United States (telephone survey, n = 201) served as study subjects. We generated items for each construct in Weiner's theory of organizational readiness for change. We also measured workplace characteristics and current implementation of workplace wellness programs. We assessed reliability by coefficient alpha for each of the readiness questionnaire subscales. We tested the association of all subscales with employers' current implementation of wellness policies, programs, and communications, and conducted a path analysis to test the associations in the theory of organizational readiness to change. Each of the readiness subscales exhibited acceptable internal reliability (coefficient alpha range, .75-.88) and was positively associated with wellness program implementation ( p < .05). The path analysis was consistent with the theory of organizational readiness to change, except change efficacy did not predict change-related effort. We developed a new questionnaire to assess small workplaces' readiness to adopt and implement evidence-based wellness programs. Our findings also provide empirical validation of Weiner's theory of readiness for change.
Rasmussen, Charlotte Diana Nørregaard; Højberg, Helene; Bengtsen, Elizabeth; Jørgensen, Marie Birk
2018-02-01
In a recent study, we involved all relevant stakeholders to identify practice-based implementation components for successful implementation and sustainability in work environment interventions. To understand possible knowledge gaps between evidence and practice, the aim of this paper is to investigate if effectiveness studies of the 11 practice-based implementation components can be identified in existing scientific literature. PubMed/MEDLINE, PsycINFO, and Web of Science were searched for relevant studies. After screening, 38 articles met the inclusion criteria. Since some of the studies describe more than one practice-based implementation concept a total of 125 quality criteria assessments were made. The overall result is that 10 of the 11 practice-based implementation components can be found in the scientific literature, but the evaluation of them is poor. From this review it is clear that there are knowledge gaps between evidence and practice with respect to the effectiveness of implementation concepts. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.
Organizational readiness for implementing change: a psychometric assessment of a new measure.
Shea, Christopher M; Jacobs, Sara R; Esserman, Denise A; Bruce, Kerry; Weiner, Bryan J
2014-01-10
Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change. We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.
Organizational readiness for implementing change: a psychometric assessment of a new measure
2014-01-01
Background Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner’s theory of organizational readiness for change. Methods We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure’s factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Results Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. Conclusions This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity. PMID:24410955
Acosta, Joie; Ebener, Patricia; Driver, Jennifer; Keith, Jamie; Peebles, Dana
2013-01-01
Abstract Translational research is expanding, in part, because Evidence‐Based Programs or Practices (EBPs) are not adopted in many medical domains. However, little translational research exists on EBPs that are prevention programs delivered in nonclinical, community‐based settings. These organizations often have low capacity, which undermines implementation quality and outcomes. Rigorous translational research is needed in these settings so within a single study, capacity, implementation quality, and outcomes are measured and links between them tested. This paper overviews the study Enhancing Quality Interventions Promoting Healthy Sexuality (EQUIPS), which tests how well a community‐based setting (Boys & Girls Clubs) conducts an EBP called Making Proud Choices that aims to prevent teen pregnancy and sexually transmitted infections, with and without an implementation support intervention called Getting To Outcomes. The study design is novel as it assesses: Getting To Outcomes’ impact on capacity, implementation quality, and outcomes simultaneously and in both study conditions; will assess sustainability by measuring capacity and fidelity a year after the Getting To Outcomes support ends; and will operate on a large scale similar to many national initiatives. Many studies have not incorporated all these elements and thus EQUIPS could serve as a model for translational research in many domains. PMID:23751031
ERIC Educational Resources Information Center
Spielberger, Julie; Goyette, Paul
2006-01-01
This report summarizes findings from the first year of an implementation study of the Early Childhood Cluster Initiative (ECCI). ECCI is a prekindergarten program in ten elementary schools and a community child care center in Palm Beach County, based on the design of the High/Scope Perry Preschool model. The initiative is characterized by low…
Syrjala, Karen L.; Stover, Allison C.; Yi, Jean C.; Artherholt, Samantha B.; Romano, Eleni M.; Schoch, Gary; Stewart, Susan; Flowers, Mary E.D.
2011-01-01
Introduction The internet provides a widely accessible modality for meeting survivorship care needs of cancer survivors. In this paper we describe the development and implementation of an internet site designed as a base from which to conduct a randomized controlled trial to meet psycho-educational needs of hematopoietic stem cell transplantation (HSCT) survivors. Methods A cross-disciplinary team designed, wrote content and programmed an internet site for online study registration, consent, assessment, and study implementation. All 3–18 year survivors of HSCT for hematologic malignancy treated at one transplant center were approached by mail for participation. All study activities could be conducted without study staff contact. However, participants had options for phone or email contact with study staff as desired. Results Of 1775 participants approached for the study, 775 (58% of those eligible) consented and completed baseline assessment. Mean age was 51.7 (SD=12.5, age range 18–79), with 56% male. 57% required staff contact one or more times; a majority were for minor technical issues or delays in completion of enrollment or baseline assessment. Discussions/Conclusions This study demonstrated the potential for providing internet-based survivorship care to long-term survivors of HSCT. Although building a survivorship internet site requires a team with diverse expertise, once built, these resources can be implemented rapidly with large numbers of survivors. Implications for Cancer Survivors While internet-based services will not meet all the needs of cancer survivors, this methodology represents an important modality for augmenting onsite clinical services as a method for meeting psycho-educational, information and resource needs of cancer survivors. PMID:21544671
Barrett, Jason R; French, P Edward
2013-01-01
The events of September 11, 2001, increased and intensified domestic preparedness efforts in the United States against terrorism and other threats. The heightened focus on protecting this nation's critical infrastructure included legislation requiring implementation of extensive new security measures to better defend water supply systems against physical, chemical/biological, and cyber attacks. In response, municipal officials have implemented numerous safeguards to reduce the vulnerability of these systems to purposeful intrusions including ongoing vulnerability assessments, extensive personnel training, and highly detailed emergency response and communication plans. This study evaluates fiscal year 2010 annual compliance assessments of public water systems with security measures that were implemented by Mississippi's Department of Health as a response to federal requirements to address these potential terrorist threats to water distribution systems. The results show that 20 percent of the water systems in this state had at least one security violation on their 2010 Capacity Development Assessment, and continued perseverance from local governments is needed to enhance the resiliency and robustness of these systems against physical threats.
Application of Competency-Based Education in Laparoscopic Training
Xue, Dongbo; Bo, Hong; Zhao, Song; Meng, Xianzhi
2015-01-01
Background and Objectives: To induce competency-based education/developing a curriculum in the training of postgraduate students in laparoscopic surgery. Methods: This study selected postgraduate students before the implementation of competency-based education (n = 16) or after the implementation of competency-based education (n = 17). On the basis of the 5 competencies of patient care, medical knowledge, practice-based learning and improvement, interpersonal and communication skills, and professionalism, the research team created a developing a curriculum chart and specific improvement measures that were implemented in the competency-based education group. Results: On the basis of the developing a curriculum chart, the assessment of the 5 comprehensive competencies using the 360° assessment method indicated that the competency-based education group's competencies were significantly improved compared with those of the traditional group (P < .05). The improvement in the comprehensive assessment was also significant compared with the traditional group (P < .05). Conclusion: The implementation of competency-based education/developing a curriculum teaching helps to improve the comprehensive competencies of postgraduate students and enables them to become qualified clinicians equipped to meet society's needs. PMID:25901105
Measuring the food service environment: development and implementation of assessment tools.
Minaker, Leia M; Raine, Kim D; Cash, Sean B
2009-01-01
The food environment is increasingly being implicated in the obesity epidemic, though few reported measures of it exist. In order to assess the impact of the food environment on food intake, valid measures must be developed and tested. The current study describes the development of a food service environment assessment tool and its implementation in a community setting. A descriptive study with mixed qualitative and quantitative methods at a large, North American university campus was undertaken. Measures were developed on the basis of a conceptual model of nutrition environments. Measures of community nutrition environment were the number, type and hours of operation of each food service outlet on campus. Measures of consumer nutrition environment were food availability, food affordability, food promotion and nutrition information availability. Seventy-five food service outlets within the geographic boundaries were assessed. Assessment tools could be implemented in a reasonable amount of time and showed good face and content validity. The food environments were described and measures were grouped so that food service outlet types could be compared in terms of purchasing convenience, cost/value, healthy food promotion and health. Food service outlet types that scored higher in purchasing convenience and cost/value tended to score lower in healthy food promotion and health. This study adds evidence that food service outlet types that are convenient to consumers and supply high value (in terms of calories per dollar) tend to be less health-promoting. Results from this study also suggest the possibility of characterizing the food environment according to the type of food service outlet observed.
Murphy, Kelly R; McManigle, John E; Wildman-Tobriner, Benjamin M; Little Jones, Amy; Dekker, Travis J; Little, Barrett A; Doty, Joseph P; Taylor, Dean C
2016-01-01
The medical community has recognized the importance of leadership skills among its members. While numerous leadership assessment tools exist at present, few are specifically tailored to the unique health care environment. The study team designed a 24-item survey (Healthcare Evaluation & Assessment of Leadership [HEAL]) to measure leadership competency based on the core competencies and core principles of the Duke Healthcare Leadership Model. A novel digital platform was created for use on handheld devices to facilitate its distribution and completion. This pilot phase involved 126 health care professionals self-assessing their leadership abilities. The study aimed to determine both the content validity of the survey and the feasibility of its implementation and use. The digital platform for survey implementation was easy to complete, and there were no technical problems with survey use or data collection. With regard to reliability, initial survey results revealed that each core leadership tenet met or exceeded the reliability cutoff of 0.7. In self-assessment of leadership, women scored themselves higher than men in questions related to patient centeredness (P=0.016). When stratified by age, younger providers rated themselves lower with regard to emotional intelligence and integrity. There were no differences in self-assessment when stratified by medical specialty. While only a pilot study, initial data suggest that HEAL is a reliable and easy-to-administer survey for health care leadership assessment. Differences in responses by sex and age with respect to patient centeredness, integrity, and emotional intelligence raise questions about how providers view themselves amid complex medical teams. As the survey is refined and further administered, HEAL will be used not only as a self-assessment tool but also in “360” evaluation formats. PMID:29355186
Murphy, Kelly R; McManigle, John E; Wildman-Tobriner, Benjamin M; Little Jones, Amy; Dekker, Travis J; Little, Barrett A; Doty, Joseph P; Taylor, Dean C
2016-01-01
The medical community has recognized the importance of leadership skills among its members. While numerous leadership assessment tools exist at present, few are specifically tailored to the unique health care environment. The study team designed a 24-item survey (Healthcare Evaluation & Assessment of Leadership [HEAL]) to measure leadership competency based on the core competencies and core principles of the Duke Healthcare Leadership Model. A novel digital platform was created for use on handheld devices to facilitate its distribution and completion. This pilot phase involved 126 health care professionals self-assessing their leadership abilities. The study aimed to determine both the content validity of the survey and the feasibility of its implementation and use. The digital platform for survey implementation was easy to complete, and there were no technical problems with survey use or data collection. With regard to reliability, initial survey results revealed that each core leadership tenet met or exceeded the reliability cutoff of 0.7. In self-assessment of leadership, women scored themselves higher than men in questions related to patient centeredness ( P =0.016). When stratified by age, younger providers rated themselves lower with regard to emotional intelligence and integrity. There were no differences in self-assessment when stratified by medical specialty. While only a pilot study, initial data suggest that HEAL is a reliable and easy-to-administer survey for health care leadership assessment. Differences in responses by sex and age with respect to patient centeredness, integrity, and emotional intelligence raise questions about how providers view themselves amid complex medical teams. As the survey is refined and further administered, HEAL will be used not only as a self-assessment tool but also in "360" evaluation formats.
ERIC Educational Resources Information Center
Nguyen, Viet Anh
2017-01-01
Purpose: The purpose of this paper is to build an assessment-centred blended learning (BL) framework to assess learners, to analyse and to evaluate the impact of the technology support in the form of formative assessment in students' positive learning. Design/methodology/approach: This research proposed an assessment-centred BL framework at the…
Porter, Kathleen; Estabrooks, Paul; Zoellner, Jamie
2016-01-01
Background Sugar-sweetened beverage (SSB) consumption among children and adolescents is a determinant of childhood obesity. Many programs to reduce consumption across the socio-ecological model report significant positive results; however, the generalizability of the results, including whether reporting differences exist among socio-ecological strategy levels, is unknown. Objectives This systematic review aims to (1) examine the extent to which studies reported internal and external validity indicators defined by RE-AIM (reach, effectiveness, adoption, implementation, maintenance) and (2) assess reporting differences by socio-ecological level: intrapersonal/interpersonal (Level 1), environmental/policy (Level 2), multi-level (Combined Level). Methods Six major databases (PubMed, Web of Science, Cinahl, CAB Abstracts, ERIC, and Agiricola) systematic literature review was conducted to identify studies from 2004–2015 meeting inclusion criteria (targeting children aged 3–12, adolescents 13–17, and young adults 18 years, experimental/quasi-experimental, substantial SSB component). Interventions were categorized by socio-ecological level, and data were extracted using a validated RE-AIM protocol. A one-way ANOVA assessed differences between levels. Results There were 55 eligible studies (N) accepted, including 21 Level 1, 18 Level 2, and 16 Combined Level studies. Thirty-six (65%) were conducted in the USA, 19 (35%) internationally, and 39 (71%) were implemented in schools. Across levels, reporting averages were low for all RE-AIM dimensions (reach=29%, efficacy/effectiveness=45%, adoption=26%, implementation=27%, maintenance=14%). Level 2 studies had significantly lower reporting on reach and effectiveness (10% and 26%, respectively) compared to Level 1 (44%, 57%) or Combined Level studies (31%, 52%) (p<0.001). Adoption, implementation, and maintenance reporting did not vary among levels. Conclusion Interventions to reduce SSB in children and adolescents across the socio-ecological spectrum do not provide the necessary information for dissemination and implementation in community nutrition settings. Future interventions should address both internal and external validity to maximize population impact. PMID:27262383
Atkins, Lou; Francis, Jill; Islam, Rafat; O'Connor, Denise; Patey, Andrea; Ivers, Noah; Foy, Robbie; Duncan, Eilidh M; Colquhoun, Heather; Grimshaw, Jeremy M; Lawton, Rebecca; Michie, Susan
2017-06-21
Implementing new practices requires changes in the behaviour of relevant actors, and this is facilitated by understanding of the determinants of current and desired behaviours. The Theoretical Domains Framework (TDF) was developed by a collaboration of behavioural scientists and implementation researchers who identified theories relevant to implementation and grouped constructs from these theories into domains. The collaboration aimed to provide a comprehensive, theory-informed approach to identify determinants of behaviour. The first version was published in 2005, and a subsequent version following a validation exercise was published in 2012. This guide offers practical guidance for those who wish to apply the TDF to assess implementation problems and support intervention design. It presents a brief rationale for using a theoretical approach to investigate and address implementation problems, summarises the TDF and its development, and describes how to apply the TDF to achieve implementation objectives. Examples from the implementation research literature are presented to illustrate relevant methods and practical considerations. Researchers from Canada, the UK and Australia attended a 3-day meeting in December 2012 to build an international collaboration among researchers and decision-makers interested in the advancing use of the TDF. The participants were experienced in using the TDF to assess implementation problems, design interventions, and/or understand change processes. This guide is an output of the meeting and also draws on the authors' collective experience. Examples from the implementation research literature judged by authors to be representative of specific applications of the TDF are included in this guide. We explain and illustrate methods, with a focus on qualitative approaches, for selecting and specifying target behaviours key to implementation, selecting the study design, deciding the sampling strategy, developing study materials, collecting and analysing data, and reporting findings of TDF-based studies. Areas for development include methods for triangulating data, e.g. from interviews, questionnaires and observation and methods for designing interventions based on TDF-based problem analysis. We offer this guide to the implementation community to assist in the application of the TDF to achieve implementation objectives. Benefits of using the TDF include the provision of a theoretical basis for implementation studies, good coverage of potential reasons for slow diffusion of evidence into practice and a method for progressing from theory-based investigation to intervention.
ERIC Educational Resources Information Center
Isonio, Steven
In May 1991, Golden West College (California) conducted a validation study of the English portion of the Assessment and Placement Services for Community Colleges (APS), followed by a predictive validity study in July 1991. The initial study was designed to aid in the implementation of the new test at GWC by comparing data on APS use at other…
Stewart, Donna E; Dorado, Linda M; Diaz-Granados, Natalia; Rondon, Marta; Saavedra, Javier; Posada-Villa, Jose; Torres, Yolanda
2009-12-01
Gender inequities in health prevail in most countries despite ongoing attempts to eliminate them. Assessment of gender-sensitive health policies can be used to identify country specific progress as well as gaps and issues that need to be addressed to meet health equity goals. This study selected and measured the existence of gender-sensitive health policies in a low- (Peru), middle- (Colombia), and high (Canada)-income country in the Americas. Investigators selected 10 of 20 gender-sensitive health policy indicators and found eight to be feasible to measure in all three countries, although the wording and scope varied. The results from this study inform policy makers and program planners who aim to develop, improve, implement, and monitor national gender-sensitive health policies. Future studies should assess the implementation of policy indicators within countries and assess their performance in increasing gender equity.
Assessing Student Threats: A Handbook for Implementing the Salem-Keizer System
ERIC Educational Resources Information Center
Van Dreal, John
2011-01-01
"Assessing Student Threats: A Handbook for Implementing the Salem-Keizer System" is a manual for the implementation of a threat assessment system that follows the recommendations of the Safe Schools Initiative and the prescriptive outline provided by the FBI. Written from an educator's perspective with contributing authors from law…
The Practice of Campus-Based Threat Assessment: An Overview
ERIC Educational Resources Information Center
Pollard, Jeffrey W.; Nolan, Jeffrey J.; Deisinger, Eugene R. D.
2012-01-01
This article provides an overview of threat assessment and management as implemented on campuses of higher education. Standards of practice and state calls for implementation are cited. An overview of some of the basic principles for threat assessment and management implementation is accompanied by examples of how they are utilized. Pitfalls…
A New Age of Implementation: Guiding Principles for Implementing Performance Assessment Systems
ERIC Educational Resources Information Center
Chapin, Gary; Gagnon, Laurie; Hammonds, Virgel
2017-01-01
In an examination of the conditions required for the successful implementation of performance assessment, the authors draw on a range of personal experience and other insights to guide practitioners and policymakers. Building on the authentic assessment work of the Boston Pilot Schools (CCE 2004), in 2008 the Center for Collaborative Education…
Feasibility Study of Solar Photovoltaics on Landfills in Puerto Rico (Second Study)
DOE Office of Scientific and Technical Information (OSTI.GOV)
Salasovich, J.; Mosey, G.
2011-08-01
This report presents the results of an assessment of the technical and economic feasibility of deploying a solar photovoltaics (PV) system on landfill sites in Puerto Rico. The purpose of this report is to assess the landfills with the highest potential for possible solar PV installation and estimate cost, performance, and site impacts of three different PV options: crystalline silicon (fixed tilt), crystalline silicon (single-axis tracking), and thin film (fixed tilt). The report outlines financing options that could assist in the implementation of a system. According to the site production calculations, the most cost-effective system in terms of return onmore » investment is the thin-film fixed-tilt technology. The report recommends financing options that could assist in the implementation of such a system. The landfills and sites considered in this report were all determined feasible areas in which to implement solar PV systems.« less
Global Patterns in the Implementation of Payments for Environmental Services
Ezzine-de-Blas, Driss; Wunder, Sven; Ruiz-Pérez, Manuel; Moreno-Sanchez, Rocio del Pilar
2016-01-01
Assessing global tendencies and impacts of conditional payments for environmental services (PES) programs is challenging because of their heterogeneity, and scarcity of comparative studies. This meta-study systematizes 55 PES schemes worldwide in a quantitative database. Using categorical principal component analysis to highlight clustering patterns, we reconfirm frequently hypothesized differences between public and private PES schemes, but also identify diverging patterns between commercial and non-commercial private PES vis-à-vis their service focus, area size, and market orientation. When do these PES schemes likely achieve significant environmental additionality? Using binary logistical regression, we find additionality to be positively influenced by three theoretically recommended PES ‘best design’ features: spatial targeting, payment differentiation, and strong conditionality, alongside some contextual controls (activity paid for and implementation time elapsed). Our results thus stress the preeminence of customized design over operational characteristics when assessing what determines the outcomes of PES implementation. PMID:26938065
Connected Classroom Technology Facilitates Multiple Components of Formative Assessment Practice
NASA Astrophysics Data System (ADS)
Shirley, Melissa L.; Irving, Karen E.
2015-02-01
Formative assessment has been demonstrated to result in increased student achievement across a variety of educational contexts. When using formative assessment strategies, teachers engage students in instructional tasks that allow the teacher to uncover levels of student understanding so that the teacher may change instruction accordingly. Tools that support the implementation of formative assessment strategies are therefore likely to enhance student achievement. Connected classroom technologies (CCTs) include a family of devices that show promise in facilitating formative assessment. By promoting the use of interactive student tasks and providing both teachers and students with rapid and accurate data on student learning, CCT can provide teachers with necessary evidence for making instructional decisions about subsequent lessons. In this study, the experiences of four middle and high school science teachers in their first year of implementing the TI-Navigator™ system, a specific type of CCT, are used to characterize the ways in which CCT supports the goals of effective formative assessment. We present excerpts of participant interviews to demonstrate the alignment of CCT with several main phases of the formative assessment process. CCT was found to support implementation of a variety of instructional tasks that generate evidence of student learning for the teacher. The rapid aggregation and display of student learning evidence provided teachers with robust data on which to base subsequent instructional decisions.
Lauritzen, Camilla; van Doesum, Karin T M
2012-01-01
Background According to new Norwegian laws, mental healthcare for adults are obligated to assess all patients who are parents and to act on their children's needs. This article describes the study protocol of implementing the interventions Family Assessment and Child Talks for children of patients in the adult psychiatry of the University Hospital of Northern Norway. The project is designed to evaluate the process of changes in clinical practice due to the implementation of two interventions. The interventions to be implemented are a standardised Family Assessment Form and the intervention called Child Talks. The family assessment form is an intervention to identify children of mentally ill parents and their needs. The intervention Child Talks is a health-promoting and preventive intervention where the mental health workers talk with the family about the situation of the children and their needs. Methods/design There are two groups of participants in this study: (1) mental health workers in the clinic (N=220) and (2) patients who are parents (N=200) receiving treatment in the clinic. (1) In the evaluation of clinical practice, the authors use a pre-test, post-test and 1-year follow-up design. At pre-test, the authors evaluate status quo among mental health workers in the clinic regarding knowledge, attitudes, collaborative routines and clinical practice related to families with parental mental illness. After the pre-test is finished, the project move on to implement the interventions Family Assessment Form and Child Talks in the clinic. At post-test and 1-year follow-up, the authors evaluate the impact of implementing the Family Assessment Form in terms of how many children were identified and offered Child Talks in the clinic or referred to other services for additional support. (2) In the evaluation of parents/patients experience with the interventions, the authors use a pre-test post-test design. To identify children of mentally ill patients, the authors collect data on demographical variables for the patient and the child at pre-measures, as well as data on parental competence (PSOC) and parental concerns (PEDS) about their children. At post-measures, the authors evaluate the impact of the intervention in terms of user satisfaction, as well as changes between pre- and post-measures on parental competence (PSOC) and parental concerns (PEDS) about their children. Discussion The implication of implementing new interventions to safeguard children of mentally ill patients and the limitation of not measuring child development directly are discussed. PMID:22556160
Reedtz, Charlotte; Lauritzen, Camilla; van Doesum, Karin T M
2012-01-01
According to new Norwegian laws, mental healthcare for adults are obligated to assess all patients who are parents and to act on their children's needs. This article describes the study protocol of implementing the interventions Family Assessment and Child Talks for children of patients in the adult psychiatry of the University Hospital of Northern Norway. The project is designed to evaluate the process of changes in clinical practice due to the implementation of two interventions. The interventions to be implemented are a standardised Family Assessment Form and the intervention called Child Talks. The family assessment form is an intervention to identify children of mentally ill parents and their needs. The intervention Child Talks is a health-promoting and preventive intervention where the mental health workers talk with the family about the situation of the children and their needs. There are two groups of participants in this study: (1) mental health workers in the clinic (N=220) and (2) patients who are parents (N=200) receiving treatment in the clinic. (1) In the evaluation of clinical practice, the authors use a pre-test, post-test and 1-year follow-up design. At pre-test, the authors evaluate status quo among mental health workers in the clinic regarding knowledge, attitudes, collaborative routines and clinical practice related to families with parental mental illness. After the pre-test is finished, the project move on to implement the interventions Family Assessment Form and Child Talks in the clinic. At post-test and 1-year follow-up, the authors evaluate the impact of implementing the Family Assessment Form in terms of how many children were identified and offered Child Talks in the clinic or referred to other services for additional support. (2) In the evaluation of parents/patients experience with the interventions, the authors use a pre-test post-test design. To identify children of mentally ill patients, the authors collect data on demographical variables for the patient and the child at pre-measures, as well as data on parental competence (PSOC) and parental concerns (PEDS) about their children. At post-measures, the authors evaluate the impact of the intervention in terms of user satisfaction, as well as changes between pre- and post-measures on parental competence (PSOC) and parental concerns (PEDS) about their children. The implication of implementing new interventions to safeguard children of mentally ill patients and the limitation of not measuring child development directly are discussed.
Predicting Early School Achievement with the EDI: A Longitudinal Population-Based Study
ERIC Educational Resources Information Center
Forget-Dubois, Nadine; Lemelin, Jean-Pascal; Boivin, Michel; Dionne, Ginette; Seguin, Jean R.; Vitaro, Frank; Tremblay, Richard E.
2007-01-01
School readiness tests are significant predictors of early school achievement. Measuring school readiness on a large scale would be necessary for the implementation of intervention programs at the community level. However, assessment of school readiness is costly and time consuming. This study assesses the predictive value of a school readiness…
Assessing CLIL at Primary School: A Longitudinal Study
ERIC Educational Resources Information Center
Serra, Cecilia
2007-01-01
This paper presents aspects of a longitudinal study assessing integrative bilingual learning based on Content and Language Integrated Learning (CLIL), implemented in three Swiss primary schools. From Grades 1 to 6, three classes of German-speaking pupils were taught 50% of the curriculum, notably mathematics, in Italian or in Romansh as a second…
Factors Affecting the Adoption of an E-Assessment System
ERIC Educational Resources Information Center
McCann, Ann L.
2010-01-01
A case study was conducted in 2006-07 to explore how one US campus implemented a centralised e-assessment system. The study specifically measured the extent of adoption by faculty members, identified their reasons for adoption and evaluated the impact on teaching and learning. The purposes of the system, entitled researching learning (REAL, a…
Model Meets Data: Challenges and Opportunities to Implement Land Management in Earth System Models
NASA Astrophysics Data System (ADS)
Pongratz, J.; Dolman, A. J.; Don, A.; Erb, K. H.; Fuchs, R.; Herold, M.; Jones, C.; Luyssaert, S.; Kuemmerle, T.; Meyfroidt, P.
2016-12-01
Land-based demand for food and fibre is projected to increase in the future. In light of global sustainability challenges only part of this increase will be met by expansion of land use into relatively untouched regions. Additional demand will have to be fulfilled by intensification and other adjustments in management of land that already is under agricultural and forestry use. Such land management today occurs on about half of the ice-free land surface, as compared to only about one quarter that has undergone a change in land cover. As the number of studies revealing substantial biogeophysical and biogeochemical effects of land management is increasing, moving beyond land cover change towards including land management has become a key focus for Earth system modeling. However, a basis for prioritizing land management activities for implementation in models is lacking. We lay this basis for prioritization in a collaborative project across the disciplines of Earth system modeling, land system science, and Earth observation. We first assess the status and plans of implementing land management in Earth system and dynamic global vegetation models. A clear trend towards higher complexity of land use representation is visible. We then assess five criteria for prioritizing the implementation of land management activities: (1) spatial extent, (2) evidence for substantial effects on the Earth system, (3) process understanding, (4) possibility to link the management activity to existing concepts and structures of models, (5) availability of data required as model input. While the first three criteria have been assessed by an earlier study for ten common management activities, we review strategies for implementation in models and the availability of required datasets. We can thus evaluate the management activities for their performance in terms of importance for the Earth system, possibility of technical implementation in models, and data availability. This synthesis reveals some "low-hanging" fruits for model implementation, but also challenges for the assessment of land management effects by modeling. The identified gaps can guide prioritization within the data community from the Earth system and Earth system modeling perspective.
Model meets data: Challenges and opportunities to implement land management in Earth System Models
NASA Astrophysics Data System (ADS)
Pongratz, Julia; Dolman, Han; Don, Axel; Erb, Karl-Heinz; Fuchs, Richard; Herold, Martin; Jones, Chris; Luyssaert, Sebastiaan; Kuemmerle, Tobias; Meyfroidt, Patrick; Naudts, Kim
2017-04-01
Land-based demand for food and fibre is projected to increase in the future. In light of global sustainability challenges only part of this increase will be met by expansion of land use into relatively untouched regions. Additional demand will have to be fulfilled by intensification and other adjustments in management of land that already is under agricultural and forestry use. Such land management today occurs on about half of the ice-free land surface, as compared to only about one quarter that has undergone a change in land cover. As the number of studies revealing substantial biogeophysical and biogeochemical effects of land management is increasing, moving beyond land cover change towards including land management has become a key focus for Earth system modeling. However, a basis for prioritizing land management activities for implementation in models is lacking. We lay this basis for prioritization in a collaborative project across the disciplines of Earth system modeling, land system science, and Earth observation. We first assess the status and plans of implementing land management in Earth system and dynamic global vegetation models. A clear trend towards higher complexity of land use representation is visible. We then assess five criteria for prioritizing the implementation of land management activities: (1) spatial extent, (2) evidence for substantial effects on the Earth system, (3) process understanding, (4) possibility to link the management activity to existing concepts and structures of models, (5) availability of data required as model input. While the first three criteria have been assessed by an earlier study for ten common management activities, we review strategies for implementation in models and the availability of required datasets. We can thus evaluate the management activities for their performance in terms of importance for the Earth system, possibility of technical implementation in models, and data availability. This synthesis reveals some "low-hanging" fruits for model implementation, but also challenges for the assessment of land management effects by modeling. The identified gaps can guide prioritization within the data community from the Earth system and Earth system modeling perspective.
Audette, Jennifer Gail; Baldew, Se-Sergio; Chang, Tony C M S; de Vries, Jessica; Ho A Tham, Nancy; Janssen, Johanna; Vyt, Andre
2017-01-01
To describe how a multinational team worked together to transition a physical therapy (PT) educational program in Paramaribo, Suriname, from a Bachelor level to a Master of Science in Physical Therapy (MSPT) level. The team was made up of PT faculty from Anton De Kom Universiteit van Suriname (AdeKUS), the Flemish Interuniversity Council University Development Cooperation (VLIR-UOS) leadership, and Health Volunteers Overseas volunteers. In this case study, the process for curricular assessment, redesign, and upgrade is described retrospectively using a Plan, Do, Study, Act (PDSA) framework. PT educational programs in developing countries are eager for upgrade to meet international expectations and to better meet community health-care needs. An ongoing process which included baseline assessment of all aspects of the existing bachelor's program in PT, development of a plan for a MSPT, implementation of the master's program, and evaluation following implementation is described. Curricular assessment and upgrade in resource-limited countries requires the implementation of process-oriented methods. The PDSA process is a useful tool to explore curricular development. The international collaboration described in this paper provides an example of the diligence, consistency, and dedication required to see a project through and achieve success while providing adequate support to the host site. This project might provide valuable insights for those involved in curricular redesign in similar settings.
ERIC Educational Resources Information Center
Troudi, Salah; Coombe, Christine; Al-Hamliy, Mashael
2009-01-01
Issues of assessment design and implementation in Kuwait and the United Arab Emirates (UAE) have attracted some attention over recent years, but teachers' philosophies about assessment remain underexplored. This article reports the findings of a qualitative study into the assessment roles and philosophies of a group of teachers of English as a…
ERIC Educational Resources Information Center
Horrocks, Erin L.; Morgan, Robert L.
2011-01-01
A multicomponent training package (live training, video modeling, role playing, and feedback) was used to train teachers to conduct assessment and to instruct students with profound multiple disabilities. Phase 1 of the study involved training seven teachers to conduct assessment in three areas: (a) preference assessment (i.e., identification of…
Matthews, Elizabeth B; Stanhope, Victoria; Choy-Brown, Mimi; Doherty, Meredith
2018-07-01
Person-centered care (PCC) is a central feature of health care reform, yet the tools needed to deliver this practice have not been implemented consistently. Person-centered care planning (PCCP) is a treatment planning approach operationalizing the values of recovery. To better understand PCCP implementation, this study examined the relationship between recovery knowledge and self-reported PCCP behaviors among 224 community mental health center staff. Results indicated that increased knowledge decreased the likelihood of endorsing non-recovery implementation barriers and self-reporting a high level of PCCP implementation. Findings suggest that individuals have difficulty assessing their performance, and point to the importance of objective fidelity measures.
Exploring a Framework for Consequential Validity for Performance-Based Assessments
ERIC Educational Resources Information Center
Kim, Su Jung
2017-01-01
This study explores a new comprehensive framework for understanding elements of validity, specifically for performance assessments that are administered within specific and dynamic contexts. The adoption of edTPA is a good empirical case for examining the concept of consequential validity because this assessment has been implemented at the state…
Exploring Tensions in Developing Assessment for Learning
ERIC Educational Resources Information Center
Webb, Mary; Jones, Jane
2009-01-01
This paper is based on a study of classroom practice of primary school teachers who were engaged in a programme of professional development to implement formative assessment in their classrooms. The programme sought to develop the skills and expertise of teachers to enable formative assessment to be used to support and improve the learning of…
ERIC Educational Resources Information Center
Ciorba, Charles R.; Smith, Neal Y.
2009-01-01
Recent policy initiatives instituted by major accrediting bodies require the implementation of specific assessment tools to provide evidence of student achievement in a number of areas, including applied music study. The purpose of this research was to investigate the effectiveness of a multidimensional assessment rubric, which was administered to…
ERIC Educational Resources Information Center
Lan, Chung-Hsien; Chao, Stefan; Kinshuk; Chao, Kuo-Hung
2013-01-01
This study presents a conceptual framework for supporting mobile peer assessment by incorporating augmented reality technology to eliminate limitation of reviewing and assessing. According to the characteristics of mobile technology and augmented reality, students' work can be shown in various ways by considering the locations and situations. This…
ERIC Educational Resources Information Center
Hunter, Karla M.; Westwick, Joshua N.; Haleta, Laurie L.
2014-01-01
Despite assessment's prominence in higher education, many communication departments still find its implementation problematic. In this case study, we answer a call for heightened research pertaining to the best practices for assessment of large, multisection, standardized public speaking courses. We demonstrate the ease with which the basic course…
Cornell, Dewey; Maeng, Jennifer L; Burnette, Anna Grace; Jia, Yuane; Huang, Francis; Konold, Timothy; Datta, Pooja; Malone, Marisa; Meyer, Patrick
2018-06-01
Threat assessment has been widely endorsed as a school safety practice, but there is little research on its implementation. In 2013, Virginia became the first state to mandate student threat assessment in its public schools. The purpose of this study was to examine the statewide implementation of threat assessment and to identify how threat assessment teams distinguish serious from nonserious threats. The sample consisted of 1,865 threat assessment cases reported by 785 elementary, middle, and high schools. Students ranged from pre-K to Grade 12, including 74.4% male, 34.6% receiving special education services, 51.2% White, 30.2% Black, 6.8% Hispanic, and 2.7% Asian. Survey data were collected from school-based teams to measure student demographics, threat characteristics, and assessment results. Logistic regression indicated that threat assessment teams were more likely to identify a threat as serious if it was made by a student above the elementary grades (odds ratio 0.57; 95% lower and upper bound 0.42-0.78), a student receiving special education services (1.27; 1.00-1.60), involved battery (1.61; 1.20-2.15), homicide (1.40; 1.07-1.82), or weapon possession (4.41; 2.80-6.96), or targeted an administrator (3.55; 1.73-7.30). Student race and gender were not significantly associated with a serious threat determination. The odds ratio that a student would attempt to carry out a threat classified as serious was 12.48 (5.15-30.22). These results provide new information on the nature and prevalence of threats in schools using threat assessment that can guide further work to develop this emerging school safety practice. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Service-Learning Enhances Physical Therapy Students' Ability to Examine Fall Risk in Older Adults.
Nordon-Craft, Amy; Schwarz, Brandy; Kowalewski, Victoria; Hartos, Jessica; Jurado Severance, Jennifer; Bugnariu, Nicoleta
2017-01-01
Service-learning (SL) is one educational methodology that provides students opportunities to practice and refine affective, cognitive and psychomotor skills in a community-based setting. The aims of this study were: 1) to investigate the impact of SL on physical therapy (PT) students' attitudes and perceived clinical competence when working with older adults, and 2) to evaluate the difference between perceptions of students who developed and implemented the SL activity vs those who implemented only. Eighty PT students, (from two consecutive cohorts) enrolled in a first-year geriatrics course, participated in this study. The first cohort designed and implemented the SL activities, while the second cohort only implemented these activities. Student self-perceived anxiety, confidence, knowledge and skills were assessed by pre- and post-SL surveys using a 5- point Likert-like scale. Both cohorts reported similar anxiety and confidence levels pre-SL. For both cohorts, with the exception of one item, all responses to anxiety items significantly decreased from pre- to post-SL. All students' confidence levels for assessing and mitigating fall risk in older adults increased post-SL (p<0.01). Moreover, students in cohort 1, who designed and delivered SL activities, expressed self-perceived improvement in their ability to interpret results of evaluations, to determine type and severity of balance impairments, and to serve a geriatric population (p<0.05) compared to students in cohort 2 who only implemented the activities. Embedding SL into a geriatrics course decreased self-perceived anxiety and improved student confidence regarding working with older adults. Also, empowering students to be actively involved in the design and implementation of SL increased self-perceived ability in interpreting results from assessments.
Journey toward a patient-centered medical home: readiness for change in primary care practices.
Wise, Christopher G; Alexander, Jeffrey A; Green, Lee A; Cohen, Genna R; Koster, Christina R
2011-09-01
Information is limited regarding the readiness of primary care practices to make the transformational changes necessary to implement the patient-centered medical home (PCMH) model. Using comparative, qualitative data, we provide practical guidelines for assessing and increasing readiness for PCMH implementation. We used a comparative case study design to assess primary care practices' readiness for PCMH implementation in sixteen practices from twelve different physician organizations in Michigan. Two major components of organizational readiness, motivation and capability, were assessed. We interviewed eight practice teams with higher PCMH scores and eight with lower PCMH scores, along with the leaders of the physician organizations of these practices, yielding sixty-six semistructured interviews. The respondents from the higher and lower PCMH scoring practices reported different motivations and capabilities for pursuing PCMH. Their motivations pertained to the perceived value of PCMH, financial incentives, understanding of specific PCMH requirements, and overall commitment to change. Capabilities that were discussed included the time demands of implementation, the difficulty of changing patients' behavior, and the challenges of adopting health information technology. Enhancing the implementation of PCMH within practices included taking an incremental approach, using data, building a team and defining roles of its members, and meeting regularly to discuss the implementation. The respondents valued external organizational support, regardless of its source. The respondents from the higher and lower PCMH scoring practices commented on similar aspects of readiness-motivation and capability-but offered very different views of them. Our findings suggest the importance of understanding practice perceptions of the motivations for PCMH and the capability to undertake change. While this study identified some initial approaches that physician organizations and practices have used to prepare for practice redesign, we need much more information about their effectiveness. © 2011 Milbank Memorial Fund. Published by Wiley Periodicals Inc.
Koskela, Sian A; Jones, Fiona; Clarke, Natasha; Anderson, Liezl; Kennedy, Bernadette; Grant, Robert; Gage, Heather; Hurley, Michael V
2017-03-01
To evaluate the effectiveness, acceptability and costs of Active Residents in Care Homes, ARCH - a programme aiming to increase opportunities for activity in older care home residents. Feasibility study. Residential care homes for older people. 10-15 residents, staff and family members will be recruited in each of the three participating care homes. ARCH is a 12-month 'whole-systems' programme implemented by occupational therapists and physiotherapists. They will conduct a comprehensive assessment of each care home, considering the physical environment, working practices and organisation structure as well as residents' individual needs, and recommend ways to address barriers and increase residents' activity levels. The therapists will then work with staff to improve understanding of the issues, instigate training, environmental, organisational and working practice changes as necessary. Residents' activity levels, health and quality of life will be tested using several measures to see which are practicable and appropriate for this population in this context. This includes: Assessment of Physical Activity in Frail Older People; Pool Activity Level Checklist; Dementia Care Mapping observations; and EQ-5D-5L. Residents will be assessed prior to programme implementation then 4- and 12-months post-implementation. Semi-structured interviews will explore the experiences of residents, staff, family members and therapists. Providing evidence of effectiveness and acceptability of ARCH, and documenting factors that impede/facilitate implementation will help us identify ways to enhance the care and quality of life of older people in residential care, and our understanding of how to implement them. ISRCTN24000891. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.
Dallas area rapid transit LRT starter line assessment study design. Final research report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Shunk, G.A.; Turnbull, K.F.; Lindquist, N.F.
1995-03-01
Light rail transit (LRT) systems have recently been implemented in a number of urban areas throughout the United States and additional projects are in various stages of planning and development. Questions have been raised concerning the impact of these systems on ridership levels, transit operating costs, regional mobility, land use, economic development, energy, air quality, congestion levels, and other factors. The implementation of the Dallas Area Rapid Transit (DART) LRT starter line provides the opportunity to assess the impact of an LRT system in a Southwestern city in the United States. This research project was undertaken to assist with themore » development of a comprehensive study design for assessing the effects of the DART LRT starter line. To accomplish this objective, a review was conducted of before-and-after studies of recent LRT, heavy rail, and high-occupancy vehicle (HOV) projects. The goals and objectives of the DART system were also reviewed and existing transportation-related data collection activities in the Dallas area were examined. This information was used to develop a preliminary study design for assessing the effects of the DART LRT starter line. This report documents the review of recent before-and-after studies and presents the preliminary study design for assessing the effects of the DART LRT starter line.« less
Vet, Raymond; de Wit, John B F; Das, Enny
2014-02-01
This study assessed the separate and joint effects of having a goal intention and the completeness of implementation intention formation on the likelihood of attending an appointment to obtain vaccination against the hepatitis B virus among men who have sex with men (MSM) in the Netherlands. Extending previous research, it was hypothesized that to be effective in promoting vaccination, implementation intention formation not only requires a strong goal intention, but also complete details specifying when, where and how to make an appointment to obtain hepatitis B virus vaccination among MSM. MSM at risk for hepatitis B virus (N = 616), with strong or weak intentions to obtain hepatitis B virus vaccination, were randomly assigned to form an implementation intention or not. Completeness of implementation intentions was rated and hepatitis B virus uptake was assessed through data linkage with the joint vaccination registry of the collaborating Public Health Services. Having a strong goal intention to obtain hepatitis B virus vaccination and forming an implementation intention, each significantly and independently increased the likelihood of MSM obtaining hepatitis B virus vaccination. In addition, MSM who formed complete implementation intentions were more successful in obtaining vaccination (p < 0.01). The formation of complete implementation intentions was promoted by strong goal intentions (p < 0.01).
Implementing team huddles in small rural hospitals: How does the Kotter model of change apply?
Baloh, Jure; Zhu, Xi; Ward, Marcia M
2017-12-17
To examine how the process of change prescribed in Kotter's change model applies in implementing team huddles, and to assess the impact of the execution of early change phases on change success in later phases. Kotter's model can help to guide hospital leaders to implement change and potentially to improve success rates. However, the model is under studied, particularly in health care. We followed eight hospitals implementing team huddles for 2 years, interviewing the change teams quarterly to inquire about implementation progress. We assessed how the hospitals performed in the three overarching phases of the Kotter model, and examined whether performance in the initial phase influenced subsequent performance. In half of the hospitals, change processes were congruent with Kotter's model, where performance in the initial phase influenced their success in subsequent phases. In other hospitals, change processes were incongruent with the model, and their success depended on implementation scope and the strategies employed. We found mixed support for the Kotter model. It better fits implementation that aims to spread to multiple hospital units. When the scope is limited, changes can be successful even when steps are skipped. Kotter's model can be a useful guide for nurse managers implementing changes. © 2017 John Wiley & Sons Ltd.
TIMSS 2007 Assessment Frameworks
ERIC Educational Resources Information Center
Mullis, Ina V. S.; Martin, Michael O.; Ruddock, Graham J.; O'Sullivan, Christine Y.; Arora, Alka; Erberber, Ebru
2005-01-01
Developing the Trends in International Mathematics and Science Study (TIMSS) 2007 Assessment Frameworks represents an extensive collaborative effort involving individuals and expert groups from more than 60 countries around the world. The document contains three frameworks for implementing TIMSS 2007--the Mathematics Framework, the Science…
ERIC Educational Resources Information Center
Wills, Howard P.; Mason, Benjamin A.
2014-01-01
Technological innovations offer promise for improving intervention implementation in secondary, inclusive classrooms. A withdrawal design was employed with two high-school students in order to assess the effectiveness of a technologically delivered, self-monitoring intervention in improving on-task behavior in a science classroom. Two students…
Integrating and Assessing Essential Learning Outcomes: The Syllabus and Formative Feedback
ERIC Educational Resources Information Center
Cydis, Susan; Galantino, MaryLou; Hood, Carra Leah; Padden, Mary; Richard, Marc
2017-01-01
This article describes the results of a follow-up investigation to a study in which researchers proposed a model for implementing a college-wide initiative in which ten essential learning outcomes students acquire from curricular and extra-curricular learning experiences were developed and implemented at the university. Using descriptive and…
Process Evaluation Results from the HEALTHY Physical Education Intervention
ERIC Educational Resources Information Center
Hall, William J.; Zeveloff, Abigail; Steckler, Allan; Schneider, Margaret; Thompson, Deborah; Pham, Trang; Volpe, Stella L.; Hindes, Katie; Sleigh, Adriana; McMurray, Robert G.
2012-01-01
Process evaluation is an assessment of the implementation of an intervention. A process evaluation component was embedded in the HEALTHY study, a primary prevention trial for Type 2 diabetes implemented over 3 years in 21 middle schools across the United States. The HEALTHY physical education (PE) intervention aimed at maximizing student…
ERIC Educational Resources Information Center
Dinkel, Danae M.; Lee, Jung-Min; Schaffer, Connie
2016-01-01
This study examined teachers' zone of proximal development for classroom physical activity breaks by assessing teachers' knowledge and capacity for implementing classroom physical activity breaks. Five school districts of various sizes (n = 346 teachers) took part in a short online survey. Descriptive statistics were calculated and chi-square…
ERIC Educational Resources Information Center
Durand, Francesca T.; Lawson, Hal A.; Wilcox, Kristen Campbell; Schiller, Kathryn S.
2016-01-01
Purpose: This multiple case study investigated district leaders' orientations and strategies as their elementary schools proceeded with state-mandated implementation of the Common Core State Standards (CCSS). We identified differences between schools achieving above-predicted outcomes on state CCSS assessments ("odds-beaters") and…
Academic-Career Integration in Magnet High Schools: Assessing the Level of Implementation.
ERIC Educational Resources Information Center
Tokarska, Barbara; And Others
An ongoing study examined implementation and student response to academic career magnet (ACM) programs in New York City high schools. The programs emphasize both college preparation and career education, demonstrating one approach to the current emphasis on integrating academic and vocational education. New York City offers a wide array of magnet…
Psychiatry Morbidity and Mortality Rounds: Implementation and Impact
ERIC Educational Resources Information Center
Goldman, Stuart; Demaso, David R.; Kemler, Beth
2009-01-01
Objective: This study assessed the implementation of psychiatry morbidity and mortality rounds (M&Ms) on the clinical and educational practice in a children's hospital. Methods: Attendees to monthly M&Ms between July 2005 and May 2007 included staff and trainees from psychiatry, psychology, nursing, and social work. Cases were selected based on a…
The Struggle for Teacher Professionalism in a Mandated Literacy Curriculum
ERIC Educational Resources Information Center
Costello, Marsha; Costello, David
2016-01-01
This article reports on a study investigating how elementary teachers experienced the literacy initiatives that have been implemented in schools across PEI over the past five years. Such initiatives included the implementation of standardized instructional and assessment materials across the board and the emphasis on consistency of program use,…
ERIC Educational Resources Information Center
Dugas, Michelle; Gaudreau, Patrick; Carraro, Natasha
2012-01-01
This 4-week prospective study examined whether the use of life-management strategies mediates the relationship between implementation planning and short-term progress on physical activity goals. In particular, the strategies of elective selection, compensation, and loss-based selection were disentangled to assess their specific mediating effects.…
ERIC Educational Resources Information Center
McIntosh, Kent; Predy, Larissa K.; Upreti, Gita; Hume, Amanda E.; Turri, Mary G.; Mathews, Susanna
2014-01-01
The purpose of this study was to assess the perceived importance of specific contextual variables for initial implementation and sustainability of School-Wide Positive Behavior Support (SWPBS). A large, national sample of 257 school team members completed the "School-Wide Universal Behavior Sustainability Index: School Teams", a…
An Effective Model for Improving Global Health Nursing Competence.
Kang, Sun-Joo
2016-01-01
This paper proposed an effective model for improving global health nursing competence among undergraduate students. A descriptive case study was conducted by evaluation of four implemented programs by the author. All programs were conducted with students majoring in nursing and healthcare, where the researcher was a program director, professor, or facilitator. These programs were analyzed in terms of students' needs assessment, program design, and implementation and evaluation factors. The concept and composition of global nursing competence, identified within previous studies, were deemed appropriate in all of our programs. Program composition varied from curricular to extracurricular domains. During the implementation phase, some of the programs included non-Korean students to improve cultural diversity and overcome language barriers. Qualitative and quantitative surveys were conducted to assess program efficacy. Data triangulation from students' reflective journals was examined. Additionally, students' awareness regarding changes within global health nursing, improved critical thinking, cultural understanding, and global leadership skills were investigated pre- and post-program implementation. The importance of identifying students' needs regarding global nursing competence when developing appropriate curricula is discussed.
Rocha, Paulo de Medeiros; Uchoa, Alice da Costa; Rocha, Nadja de Sá Pinto Dantas; Souza, Elizabethe Cristina Fagundes de; Rocha, Marconi de Lima; Pinheiro, Themis Xavier de Albuquerque
2008-01-01
This article presents part of the results from the Baseline Studies, an evaluative research conducted in 21 municipalities with more than 100,000 inhabitants each, in three States of Northeast Brazil. The overall objective was to assess experiences in the implementation of the Family Health Program (FHP), with a focus on inductions in the PROESF. An implementation analysis was performed, using the case study method. The analysis focused on these dimensions: political-institutional, health organization, and comprehensive care. Outstanding advances included: prioritize the FHP in high-risk areas; institutional learning, with qualification of managers and teams; definition of institutional levels for regulating the FHP; and health team-user bonds and positive perceptions concerning the program. Challenges included: strengthening of local policy and decision-making capacity; allocation of primary care resources; greater employment security for human resources; effective implementation of the health care network; strengthening of social participation; upgrading of monitoring and evaluation for decision-making; receptivity; waiting lines for tests, appointments, and hospital admissions; implementation of teamwork; health promotion and inter-sector activities.
Development and implementation of Strategic Environmental Assessment in Taiwan
DOE Office of Scientific and Technical Information (OSTI.GOV)
Liou, M.-L.; Yu, Y.-H
2004-04-01
Taiwan is one of the few Asian countries to have officially adopted Strategic Environmental Assessment (SEA) as one important means towards the achievement of environmental conservation and sustainable development. Despite implementation almost a decade ago, SEA remains premature in its development. This paper analyzes the progress and characteristics of SEA in Taiwan and, through examination of its limited case studies, reveals the positive and apparent influence of SEA on policy making. This paper also identifies the barriers hindering SEA's advancement and concludes with recommendations on strategies to overcome these obstacles.
Symptom relief in patients with pneumonia and dementia: implementation of a practice guideline.
van der Maaden, Tessa; van der Steen, Jenny T; Koopmans, Raymond T C M; Doncker, Sarah M M M; Anema, Johannes R; Hertogh, Cees M P M; de Vet, Henrica C W
2017-08-01
This study aimed to assess the degree of implementation and barriers encountered in the use of a practice guideline for optimal symptom relief for patients with dementia and pneumonia in Dutch nursing homes. A process evaluation included assessment of reach, fidelity, and dose delivered using researcher's observations, and dose received was addressed in a question "use of the practice guideline," which the physicians completed for each patient included in the study. Perceived barriers were assessed with a structured questionnaire (response 69%) and semi-structured interviews (n = 14), which were subject to qualitative content analysis. Of the 55 physicians involved in the intervention phase, 87% attended an implementation meeting; 20 physicians joined the study later (reach). The intervention was implemented as planned, and all intervention components were delivered by the researchers (fidelity and dose delivered). Thirty-six physicians included 109 patients. For 81% of the patients, the treating physician stated to have used the guideline (dose received). The guideline was perceived as providing a good overview of current practice, but some physicians had expected a more directive protocol or algorithm. Further, recommended regular observations of symptoms were rarely performed. Physician's often felt that "this is not different from what we usually do," and with the acute illness, there was not always enough time to (re)familiarize with the contents. The physicians used the practice guideline frequently despite important barriers. Future implementation may involve strategies such as multiple interactive meetings. Further, the greatest potential to alter usual practice should be emphasized, such as using observational instruments. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.
Oddone, Eugene Z; Damschroder, Laura J; Gierisch, Jennifer; Olsen, Maren; Fagerlin, Angela; Sanders, Linda; Sparks, Jordan; Turner, Marsha; May, Carrie; McCant, Felicia; Curry, David; White-Clark, Courtney; Juntilla, Karen
2017-04-01
A large proportion of deaths and many illnesses can be attributed to three modifiable risk factors: tobacco use, overweight/obesity, and physical inactivity. Health risk assessments (HRAs) are widely available online but have not been consistently used in healthcare systems to activate patients to participate in prevention programs aimed at improving lifestyle behaviors. The goal of this study is to test whether adding telephone-based coaching to use of a comprehensive HRA increases at-risk patients' activation and enrollment into a prevention program compared to HRA use alone. Participants were randomized to either complete an HRA alone or in conjunction with a telephone coaching intervention. To be eligible Veterans had to have at least one modifiable risk factor (current smoker, overweight/obese, or physically inactive). The primary outcome is enrollment and participation in a prevention program by 6months. Secondary outcomes include change in a Patient Activation Measure and Framingham Risk Score. This study is the first to test a web-based health risk assessment coupled with a health coaching intervention within a large healthcare system. Results from this study will help the Veterans Health Administration (VHA) implement its national plan to include comprehensive health risk assessments as a tool to engage Veterans in prevention. The results will also inform health systems outside VHA who seek to implement Medicare's advisement that health risk assessment become a mandatory component of care under the Affordable Care Act. © 2016.
Student self-assessment and its impact on learning - a pilot study.
Dearnley, Christine A; Meddings, Fiona S
2007-05-01
Student self-assessment is widely reported to offer numerous advantages to the learner. It is a popular practice for empowering students and the advantages are claimed to incorporate increased dialogue between students and teachers and the development of skills that encompass critical awareness and reflectivity. It is, potentially, a process that may enable health care practitioners to be lifelong learners, equipped with the skills for autonomy in learning and professional practice. As such it might be viewed as an essential element of the curriculum. This paper reports on a study designed to evaluate the implementation of self-assessment among student health care practitioners. The pilot study examined the impact of self-assessment on learning and how the process was perceived by students and staff. Findings indicated that a varied approach had been taken to its implementation, which had significant repercussions in the way in which it was perceived by students. Similarly, there was a varied approach taken by students to the process of self-assessment and this had significant repercussions for its overall value as a learning tool. The outcomes of this study provide a sound rational for maintaining and expanding the practice of student self-assessment and important lessons for the process of doing so.
Galaviz, Karla I.; Lobelo, Felipe; Joy, Elizabeth; Heath, Gregory W.; Hutber, Adrian; Estabrooks, Paul
2018-01-01
Introduction Exercise is Medicine (EIM) is an initiative that seeks to integrate physical activity assessment, prescription, and patient referral as a standard in patient care. Methods to assess this integration have lagged behind its implementation. Purpose and Objectives The purpose of this work is to provide a pragmatic framework to guide health care systems in assessing the implementation and impact of EIM. Evaluation Methods A working group of experts from health care, public health, and implementation science convened to develop an evaluation model based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. The working group aimed to provide pragmatic guidance on operationalizing EIM across the different RE-AIM dimensions based on data typically available in health care settings. Results The Reach of EIM can be determined by the number and proportion of patients that were screened for physical inactivity, received brief counseling and/or a physical activity prescription, and were referred to physical activity resources. Effectiveness can be assessed through self-reported changes in physical activity, cardiometabolic biometric factors, incidence/burden of chronic disease, as well as health care utilization and costs. Adoption includes assessing the number and representativeness of health care settings that adopt any component of EIM, and Implementation involves assessing the extent to which health care teams implement EIM in their clinic. Finally, Maintenance involves assessing the long-term effectiveness (patient level) and sustained implementation (clinic level) of EIM in a given health care setting. Implications for Public Health The availability of a standardized, pragmatic, evaluation framework is critical in determining the impact of implementing EIM as a standard of care across health care systems. PMID:29752803
Stoutenberg, Mark; Galaviz, Karla I; Lobelo, Felipe; Joy, Elizabeth; Heath, Gregory W; Hutber, Adrian; Estabrooks, Paul
2018-05-10
Exercise is Medicine (EIM) is an initiative that seeks to integrate physical activity assessment, prescription, and patient referral as a standard in patient care. Methods to assess this integration have lagged behind its implementation. The purpose of this work is to provide a pragmatic framework to guide health care systems in assessing the implementation and impact of EIM. A working group of experts from health care, public health, and implementation science convened to develop an evaluation model based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. The working group aimed to provide pragmatic guidance on operationalizing EIM across the different RE-AIM dimensions based on data typically available in health care settings. The Reach of EIM can be determined by the number and proportion of patients that were screened for physical inactivity, received brief counseling and/or a physical activity prescription, and were referred to physical activity resources. Effectiveness can be assessed through self-reported changes in physical activity, cardiometabolic biometric factors, incidence/burden of chronic disease, as well as health care utilization and costs. Adoption includes assessing the number and representativeness of health care settings that adopt any component of EIM, and Implementation involves assessing the extent to which health care teams implement EIM in their clinic. Finally, Maintenance involves assessing the long-term effectiveness (patient level) and sustained implementation (clinic level) of EIM in a given health care setting. The availability of a standardized, pragmatic, evaluation framework is critical in determining the impact of implementing EIM as a standard of care across health care systems.
Assessing Integrated Pest Management Adoption: Measurement Problems and Policy Implications
NASA Astrophysics Data System (ADS)
Puente, Molly; Darnall, Nicole; Forkner, Rebecca E.
2011-11-01
For more than a decade, the U.S. government has promoted integrated pest management (IPM) to advance sustainable agriculture. However, the usefulness of this practice has been questioned because of lagging implementation. There are at least two plausible rationales for the slow implementation: (1) growers are not adopting IPM—for whatever reason—and (2) current assessment methods are inadequate at assessing IPM implementation. Our research addresses the second plausibility. We suggest that the traditional approach to measuring IPM implementation on its own fails to assess the distinct, biologically hierarchical components of IPM, and instead aggregates growers' management practices into an overall adoption score. Knowledge of these distinct components and the extent to which they are implemented can inform government officials as to how they should develop targeted assistance programs to encourage broader IPM use. We address these concerns by assessing the components of IPM adoption and comparing our method to the traditional approach alone. Our results indicate that there are four distinct components of adoption—weed, insect, general, and ecosystem management—and that growers implement the first two components significantly more often than the latter two. These findings suggest that using a more nuanced measure to assess IPM adoption that expands on the traditional approach, allows for a better understanding of the degree of IPM implementation.
2012-01-01
Hundreds of studies have shown the efficacy of treatments for problem behavior based on an understanding of its function. Assertions regarding the legitimacy of different types of functional assessment vary substantially across published articles, and best practices regarding the functional assessment process are sometimes difficult to cull from the empirical literature or from published discussions of the behavioral assessment process. A number of myths regarding the functional assessment process, which appear to be pervasive within different behavior-analytic research and practice communities, will be reviewed in the context of an attempt to develop new lore regarding the functional assessment process. Frequently described obstacles to implementing a critical aspect of the functional assessment process, the functional analysis, will be reviewed in the context of solutions for overcoming them. Finally, the aspects of the functional assessment process that should be exported to others versus those features that should remain the sole technological property of behavior analysts will be discussed. PMID:23326630
Li, Junhua; Seale, Holly; Ray, Pradeep; Wang, Quanyi; Yang, Peng; Li, Shuang; Zhang, Yi; Macintyre, C Raina
2013-03-13
To assess the preparedness status of a hospital in Beijing, China for implementation of an e-Health system in the context of a pandemic response. This research project used qualitative methods and involved two phases: (1) group interviews were conducted with key stakeholders to examine how the surveillance system worked with information and communication technology (ICT) support in Beijing, the results of which provided background information for a case study at the second phase and (2) individual interviews were conducted in order to gather a rich data set in relation to e-Health preparedness at the selected hospital. In phase 1, group interviews were conducted at Centres for Disease Prevention and Control (CDC) in Beijing. In phase 2, individual interviews were performed at a secondary hospital selected for the case study. In phase 1, three group interviews were undertaken with 12 key stakeholders (public health/medical practitioners from the Beijing city CDC, two district CDCs and a tertiary hospital) who were involved in the 2009 influenza A (H1N1) pandemic response in Beijing. In phase 2, individual interviews were conducted with 23 participants (including physicians across medical departments, an IT manager and a general administrative officer). PRIMARY AND SECONDARY MEASURES: For the case study, five areas were examined to assess the hospital's preparedness for implementation of an e-Health system in the context of a pandemic response: (1) motivational forces for change; (2) healthcare providers' exposure to e-Health; (3) technological preparedness; (4) organisational non-technical ability to support a clinical ICT innovation and (5) sociocultural issues at the organisation in association with e-Health implementation and a pandemic response. This article reports a small subset of the case study results from which major issues were identified under three main themes in relation to the hospital's preparedness. These issues include a poor sharing of patient health records, prescription errors, unavailability of software tools to assist physicians in answering patient questions, physicians' concerns about the reliability of ICT and the high monetary cost of e-health implementation and uncertainty over return on investment, and their dissatisfaction with the software in use. Prior to the implementation of e-Health, planning must be undertaken to ensure the smooth introduction of the system. The assessment of organisational preparedness is an important step in this planning process. On the basis of a case study, deficient areas of organisational preparedness were identified for the prospective implementation of electronic health records. Accordingly, we suggested possible solutions for the areas in need of improvement to facilitate e-Health implementation's success.
Li, Junhua; Seale, Holly; Ray, Pradeep; Wang, Quanyi; Yang, Peng; Li, Shuang; Zhang, Yi; MacIntyre, C Raina
2013-01-01
Objective To assess the preparedness status of a hospital in Beijing, China for implementation of an e-Health system in the context of a pandemic response. Design This research project used qualitative methods and involved two phases: (1) group interviews were conducted with key stakeholders to examine how the surveillance system worked with information and communication technology (ICT) support in Beijing, the results of which provided background information for a case study at the second phase and (2) individual interviews were conducted in order to gather a rich data set in relation to e-Health preparedness at the selected hospital. Setting In phase 1, group interviews were conducted at Centres for Disease Prevention and Control (CDC) in Beijing. In phase 2, individual interviews were performed at a secondary hospital selected for the case study. Participants In phase 1, three group interviews were undertaken with 12 key stakeholders (public health/medical practitioners from the Beijing city CDC, two district CDCs and a tertiary hospital) who were involved in the 2009 influenza A (H1N1) pandemic response in Beijing. In phase 2, individual interviews were conducted with 23 participants (including physicians across medical departments, an IT manager and a general administrative officer). Primary and secondary measures For the case study, five areas were examined to assess the hospital's preparedness for implementation of an e-Health system in the context of a pandemic response: (1) motivational forces for change; (2) healthcare providers’ exposure to e-Health; (3) technological preparedness; (4) organisational non-technical ability to support a clinical ICT innovation and (5) sociocultural issues at the organisation in association with e-Health implementation and a pandemic response. Results This article reports a small subset of the case study results from which major issues were identified under three main themes in relation to the hospital's preparedness. These issues include a poor sharing of patient health records, prescription errors, unavailability of software tools to assist physicians in answering patient questions, physicians’ concerns about the reliability of ICT and the high monetary cost of e-health implementation and uncertainty over return on investment, and their dissatisfaction with the software in use. Conclusions Prior to the implementation of e-Health, planning must be undertaken to ensure the smooth introduction of the system. The assessment of organisational preparedness is an important step in this planning process. On the basis of a case study, deficient areas of organisational preparedness were identified for the prospective implementation of electronic health records. Accordingly, we suggested possible solutions for the areas in need of improvement to facilitate e-Health implementation's success. PMID:23485719
2008-08-01
the Proposed Action and as a basis for assessing the significance of potential impacts. The areas of environmental consideration were air quality... ENVIRONMENTAL ASSESSMENT FOR THE IMPLEMENTATION OF THE INTEGRATED NATURAL RESOURCES MANAGEMENT PLAN FOR 45th SPACE WING August...DATE AUG 2008 2. REPORT TYPE 3. DATES COVERED 00-00-2008 to 00-00-2008 4. TITLE AND SUBTITLE Environmental Assessment for the Implementation of
Addressing unmeasured confounding in comparative observational research.
Zhang, Xiang; Faries, Douglas E; Li, Hu; Stamey, James D; Imbens, Guido W
2018-04-01
Observational pharmacoepidemiological studies can provide valuable information on the effectiveness or safety of interventions in the real world, but one major challenge is the existence of unmeasured confounder(s). While many analytical methods have been developed for dealing with this challenge, they appear under-utilized, perhaps due to the complexity and varied requirements for implementation. Thus, there is an unmet need to improve understanding the appropriate course of action to address unmeasured confounding under a variety of research scenarios. We implemented a stepwise search strategy to find articles discussing the assessment of unmeasured confounding in electronic literature databases. Identified publications were reviewed and characterized by the applicable research settings and information requirements required for implementing each method. We further used this information to develop a best practice recommendation to help guide the selection of appropriate analytical methods for assessing the potential impact of unmeasured confounding. Over 100 papers were reviewed, and 15 methods were identified. We used a flowchart to illustrate the best practice recommendation which was driven by 2 critical components: (1) availability of information on the unmeasured confounders; and (2) goals of the unmeasured confounding assessment. Key factors for implementation of each method were summarized in a checklist to provide further assistance to researchers for implementing these methods. When assessing comparative effectiveness or safety in observational research, the impact of unmeasured confounding should not be ignored. Instead, we suggest quantitatively evaluating the impact of unmeasured confounding and provided a best practice recommendation for selecting appropriate analytical methods. Copyright © 2018 John Wiley & Sons, Ltd.
Altuwaijri, Majid M; Bahanshal, Abdullah; Almehaid, Mona
2011-09-01
The purpose of this study is to describe the needs, process and experience of implementing a computerized physician order entry (CPOE) system in a leading healthcare organization in Saudi Arabia. The National Guard Health Affairs (NGHA) deployed the CPOE in a pilot department, which was the intensive care unit (ICU) in order to assess its benefits and risks and to test the system. After the CPOE was implemented in the ICU area, a survey was sent to the ICU clinicians to assess their perception on the importance of 32 critical success factors (CSFs) that was acquired from the literature. The project team also had several meetings to gather lessons learned from the pilot project in order to utilize them for the expansion of the project to other NGHA clinics and hospitals. The results of the survey indicated that the selected CSFs, even though they were developed with regard to international settings, are very much applicable for the pilot area. The top three CSFs rated by the survey respondents were: The "before go-live training", the adequate clinical resources during implementation, and the ordering time. After the assessment of the survey and the lessons learned from the pilot project, NGHA decided that the potential benefits of the CPOE are expected to be greater the risks expected. The project was then expanded to cover all NGHA clinics and hospitals in a phased approach. Currently, the project is in its final stages and expected to be completed by the end of 2011. The role of CPOE systems is very important in hospitals in order to reduce medication errors and to improve the quality of care. In spite of their great benefits, many studies suggest that a high percentage of these projects fail. In order to increase the chances of success and due to the fact that CPOE is a clinical system, NGHA implemented the system first in a pilot area in order to test the system without putting patients at risk and to learn from mistakes before expanding the system to other areas. As a result of the pilot project, NGHA developed a list of CSFs to increase the likelihood of project success for the expansion of the system to other clinics and hospitals. The authors recommend a future study for the CPOE implementation to be done that covers the implementation in all the four NGHA hospitals. The results of the study can then be generalized to other hospitals in Saudi Arabia.
ERIC Educational Resources Information Center
Lewis, Morgan V.; Kosine, Natalie R.
2008-01-01
This publication provides background to inform the implementation of Programs of Study (POS) as required by grantees of funds authorized under the Carl D. Perkins Career and Technical Education Improvement Act of 2006. The report is a review of the evidence on the effectiveness of previous similar initiatives and an examination of the implications…
ERIC Educational Resources Information Center
Spielberger, Julie; Goyette, Paul
2006-01-01
This publication reports findings from the first year of an implementation study of the Early Childhood Cluster Initiative (ECCI). ECCI is a prekindergarten program in ten elementary schools and a community child care center in Palm Beach County, based on the design of the High/Scope Perry Preschool model. The initiative is characterized by low…
The Effects of an Internet2 Implementation at the Food and Drug Administration: A Case Study
ERIC Educational Resources Information Center
Chen, Melinda Elena
2010-01-01
The purpose of this study is to determine the potential effects of an Internet2 implementation at the FDA. Because Internet2 does not currently exist in the FDA, research will be made to compare the tools used today to transmit data to what may develop with an Internet2 presence. These effects will be assessed from the point-of-view of the…
ERIC Educational Resources Information Center
Akech, Benta Achieng' Opul; Simatwa, Enose M. W.
2010-01-01
This study investigated opportunities and challenges for public primary school head teachers in the implementation of Free Primary Education in Kisumu municipality. Being a descriptive research, the study population consisted of 114 head teachers, 17,100 class seven and eight pupils in the municipality. Out of this, a sample of 37 head teachers…
Ecological mitigation measures in English Environmental Impact Assessment.
Drayson, Katherine; Thompson, Stewart
2013-04-15
Built development is one of the main drivers of biodiversity loss in the UK. Major built developments usually require an Environmental Impact Assessment (EIA) to be conducted, which frequently includes an Ecological Impact Assessment (EcIA) chapter. By identifying the flaws in EcIA mitigation measure proposals and their implementation in completed developments, it may be possible to develop measures to reduce biodiversity loss and help meet the UK's EU obligation to halt biodiversity loss by 2020. A review of 112 English EcIAs from 2000 onwards was conducted to provide a broad-scale overview of the information provision and detail of ecological mitigation measures. Audits of seven EIA development case study sites provided finer-scale detail of mitigation measure implementation, and the effectiveness of their grassland and marginal habitat creation and management measures was assessed using standard NVC methodology. Despite higher than expected levels of mitigation measure implementation in completed developments, EcIA mitigation proposal information and detail has seen little improvement since a 1997 review, and the effectiveness of the habitat mitigation measures studied was poor. This suggests that measures to improve ecological mitigation measures are best targeted at ecological consultants. A recommendation for EcIA-specific training of Competent Authorities is also made. Copyright © 2013 Elsevier Ltd. All rights reserved.
Stevens, Bonnie J; Yamada, Janet; Promislow, Sara; Stinson, Jennifer; Harrison, Denise; Victor, J Charles
2014-11-25
Despite extensive research, institutional policies, and practice guidelines, procedural pain remains undertreated in hospitalized children. Knowledge translation (KT) strategies have been employed to bridge the research to practice gap with varying success. The most effective single or combination of KT strategies has not been found. A multifaceted KT intervention, Evidence-based Practice for Improving Quality (EPIQ), that included tailored KT strategies was effective in improving pain practices and clinical outcomes at the unit level in a prospective comparative cohort study in 32 hospital units (16 EPIQ intervention and 16 Standard Care), in eight pediatric hospitals in Canada. In a study of the 16 EPIQ units (two at each hospital) only, the objectives were to: determine the effectiveness of evidence-based KT strategies implemented to achieve unit aims; describe the KT strategies implemented and their influence on pain assessment and management across unit types; and identify facilitators and barriers to their implementation. Data were collected from each EPIQ intervention unit on targeted pain practices and KT strategies implemented, through chart review and a process evaluation checklist, following four intervention cycles over a 15-month period. Following the completion of the four cycle intervention, 78% of 23 targeted pain practice aims across units were achieved within 80% of the stated aims. A statistically significant improvement was found in the proportion of children receiving pain assessment and management, regardless of pre-determined aims (p < 0.001). The median number of KT strategies implemented was 35 and included reminders, educational outreach and materials, and audit and feedback. Units successful in achieving their aims implemented more KT strategies than units that did not. No specific type of single or combination of KT strategies was more effective in improving pain assessment and management outcomes. Tailoring KT strategies to unit context, support from unit leadership, staff engagement, and dedicated time and resources were identified as facilitating effective implementation of the strategies. Further research is required to better understand implementation outcomes, such as feasibility and fidelity, how context influences the effectiveness of multifaceted KT strategies, and the sustainability of improved pain practices and outcomes over time.
Implementing Same Day Discharge Following Percutaneous Coronary Intervention: A Process Evaluation.
Chen, Yingyan; Lin, Frances; Marshall, Andrea
2018-06-14
The safety and effectiveness of same day discharge (SDD) following percutaneous coronary intervention are well demonstrated; however, the uptake of this model of care is low. The aim was to examine the effectiveness of implementing SDD using a process evaluation methodology. This study was undertaken in a cardiac services department of a tertiary teaching hospital in southeast Queensland, Australia. It was anticipated before the implementation that 120 patients could be discharged the same day in a 6 months' time period. Patient selection process and guideline adherence were assessed along with patients' and relatives' satisfaction. During implementation, 22 patients were discharged home the same day. It was found that staff did not follow the guideline consistently, with an overall adherence of 77.3%. The uptake of SDD was low in this implementation. The study is important as it provides direction for future improvement both in the criteria and the implementation process.
Yeung, S S T; Yeung, J K; Lau, T T Y; Forrester, L A; Steiner, T S; Bowie, W R; Bryce, E A
2015-12-01
Clostridium difficile infection (CDI) represents a spectrum of disease and is a significant concern for healthcare institutions. Our study objective was to assess whether implementation of a regional CDI management policy with Clinical Pharmacy and Medical Microbiology and Infection Control involvement would lead to an improvement in concordance in prescribing practices to an evidence-based CDI disease severity assessment and pharmacological treatment algorithm. Conducted at a tertiary care teaching hospital, this two-phase quality assurance study consisted of a baseline retrospective healthcare record review of patients with CDI prior to the implementation of a regional CDI management policy followed by a prospective evaluation post-implementation. One hundred and forty-one CDI episodes in the pre-implementation group were compared to 283 episodes post-implementation. Overall treatment concordance to the CDI treatment algorithm was achieved in 48 of 141 cases (34%) pre-implementation compared with 136 of 283 cases (48·1%) post-implementation (P = 0·01). The median time to treatment with vancomycin was reduced from five days to one day (P < 0·01), with median length of hospital stay decreasing from 30 days to 21 days (P = 0·01) post-implementation. There was no difference in 30-day all-cause mortality. A comprehensive approach with appropriate stakeholder involvement in the development of clinical pathways, education to healthcare workers and prospective audit with intervention and feedback can ensure patients diagnosed with CDI are optimally managed and prescribed the most appropriate therapy based on CDI disease severity. © 2015 John Wiley & Sons Ltd.
Harriger, Dinah; Lu, Wenhua; McKyer, E Lisako J; Pruitt, Buzz E; Goodson, Patricia
2014-04-01
The School Wellness Policy (SWP) mandate marks one of the first innovative and extensive efforts of the US government to address the child obesity epidemic and the influence of the school environment on child health. However, no systematic review has been conducted to examine the implementation of the mandate. The study examines the literature on SWP implementation by using the Diffusion of Innovations Theory as a framework. Empirically based literature on SWP was systematically searched and analyzed. A theory-driven approach was used to categorize the articles by 4 diffusion stages: restructuring/redefining, clarifying, routinizing, and multiple stages. Twenty-one studies were identified, and 3 key characteristics of the reviewed literature were captured: (1) uniformity in methodology, (2) role of context in analyzing policy implementation, and (3) lack of information related to policy clarification. Over half of the studies were published by duplicate set of authors, and only 1 study employed a pure qualitative methodology. Only 2 articles include an explicit theoretical framework to study theory-driven constructs related to SWP implementation. Policy implementation research can inform the policy process. Therefore, it is essential that policy implementation is measured accurately. Failing to clearly define implementation constructs may result in misguided conclusion. © 2014, American School Health Association.
Frankel, Allan; Grillo, Sarah Pratt; Pittman, Mary; Thomas, Eric J; Horowitz, Lisa; Page, Martha; Sexton, Bryan
2008-01-01
Objective To evaluate the impact of rigorous WalkRounds on frontline caregiver assessments of safety climate, and to clarify the steps and implementation of rigorous WalkRounds. Data Sources/Study Setting Primary outcome variables were baseline and post WalkRounds safety climate scores from the Safety Attitudes Questionnaire (SAQ). Secondary outcomes were safety issues elicited through WalkRounds. Study period was August 2002 to April 2005; seven hospitals in Massachusetts agreed to participate; and the project was implemented in all patient care areas. Study Design Prospective study of the impact of rigorously applied WalkRounds on frontline caregivers assessments of safety climate in their patient care area. WalkRounds were conducted weekly and according to the seven-step WalkRounds Guide. The SAQ was administered at baseline and approximately 18 months post-WalkRounds implementation to all caregivers in patient care areas. Results Two of seven hospitals complied with the rigorous WalkRounds approach; hospital A was an academic teaching center and hospital B a community teaching hospital. Of 21 patient care areas, SAQ surveys were received from 62 percent of respondents at baseline and 60 percent post WalkRounds. At baseline, 10 of 21 care areas (48 percent) had safety climate scores below 60 percent, whereas post-WalkRounds three care areas (14 percent) had safety climate scores below 60 percent without improving by 10 points or more. Safety climate scale scores in hospital A were 62 percent at baseline and 77 percent post-WalkRounds (t=2.67, p=.03), and in hospital B were 46 percent at baseline and 56 percent post WalkRounds (t=2.06, p=.06). Main safety issues by category were equipment/facility (A [26 percent] and B [33 percent]) and communication (A [24 percent] and B [18 percent]). Conclusions WalkRounds implementation requires significant organizational will; sustainability requires outstanding project management and leadership engagement. In the patient care areas that rigorously implemented WalkRounds, frontline caregiver assessments of patient safety increased. SAQ results such as safety climate scores facilitate the triage of quality improvement efforts, and provide consensus assessments of frontline caregivers that identify themes for improvement. PMID:18671751
Biruk, Senafekesh; Yilma, Tesfahun; Andualem, Mulusew; Tilahun, Binyam
2014-12-12
Electronic medical record systems are being implemented in many countries to support healthcare services. However, its adoption rate remains low, especially in developing countries due to technological, financial, and organizational factors. There is lack of solid evidence and empirical research regarding the pre implementation readiness of healthcare providers. The aim of this study is to assess health professionals' readiness and to identify factors that affect the acceptance and use of electronic medical recording system in the pre implementation phase at hospitals of North Gondar Zone, Ethiopia. An institution based cross-sectional quantitative study was conducted on 606 study participants from January to July 2013 at 3 hospitals in northwest Ethiopia. A pretested self-administered questionnaire was used to collect the required data. The data were entered using the Epi-Info version 3.5.1 software and analyzed using SPSS version 16 software. Descriptive statistics, bi-variate, and multi-variate logistic regression analyses were used to describe the study objectives and assess the determinants of health professionals' readiness for the system. Odds ratio at 95% CI was used to describe the association between the study and the outcome variables. Out of 606 study participants only 328 (54.1%) were found ready to use the electronic medical recording system according to our criteria assessment. The majority of the study participants, 432 (71.3%) and 331(54.6%) had good knowledge and attitude for EMR system, respectively. Gender (AOR = 1.87, 95% CI: [1.26, 2.78]), attitude (AOR = 1.56, 95% CI: [1.03, 2.49]), knowledge (AOR = 2.12, 95% CI: [1.32, 3.56]), and computer literacy (AOR =1.64, 95% CI: [0.99, 2.68]) were significantly associated with the readiness for EMR system. In this study, the overall health professionals' readiness for electronic medical record system and utilization was 54.1% and 46.5%, respectively. Gender, knowledge, attitude, and computer related skills were the determinants of the presence of a relatively low readiness and utilization of the system. Increasing awareness, knowledge, and skills of healthcare professionals on EMR system before system implementation is necessary to increase its adoption.
Assessment of Technical Skills Competence in the Operating Room: A Systematic and Scoping Review.
Fahim, Christine; Wagner, Natalie; Nousiainen, Markku T; Sonnadara, Ranil
2018-05-01
While academic accreditation bodies continue to promote competency-based medical education (CBME), the feasibility of conducting regular CBME assessments remains challenging. The purpose of this study was to identify evidence pertaining to the practical application of assessments that aim to measure technical competence for surgical trainees in a nonsimulated, operative setting. In August 2016, the authors systematically searched Medline, Embase, and the Cochrane Database of Systematic Reviews for English-language, peer-reviewed articles published in or after 1996. The title, abstract, and full text of identified articles were screened. Data regarding study characteristics, psychometric and measurement properties, implementation of assessment, competency definitions, and faculty training were extracted. The findings from the systematic review were supplemented by a scoping review to identify key strategies related to faculty uptake and implementation of CBME assessments. A total of 32 studies were included. The majority of studies reported reasonable scores of interrater reliability and internal consistency. Seven articles identified minimum scores required to establish competence. Twenty-five articles mentioned faculty training. Many of the faculty training interventions focused on timely completion of assessments or scale calibration. There are a number of diverse tools used to assess competence for intraoperative technical skills and a lack of consensus regarding the definition of technical competence within and across surgical specialties. Further work is required to identify when and how often trainees should be assessed and to identify strategies to train faculty to ensure timely and accurate assessment.
A model for communication skills assessment across the undergraduate curriculum.
Rider, Elizabeth A; Hinrichs, Margaret M; Lown, Beth A
2006-08-01
Physicians' interpersonal and communication skills have a significant impact on patient care and correlate with improved healthcare outcomes. Some studies suggest, however, that communication skills decline during the four years of medical school. Regulatory and other medical organizations, recognizing the importance of interpersonal and communication skills in the practice of medicine, now require competence in communication skills. Two challenges exist: to select a framework of interpersonal and communication skills to teach across undergraduate medical education, and to develop and implement a uniform model for the assessment of these skills. The authors describe a process and model for developing and institutionalizing the assessment of communication skills across the undergraduate curriculum. Consensus was built regarding communication skill competencies by working with course leaders and examination directors, a uniform framework of competencies was selected to both teach and assess communication skills, and the framework was implemented across the Harvard Medical School undergraduate curriculum. The authors adapted an assessment framework based on the Bayer-Fetzer Kalamazoo Consensus Statement adapted a patient and added and satisfaction tool to bring patients' perspectives into the assessment of the learners. The core communication competencies and evaluation instruments were implemented in school-wide courses and assessment exercises including the first-year Patient-Doctor I Clinical Assessment, second-year Objective Structured Clinical Exam (OSCE), third-year Patient-Doctor III Clinical Assessment, fourth-year Comprehensive Clinical Practice Examination and the Core Medicine Clerkships. Faculty were offered workshops and interactive web-based teaching to become familiar with the framework, and students used the framework with repeated opportunities for faculty feedback on these skills. A model is offered for educational leaders and others who are involved in designing assessment in communication skills. By presenting an approach for implementation, the authors hope to provide guidance for the successful integration of communication skills assessment in undergraduate medical education.
Shanbhag, Deepti; Graham, Ian D; Harlos, Karen; Haynes, R. Brian; Gabizon, Itzhak; Connolly, Stuart J; Van Spall, Harriette Gillian Christine
2018-01-01
Background The uptake of guideline recommendations that improve heart failure (HF) outcomes remains suboptimal. We reviewed implementation interventions that improve physician adherence to these recommendations, and identified contextual factors associated with implementation success. Methods We searched databases from January 1990 to November 2017 for studies testing interventions to improve uptake of class I HF guidelines. We used the Cochrane Effective Practice and Organisation of Care and Process Redesign frameworks for data extraction. Primary outcomes included: proportion of eligible patients offered guideline-recommended pharmacotherapy, self-care education, left ventricular function assessment and/or intracardiac devices. We reported clinical outcomes when available. Results We included 38 studies. Provider-level interventions (n=13 studies) included audit and feedback, reminders and education. Organisation-level interventions (n=18) included medical records system changes, multidisciplinary teams, clinical pathways and continuity of care. System-level interventions (n=3) included provider/institutional incentives. Four studies assessed multi-level interventions. We could not perform meta-analyses due to statistical/conceptual heterogeneity. Thirty-two studies reported significant improvements in at least one primary outcome. Clinical pathways, multidisciplinary teams and multifaceted interventions were most consistently successful in increasing physician uptake of guidelines. Among randomised controlled trials (RCT) (n=10), pharmacist and nurse-led interventions improved target dose prescriptions. Eleven studies reported clinical outcomes; significant improvements were reported in three, including a clinical pathway, a multidisciplinary team and a multifaceted intervention. Baseline assessment of barriers, staff training, iterative intervention development, leadership commitment and policy/financial incentives were associated with intervention effectiveness. Most studies (n=20) had medium risk of bias; nine RCTs had low risk of bias. Conclusion Our study is limited by the quality and heterogeneity of the primary studies. Clinical pathways, multidisciplinary teams and multifaceted interventions appear to be most consistent in increasing guideline uptake. However, improvements in process outcomes were rarely accompanied by improvements in clinical outcomes. Our work highlights the need for improved research methodology to reliably assess the effectiveness of implementation interventions. PMID:29511005
Shanbhag, Deepti; Graham, Ian D; Harlos, Karen; Haynes, R Brian; Gabizon, Itzhak; Connolly, Stuart J; Van Spall, Harriette Gillian Christine
2018-03-06
The uptake of guideline recommendations that improve heart failure (HF) outcomes remains suboptimal. We reviewed implementation interventions that improve physician adherence to these recommendations, and identified contextual factors associated with implementation success. We searched databases from January 1990 to November 2017 for studies testing interventions to improve uptake of class I HF guidelines. We used the Cochrane Effective Practice and Organisation of Care and Process Redesign frameworks for data extraction. Primary outcomes included: proportion of eligible patients offered guideline-recommended pharmacotherapy, self-care education, left ventricular function assessment and/or intracardiac devices. We reported clinical outcomes when available. We included 38 studies. Provider-level interventions (n=13 studies) included audit and feedback, reminders and education. Organisation-level interventions (n=18) included medical records system changes, multidisciplinary teams, clinical pathways and continuity of care. System-level interventions (n=3) included provider/institutional incentives. Four studies assessed multi-level interventions. We could not perform meta-analyses due to statistical/conceptual heterogeneity. Thirty-two studies reported significant improvements in at least one primary outcome. Clinical pathways, multidisciplinary teams and multifaceted interventions were most consistently successful in increasing physician uptake of guidelines. Among randomised controlled trials (RCT) (n=10), pharmacist and nurse-led interventions improved target dose prescriptions. Eleven studies reported clinical outcomes; significant improvements were reported in three, including a clinical pathway, a multidisciplinary team and a multifaceted intervention. Baseline assessment of barriers, staff training, iterative intervention development, leadership commitment and policy/financial incentives were associated with intervention effectiveness. Most studies (n=20) had medium risk of bias; nine RCTs had low risk of bias. Our study is limited by the quality and heterogeneity of the primary studies. Clinical pathways, multidisciplinary teams and multifaceted interventions appear to be most consistent in increasing guideline uptake. However, improvements in process outcomes were rarely accompanied by improvements in clinical outcomes. Our work highlights the need for improved research methodology to reliably assess the effectiveness of implementation interventions. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Mou, J.I.; King, C.
The focus of this study is to develop a sensor fused process modeling and control methodology to model, assess, and then enhance the performance of a hexapod machine for precision product realization. Deterministic modeling technique was used to derive models for machine performance assessment and enhancement. Sensor fusion methodology was adopted to identify the parameters of the derived models. Empirical models and computational algorithms were also derived and implemented to model, assess, and then enhance the machine performance. The developed sensor fusion algorithms can be implemented on a PC-based open architecture controller to receive information from various sensors, assess themore » status of the process, determine the proper action, and deliver the command to actuators for task execution. This will enhance a hexapod machine`s capability to produce workpieces within the imposed dimensional tolerances.« less
Sugarman, Jeremy; Barnes, Mark; Rose, Scott; Dumchev, Kostyantyn; Sarasvita, Riza; Viet, Ha Tran; Zeziulin, Oleksandr; Susami, Hepa; Go, Vivian; Hoffman, Irving; Miller, William C
2018-06-22
People who inject drugs with high-risk sharing practices have high rates of HIV transmission and face barriers to HIV care. Interventions to overcome these barriers are needed; however, stigmatisation of drug use and HIV infection leads to safety concerns during the planning and conduct of research on such interventions. In preparing to address concerns about safety and wellbeing of participants in an international research study, HIV Prevention Trials Network 074, we developed participant safety plans (PSPs) at each site to supplement local research ethics committee oversight, community engagement, and usual clinical trial procedures. The PSPs were informed by systematic local legal and policy assessments, and interviews with key stakeholders. After PSP refinement and implementation, we assessed social impacts at each study visit to ensure continued safety. Throughout the study, five participants reported a negative social impact, with three resulting from study participation. Future research with stigmatised populations should consider using and assessing this approach to enhance safety and welfare. Copyright © 2018 Elsevier Ltd. All rights reserved.
Freidl, Marion; Pesola, Francesca; Konrad, Jana; Puschner, Bernd; Kovacs, Attila Istvan; De Rosa, Corrado; Fiorillo, Andrea; Krogsgaard Bording, Malene; Kawohl, Wolfram; Rössler, Wulf; Nagy, Marietta; Munk-Jørgensen, Povl; Slade, Mike
2016-06-01
Clinical decision making is an important aspect of mental health care. Predictors of how patients experience decision making and whether decisions are implemented are underresearched. This study investigated the relationship between decision topic and involvement in the decision, satisfaction with it, and its subsequent implementation from both staff and patient perspectives. As part of the Clinical Decision Making and Outcome in Routine Care for People With Severe Mental Illness study, patients (N=588) and their providers (N=213) were recruited from community-based mental health services in six European countries. Both completed bimonthly assessments for one year using the Clinical Decision Making in Routine Care Scale to assess the decision topic and implementation; both also completed the Clinical Decision Making Involvement and Satisfaction Scale. Three categories of decision topics were determined: treatment (most frequently cited), social, and financial. The topic identified as most important remained stable over the follow-up. Patients were more likely to rate their involvement as active rather than passive for social decisions (odds ratio [OR]=5.7, p<.001) and financial decisions (OR=9.5, p<.001). They were more likely to report higher levels of satisfaction rather than lower levels for social decisions (OR=1.5, p=.01) and financial decisions (OR=1.7, p=.01). Social decisions were more likely to be partly implemented (OR=3.0, p<.001) or fully implemented (OR=1.7, p=.03) than not implemented. Patients reported poorer involvement, satisfaction, and implementation in regard to treatment-related decisions, compared with social and financial decisions. Clinicians may need to employ different interactional styles for different types of decisions to maximize satisfaction and decision implementation.
2014-01-01
Background Some countries have undertaken programs that included scaling up kangaroo mother care. The aim of this study was to systematically evaluate the implementation status of facility-based kangaroo mother care services in four African countries: Malawi, Mali, Rwanda and Uganda. Methods A cross-sectional, mixed-method research design was used. Stakeholders provided background information at national meetings and in individual interviews. Facilities were assessed by means of a standardized tool previously applied in other settings, employing semi-structured key-informant interviews and observations in 39 health care facilities in the four countries. Each facility received a score out of a total of 30 according to six stages of implementation progress. Results Across the four countries 95 per cent of health facilities assessed demonstrated some evidence of kangaroo mother care practice. Institutions that fared better had a longer history of kangaroo mother care implementation or had been developed as centres of excellence or had strong leaders championing the implementation process. Variation existed in the quality of implementation between facilities and across countries. Important factors identified in implementation are: training and orientation; supportive supervision; integrating kangaroo mother care into quality improvement; continuity of care; high-level buy in and support for kangaroo mother care implementation; and client-oriented care. Conclusion The integration of kangaroo mother care into routine newborn care services should be part of all maternal and newborn care initiatives and packages. Engaging ministries of health and other implementing partners from the outset may promote buy in and assist with the mobilization of resources for scaling up kangaroo mother care services. Mechanisms for monitoring these services should be integrated into existing health management information systems. PMID:25001366
Assessment-Ready Preservice Teachers
ERIC Educational Resources Information Center
Kelting-Gibson, Lynn; Karsted, Kimberly; Weikert, Angela
2013-01-01
As teacher educators search for ways to prepare future educators for the challenges of assessment implementation, we suggest that authentic practice by preservice teachers in an informal learning environment promotes assessment implementation. The analysis of 28 volunteer assessment students' reflections revealed that practicing assessment…
NASA Astrophysics Data System (ADS)
Juhler, Martin Vogt
2018-06-01
Research finds that student teachers often fail to make observable instructional goals, without which a secure bridge between instruction and assessment is precluded. This is one reason that recent reports state that teacher education needs to become better at helping student teachers to develop their thinking about and skills in assessing pupils' learning. Currently in Europe, the Lesson Study method and the Content Representation tool, which both have a specific focus on assessment, have started to address this problem. This article describes and discusses an intervention in which Lesson Study was used in combination with Content Representation in student teachers' field practice. Empirical materials from one group of student teachers were analyzed to illustrate how the student teachers worked with assessment during the planning of a lesson, how they implemented it in a research lesson, and how they used the gathered observations to make claims about assessment aims. The findings suggest that the student teachers placed greater emphasis on assessment through the intervention. However, it is also found that more attention should have been dedicated to the planning phase and that the group did not manage to keep a research focus throughout the Lesson Study process. This suggests that it properly would be beneficial with several planning sessions prior to the research lesson, as well as having an expert teacher leading the Lesson Study.
NASA Astrophysics Data System (ADS)
Juhler, Martin Vogt
2017-05-01
Research finds that student teachers often fail to make observable instructional goals, without which a secure bridge between instruction and assessment is precluded. This is one reason that recent reports state that teacher education needs to become better at helping student teachers to develop their thinking about and skills in assessing pupils' learning. Currently in Europe, the Lesson Study method and the Content Representation tool, which both have a specific focus on assessment, have started to address this problem. This article describes and discusses an intervention in which Lesson Study was used in combination with Content Representation in student teachers' field practice. Empirical materials from one group of student teachers were analyzed to illustrate how the student teachers worked with assessment during the planning of a lesson, how they implemented it in a research lesson, and how they used the gathered observations to make claims about assessment aims. The findings suggest that the student teachers placed greater emphasis on assessment through the intervention. However, it is also found that more attention should have been dedicated to the planning phase and that the group did not manage to keep a research focus throughout the Lesson Study process. This suggests that it properly would be beneficial with several planning sessions prior to the research lesson, as well as having an expert teacher leading the Lesson Study.
Silvestrin, Terry M; Steenrod, Anna W; Coyne, Karin S; Gross, David E; Esinduy, Canan B; Kodsi, Angela B; Slifka, Gayle J; Abraham, Lucy; Araiza, Anna L; Bushmakin, Andrew G; Luo, Xuemei
2016-01-01
The objectives of this study are to describe the implementation process of the Women’s Health Assessment Tool/Clinical Decision Support toolkit and summarize patients’ and clinicians’ perceptions of the toolkit. The Women’s Health Assessment Tool/Clinical Decision Support toolkit was piloted at three clinical sites over a 4-month period in Washington State to evaluate health outcomes among mid-life women. The implementation involved a multistep process and engagement of multiple stakeholders over 18 months. Two-thirds of patients (n = 76/110) and clinicians (n = 8/12) participating in pilot completed feedback surveys; five clinicians participated in qualitative interviews. Most patients felt more prepared for their annual visit (69.7%) and that quality of care improved (68.4%) while clinicians reported streamlined patient visits and improved communication with patients. The Women’s Health Assessment Tool/Clinical Decision Support toolkit offers a unique approach to introduce and address some of the key health issues that affect mid-life women. PMID:27558508
40 CFR 6.406 - Implementation.
Code of Federal Regulations, 2010 CFR
2010-07-01
... Protection of Environment ENVIRONMENTAL PROTECTION AGENCY GENERAL PROCEDURES FOR IMPLEMENTING THE NATIONAL ENVIRONMENTAL POLICY ACT AND ASSESSING THE ENVIRONMENTAL EFFECTS ABROAD OF EPA ACTIONS Assessing the Environmental Effects Abroad of EPA Actions § 6.406 Implementation. (a) Oversight. OFA is responsible for...
Schweikhard, April J; Hoberecht, Toni; Peterson, Alyssa; Randall, Ken
2018-01-01
This study measures how online library instructional tutorials implemented into an evidence-based practice course have impacted the information literacy skills of occupational and physical therapy graduate students. Through a rubric assessment of final course papers, this study compares differences in students' search strategies and cited sources pre- and post-implementation of the tutorials. The population includes 180 randomly selected graduate students from before and after the library tutorials were introduced into the course curriculum. Results indicate a statistically significant increase in components of students' searching skills and ability to find higher levels of evidence after completing the library tutorials.
Nijhuis-van der Sanden, Maria W G; Driehuis, Femke; Heerkens, Yvonne F; van der Vleuten, Cees P M; van der Wees, Philip J
2017-01-01
Objectives To evaluate the feasibility of a quality improvement programme aimed to enhance the client-centeredness, effectiveness and transparency of physiotherapy services by addressing three feasibility domains: (1) acceptability of the programme design, (2) appropriateness of the implementation strategy and (3) impact on quality improvement. Design Mixed methods study. Participants and setting 64 physiotherapists working in primary care, organised in a network of communities of practice in the Netherlands. Methods The programme contained: (1) two cycles of online self-assessment and peer assessment (PA) of clinical performance using client records and video-recordings of client communication followed by face-to-face group discussions, and (2) clinical audit assessing organisational performance. Assessment was based on predefined performance indicators which could be scored on a 5-point Likert scale. Discussions addressed performance standards and scoring differences. All feasibility domains were evaluated qualitatively with two focus groups and 10 in-depth interviews. In addition, we evaluated the impact on quality improvement quantitatively by comparing self-assessment and PA scores in cycles 1 and 2. Results We identified critical success features relevant to programme development and implementation, such as clarifying expectations at baseline, training in PA skills, prolonged engagement with video-assessment and competent group coaches. Self-reported impact on quality improvement included awareness of clinical and organisational performance, improved evidence-based practice and client-centeredness and increased motivation to self-direct quality improvement. Differences between self-scores and peer scores on performance indicators were not significant. Between cycles 1 and 2, scores for record keeping showed significant improvement, however not for client communication. Conclusions This study demonstrated that bottom-up initiatives to improve healthcare quality can be effective. The results justify ongoing evaluation to inform nationwide implementation when the critical success features are addressed. Further research is necessary to explore the sustainability of the results and the impact on client outcomes in a full-scale study. PMID:28188156
Atchison, Christina; Zvoc, Miro; Balakrishnan, Ravikumar
2013-06-01
To improve uptake of childhood immunizations in Wandsworth we developed a standardized call/recall system based on parents being sent three reminders and defaulters being referred to a Health Visitor. Thirty-two out of 44 primary care practices in the area implemented the intervention in September 2011. The aim of this study was to evaluate the implementation, delivery and impact on immunization uptake of the new call/recall system. To assess implementation and delivery, a mixed method approach was used including qualitative (structured interviews) and quantitative (data collected at three months post-implementation) assessment. To assess the impact, we used Student's t test to compare the difference in immunization uptake rates between intervention and non-intervention practices before and after implementation. The call/recall system was viewed positively by both parents and staff. Most children due or overdue immunizations were successfully captured by the 1st invitation reminder. After three invitations, between 87.3 % (MMR1) and 92.2 % (pre-school booster) of children identified as due or overdue immunizations successfully responded. Prior to implementation there was no difference in uptake rates between intervention and non-intervention practices. Post-implementation uptake rates for DTaP/IPV/Hib, MMR1, MMR2 and the pre-school booster were significantly greater in the intervention practices. Similar findings were seen for PCV and Hib/MenC boosters, although the differences were not statistically significant at the 5 % level. Following the successful implementation of a standardized call/recall system in Wandsworth, other regions or primary care practices may wish to consider introducing a similar system to help improve their immunization coverage levels.
Implementing Performance Assessment in the Classroom.
ERIC Educational Resources Information Center
Brualdi, Amy
1999-01-01
Provides advice on implementing performance assessment in the classroom. Outlines the basic steps from defining the purpose of the assessment to giving the student feedback. Advice is also given about scoring rubrics. (SLD)
Feraco, Angela M; Starmer, Amy J; Sectish, Theodore C; Spector, Nancy D; West, Daniel C; Landrigan, Christopher P
2016-08-01
1) To develop validity evidence for the use of the Verbal Handoff Assessment Tool (VHAT) and examine the reliability of VHAT scores, and 2) to determine whether implementation of a resident handoff bundle (RHB) was associated with improved verbal patient handoffs among pediatric resident physicians. In a pre-post design, prospectively audio recorded verbal patient handoffs conducted at Boston Children's Hospital before and after implementation of the RHB were rated using the VHAT, which was developed for this study (primary outcome). Using generalizability theory, we evaluated the reliability of VHAT scores. Overall, VHAT scores increased after RHB implementation (mean 142 vs 191, possible score 0-500; P < .0001). When accounting for clustering according to resident physician, hospital unit, unit census, and patient complexity, implementation of the RHB was associated with a 63-point increase in VHAT score. Using generalizability theory, we determined that a resident's mean VHAT score on the basis of a handoff of 15 patients assessed by a single observer was sufficiently reliable for relative ranking decisions (ie, norm-based; generalizability coefficient, 0.81), whereas a VHAT score on the basis of a handoff of 21 patients would be sufficiently reliable for high-stakes, standard-based decisions (Phi, 0.80). Verbal handoffs improved after implementation of a RHB, although gains were variable across the 2 clinical units. The VHAT shows promise as an assessment tool for resident handoff skills. If used for competency or entrustment decisions, a resident's mean VHAT score should be on the basis of observation of verbal handoff of ≥21 patients. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.
Savvas, Steven; Toye, Christine; Beattie, Elizabeth; Gibson, Stephen J
2014-12-01
Pain is common in residential aged care facilities (RACFs). In 2005, the Australian Pain Society developed 27 recommendations for good practice in the identification, assessment, and management of pain in these settings. This study aimed to address implementation of the standards and evaluate outcomes. Five facilities in Australia participated in a comprehensive evaluation of RACF pain practice and outcomes. Pre-existing pain management practices were compared with the 27 recommendations, before an evidence-based pain management program was introduced that included training and education for staff and revised in-house pain-management procedures. Post-implementation audits evaluated the program's success. Aged care staff teams also were assessed on their reports of self-efficacy in pain management. The results show that before the implementation program, the RACFs demonstrated full compliance on 6 to 12 standards. By the project's completion, RACFs demonstrated full compliance with 10 to 23 standards and major improvements toward compliance in the remaining standards. After implementation, the staff also reported better understanding of the standards (p < .001) or of facility pain management guidelines (p < .001), increased confidence in therapies for pain management (p < .001), and increased confidence in their training to assess pain (p < .001) and recognize pain in residents with dementia who are nonverbal (p = .003). The results show that improved evidence-based practice in RACFs can be achieved with appropriate training and education. Investing resources in the aged care workforce via this implementation program has shown improvements in staff self-efficacy and practice. Copyright © 2014 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.
Meerhoff, Guus A; van Dulmen, Simone A; Maas, Marjo J M; Heijblom, Karin; Nijhuis-van der Sanden, Maria W G; Van der Wees, Philip J
2017-08-01
In 2013, the Royal Dutch Society for Physical Therapy launched the program "Quality in Motion." This program aims to collect data from electronic health record systems in a registry that is fed back to physical therapists, facilitating quality improvement. The purpose of this study was to describe the development of an implementation strategy for the program and to evaluate the feasibility of building a registry and implementing patient-reported outcome measures (PROMs) in physical therapist practices. A stepwise approach using mixed methods was established in 3 consecutive pilots with 355 physical therapists from 66 practices. Interim results were evaluated using quantitative data from a self-assessment questionnaire and the registry and qualitative data from 21 semistructured interviews with physical therapists. Descriptive statistics and McNemar's symmetry chi-squared test were used to summarize the feasibility of implementing PROMs. PROMs were selected for the 5 most prevalent musculoskeletal conditions in Dutch physical therapist practices. A core component of the implementation strategy was the introduction of knowledge brokers to support physical therapists in establishing the routine use of PROMs in clinical practice and to assist in executing peer assessment workshops. In February 2013, 30.3% of the physical therapist practices delivered 4.4 completed treatment episodes per physical therapist to the registry; this increased to 92.4% in November 2014, delivering 54.1 completed patient episodes per physical therapist. Pre- and posttreatment PROM use increased from 12.2% to 39.5%. It is unclear if the participating physical therapists reflect a representative sample of Dutch therapists. Building a registry and implementing PROMs in physical therapist practices are feasible. The routine use of PROMs needs to increase to ensure valid feedback of outcomes. Using knowledge brokers is promising for implementing the program via peer assessment workshops. © 2017 American Physical Therapy Association
Tobacco packaging design for reducing tobacco use.
McNeill, Ann; Gravely, Shannon; Hitchman, Sara C; Bauld, Linda; Hammond, David; Hartmann-Boyce, Jamie
2017-04-27
Tobacco use is the largest single preventable cause of death and disease worldwide. Standardised tobacco packaging is an intervention intended to reduce the promotional appeal of packs and can be defined as packaging with a uniform colour (and in some cases shape and size) with no logos or branding, apart from health warnings and other government-mandated information, and the brand name in a prescribed uniform font, colour and size. Australia was the first country to implement standardised tobacco packaging between October and December 2012, France implemented standardised tobacco packaging on 1 January 2017 and several other countries are implementing, or intending to implement, standardised tobacco packaging. To assess the effect of standardised tobacco packaging on tobacco use uptake, cessation and reduction. We searched MEDLINE, Embase, PsycINFO and six other databases from 1980 to January 2016. We checked bibliographies and contacted study authors to identify additional peer-reviewed studies. Primary outcomes included changes in tobacco use prevalence incorporating tobacco use uptake, cessation, consumption and relapse prevention. Secondary outcomes covered intermediate outcomes that can be measured and are relevant to tobacco use uptake, cessation or reduction. We considered multiple study designs: randomised controlled trials, quasi-experimental and experimental studies, observational cross-sectional and cohort studies. The review focused on all populations and people of any age; to be included, studies had to be published in peer-reviewed journals. We examined studies that assessed the impact of changes in tobacco packaging such as colour, design, size and type of health warnings on the packs in relation to branded packaging. In experiments, the control condition was branded tobacco packaging but could include variations of standardised packaging. Screening and data extraction followed standard Cochrane methods. We used different 'Risk of bias' domains for different study types. We have summarised findings narratively. Fifty-one studies met our inclusion criteria, involving approximately 800,000 participants. The studies included were diverse, including observational studies, between- and within-participant experimental studies, cohort and cross-sectional studies, and time-series analyses. Few studies assessed behavioural outcomes in youth and non-smokers. Five studies assessed the primary outcomes: one observational study assessed smoking prevalence among 700,000 participants until one year after standardised packaging in Australia; four studies assessed consumption in 9394 participants, including a series of Australian national cross-sectional surveys of 8811 current smokers, in addition to three smaller studies. No studies assessed uptake, cessation, or relapse prevention. Two studies assessed quit attempts. Twenty studies examined other behavioural outcomes and 45 studies examined non-behavioural outcomes (e.g. appeal, perceptions of harm). In line with the challenges inherent in evaluating standardised tobacco packaging, a number of methodological imitations were apparent in the included studies and overall we judged most studies to be at high or unclear risk of bias in at least one domain. The one included study assessing the impact of standardised tobacco packaging on smoking prevalence in Australia found a 3.7% reduction in odds when comparing before to after the packaging change, or a 0.5 percentage point drop in smoking prevalence, when adjusting for confounders. Confidence in this finding is limited, due to the nature of the evidence available, and is therefore rated low by GRADE standards. Findings were mixed amongst the four studies assessing consumption, with some studies finding no difference and some studies finding evidence of a decrease; certainty in this outcome was rated very low by GRADE standards due to the limitations in study design. One national study of Australian adult smoker cohorts (5441 participants) found that quit attempts increased from 20.2% prior to the introduction of standardised packaging to 26.6% one year post-implementation. A second study of calls to quitlines provides indirect support for this finding, with a 78% increase observed in the number of calls after the implementation of standardised packaging. Here again, certainty is low. Studies of other behavioural outcomes found evidence of increased avoidance behaviours when using standardised packs, reduced demand for standardised packs and reduced craving. Evidence from studies measuring eye-tracking showed increased visual attention to health warnings on standardised compared to branded packs. Corroborative evidence for the latter finding came from studies assessing non-behavioural outcomes, which in general found greater warning salience when viewing standardised, than branded packs. There was mixed evidence for quitting cognitions, whereas findings with youth generally pointed towards standardised packs being less likely to motivate smoking initiation than branded packs. We found the most consistent evidence for appeal, with standardised packs rating lower than branded packs. Tobacco in standardised packs was also generally perceived as worse-tasting and lower quality than tobacco in branded packs. Standardised packaging also appeared to reduce misperceptions that some cigarettes are less harmful than others, but only when dark colours were used for the uniform colour of the pack. The available evidence suggests that standardised packaging may reduce smoking prevalence. Only one country had implemented standardised packaging at the time of this review, so evidence comes from one large observational study that provides evidence for this effect. A reduction in smoking behaviour is supported by routinely collected data by the Australian government. Data on the effects of standardised packaging on non-behavioural outcomes (e.g. appeal) are clearer and provide plausible mechanisms of effect consistent with the observed decline in prevalence. As standardised packaging is implemented in different countries, research programmes should be initiated to capture long term effects on tobacco use prevalence, behaviour, and uptake. We did not find any evidence suggesting standardised packaging may increase tobacco use.
The Effect of Portfolio Assessments on Metacognitive Skills and on Attitudes toward a Course
ERIC Educational Resources Information Center
Gencel, Ilke Evin
2017-01-01
The aim of this study is to determine through teacher candidates' thoughts the effects of a portfolio assessment implementation on their metacognitive skills and attitudes towards a course on measurement and evaluation. Exploratory sequential mixed-methods design is employed within the study. The pretest/posttest control group design was used in…
Use of Chemistry Software to Teach and Assess Model-Based Reaction and Equation Knowledge
ERIC Educational Resources Information Center
Pyatt, Kevin
2014-01-01
This study investigated the challenges students face when learning chemical reactions in a first-year chemistry course and the effectiveness of a curriculum and software implementation that was used to teach and assess student understanding of chemical reactions and equations. This study took place over a two year period in a public suburban…
ERIC Educational Resources Information Center
Dattey, Kwame; Westerheijden, Don F.; Hofman, W. H. A.
2017-01-01
The study assesses the influence of accreditation, after two cycles of evaluation on some selected Ghanaian universities. This was done by examining the changes that had occurred in specified indicators, mainly because of the implementation of suggestions for improvement made by the previous cycle's evaluators. The study employed quantitative…
ERIC Educational Resources Information Center
Gerstner, Jerusha J.; Finney, Sara J.
2013-01-01
Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…
Evaluation of interventions on road traffic injuries in Peru: a qualitative approach
2012-01-01
Background Evaluation of interventions on road traffic injuries (RTI) going beyond the assessment of impact to include factors underlying success or failure is an important complement to standard impact evaluations. We report here how we used a qualitative approach to assess current interventions implemented to reduce RTIs in Peru. Methods We performed in-depth interviews with policymakers and technical officers involved in the implementation of RTI interventions to get their insight on design, implementation and evaluation aspects. We then conducted a workshop with key stakeholders to analyze the results of in-depth interviews, and to further discuss and identify key programmatic considerations when designing and implementing RTI interventions. We finally performed brainstorming sessions to assess potential system-wide effects of a selected intervention (Zero Tolerance), and to identify adaptation and redesign needs for this intervention. Results Key programmatic components were consistently identified that should be considered when designing and implementing RTI interventions. They include effective and sustained political commitment and planning; sufficient and sustained budget allocation; training, supervision, monitoring and evaluation of implemented policies; multisectoral participation; and strong governance and accountability. Brainstorming sessions revealed major negative effects of the selected intervention on various system building blocks. Conclusions Our approach revealed substantial caveats in current RTI interventions in Peru, and fundamental negative effects on several components of the sectors and systems involved. It also highlighted programmatic issues that should be applied to guarantee an effective implementation and evaluation of these policies. The findings from this study were discussed with key stakeholders for consideration in further designing and planning RTI control interventions in Peru. PMID:22269578
Evaluation of interventions on road traffic injuries in Peru: a qualitative approach.
Huicho, Luis; Adam, Taghreed; Rosales, Edmundo; Paca-Palao, Ada; López, Luis; Luna, Diego; Miranda, J Jaime
2012-01-23
Evaluation of interventions on road traffic injuries (RTI) going beyond the assessment of impact to include factors underlying success or failure is an important complement to standard impact evaluations. We report here how we used a qualitative approach to assess current interventions implemented to reduce RTIs in Peru. We performed in-depth interviews with policymakers and technical officers involved in the implementation of RTI interventions to get their insight on design, implementation and evaluation aspects. We then conducted a workshop with key stakeholders to analyze the results of in-depth interviews, and to further discuss and identify key programmatic considerations when designing and implementing RTI interventions. We finally performed brainstorming sessions to assess potential system-wide effects of a selected intervention (Zero Tolerance), and to identify adaptation and redesign needs for this intervention. Key programmatic components were consistently identified that should be considered when designing and implementing RTI interventions. They include effective and sustained political commitment and planning; sufficient and sustained budget allocation; training, supervision, monitoring and evaluation of implemented policies; multisectoral participation; and strong governance and accountability. Brainstorming sessions revealed major negative effects of the selected intervention on various system building blocks. Our approach revealed substantial caveats in current RTI interventions in Peru, and fundamental negative effects on several components of the sectors and systems involved. It also highlighted programmatic issues that should be applied to guarantee an effective implementation and evaluation of these policies. The findings from this study were discussed with key stakeholders for consideration in further designing and planning RTI control interventions in Peru.
McIntyre, Teresa M; McIntyre, Scott E; Barr, Christopher D; Woodward, Phillip S; Francis, David J; Durand, Angelia C; Mehta, Paras; Kamarck, Thomas W
2016-10-01
There is a lack of comprehensive research on Ecological Momentary Assessment (EMA) feasibility to study occupational stress, especially its long-term sustainability. EMA application in education contexts has also been sparse. This study investigated the feasibility of using EMA to study teacher stress over 2 years using both objective compliance data and a self-reported feasibility survey. It also examined the influence of individual and school factors on EMA feasibility. Participants were 202 sixth through eighth grade teachers from 22 urban middle schools in the southern United States. EMA was implemented via an iPod-based Teacher Stress Diary (TSD). Teachers recorded demands, stress responses, and resources during 12 days (6 waves) over 2 years. Feasibility was assessed via compliance data generated by the TSD (e.g., entry completion) and an EMA Feasibility Survey of self-reported user-friendliness and EMA interference. The results showed high compliance regarding entry and item completion, and completion time, which was sustained over time. User-friendliness was appraised as very high and EMA interference as low. Initial difficulties regarding timing and length of assessments were addressed via EMA method refinement, resulting in improved feasibility. Teachers' ethnicity, age, marital status, grade/course taught, class size, class load, and daily workload impacted feasibility. The results supported the feasibility of using EMA to study work stress longitudinally and the value of continued feasibility monitoring. They also support EMA use to study teacher stress and inform EMA implementation in schools. Some teacher and school factors need to be taken into consideration when deciding on EMA implementation in education contexts. (PsycINFO Database Record (c) 2016 APA, all rights reserved).
ERIC Educational Resources Information Center
Abbott, Amy Lynn
2016-01-01
The purpose for this study was to develop a descriptive account of one large Virginia school district's plan for implementation of alternative, locally developed assessments designed to supplant standardized measures. As policy reform with alternative assessments has been under-researched for the past 30 years, there is a need for studies…
ERIC Educational Resources Information Center
Matrundola, Deborah La Torre; Chang, Sandy; Herman, Joan
2012-01-01
The purpose of these case studies was to examine the ways technology and professional development supported the use of the SimScientists assessment systems. Qualitative research methodology was used to provide narrative descriptions of six classes implementing simulation-based assessments for either the topic of Ecosystems or Atoms and Molecules.…
ERIC Educational Resources Information Center
Thanh Pham, Thi Hong; Renshaw, Peter
2015-01-01
Formative assessment has recently become a preferred assessment strategy in educational institutions worldwide. However, it is not easy to implement in Asian classrooms, because local cultures and institutional constraints potentially hinder the practice. This one-semester study aimed to use the "third space", as the core of the third…
A Calculus of Occupational Skill Attainment: Building More Validity into a Valid Assessment System
ERIC Educational Resources Information Center
Munyofu, Paul; Kohr, Richard
2009-01-01
This study investigated several aspects of occupational skill assessment as implemented in one state: (1) What is the extent to which student achievement on the cognitive component was related to their achievement on the psychomotor component of the technical skill assessments? (2) How efficiently was their overall composite attainment calculated?…
ERIC Educational Resources Information Center
Ringer, Catharina W.
2013-01-01
In today's mathematics education, there is an increasing emphasis on students' understanding of the mathematics set forth in standards documents such as the "Principles and Standards for School Mathematics" (National Council of Teachers of Mathematics, 2000) and, most recently, the "Common Core State Standards for Mathematics"…
ERIC Educational Resources Information Center
Mantzicopoulos, Panayota; French, Brian F.; Patrick, Helen; Watson, J. Samuel; Ahn, Inok
2018-01-01
To meet recent accountability mandates, school districts are implementing assessment frameworks to document teachers' effectiveness. Observational assessments play a key role in this process, albeit without compelling evidence of their psychometric rigor. Using a sample of kindergarten teachers, we employed Generalizability theory to investigate…
Does Assessment for Learning Work to Promote Student Learning? The England Paradigm
ERIC Educational Resources Information Center
Vlachou, Maria A.
2015-01-01
Assessment for Learning (AfL) has influenced the assessment policy of many countries around the world because a range of research studies have shown the effectiveness of AfL on student learning. In the English context, although significant AfL developments have taken place in schools, its implementation seems not to have produced significant and…
van der Togt, Remko; Bakker, Piet J M; Jaspers, Monique W M
2011-04-01
RFID offers great opportunities to health care. Nevertheless, prior experiences also show that RFID systems have not been designed and tested in response to the particular needs of health care settings and might introduce new risks. The aim of this study is to present a framework that can be used to assess the performance of RFID systems particularly in health care settings. We developed a framework describing a systematic approach that can be used for assessing the feasibility of using an RFID technology in a particular healthcare setting; more specific for testing the impact of environmental factors on the quality of RFID generated data and vice versa. This framework is based on our own experiences with an RFID pilot implementation in an academic hospital in The Netherlands and a literature review concerning RFID test methods and current insights of RFID implementations in healthcare. The implementation of an RFID system within the blood transfusion chain inside a hospital setting was used as a show case to explain the different phases of the framework. The framework consists of nine phases, including an implementation development plan, RFID and medical equipment interference tests, data accuracy- and data completeness tests to be run in laboratory, simulated field and real field settings. The potential risks that RFID technologies may bring to the healthcare setting should be thoroughly evaluated before they are introduced into a vital environment. The RFID performance assessment framework that we present can act as a reference model to start an RFID development, engineering, implementation and testing plan and more specific, to assess the potential risks of interference and to test the quality of the RFID generated data potentially influenced by physical objects in specific health care environments. Copyright © 2010 Elsevier Inc. All rights reserved.
Riis, Allan; Jensen, Cathrine Elgaard; Bro, Flemming; Maindal, Helle Terkildsen; Petersen, Karin Dam; Jensen, Martin Bach
2013-10-20
Evidence-based clinical practice guidelines may improve treatment quality, but the uptake of guideline recommendations is often incomplete and slow. Recently new low back pain guidelines are being launched in Denmark. The guidelines are considered to reduce personal and public costs. The aim of this study is to evaluate whether a complex, multifaceted implementation strategy of the low back pain guidelines will reduce secondary care referral and improve patient outcomes compared to the usual simple implementation strategy. In a two-armed cluster randomised trial, 100 general practices (clusters) and 2,700 patients aged 18 to 65 years from the North Denmark region will be included. Practices are randomly allocated 1:1 to a simple or a complex implementation strategy. Intervention practices will receive a complex implementation strategy, including guideline facilitator visits, stratification tools, and quality reports on low back pain treatment. Primary outcome is referral to secondary care. Secondary outcomes are pain, physical function, health-related quality of life, patient satisfaction with care and treatment outcome, employment status, and sick leave. Primary and secondary outcomes pertain to the patient level. Assessments of outcomes are blinded and follow the intention-to-treat principle. Additionally, a process assessment will evaluate the degree to which the intervention elements will be delivered as planned, as well as measure changes in beliefs and behaviours among general practitioners and patients. This study provides knowledge concerning the process and effect of an intervention to implement low back pain guidelines in general practice, and will provide insight on essential elements to include in future implementation strategies in general practice. Registered as NCT01699256 on ClinicalTrials.gov.