A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: a pre-post study using full immersion simulation.

PubMed

Munroe, Belinda; Curtis, Kate; Murphy, Margaret; Strachan, Luke; Considine, Julie; Hardy, Jennifer; Wilson, Mark; Ruperto, Kate; Fethney, Judith; Buckley, Thomas

2016-08-01

The aim of this study was to evaluate the effect of the new evidence-informed nursing assessment framework HIRAID (History, Identify Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) on the quality of patient assessment and fundamental nontechnical skills including communication, decision making, task management and situational awareness. Assessment is a core component of nursing practice and underpins clinical decisions and the safe delivery of patient care. Yet there is no universal or validated system used to teach emergency nurses how to comprehensively assess and care for patients. A pre-post design was used. The performance of thirty eight emergency nurses from five Australian hospitals was evaluated before and after undertaking education in the application of the HIRAID assessment framework. Video recordings of participant performance in immersive simulations of common presentations to the emergency department were evaluated, as well as participant documentation during the simulations. Paired parametric and nonparametric tests were used to compare changes from pre to postintervention. From pre to postintervention, participant performance increases were observed in the percentage of patient history elements collected, critical indicators of urgency collected and reported to medical officers, and patient reassessments performed. Participants also demonstrated improvement in each of the four nontechnical skills categories: communication, decision making, task management and situational awareness. The HIRAID assessment framework improves clinical patient assessments performed by emergency nurses and has the potential to enhance patient care. HIRAID should be considered for integration into clinical practice to provide nurses with a systematic approach to patient assessment and potentially improve the delivery of safe patient care. © 2016 John Wiley & Sons Ltd.

Building on the EGIPPS performance assessment: the multipolar framework as a heuristic to tackle the complexity of performance of public service oriented health care organisations.

PubMed

Marchal, Bruno; Hoerée, Tom; da Silveira, Valéria Campos; Van Belle, Sara; Prashanth, Nuggehalli S; Kegels, Guy

2014-04-17

Performance of health care systems is a key concern of policy makers and health service managers all over the world. It is also a major challenge, given its multidimensional nature that easily leads to conceptual and methodological confusion. This is reflected by a scarcity of models that comprehensively analyse health system performance. In health, one of the most comprehensive performance frameworks was developed by the team of Leggat and Sicotte. Their framework integrates 4 key organisational functions (goal attainment, production, adaptation to the environment, and values and culture) and the tensions between these functions.We modified this framework to better fit the assessment of the performance of health organisations in the public service domain and propose an analytical strategy that takes it into the social complexity of health organisations. The resulting multipolar performance framework (MPF) is a meta-framework that facilitates the analysis of the relations and interactions between the multiple actors that influence the performance of health organisations. Using the MPF in a dynamic reiterative mode not only helps managers to identify the bottlenecks that hamper performance, but also the unintended effects and feedback loops that emerge. Similarly, it helps policymakers and programme managers at central level to better anticipate the potential results and side effects of and required conditions for health policies and programmes and to steer their implementation accordingly.

EFF/NRS Data Collection Project, 2000-2001: An Interim Report on the Development of the EFF Assessment Framework.

ERIC Educational Resources Information Center

SRI International, Arlington, VA.

The Equipped for the Future (EFF) framework describes adult performance along these four dimensions: structure of the knowledge-base; fluency of performance; independence of performance; and range of conditions for performance. When completed it will include a developmental sequence of descriptions of learner performance for each EFF standard;…

A framework for performance and data quality assessment of Radio Frequency IDentification (RFID) systems in health care settings.

PubMed

van der Togt, Remko; Bakker, Piet J M; Jaspers, Monique W M

2011-04-01

RFID offers great opportunities to health care. Nevertheless, prior experiences also show that RFID systems have not been designed and tested in response to the particular needs of health care settings and might introduce new risks. The aim of this study is to present a framework that can be used to assess the performance of RFID systems particularly in health care settings. We developed a framework describing a systematic approach that can be used for assessing the feasibility of using an RFID technology in a particular healthcare setting; more specific for testing the impact of environmental factors on the quality of RFID generated data and vice versa. This framework is based on our own experiences with an RFID pilot implementation in an academic hospital in The Netherlands and a literature review concerning RFID test methods and current insights of RFID implementations in healthcare. The implementation of an RFID system within the blood transfusion chain inside a hospital setting was used as a show case to explain the different phases of the framework. The framework consists of nine phases, including an implementation development plan, RFID and medical equipment interference tests, data accuracy- and data completeness tests to be run in laboratory, simulated field and real field settings. The potential risks that RFID technologies may bring to the healthcare setting should be thoroughly evaluated before they are introduced into a vital environment. The RFID performance assessment framework that we present can act as a reference model to start an RFID development, engineering, implementation and testing plan and more specific, to assess the potential risks of interference and to test the quality of the RFID generated data potentially influenced by physical objects in specific health care environments. Copyright © 2010 Elsevier Inc. All rights reserved.

Building on the EGIPPS performance assessment: the multipolar framework as a heuristic to tackle the complexity of performance of public service oriented health care organisations

PubMed Central

2014-01-01

Background Performance of health care systems is a key concern of policy makers and health service managers all over the world. It is also a major challenge, given its multidimensional nature that easily leads to conceptual and methodological confusion. This is reflected by a scarcity of models that comprehensively analyse health system performance. Discussion In health, one of the most comprehensive performance frameworks was developed by the team of Leggat and Sicotte. Their framework integrates 4 key organisational functions (goal attainment, production, adaptation to the environment, and values and culture) and the tensions between these functions. We modified this framework to better fit the assessment of the performance of health organisations in the public service domain and propose an analytical strategy that takes it into the social complexity of health organisations. The resulting multipolar performance framework (MPF) is a meta-framework that facilitates the analysis of the relations and interactions between the multiple actors that influence the performance of health organisations. Summary Using the MPF in a dynamic reiterative mode not only helps managers to identify the bottlenecks that hamper performance, but also the unintended effects and feedback loops that emerge. Similarly, it helps policymakers and programme managers at central level to better anticipate the potential results and side effects of and required conditions for health policies and programmes and to steer their implementation accordingly. PMID:24742181

A new framework to enhance the interpretation of external validation studies of clinical prediction models.

PubMed

Debray, Thomas P A; Vergouwe, Yvonne; Koffijberg, Hendrik; Nieboer, Daan; Steyerberg, Ewout W; Moons, Karel G M

2015-03-01

It is widely acknowledged that the performance of diagnostic and prognostic prediction models should be assessed in external validation studies with independent data from "different but related" samples as compared with that of the development sample. We developed a framework of methodological steps and statistical methods for analyzing and enhancing the interpretation of results from external validation studies of prediction models. We propose to quantify the degree of relatedness between development and validation samples on a scale ranging from reproducibility to transportability by evaluating their corresponding case-mix differences. We subsequently assess the models' performance in the validation sample and interpret the performance in view of the case-mix differences. Finally, we may adjust the model to the validation setting. We illustrate this three-step framework with a prediction model for diagnosing deep venous thrombosis using three validation samples with varying case mix. While one external validation sample merely assessed the model's reproducibility, two other samples rather assessed model transportability. The performance in all validation samples was adequate, and the model did not require extensive updating to correct for miscalibration or poor fit to the validation settings. The proposed framework enhances the interpretation of findings at external validation of prediction models. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Assessment of a Hospital Palliative Care Unit (HPCU) for Cancer Patients; A Conceptual Framework.

PubMed

Rouhollahi, Mohammad Reza; Saghafinia, Masoud; Zandehdel, Kazem; Motlagh, Ali Ghanbari; Kazemian, Ali; Mohagheghi, Mohammad Ali; Tahmasebi, Mamak

2015-01-01

The first hospital palliative care unit (HPCU) in Iran (FARS-HPCU) has been established in 2008 in the Cancer Institute, which is the largest referral cancer center in the country. We attempted to assess the performance of the HPCU based on a comprehensive conceptual framework. The main aim of this study was to develop a conceptual framework for assessment of the HPCU performances through designing a value chain in line with the goals and the main processes (core and support). We collected data from a variety of sources, including international guidelines, international best practices, and expert opinions in the country and compared them with national policies and priorities. We also took into consideration the trend of the HPCU development in the Cancer Institute of Iran. Through benchmarking the gap area with the performance standards, some recommendations for better outcome are proposed. The framework for performance assessment consisted of 154 process indicators (PIs), based on which the main stakeholders of the HPCU (including staff, patients, and families) offered their scoring. The outcome revealed the state of the processes as well as the gaps. Despite a significant improvement in many processes and indicators, more development in the comprehensive and integrative aspects of FARS-HPCU performance is required. Consideration of all supportive and palliative requirements of the patients through interdisciplinary and collaborative approaches is recommended.

Engaging with Faculty to Develop, Implement, and Pilot Electronic Performance Assessments of Student Teachers Using Mobile Devices

ERIC Educational Resources Information Center

Haughton, Noela A.; Keil, Virginia L.

2009-01-01

This article discusses the development and implementation of a technology-supported student teacher performance assessment that supports integration with a larger electronic assessment system. The authors spearheaded a multidisciplinary team to develop a comprehensive performance assessment based on the Pathwise framework. The team collaborated…

Formulating a Theoretical Framework for Assessing Network Loads for Effective Deployment in Network-Centric Operations and Warfare

DTIC Science & Technology

2008-11-01

is particularly important in order to design a network that is realistically deployable. The goal of this project is the design of a theoretical ... framework to assess and predict the effectiveness and performance of networks and their loads.

Framework for Assessing Environmental, Social, and Economic Sustainability of ICT Organizations

ERIC Educational Resources Information Center

Odeh, Khuloud

2013-01-01

Key challenges that confront the Information and Communication Technology (ICT) industry today in defining and achieving social, environmental, and economic sustainability goals include identifying sustainable operating standards and best practices and measuring and assessing performance against those practices. The industry lacks a framework for…

A novel framework for assessing metadata quality in epidemiological and public health research settings

PubMed Central

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly. PMID:27570670

A novel framework for assessing metadata quality in epidemiological and public health research settings.

PubMed

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review.

PubMed

Rixon, Lorna; Baron, Justine; McGale, Nadine; Lorencatto, Fabiana; Francis, Jill; Davies, Anna

2016-11-18

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature. A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis. 19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used. Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Proposed evaluation framework for assessing operator performance with multisensor displays

NASA Technical Reports Server (NTRS)

Foyle, David C.

1992-01-01

Despite aggressive work on the development of sensor fusion algorithms and techniques, no formal evaluation procedures have been proposed. Based on existing integration models in the literature, an evaluation framework is developed to assess an operator's ability to use multisensor, or sensor fusion, displays. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The operator's performance with the sensor fusion display can be compared to the models' predictions based on the operator's performance when viewing the original sensor displays prior to fusion. This allows for the determination as to when a sensor fusion system leads to: 1) poorer performance than one of the original sensor displays (clearly an undesirable system in which the fused sensor system causes some distortion or interference); 2) better performance than with either single sensor system alone, but at a sub-optimal (compared to the model predictions) level; 3) optimal performance (compared to model predictions); or, 4) super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays. An experiment demonstrating the usefulness of the proposed evaluation framework is discussed.

The Conceptual Framework for the Development of a Mathematics Performance Assessment Instrument.

ERIC Educational Resources Information Center

Lane, Suzanne

1993-01-01

A conceptual framework is presented for the development of the Quantitative Understanding: Amplifying Student Achievement and Reasoning (QUASAR) Cognitive Assessment Instrument (QCAI) that focuses on the ability of middle-school students to problem solve, reason, and communicate mathematically. The instrument will provide programatic rather than…

A Historical Perspective of Testing and Assessment Including the Impact of Summative and Formative Assessment on Student Achievement

ERIC Educational Resources Information Center

Brink, Carole Sanger

2011-01-01

In 2007, Georgia developed a comprehensive framework to define what students need to know. One component of this framework emphasizes the use of both formative and summative assessments as part of an integral and specific component of the teachers. performance evaluation. Georgia administers the Criterion-Referenced Competency Test (CRCT) to every…

Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda.

PubMed

Hotchkiss, David R; Aqil, Anwer; Lippeveld, Theo; Mukooyo, Edward

2010-07-03

Sound policy, resource allocation and day-to-day management decisions in the health sector require timely information from routine health information systems (RHIS). In most low- and middle-income countries, the RHIS is viewed as being inadequate in providing quality data and continuous information that can be used to help improve health system performance. In addition, there is limited evidence on the effectiveness of RHIS strengthening interventions in improving data quality and use. The purpose of this study is to evaluate the usefulness of the newly developed Performance of Routine Information System Management (PRISM) framework, which consists of a conceptual framework and associated data collection and analysis tools to assess, design, strengthen and evaluate RHIS. The specific objectives of the study are: a) to assess the reliability and validity of the PRISM instruments and b) to assess the validity of the PRISM conceptual framework. Facility- and worker-level data were collected from 110 health care facilities in twelve districts in Uganda in 2004 and 2007 using records reviews, structured interviews and self-administered questionnaires. The analysis procedures include Cronbach's alpha to assess internal consistency of selected instruments, test-retest analysis to assess the reliability and sensitivity of the instruments, and bivariate and multivariate statistical techniques to assess validity of the PRISM instruments and conceptual framework. Cronbach's alpha analysis suggests high reliability (0.7 or greater) for the indices measuring a promotion of a culture of information, RHIS tasks self-efficacy and motivation. The study results also suggest that a promotion of a culture of information influences RHIS tasks self-efficacy, RHIS tasks competence and motivation, and that self-efficacy and the presence of RHIS staff have a direct influence on the use of RHIS information, a key aspect of RHIS performance. The study results provide some empirical support for the reliability and validity of the PRISM instruments and the validity of the PRISM conceptual framework, suggesting that the PRISM approach can be effectively used by RHIS policy makers and practitioners to assess the RHIS and evaluate RHIS strengthening interventions. However, additional studies with larger sample sizes are needed to further investigate the value of the PRISM instruments in exploring the linkages between RHIS data quality and use, and health systems performance.

Conceptual Modeling Framework for E-Area PA HELP Infiltration Model Simulations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dyer, J. A.

A conceptual modeling framework based on the proposed E-Area Low-Level Waste Facility (LLWF) closure cap design is presented for conducting Hydrologic Evaluation of Landfill Performance (HELP) model simulations of intact and subsided cap infiltration scenarios for the next E-Area Performance Assessment (PA).

A Flexible Modeling Framework For Hydraulic and Water Quality Performance Assessment of Stormwater Green Infrastructure

EPA Science Inventory

A flexible framework has been created for modeling multi-dimensional hydrological and water quality processes within stormwater green infrastructures (GIs). The framework models a GI system using a set of blocks (spatial features) and connectors (interfaces) representing differen...

A framework to assess management performance in district health systems: a qualitative and quantitative case study in Iran.

PubMed

Tabrizi, Jafar Sadegh; Gholipour, Kamal; Iezadi, Shabnam; Farahbakhsh, Mostafa; Ghiasi, Akbar

2018-01-01

The aim was to design a district health management performance framework for Iran's healthcare system. The mixed-method study was conducted between September 2015 and May 2016 in Tabriz, Iran. In this study, the indicators of district health management performance were obtained by analyzing the 45 semi-structured surveys of experts in the public health system. Content validity of performance indicators which were generated in qualitative part were reviewed and confirmed based on content validity index (CVI). Also content validity ratio (CVR) was calculated using data acquired from a survey of 21 experts in quantitative part. The result of this study indicated that, initially, 81 indicators were considered in framework of district health management performance and, at the end, 53 indicators were validated and confirmed. These indicators were classified in 11 categories which include: human resources and organizational creativity, management and leadership, rules and ethics, planning and evaluation, district managing, health resources management and economics, community participation, quality improvement, research in health system, health information management, epidemiology and situation analysis. The designed framework model can be used to assess the district health management and facilitates performance improvement at the district level.

Assessment of School-Based Management. [Volume I: Findings and Conclusions.] Studies of Education Reform.

ERIC Educational Resources Information Center

Wohlstetter, Priscilla; Mohrman, Susan Albers

This document presents findings of the Assessment of School-Based Management Study, which identified the conditions in schools that promote high performance through school-based management (SBM). The study's conceptual framework was based on Edward E. Lawler's (1986) model. The high-involvement framework posits that four resources must spread…

Framework for e-learning assessment in dental education: a global model for the future.

PubMed

Arevalo, Carolina R; Bayne, Stephen C; Beeley, Josie A; Brayshaw, Christine J; Cox, Margaret J; Donaldson, Nora H; Elson, Bruce S; Grayden, Sharon K; Hatzipanagos, Stylianos; Johnson, Lynn A; Reynolds, Patricia A; Schönwetter, Dieter J

2013-05-01

The framework presented in this article demonstrates strategies for a global approach to e-curricula in dental education by considering a collection of outcome assessment tools. By combining the outcomes for overall assessment, a global model for a pilot project that applies e-assessment tools to virtual learning environments (VLE), including haptics, is presented. Assessment strategies from two projects, HapTEL (Haptics in Technology Enhanced Learning) and UDENTE (Universal Dental E-learning), act as case-user studies that have helped develop the proposed global framework. They incorporate additional assessment tools and include evaluations from questionnaires and stakeholders' focus groups. These measure each of the factors affecting the classical teaching/learning theory framework as defined by Entwistle in a standardized manner. A mathematical combinatorial approach is proposed to join these results together as a global assessment. With the use of haptic-based simulation learning, exercises for tooth preparation assessing enamel and dentine were compared to plastic teeth in manikins. Equivalence for student performance for haptic versus traditional preparation methods was established, thus establishing the validity of the haptic solution for performing these exercises. Further data collected from HapTEL are still being analyzed, and pilots are being conducted to validate the proposed test measures. Initial results have been encouraging, but clearly the need persists to develop additional e-assessment methods for new learning domains.

Risk Assessment

EPA Pesticide Factsheets

How the EPA conducts risk assessment to protect human health and the environment. Several assessments are included with the guidelines, models, databases, state-based RSL Tables, local contacts and framework documents used to perform these assessments.

A new framework for interactive quality assessment with application to light field coding

NASA Astrophysics Data System (ADS)

Viola, Irene; Ebrahimi, Touradj

2017-09-01

In recent years, light field has experienced a surge of popularity, mainly due to the recent advances in acquisition and rendering technologies that have made it more accessible to the public. Thanks to image-based rendering techniques, light field contents can be rendered in real time on common 2D screens, allowing virtual navigation through the captured scenes in an interactive fashion. However, this richer representation of the scene poses the problem of reliable quality assessments for light field contents. In particular, while subjective methodologies that enable interaction have already been proposed, no work has been done on assessing how users interact with light field contents. In this paper, we propose a new framework to subjectively assess the quality of light field contents in an interactive manner and simultaneously track users behaviour. The framework is successfully used to perform subjective assessment of two coding solutions. Moreover, statistical analysis performed on the results shows interesting correlation between subjective scores and average interaction time.

Looking Under the Streetlight? A Framework for Differentiating Performance Measures by Level of Care in a Value-Based Payment Environment

PubMed Central

Van Such, Monica B.; Nesse, Robert E.; Dilling, James A.; Swensen, Stephen J.; Thompson, Kristine M.; Orlowski, Janis M.; Santrach, Paula J.

2017-01-01

The majority of quality measures used to assess providers and hospitals are based on easily obtained data, focused on a few dimensions of quality, and developed mainly for primary/community care and population health. While this approach supports efforts focused on addressing the triple aim of health care, many current quality report cards and assessments do not reflect the breadth or complexity of many referral center practices. In this article, the authors highlight the differences between population health efforts and referral care and address issues related to value measurement and performance assessment. They discuss why measures may need to differ across the three levels of care (primary/community care, secondary care, complex care) and illustrate the need for further risk adjustment to eliminate referral bias. With continued movement toward value-based purchasing, performance measures and reimbursement schemes need to reflect the increased level of intensity required to provide complex care. The authors propose a framework to operationalize value measurement and payment for specialty care, and they make specific recommendations to improve performance measurement for complex patients. Implementing such a framework to differentiate performance measures by level of care involves coordinated efforts to change both policy and operational platforms. An essential component of this framework is a new model that defines the characteristics of patients who require complex care and standardizes metrics that incorporate those definitions. PMID:28353502

Looking Under the Streetlight? A Framework for Differentiating Performance Measures by Level of Care in a Value-Based Payment Environment.

PubMed

Naessens, James M; Van Such, Monica B; Nesse, Robert E; Dilling, James A; Swensen, Stephen J; Thompson, Kristine M; Orlowski, Janis M; Santrach, Paula J

2017-07-01

The majority of quality measures used to assess providers and hospitals are based on easily obtained data, focused on a few dimensions of quality, and developed mainly for primary/community care and population health. While this approach supports efforts focused on addressing the triple aim of health care, many current quality report cards and assessments do not reflect the breadth or complexity of many referral center practices.In this article, the authors highlight the differences between population health efforts and referral care and address issues related to value measurement and performance assessment. They discuss why measures may need to differ across the three levels of care (primary/community care, secondary care, complex care) and illustrate the need for further risk adjustment to eliminate referral bias.With continued movement toward value-based purchasing, performance measures and reimbursement schemes need to reflect the increased level of intensity required to provide complex care. The authors propose a framework to operationalize value measurement and payment for specialty care, and they make specific recommendations to improve performance measurement for complex patients. Implementing such a framework to differentiate performance measures by level of care involves coordinated efforts to change both policy and operational platforms. An essential component of this framework is a new model that defines the characteristics of patients who require complex care and standardizes metrics that incorporate those definitions.

An empirical assessment of high-performing medical groups: results from a national study.

PubMed

Shortell, Stephen M; Schmittdiel, Julie; Wang, Margaret C; Li, Rui; Gillies, Robin R; Casalino, Lawrence P; Bodenheimer, Thomas; Rundall, Thomas G

2005-08-01

The performance of medical groups is receiving increased attention. Relatively little conceptual or empirical work exists that examines the various dimensions of medical group performance. Using a national database of 693 medical groups, this article develops a scorecard approach to assessing group performance and presents a theory-driven framework for differentiating between high-performing versus low-performing medical groups. The clinical quality of care, financial performance, and organizational learning capability of medical groups are assessed in relation to environmental forces, resource acquisition and resource deployment factors, and a quality-centered culture. Findings support the utility of the performance scorecard approach and identification of a number of key factors differentiating high-performing from low-performing groups including, in particular, the importance of a quality-centered culture and the requirement of outside reporting from third party organizations. The findings hold a number of important implications for policy and practice, and the framework presented provides a foundation for future research.

Communication Channels as Implementation Determinants of Performance Management Framework in Kenya

ERIC Educational Resources Information Center

Sang, Jane

2016-01-01

The purpose of this study to assess communication channels as implementation determinants of performance management framework In Kenya at Moi Teaching and Referral Hospital (MTRH). The communication theory was used to inform the study. This study adopted an explanatory design. The target sampled 510 respondents through simple random and stratified…

Assessing Vocal Performances Using Analytical Assessment: A Case Study

ERIC Educational Resources Information Center

Gynnild, Vidar

2016-01-01

This study investigated ways to improve the appraisal of vocal performances within a national academy of music. Since a criterion-based assessment framework had already been adopted, the conceptual foundation of an assessment rubric was used as a guide in an action research project. The group of teachers involved wanted to explore thinking…

Peer-Formativity: A Framework for Academic Writing

ERIC Educational Resources Information Center

Murray, Rowena; Thow, Morag

2014-01-01

The system currently deployed to assess research outputs in higher education can influence what, how and for whom academics write; for some it may determine whether or not they write at all. This article offers a framework for negotiating this performative context--the writing meeting. This framework uses the established theoretical underpinning…

Critical analysis of e-health readiness assessment frameworks: suitability for application in developing countries.

PubMed

Mauco, Kabelo Leonard; Scott, Richard E; Mars, Maurice

2018-02-01

Introduction e-Health is an innovative way to make health services more effective and efficient and application is increasing worldwide. e-Health represents a substantial ICT investment and its failure usually results in substantial losses in time, money (including opportunity costs) and effort. Therefore it is important to assess e-health readiness prior to implementation. Several frameworks have been published on e-health readiness assessment, under various circumstances and geographical regions of the world. However, their utility for the developing world is unknown. Methods A literature review and analysis of published e-health readiness assessment frameworks or models was performed to determine if any are appropriate for broad assessment of e-health readiness in the developing world. A total of 13 papers described e-health readiness in different settings. Results and Discussion Eight types of e-health readiness were identified and no paper directly addressed all of these. The frameworks were based upon varying assumptions and perspectives. There was no underlying unifying theory underpinning the frameworks. Few assessed government and societal readiness, and none cultural readiness; all are important in the developing world. While the shortcomings of existing frameworks have been highlighted, most contain aspects that are relevant and can be drawn on when developing a framework and assessment tools for the developing world. What emerged is the need to develop different assessment tools for the various stakeholder sectors. This is an area that needs further research before attempting to develop a more generic framework for the developing world.

A Framework for Designing and Developing Multimedia-Based Performance Assessment in Vocational Education

ERIC Educational Resources Information Center

de Klerk, Sebastiaan; Veldkamp, Bernard P.; Eggen, Theo J. H. M.

2018-01-01

The development of any assessment should be an iterative and careful process. Ideally, this process is guided by a well-defined framework (see for example Downing in: Downing and Haladyna (eds) "Handbook of test development," Lawrence Erlbaum Associates, Mahwah, 2006; Mislevy et al. in "On the roles of task model variables in…

Integrated risk framework for onsite wastewater treatment systems.

PubMed

Carroll, Steven; Goonetilleke, Ashantha; Thomas, Evan; Hargreaves, Megan; Frost, Ray; Dawes, Les

2006-08-01

Onsite wastewater treatment systems (OWTS) are becoming increasingly important for the treatment and dispersal of effluent in new urbanised developments that are not serviced by centralised wastewater collection and treatment systems. However, the current standards and guidelines adopted by many local authorities for assessing suitable site and soil conditions for OWTS are increasingly coming under scrutiny due to the public health and environmental impacts caused by poorly performing systems, in particular septic tank-soil adsorption systems. In order to achieve sustainable onsite wastewater treatment with minimal impacts on the environment and public health, more appropriate means of assessment are required. This paper highlights an integrated risk based approach for assessing the inherent hazards associated with OWTS in order to manage and mitigate the environmental and public health risks inherent with onsite wastewater treatment. In developing a sound and cohesive integrated risk framework for OWTS, several key issues must be recognised. These include the inclusion of relevant stakeholders throughout framework development, the integration of scientific knowledge, data and analysis with risk assessment and management ideals, and identification of the appropriate performance goals for successful management and mitigation of associated risks. These issues were addressed in the development of the risk framework to provide a generic approach to assessing risk from OWTS. The utilisation of the developed risk framework for achieving more appropriate assessment and management techniques for OWTS is presented in a case study for the Gold Coast region, Queensland State, Australia.

Integrated Risk Framework for Onsite Wastewater Treatment Systems

NASA Astrophysics Data System (ADS)

Carroll, Steven; Goonetilleke, Ashantha; Thomas, Evan; Hargreaves, Megan; Frost, Ray; Dawes, Les

2006-08-01

Onsite wastewater treatment systems (OWTS) are becoming increasingly important for the treatment and dispersal of effluent in new urbanised developments that are not serviced by centralised wastewater collection and treatment systems. However, the current standards and guidelines adopted by many local authorities for assessing suitable site and soil conditions for OWTS are increasingly coming under scrutiny due to the public health and environmental impacts caused by poorly performing systems, in particular septic tank-soil adsorption systems. In order to achieve sustainable onsite wastewater treatment with minimal impacts on the environment and public health, more appropriate means of assessment are required. This paper highlights an integrated risk based approach for assessing the inherent hazards associated with OWTS in order to manage and mitigate the environmental and public health risks inherent with onsite wastewater treatment. In developing a sound and cohesive integrated risk framework for OWTS, several key issues must be recognised. These include the inclusion of relevant stakeholders throughout framework development, the integration of scientific knowledge, data and analysis with risk assessment and management ideals, and identification of the appropriate performance goals for successful management and mitigation of associated risks. These issues were addressed in the development of the risk framework to provide a generic approach to assessing risk from OWTS. The utilisation of the developed risk framework for achieving more appropriate assessment and management techniques for OWTS is presented in a case study for the Gold Coast region, Queensland State, Australia.

GUIDE TO INDUSTRIAL ASSESSMENTS FOR POLLUTION PREVENTION AND ENERGY EFFICIENCY

EPA Science Inventory

This document presents an overview of industrial assessments and the general framework for conducting an assessment. It describes combined assessments for pollution prevention and energy, "industrial assessments," providing guidance to those performing assessments at industrial o...

Assessing a cross-border logistics policy using a performance measurement system framework: the case of Hong Kong and the Pearl River Delta region

NASA Astrophysics Data System (ADS)

Wong, David W. C.; Choy, K. L.; Chow, Harry K. H.; Lin, Canhong

2014-06-01

For the most rapidly growing economic entity in the world, China, a new logistics operation called the indirect cross-border supply chain model has recently emerged. The primary idea of this model is to reduce logistics costs by storing goods at a bonded warehouse with low storage cost in certain Chinese regions, such as the Pearl River Delta (PRD). This research proposes a performance measurement system (PMS) framework to assess the direct and indirect cross-border supply chain models. The PMS covers four categories including cost, time, quality and flexibility in the assessment of the performance of direct and indirect models. Furthermore, a survey was conducted to investigate the logistics performance of third party logistics (3PLs) at the PRD regions, including Guangzhou, Shenzhen and Hong Kong. The significance of the proposed PMS framework allows 3PLs accurately pinpoint the weakness and strengths of it current operations policy at four major performance measurement categories. Hence, this helps 3PLs further enhance the competitiveness and operations efficiency through better resources allocation at the area of warehousing and transportation.

Improving L2 Reading Comprehension through Emotionalized Dynamic Assessment Procedures.

PubMed

Abdolrezapour, Parisa

2017-06-01

The paper reports a study on an emotionally-loaded dynamic assessment procedure used with Iranian EFL learners. It focuses on the effect of using emotional intelligence characteristics (based on Goleman's framework) as a tool for motivating learners while performing reading tasks. The study with 50 intermediate learners aged 12-15 used three modalities: a control group, which was taught under institute's normal procedures; a comparison group, which received dynamic assessment (DA); and an experimental group, which received emotionalized dynamic assessment (EDA) procedures, in the form of an intervention focusing on characteristics of Goleman's emotional intelligence framework with the express purpose of inducing them to work with their emotions. Results showed that applying EDA procedures to reading assessment tasks made a difference in learners' level of performance in comparison to those who went through pure DA procedures who in turn performed significantly better than those who did not received DA in any form.

Validity in work-based assessment: expanding our horizons.

PubMed

Govaerts, Marjan; van der Vleuten, Cees P M

2013-12-01

Although work-based assessments (WBA) may come closest to assessing habitual performance, their use for summative purposes is not undisputed. Most criticism of WBA stems from approaches to validity consistent with the quantitative psychometric framework. However, there is increasing research evidence that indicates that the assumptions underlying the predictive, deterministic framework of psychometrics may no longer hold. In this discussion paper we argue that meaningfulness and appropriateness of current validity evidence can be called into question and that we need alternative strategies to assessment and validity inquiry that build on current theories of learning and performance in complex and dynamic workplace settings. Drawing from research in various professional fields we outline key issues within the mechanisms of learning, competence and performance in the context of complex social environments and illustrate their relevance to WBA. In reviewing recent socio-cultural learning theory and research on performance and performance interpretations in work settings, we demonstrate that learning, competence (as inferred from performance) as well as performance interpretations are to be seen as inherently contextualised, and can only be under-stood 'in situ'. Assessment in the context of work settings may, therefore, be more usefully viewed as a socially situated interpretive act. We propose constructivist-interpretivist approaches towards WBA in order to capture and understand contextualised learning and performance in work settings. Theoretical assumptions underlying interpretivist assessment approaches call for a validity theory that provides the theoretical framework and conceptual tools to guide the validation process in the qualitative assessment inquiry. Basic principles of rigour specific to qualitative research have been established, and they can and should be used to determine validity in interpretivist assessment approaches. If used properly, these strategies generate trustworthy evidence that is needed to develop the validity argument in WBA, allowing for in-depth and meaningful information about professional competence. © 2013 John Wiley & Sons Ltd.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Yao; Balaprakash, Prasanna; Meng, Jiayuan

We present Raexplore, a performance modeling framework for architecture exploration. Raexplore enables rapid, automated, and systematic search of architecture design space by combining hardware counter-based performance characterization and analytical performance modeling. We demonstrate Raexplore for two recent manycore processors IBM Blue- Gene/Q compute chip and Intel Xeon Phi, targeting a set of scientific applications. Our framework is able to capture complex interactions between architectural components including instruction pipeline, cache, and memory, and to achieve a 3–22% error for same-architecture and cross-architecture performance predictions. Furthermore, we apply our framework to assess the two processors, and discover and evaluate a list ofmore » architectural scaling options for future processor designs.« less

Fuel Cycle Analysis Framework Base Cases for the IAEA/INPRO GAINS Collaborative Project

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brent Dixon

Thirteen countries participated in the Collaborative Project GAINS “Global Architecture of Innovative Nuclear Energy Systems Based on Thermal and Fast Reactors Including a Closed Fuel Cycle”, which was the primary activity within the IAEA/INPRO Program Area B: “Global Vision on Sustainable Nuclear Energy” for the last three years. The overall objective of GAINS was to develop a standard framework for assessing future nuclear energy systems taking into account sustainable development, and to validate results through sample analyses. This paper details the eight scenarios that constitute the GAINS framework base cases for analysis of the transition to future innovative nuclear energymore » systems. The framework base cases provide a reference for users of the framework to start from in developing and assessing their own alternate systems. Each base case is described along with performance results against the GAINS sustainability evaluation metrics. The eight cases include four using a moderate growth projection and four using a high growth projection for global nuclear electricity generation through 2100. The cases are divided into two sets, addressing homogeneous and heterogeneous scenarios developed by GAINS to model global fuel cycle strategies. The heterogeneous world scenario considers three separate nuclear groups based on their fuel cycle strategies, with non-synergistic and synergistic cases. The framework base case analyses results show the impact of these different fuel cycle strategies while providing references for future users of the GAINS framework. A large number of scenario alterations are possible and can be used to assess different strategies, different technologies, and different assumptions about possible futures of nuclear power. Results can be compared to the framework base cases to assess where these alternate cases perform differently versus the sustainability indicators.« less

API REST Web service and backend system Of Lecturer’s Assessment Information System on Politeknik Negeri Bali

NASA Astrophysics Data System (ADS)

Manuaba, I. B. P.; Rudiastini, E.

2018-01-01

Assessment of lecturers is a tool used to measure lecturer performance. Lecturer’s assessment variable can be measured from three aspects : teaching activities, research and community service. Broad aspect to measure the performance of lecturers requires a special framework, so that the system can be developed in a sustainable manner. Issues of this research is to create a API web service data tool, so the lecturer assessment system can be developed in various frameworks. The research was developed with web service and php programming language with the output of json extension data. The conclusion of this research is API web service data application can be developed using several platforms such as web, mobile application

A Self-Assessment Framework for Inclusive Schools Supporting Assistive Technology Users.

PubMed

Hoogerwerf, Evert-Jan; Solander-Gross, Andrea; Mavrou, Katerina; Traina, Ivan; Hersh, Marion

2017-01-01

In order to support schools to assess their performance in supporting children with disabilities in their ICT and ICT-AT needs, a self-assessment framework was developed by a task force of partners and associate partners of the ENTELIS project. The self-assessment tool aims to help educational establishments that welcome learners with disabilities to assess their current outcomes and to plan improvements in supporting these students in increasing digital literacy and developing digital skills. This includes the use of mainstream Information and Communication Technology (ICT) and specially designed digital Assistive Technologies (ICT-AT). This can only successfully happen if schools fully embrace an inclusive approach to education. In this paper the authors describe the development of the framework and the further steps for its use.

The Neglected Situation: Assessment Performance and Interaction in Context

ERIC Educational Resources Information Center

Maddox, Bryan

2015-01-01

Informed by Goffman's influential essay on "The neglected situation" this paper examines the contextual and interactive dimensions of performance in large-scale educational assessments. The paper applies Goffman's participation framework and associated theory in linguistic anthropology to examine how testing situations are framed and…

A framework for global river flood risk assessments

NASA Astrophysics Data System (ADS)

Winsemius, H. C.; Van Beek, L. P. H.; Jongman, B.; Ward, P. J.; Bouwman, A.

2013-05-01

There is an increasing need for strategic global assessments of flood risks in current and future conditions. In this paper, we propose a framework for global flood risk assessment for river floods, which can be applied in current conditions, as well as in future conditions due to climate and socio-economic changes. The framework's goal is to establish flood hazard and impact estimates at a high enough resolution to allow for their combination into a risk estimate, which can be used for strategic global flood risk assessments. The framework estimates hazard at a resolution of ~ 1 km2 using global forcing datasets of the current (or in scenario mode, future) climate, a global hydrological model, a global flood-routing model, and more importantly, an inundation downscaling routine. The second component of the framework combines hazard with flood impact models at the same resolution (e.g. damage, affected GDP, and affected population) to establish indicators for flood risk (e.g. annual expected damage, affected GDP, and affected population). The framework has been applied using the global hydrological model PCR-GLOBWB, which includes an optional global flood routing model DynRout, combined with scenarios from the Integrated Model to Assess the Global Environment (IMAGE). We performed downscaling of the hazard probability distributions to 1 km2 resolution with a new downscaling algorithm, applied on Bangladesh as a first case study application area. We demonstrate the risk assessment approach in Bangladesh based on GDP per capita data, population, and land use maps for 2010 and 2050. Validation of the hazard estimates has been performed using the Dartmouth Flood Observatory database. This was done by comparing a high return period flood with the maximum observed extent, as well as by comparing a time series of a single event with Dartmouth imagery of the event. Validation of modelled damage estimates was performed using observed damage estimates from the EM-DAT database and World Bank sources. We discuss and show sensitivities of the estimated risks with regard to the use of different climate input sets, decisions made in the downscaling algorithm, and different approaches to establish impact models.

Alternatives Assessment Frameworks: Research Needs for the Informed Substitution of Hazardous Chemicals

PubMed Central

Jacobs, Molly M.; Malloy, Timothy F.; Tickner, Joel A.; Edwards, Sally

2015-01-01

Background Given increasing pressures for hazardous chemical replacement, there is growing interest in alternatives assessment to avoid substituting a toxic chemical with another of equal or greater concern. Alternatives assessment is a process for identifying, comparing, and selecting safer alternatives to chemicals of concern (including those used in materials, processes, or technologies) on the basis of their hazards, performance, and economic viability. Objectives The purposes of this substantive review of alternatives assessment frameworks are to identify consistencies and differences in methods and to outline needs for research and collaboration to advance science policy practice. Methods This review compares methods used in six core components of these frameworks: hazard assessment, exposure characterization, life-cycle impacts, technical feasibility evaluation, economic feasibility assessment, and decision making. Alternatives assessment frameworks published from 1990 to 2014 were included. Results Twenty frameworks were reviewed. The frameworks were consistent in terms of general process steps, but some differences were identified in the end points addressed. Methodological gaps were identified in the exposure characterization, life-cycle assessment, and decision–analysis components. Methods for addressing data gaps remain an issue. Discussion Greater consistency in methods and evaluation metrics is needed but with sufficient flexibility to allow the process to be adapted to different decision contexts. Conclusion Although alternatives assessment is becoming an important science policy field, there is a need for increased cross-disciplinary collaboration to refine methodologies in support of the informed substitution and design of safer chemicals, materials, and products. Case studies can provide concrete lessons to improve alternatives assessment. Citation Jacobs MM, Malloy TF, Tickner JA, Edwards S. 2016. Alternatives assessment frameworks: research needs for the informed substitution of hazardous chemicals. Environ Health Perspect 124:265–280; http://dx.doi.org/10.1289/ehp.1409581 PMID:26339778

A framework for global river flood risk assessments

NASA Astrophysics Data System (ADS)

Winsemius, H. C.; Van Beek, L. P. H.; Jongman, B.; Ward, P. J.; Bouwman, A.

2012-08-01

There is an increasing need for strategic global assessments of flood risks in current and future conditions. In this paper, we propose a framework for global flood risk assessment for river floods, which can be applied in current conditions, as well as in future conditions due to climate and socio-economic changes. The framework's goal is to establish flood hazard and impact estimates at a high enough resolution to allow for their combination into a risk estimate. The framework estimates hazard at high resolution (~1 km2) using global forcing datasets of the current (or in scenario mode, future) climate, a global hydrological model, a global flood routing model, and importantly, a flood extent downscaling routine. The second component of the framework combines hazard with flood impact models at the same resolution (e.g. damage, affected GDP, and affected population) to establish indicators for flood risk (e.g. annual expected damage, affected GDP, and affected population). The framework has been applied using the global hydrological model PCR-GLOBWB, which includes an optional global flood routing model DynRout, combined with scenarios from the Integrated Model to Assess the Global Environment (IMAGE). We performed downscaling of the hazard probability distributions to 1 km2 resolution with a new downscaling algorithm, applied on Bangladesh as a first case-study application area. We demonstrate the risk assessment approach in Bangladesh based on GDP per capita data, population, and land use maps for 2010 and 2050. Validation of the hazard and damage estimates has been performed using the Dartmouth Flood Observatory database and damage estimates from the EM-DAT database and World Bank sources. We discuss and show sensitivities of the estimated risks with regard to the use of different climate input sets, decisions made in the downscaling algorithm, and different approaches to establish impact models.

Perceived Utility of the RE-AIM Framework for Health Promotion/Disease Prevention Initiatives for Older Adults: A Case Study from the U.S. Evidence-Based Disease Prevention Initiative.

PubMed

Ory, Marcia G; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee

2014-01-01

Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance.

A Risk-based Assessment And Management Framework For Multipollutant Air Quality

PubMed Central

Frey, H. Christopher; Hubbell, Bryan

2010-01-01

The National Research Council recommended both a risk- and performance-based multipollutant approach to air quality management. Specifically, management decisions should be based on minimizing the exposure to, and risk of adverse effects from, multiple sources of air pollution and that the success of these decisions should be measured by how well they achieved this objective. We briefly describe risk analysis and its application within the current approach to air quality management. Recommendations are made as to how current practice could evolve to support a fully risk- and performance-based multipollutant air quality management system. The ability to implement a risk assessment framework in a credible and policy-relevant manner depends on the availability of component models and data which are scientifically sound and developed with an understanding of their application in integrated assessments. The same can be said about accountability assessments used to evaluate the outcomes of decisions made using such frameworks. The existing risk analysis framework, although typically applied to individual pollutants, is conceptually well suited for analyzing multipollutant management actions. Many elements of this framework, such as emissions and air quality modeling, already exist with multipollutant characteristics. However, the framework needs to be supported with information on exposure and concentration response relationships that result from multipollutant health studies. Because the causal chain that links management actions to emission reductions, air quality improvements, exposure reductions and health outcomes is parallel between prospective risk analyses and retrospective accountability assessments, both types of assessment should be placed within a single framework with common metrics and indicators where possible. Improvements in risk reductions can be obtained by adopting a multipollutant risk analysis framework within the current air quality management system, e.g. focused on standards for individual pollutants and with separate goals for air toxics and ambient pollutants. However, additional improvements may be possible if goals and actions are defined in terms of risk metrics that are comparable across criteria pollutants and air toxics (hazardous air pollutants), and that encompass both human health and ecological risks. PMID:21209847

Health system frameworks and performance indicators in eight countries: A comparative international analysis

PubMed Central

Braithwaite, Jeffrey; Hibbert, Peter; Blakely, Brette; Plumb, Jennifer; Hannaford, Natalie; Long, Janet Cameron; Marks, Danielle

2017-01-01

Objectives: Performance indicators are a popular mechanism for measuring the quality of healthcare to facilitate both quality improvement and systems management. Few studies make comparative assessments of different countries’ performance indicator frameworks. This study identifies and compares frameworks and performance indicators used in selected Organisation for Economic Co-operation and Development health systems to measure and report on the performance of healthcare organisations and local health systems. Countries involved are Australia, Canada, Denmark, England, the Netherlands, New Zealand, Scotland and the United States. Methods: Identification of comparable international indicators and analyses of their characteristics and of their broader national frameworks and contexts were undertaken. Two dimensions of indicators – that they are nationally consistent (used across the country rather than just regionally) and locally relevant (measured and reported publicly at a local level, for example, a health service) – were deemed important. Results: The most commonly used domains in performance frameworks were safety, effectiveness and access. The search found 401 indicators that fulfilled the ‘nationally consistent and locally relevant’ criteria. Of these, 45 indicators are reported in more than one country. Cardiovascular, surgery and mental health were the most frequently reported disease groups. Conclusion: These comparative data inform researchers and policymakers internationally when designing health performance frameworks and indicator sets. PMID:28228948

Boom Minimization Framework for Supersonic Aircraft Using CFD Analysis

NASA Technical Reports Server (NTRS)

Ordaz, Irian; Rallabhandi, Sriram K.

2010-01-01

A new framework is presented for shape optimization using analytical shape functions and high-fidelity computational fluid dynamics (CFD) via Cart3D. The focus of the paper is the system-level integration of several key enabling analysis tools and automation methods to perform shape optimization and reduce sonic boom footprint. A boom mitigation case study subject to performance, stability and geometrical requirements is presented to demonstrate a subset of the capabilities of the framework. Lastly, a design space exploration is carried out to assess the key parameters and constraints driving the design.

A contemporary approach to validity arguments: a practical guide to Kane's framework.

PubMed

Cook, David A; Brydges, Ryan; Ginsburg, Shiphra; Hatala, Rose

2015-06-01

Assessment is central to medical education and the validation of assessments is vital to their use. Earlier validity frameworks suffer from a multiplicity of types of validity or failure to prioritise among sources of validity evidence. Kane's framework addresses both concerns by emphasising key inferences as the assessment progresses from a single observation to a final decision. Evidence evaluating these inferences is planned and presented as a validity argument. We aim to offer a practical introduction to the key concepts of Kane's framework that educators will find accessible and applicable to a wide range of assessment tools and activities. All assessments are ultimately intended to facilitate a defensible decision about the person being assessed. Validation is the process of collecting and interpreting evidence to support that decision. Rigorous validation involves articulating the claims and assumptions associated with the proposed decision (the interpretation/use argument), empirically testing these assumptions, and organising evidence into a coherent validity argument. Kane identifies four inferences in the validity argument: Scoring (translating an observation into one or more scores); Generalisation (using the score[s] as a reflection of performance in a test setting); Extrapolation (using the score[s] as a reflection of real-world performance), and Implications (applying the score[s] to inform a decision or action). Evidence should be collected to support each of these inferences and should focus on the most questionable assumptions in the chain of inference. Key assumptions (and needed evidence) vary depending on the assessment's intended use or associated decision. Kane's framework applies to quantitative and qualitative assessments, and to individual tests and programmes of assessment. Validation focuses on evaluating the key claims, assumptions and inferences that link assessment scores with their intended interpretations and uses. The Implications and associated decisions are the most important inferences in the validity argument. © 2015 John Wiley & Sons Ltd.

Using the International Classification of Functioning, Disability and Health in Assessment and Intervention of School-Aged Children With Language Impairments.

PubMed

Westby, Carol; Washington, Karla N

2017-07-26

The aim of this tutorial is to support speech-language pathologists' (SLPs') application of the International Classification of Functioning, Disability and Health (ICF) in assessment and treatment practices with children with language impairment. This tutorial reviews the framework of the ICF, describes the implications of the ICF for SLPs, distinguishes between students' capacity to perform a skill in a structured context and the actual performance of that skill in naturalistic contexts, and provides a case study of an elementary school child to demonstrate how the principles of the ICF can guide assessment and intervention. The Scope of Practice and Preferred Practice documents for the American Speech-Language-Hearing Association identify the ICF as the framework for practice in speech-language pathology. This tutorial will facilitate clinicians' ability to identify personal and environmental factors that influence students' skill capacity and skill performance, assess students' capacity and performance, and develop impairment-based and socially based language goals linked to Common Core State Standards that build students' language capacity and their communicative performance in naturalistic contexts.

Development of Sustainability Assessment Framework in Hydropower sector

NASA Astrophysics Data System (ADS)

Soliha Sahimi, Nur; Turan, Faiz Mohd; Johan, Kartina

2017-08-01

Nowadays, Malaysian demand in energy sector was drastically increase due to technological developments. Since, hydropower is one of potential renewable energy source in Malaysia. The largest electricity utility company, Tenaga Nasional Berhad was provide an electricity to more than seven million people via independent suppliers in peninsular Malaysia and Sabah by intended a potential sustainable hydropower system. In order to increasingly the power capacity from current use, 1882 MW to more than 3000 MW by years 2020. In this study, the environmental issues and also the penalty to the responsible company especially on Tenaga Nasional Berhad (TNB) towards their project or business are one of the problems. Other than that, every project or business has to prepare a sustainability statement or sustainability report as vital to Bursa Malaysia Securities Berhad under their listing requirements. Next, the sustainability performance on their project cannot be determined to achieve the key performance indicators (KPI) satisfaction from Government, stakeholder or any responsible agencies. This study presents an exhaustive review of these studies and suggests a direction for future developments. Sustainability Assessment framework or self-assessment is decidedly as a significant framework to assist towards sustainability reporting and to produce a Sustainability index for Hydropower sector using a mathematical model study. The results reveal that, the quantitative measurement from Sustainability Assessment framework to Systematic Sustainability Asssesment tool can be produce. In doing so, it is possible to improve the performance of the project especially in hydropower planner.

Evaluation of Course-Specific Self-Efficacy Assessment Methods.

ERIC Educational Resources Information Center

Bong, Mimi

A study was conducted to compare three methods of assessing course-level self-efficacy beliefs within a multitrait multimethod (MTMM) framework. The methods involved: (1) successfully performing a number of domain-related tasks; (2) obtaining specific letter grades in the course; and (3) successfully performing generic academic tasks in the…

Workplace-Based Assessment: Raters' Performance Theories and Constructs

ERIC Educational Resources Information Center

Govaerts, M. J. B.; Van de Wiel, M. W. J.; Schuwirth, L. W. T.; Van der Vleuten, C. P. M.; Muijtjens, A. M. M.

2013-01-01

Weaknesses in the nature of rater judgments are generally considered to compromise the utility of workplace-based assessment (WBA). In order to gain insight into the underpinnings of rater behaviours, we investigated how raters form impressions of and make judgments on trainee performance. Using theoretical frameworks of social cognition and…

Development of Performance Assessments in Science: Conceptual, Practical, and Logistical Issues.

ERIC Educational Resources Information Center

Solano-Flores, Guillermo; Shavelson, Richard J.

1997-01-01

Conceptual, practical, and logistical issues in the development of science performance assessments (SPAs) are discussed. The conceptual framework identifies task, response format, and scoring system as components, and conceives of SPAs as tasks that attempt to recreate conditions in which scientists work. Developing SPAs is a sophisticated effort…

A framework for in vitro systems toxicology assessment of e-liquids

PubMed Central

Iskandar, Anita R.; Gonzalez-Suarez, Ignacio; Majeed, Shoaib; Marescotti, Diego; Sewer, Alain; Xiang, Yang; Leroy, Patrice; Guedj, Emmanuel; Mathis, Carole; Schaller, Jean-Pierre; Vanscheeuwijck, Patrick; Frentzel, Stefan; Martin, Florian; Ivanov, Nikolai V.; Peitsch, Manuel C.; Hoeng, Julia

2016-01-01

Abstract Various electronic nicotine delivery systems (ENDS), of which electronic cigarettes (e-cigs) are the most recognized prototype, have been quickly gaining ground on conventional cigarettes because they are perceived as less harmful. Research assessing the potential effects of ENDS exposure in humans is currently limited and inconclusive. New products are emerging with numerous variations in designs and performance parameters within and across brands. Acknowledging these challenges, we present here a proposed framework for an in vitro systems toxicology assessment of e-liquids and their aerosols, intended to complement the battery of assays for standard toxicity assessments. The proposed framework utilizes high-throughput toxicity assessments of e-liquids and their aerosols, in which the device-to-device variability is minimized, and a systems-level investigation of the cellular mechanisms of toxicity is an integral part. An analytical chemistry investigation is also included as a part of the framework to provide accurate and reliable chemistry data solidifying the toxicological assessment. In its simplest form, the framework comprises of three main layers: (1) high-throughput toxicity screening of e-liquids using primary human cell culture systems; (2) toxicity-related mechanistic assessment of selected e-liquids, and (3) toxicity-related mechanistic assessment of their aerosols using organotypic air–liquid interface airway culture systems. A systems toxicology assessment approach is leveraged to enable in-depth analyses of the toxicity-related cellular mechanisms of e-liquids and their aerosols. We present example use cases to demonstrate the suitability of the framework for a robust in vitro assessment of e-liquids and their aerosols. PMID:27117495

A framework for in vitro systems toxicology assessment of e-liquids.

PubMed

Iskandar, Anita R; Gonzalez-Suarez, Ignacio; Majeed, Shoaib; Marescotti, Diego; Sewer, Alain; Xiang, Yang; Leroy, Patrice; Guedj, Emmanuel; Mathis, Carole; Schaller, Jean-Pierre; Vanscheeuwijck, Patrick; Frentzel, Stefan; Martin, Florian; Ivanov, Nikolai V; Peitsch, Manuel C; Hoeng, Julia

2016-07-01

Various electronic nicotine delivery systems (ENDS), of which electronic cigarettes (e-cigs) are the most recognized prototype, have been quickly gaining ground on conventional cigarettes because they are perceived as less harmful. Research assessing the potential effects of ENDS exposure in humans is currently limited and inconclusive. New products are emerging with numerous variations in designs and performance parameters within and across brands. Acknowledging these challenges, we present here a proposed framework for an in vitro systems toxicology assessment of e-liquids and their aerosols, intended to complement the battery of assays for standard toxicity assessments. The proposed framework utilizes high-throughput toxicity assessments of e-liquids and their aerosols, in which the device-to-device variability is minimized, and a systems-level investigation of the cellular mechanisms of toxicity is an integral part. An analytical chemistry investigation is also included as a part of the framework to provide accurate and reliable chemistry data solidifying the toxicological assessment. In its simplest form, the framework comprises of three main layers: (1) high-throughput toxicity screening of e-liquids using primary human cell culture systems; (2) toxicity-related mechanistic assessment of selected e-liquids, and (3) toxicity-related mechanistic assessment of their aerosols using organotypic air-liquid interface airway culture systems. A systems toxicology assessment approach is leveraged to enable in-depth analyses of the toxicity-related cellular mechanisms of e-liquids and their aerosols. We present example use cases to demonstrate the suitability of the framework for a robust in vitro assessment of e-liquids and their aerosols.

Identifying Key Features of Student Performance in Educational Video Games and Simulations through Cluster Analysis

ERIC Educational Resources Information Center

Kerr, Deirdre; Chung, Gregory K. W. K.

2012-01-01

The assessment cycle of "evidence-centered design" (ECD) provides a framework for treating an educational video game or simulation as an assessment. One of the main steps in the assessment cycle of ECD is the identification of the key features of student performance. While this process is relatively simple for multiple choice tests, when…

Science at Age 13. Assessment of Performance Unit. Science Report for Teachers: 3.

ERIC Educational Resources Information Center

Murphy, Patricia; Schofield, Beta

This report presents some of the results of two national surveys which assessed the performance of 13-year-old students in science. It includes an outline of the assessment framework; some of the questions which were written to match it; a description of how well, and how differently, students responded to the questions; and suggests how the…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ehlen, Mark Andrew; Vugrin, Eric D.; Warren, Drake E.

In recent years, the nation has recognized that critical infrastructure protection should consider not only the prevention of disruptive events, but also the processes that infrastructure systems undergo to maintain functionality following disruptions. This more comprehensive approach has been termed critical infrastructure resilience (CIR). Given the occurrence of a particular disruptive event, the resilience of a system to that event is the system's ability to efficiently reduce both the magnitude and duration of the deviation from targeted system performance levels. Sandia National Laboratories (Sandia) has developed a comprehensive resilience assessment framework for evaluating the resilience of infrastructure and economic systems.more » The framework includes a quantitative methodology that measures resilience costs that result from a disruption to infrastructure function. The framework also includes a qualitative analysis methodology that assesses system characteristics that affect resilience in order to provide insight and direction for potential improvements to resilience. This paper describes the resilience assessment framework. This paper further demonstrates the utility of the assessment framework through application to a hypothetical scenario involving the disruption of a petrochemical supply chain by a hurricane.« less

Framework for the Parametric System Modeling of Space Exploration Architectures

NASA Technical Reports Server (NTRS)

Komar, David R.; Hoffman, Jim; Olds, Aaron D.; Seal, Mike D., II

2008-01-01

This paper presents a methodology for performing architecture definition and assessment prior to, or during, program formulation that utilizes a centralized, integrated architecture modeling framework operated by a small, core team of general space architects. This framework, known as the Exploration Architecture Model for IN-space and Earth-to-orbit (EXAMINE), enables: 1) a significantly larger fraction of an architecture trade space to be assessed in a given study timeframe; and 2) the complex element-to-element and element-to-system relationships to be quantitatively explored earlier in the design process. Discussion of the methodology advantages and disadvantages with respect to the distributed study team approach typically used within NASA to perform architecture studies is presented along with an overview of EXAMINE s functional components and tools. An example Mars transportation system architecture model is used to demonstrate EXAMINE s capabilities in this paper. However, the framework is generally applicable for exploration architecture modeling with destinations to any celestial body in the solar system.

NASA's NPOESS Preparatory Project Science Data Segment: A Framework for Measurement-based Earth Science Data Systems

NASA Technical Reports Server (NTRS)

Schwaller, Mathew R.; Schweiss, Robert J.

2007-01-01

The NPOESS Preparatory Project (NPP) Science Data Segment (SDS) provides a framework for the future of NASA s distributed Earth science data systems. The NPP SDS performs research and data product assessment while using a fully distributed architecture. The components of this architecture are organized around key environmental data disciplines: land, ocean, ozone, atmospheric sounding, and atmospheric composition. The SDS thus establishes a set of concepts and a working prototypes. This paper describes the framework used by the NPP Project as it enabled Measurement-Based Earth Science Data Systems for the assessment of NPP products.

Developing a Framework for Classroom Lesson Delivery to Improve English Teachers' Performance in the Foundation Year Programme at a Saudi University

ERIC Educational Resources Information Center

Aburizaizah, Saeed J.

2014-01-01

The current English programme provided to foundation year students at King Abdulaziz University is failing to equip learners with the desired level of English language. This paper assesses the teaching materials and proposes a teaching framework to improve teachers' lesson delivery. The framework was designed to overcome some of the shortfalls in…

A Computational Framework for Efficient Low Temperature Plasma Simulations

NASA Astrophysics Data System (ADS)

Verma, Abhishek Kumar; Venkattraman, Ayyaswamy

2016-10-01

Over the past years, scientific computing has emerged as an essential tool for the investigation and prediction of low temperature plasmas (LTP) applications which includes electronics, nanomaterial synthesis, metamaterials etc. To further explore the LTP behavior with greater fidelity, we present a computational toolbox developed to perform LTP simulations. This framework will allow us to enhance our understanding of multiscale plasma phenomenon using high performance computing tools mainly based on OpenFOAM FVM distribution. Although aimed at microplasma simulations, the modular framework is able to perform multiscale, multiphysics simulations of physical systems comprises of LTP. Some salient introductory features are capability to perform parallel, 3D simulations of LTP applications on unstructured meshes. Performance of the solver is tested based on numerical results assessing accuracy and efficiency of benchmarks for problems in microdischarge devices. Numerical simulation of microplasma reactor at atmospheric pressure with hemispherical dielectric coated electrodes will be discussed and hence, provide an overview of applicability and future scope of this framework.

Towards actionable international comparisons of health system performance: expert revision of the OECD framework and quality indicators.

PubMed

Carinci, F; Van Gool, K; Mainz, J; Veillard, J; Pichora, E C; Januel, J M; Arispe, I; Kim, S M; Klazinga, N S

2015-04-01

To review and update the conceptual framework, indicator content and research priorities of the Organisation for Economic Cooperation and Development's (OECD) Health Care Quality Indicators (HCQI) project, after a decade of collaborative work. A structured assessment was carried out using a modified Delphi approach, followed by a consensus meeting, to assess the suite of HCQI for international comparisons, agree on revisions to the original framework and set priorities for research and development. International group of countries participating to OECD projects. Members of the OECD HCQI expert group. A reference matrix, based on a revised performance framework, was used to map and assess all seventy HCQI routinely calculated by the OECD expert group. A total of 21 indicators were agreed to be excluded, due to the following concerns: (i) relevance, (ii) international comparability, particularly where heterogeneous coding practices might induce bias, (iii) feasibility, when the number of countries able to report was limited and the added value did not justify sustained effort and (iv) actionability, for indicators that were unlikely to improve on the basis of targeted policy interventions. The revised OECD framework for HCQI represents a new milestone of a long-standing international collaboration among a group of countries committed to building common ground for performance measurement. The expert group believes that the continuation of this work is paramount to provide decision makers with a validated toolbox to directly act on quality improvement strategies. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

FRAMEWORK FOR RESPONSIBLE ENVIRONMENTAL DECISION-MAKING (FRED): USING LIFE CYCLE ASSESSMENT TO EVALUATE PREFERABILITY OF PRODUCTS

EPA Science Inventory

Framework for Responsible Environmental Decision-Making (FRED) demonstrates how the life-cycle concept can be used to quantify competing products' environmental performance so that this information may be integrated with considerations of total ownership cost and technical perfor...

Student Engagement: A Framework for On-Demand Performance Assessment Tasks

ERIC Educational Resources Information Center

Taylor, Catherine; Kokka, Kari; Darling-Hammond, Linda; Dieckmann, Jack; Pacheco, Vivian Santana; Sandler, Susan; Bae, Soung

2016-01-01

Engaging students in meaningful applications of their knowledge is a key aspect of both addressing the standards and providing greater access. Not only do the standards emphasize the importance of meaningful engagement in real-world tasks, but evidence shows that engagement is strongly related to student performance on assessment tasks, especially…

A Conceptual Framework for Assessing Performance in Games and Simulations. CRESST Report 771

ERIC Educational Resources Information Center

Koenig, Alan D.; Lee, John J.; Iseli, Markus; Wainess, Richard

2010-01-01

The military's need for high-fidelity games and simulations is substantial, as these environments can be valuable for demonstration of essential knowledge, skills, and abilities required in complex tasks. However assessing performance in these settings can be difficult--particularly in non-linear simulations where more than one pathway to success…

Developing an SSAC Self-Assessment Tool for Operators and Regulators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Frazar, Sarah L.; Innes-Jones, Gemma; Hamilton, Ian

Enabling an SSAC to understand why it is performing inefficiently can help it allocate resources more effectively to better support IAEA safeguards implementation. In collaboration with international consulting firm, Environmental Resources Management (ERM) and a U.S. based nuclear fuel cycle facility, the Pacific Northwest National Laboratory (PNNL) has been developing a framework for a future self-assessment tool for nuclear operators and regulators. This paper will describe the effort to date, with particular emphasis on the steps the team took to align the framework with relevant IAEA self-assessment tools.

Performance Prediction and Validation: Data, Frameworks, and Considerations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tinnesand, Heidi

2017-05-19

Improving the predictability and reliability of wind power generation and operations will reduce costs and potentially establish a framework to attract new capital into the distributed wind sector, a key cost reduction requirement highlighted in results from the distributed wind future market assessment conducted with dWind. Quantifying and refining the accuracy of project performance estimates will also directly address several of the key challenges identified by industry stakeholders in 2015 as part of the distributed wind resource assessment workshop and be cross-cutting for several other facets of the distributed wind portfolio. This presentation covers the efforts undertaken in 2016 tomore » address these topics.« less

Assessing health system performance in developing countries: a review of the literature.

PubMed

Kruk, Margaret Elizabeth; Freedman, Lynn P

2008-03-01

With the setting of ambitious international health goals and an influx of additional development assistance for health, there is growing interest in assessing the performance of health systems in developing countries. This paper proposes a framework for the assessment of health system performance and reviews the literature on indicators currently in use to measure performance using online medical and public health databases. This was complemented by a review of relevant books and reports in the grey literature. The indicators were organized into three categories: effectiveness, equity, and efficiency. Measures of health system effectiveness were improvement in health status, access to and quality of care and, increasingly, patient satisfaction. Measures of equity included access and quality of care for disadvantaged groups together with fair financing, risk protection and accountability. Measures of efficiency were appropriate levels of funding, the cost-effectiveness of interventions, and effective administration. This framework and review of indicators may be helpful to health policy makers interested in assessing the effects of different policies, expenditures, and organizational structures on health outputs and outcomes in developing countries.

Trial Implementation of a Multihazard Risk Assessment Framework for High-Impact Low-Frequency Power Grid Events

DOE Office of Scientific and Technical Information (OSTI.GOV)

Veeramany, Arun; Coles, Garill A.; Unwin, Stephen D.

The Pacific Northwest National Laboratory developed a risk framework for modeling high-impact, low-frequency power grid events to support risk-informed decisions. In this paper, we briefly recap the framework and demonstrate its implementation for seismic and geomagnetic hazards using a benchmark reliability test system. We describe integration of a collection of models implemented to perform hazard analysis, fragility evaluation, consequence estimation, and postevent restoration. We demonstrate the value of the framework as a multihazard power grid risk assessment and management tool. As a result, the research will benefit transmission planners and emergency planners by improving their ability to maintain a resilientmore » grid infrastructure against impacts from major events.« less

Trial Implementation of a Multihazard Risk Assessment Framework for High-Impact Low-Frequency Power Grid Events

DOE PAGES

Veeramany, Arun; Coles, Garill A.; Unwin, Stephen D.; ...

2017-08-25

The Pacific Northwest National Laboratory developed a risk framework for modeling high-impact, low-frequency power grid events to support risk-informed decisions. In this paper, we briefly recap the framework and demonstrate its implementation for seismic and geomagnetic hazards using a benchmark reliability test system. We describe integration of a collection of models implemented to perform hazard analysis, fragility evaluation, consequence estimation, and postevent restoration. We demonstrate the value of the framework as a multihazard power grid risk assessment and management tool. As a result, the research will benefit transmission planners and emergency planners by improving their ability to maintain a resilientmore » grid infrastructure against impacts from major events.« less

Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?

ERIC Educational Resources Information Center

Beggrow, Elizabeth P.; Ha, Minsu; Nehm, Ross H.; Pearl, Dennis; Boone, William J.

2014-01-01

The landscape of science education is being transformed by the new "Framework for Science Education" (National Research Council, "A framework for K-12 science education: practices, crosscutting concepts, and core ideas." The National Academies Press, Washington, DC, 2012), which emphasizes the centrality of scientific…

The APU and Assessment in the Middle Years.

ERIC Educational Resources Information Center

Marjoram, D. T. E.

1978-01-01

Because of student characteristics in the middle years, several types of assessment are needed. The national monitoring system being developed by the Assessment of Performance Unit (APU) may prove a useful assessment framework for individual schools, providing developmental data for program comparisons and student movement between schools. (SJL)

Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection.

PubMed

Veillard, Jeremy; Cowling, Krycia; Bitton, Asaf; Ratcliffe, Hannah; Kimball, Meredith; Barkley, Shannon; Mercereau, Laure; Wong, Ethan; Taylor, Chelsea; Hirschhorn, Lisa R; Wang, Hong

2017-12-01

Policy Points: Strengthening accountability through better measurement and reporting is vital to ensure progress in improving quality primary health care (PHC) systems and achieving universal health coverage (UHC). The Primary Health Care Performance Initiative (PHCPI) provides national decision makers and global stakeholders with opportunities to benchmark and accelerate performance improvement through better performance measurement. Results from the initial PHC performance assessments in low- and middle-income countries (LMICs) are helping guide PHC reforms and investments and improve the PHCPI's instruments and indicators. Findings from future assessment activities will further amplify cross-country comparisons and peer learning to improve PHC. New indicators and sources of data are needed to better understand PHC system performance in LMICs. The Primary Health Care Performance Initiative (PHCPI), a collaboration between the Bill and Melinda Gates Foundation, The World Bank, and the World Health Organization, in partnership with Ariadne Labs and Results for Development, was launched in 2015 with the aim of catalyzing improvements in primary health care (PHC) systems in 135 low- and middle-income countries (LMICs), in order to accelerate progress toward universal health coverage. Through more comprehensive and actionable measurement of quality PHC, the PHCPI stimulates peer learning among LMICs and informs decision makers to guide PHC investments and reforms. Instruments for performance assessment and improvement are in development; to date, a conceptual framework and 2 sets of performance indicators have been released. The PHCPI team developed the conceptual framework through literature reviews and consultations with an advisory committee of international experts. We generated 2 sets of performance indicators selected from a literature review of relevant indicators, cross-referenced against indicators available from international sources, and evaluated through 2 separate modified Delphi processes, consisting of online surveys and in-person facilitated discussions with experts. The PHCPI conceptual framework builds on the current understanding of PHC system performance through an expanded emphasis on the role of service delivery. The first set of performance indicators, 36 Vital Signs, facilitates comparisons across countries and over time. The second set, 56 Diagnostic Indicators, elucidates underlying drivers of performance. Key challenges include a lack of available data for several indicators and a lack of validated indicators for important dimensions of quality PHC. The availability of data is critical to assessing PHC performance, particularly patient experience and quality of care. The PHCPI will continue to develop and test additional performance assessment instruments, including composite indices and national performance dashboards. Through country engagement, the PHCPI will further refine its instruments and engage with governments to better design and finance primary health care reforms. © 2017 Milbank Memorial Fund.

[Development of a Conceptual Framework for the Assessment of Chronic Care in the Spanish National Health System].

PubMed

Espallargues, Mireia; Serra-Sutton, Vicky; Solans-Domènech, Maite; Torrente, Elena; Moharra, Montse; Benítez, Dolors; Robles, Noemí; Domíngo, Laia; Escarrabill Sanglas, Joan

2016-07-07

The aim was to develop a conceptual framework for the assessment of new healthcare initiatives on chronic diseases within the Spanish National Health System. A comprehensive literature review between 2002 and 2013, including systematic reviews, meta-analysis, and reports with evaluation frameworks and/or assessment of initiatives was carried out; integrated care initiatives established in Catalonia were studied and described; and semistructured interviews with key stakeholders were performed. The scope and conceptual framework were defined by using the brainstorming approach.Of 910 abstracts identified, a total of 116 studies were included. They referred to several conceptual frameworks and/or assessment indicators at a national and international level. An overall of 24 established chronic care initiatives were identified (9 integrated care initiatives); 10 in-depth interviews were carried out. The proposed conceptual framework envisages: 1)the target population according to complexity levels; 2)an evaluation approach of the structure, processes, and outcomes considering the health status achieved, the recovery process and the maintenance of health; and 3)the dimensions or attributes to be assessed. The proposed conceptual framework will be helpful has been useful to develop indicators and implement them with a community-based and result-oriented approach and a territorial or population-based perspective within the Spanish Health System. This will be essential to know which are the most effective strategies, what are the key elements that determine greater success and what are the groups of patients who can most benefit.

Assessing performance of Botswana’s public hospital system: the use of the World Health Organization Health System Performance Assessment Framework

PubMed Central

Seitio-Kgokgwe, Onalenna; Gauld, Robin DC; Hill, Philip C; Barnett, Pauline

2014-01-01

Background: Very few studies have assessed performance of Botswana public hospitals. We draw from a large research study assessing performance of the Botswana Ministry of Health (MoH) to evaluate the performance of public hospital system using the World Health Organization Health Systems Performance Assessment Framework (WHO HSPAF). We aimed to evaluate performance of Botswana public hospital system; relate findings of the assessment to the potential for improvements in hospital performance; and determine the usefulness of the WHO HSPAF in assessing performance of hospital systems in a developing country. Methods: This article is based on data collected from document analysis, 54 key informants comprising senior managers and staff of the MoH (N= 40) and senior officers from stakeholder organizations (N= 14), and surveys of 42 hospital managers and 389 health workers. Data from documents and transcripts were analyzed using content and thematic analysis while data analysis for surveys was descriptive determining proportions and percentages. Results: The organizational structure of the Botswana’s public hospital system, authority and decision-making are highly centralized. Overall physical access to health services is high. However, challenges in the distribution of facilities and inpatient beds create inequities and inefficiencies. Capacity of the hospitals to deliver services is limited by inadequate resources. There are significant challenges with the quality of care. Conclusion: While Botswana invested considerably in building hospitals around the country resulting in high physical access to services, the organization and governance of the hospital system, and inadequate resources limit service delivery. The ongoing efforts to decentralize management of hospitals to district level entities should be expedited. The WHO HSPAF enabled us to conduct a comprehensive assessment of the public hospital system. Though relatively new, this approach proved useful in this study. PMID:25279380

Perceived Utility of the RE-AIM Framework for Health Promotion/Disease Prevention Initiatives for Older Adults: A Case Study from the U.S. Evidence-Based Disease Prevention Initiative

PubMed Central

Ory, Marcia G.; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee

2015-01-01

Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance. PMID:25964897

Performance assessment of human resource by integration of HSE and ergonomics and EFQM management system.

PubMed

Sadegh Amalnick, Mohsen; Zarrin, Mansour

2017-03-13

Purpose The purpose of this paper is to present an integrated framework for performance evaluation and analysis of human resource (HR) with respect to the factors of health, safety, environment and ergonomics (HSEE) management system, and also the criteria of European federation for quality management (EFQM) as one of the well-known business excellence models. Design/methodology/approach In this study, an intelligent algorithm based on adaptive neuro-fuzzy inference system (ANFIS) along with fuzzy data envelopment analysis (FDEA) are developed and employed to assess the performance of the company. Furthermore, the impact of the factors on the company's performance as well as their strengths and weaknesses are identified by conducting a sensitivity analysis on the results. Similarly, a design of experiment is performed to prioritize the factors in the order of importance. Findings The results show that EFQM model has a far greater impact upon the company's performance than HSEE management system. According to the obtained results, it can be argued that integration of HSEE and EFQM leads to the performance improvement in the company. Practical implications In current study, the required data for executing the proposed framework are collected via valid questionnaires which are filled in by the staff of an aviation industry located in Tehran, Iran. Originality/value Managing HR performance results in improving usability, maintainability and reliability and finally in a significant reduction in the commercial aviation accident rate. Also, study of factors affecting HR performance authorities participate in developing systems in order to help operators better manage human error. This paper for the first time presents an intelligent framework based on ANFIS, FDEA and statistical tests for HR performance assessment and analysis with the ability of handling uncertainty and vagueness existing in real world environment.

An integrated environmental modeling framework for performing Quantitative Microbial Risk Assessments

EPA Science Inventory

Standardized methods are often used to assess the likelihood of a human-health effect from exposure to a specified hazard, and inform opinions and decisions about risk management and communication. A Quantitative Microbial Risk Assessment (QMRA) is specifically adapted to detail ...

Automatic Human Movement Assessment With Switching Linear Dynamic System: Motion Segmentation and Motor Performance.

PubMed

de Souza Baptista, Roberto; Bo, Antonio P L; Hayashibe, Mitsuhiro

2017-06-01

Performance assessment of human movement is critical in diagnosis and motor-control rehabilitation. Recent developments in portable sensor technology enable clinicians to measure spatiotemporal aspects to aid in the neurological assessment. However, the extraction of quantitative information from such measurements is usually done manually through visual inspection. This paper presents a novel framework for automatic human movement assessment that executes segmentation and motor performance parameter extraction in time-series of measurements from a sequence of human movements. We use the elements of a Switching Linear Dynamic System model as building blocks to translate formal definitions and procedures from human movement analysis. Our approach provides a method for users with no expertise in signal processing to create models for movements using labeled dataset and later use it for automatic assessment. We validated our framework on preliminary tests involving six healthy adult subjects that executed common movements in functional tests and rehabilitation exercise sessions, such as sit-to-stand and lateral elevation of the arms and five elderly subjects, two of which with limited mobility, that executed the sit-to-stand movement. The proposed method worked on random motion sequences for the dual purpose of movement segmentation (accuracy of 72%-100%) and motor performance assessment (mean error of 0%-12%).

Cognitive Readiness Assessment and Reporting: An Open Source Mobile Framework for Operational Decision Support and Performance Improvement

ERIC Educational Resources Information Center

Heric, Matthew; Carter, Jenn

2011-01-01

Cognitive readiness (CR) and performance for operational time-critical environments are continuing points of focus for military and academic communities. In response to this need, we designed an open source interactive CR assessment application as a highly adaptive and efficient open source testing administration and analysis tool. It is capable…

Performance-based classrooms: A case study of two elementary teachers of mathematics and science

NASA Astrophysics Data System (ADS)

Jones, Kenneth W.

This case study depicts how two elementary teachers develop classrooms devoted to performance-based instruction in mathematics and science. The purpose is to develop empirical evidence of classroom practices that leads to a conceptual framework about the nature of performance-based instruction. Performance-based assessment and instruction are defined from the literature to entail involving students in tasks that are complex and engaging, requiring them to apply knowledge and skills in authentic contexts. In elementary mathematics and science, such an approach emphasizes problem solving, exploration, inquiry, and reasoning. The body of the work examines teacher beliefs, curricular orientations, instructional strategies, assessment approaches, management and organizational skills, and interpersonal relationships. The focus throughout is on those aspects that foster student performance in elementary mathematics and science. The resulting framework describes five characteristics that contribute to performance-based classrooms: a caring classroom community, a connectionist learning theory, a thinking and doing curriculum, diverse opportunities for learning, and ongoing assessment, feedback, and adjustment. The conclusion analyzes factors external to the classroom that support or constrain the development of performance-based classrooms and discusses the implications for educational policy and further research.

ORD Human Health Risk Assessment (HHRA) Research Program Mid-Cycle Progress Report and Review - 2010

EPA Pesticide Factsheets

The principal charge to the BOSC reviewers was to evaluate ORD’s HHRA Program from a program assessment framework relative to program relevance, structure, performance, quality, leadership, communication, and outcomes.

Gathering Validity Evidence for Surgical Simulation: A Systematic Review.

PubMed

Borgersen, Nanna Jo; Naur, Therese M H; Sørensen, Stine M D; Bjerrum, Flemming; Konge, Lars; Subhi, Yousif; Thomsen, Ann Sofia S

2018-06-01

To identify current trends in the use of validity frameworks in surgical simulation, to provide an overview of the evidence behind the assessment of technical skills in all surgical specialties, and to present recommendations and guidelines for future validity studies. Validity evidence for assessment tools used in the evaluation of surgical performance is of paramount importance to ensure valid and reliable assessment of skills. We systematically reviewed the literature by searching 5 databases (PubMed, EMBASE, Web of Science, PsycINFO, and the Cochrane Library) for studies published from January 1, 2008, to July 10, 2017. We included original studies evaluating simulation-based assessments of health professionals in surgical specialties and extracted data on surgical specialty, simulator modality, participant characteristics, and the validity framework used. Data were synthesized qualitatively. We identified 498 studies with a total of 18,312 participants. Publications involving validity assessments in surgical simulation more than doubled from 2008 to 2010 (∼30 studies/year) to 2014 to 2016 (∼70 to 90 studies/year). Only 6.6% of the studies used the recommended contemporary validity framework (Messick). The majority of studies used outdated frameworks such as face validity. Significant differences were identified across surgical specialties. The evaluated assessment tools were mostly inanimate or virtual reality simulation models. An increasing number of studies have gathered validity evidence for simulation-based assessments in surgical specialties, but the use of outdated frameworks remains common. To address the current practice, this paper presents guidelines on how to use the contemporary validity framework when designing validity studies.

The Utility of Curriculum-Based Measurement within a Multitiered Framework: Establishing Cut Scores as Predictors of Student Performance on the Alaska Standards-Based Assessment

ERIC Educational Resources Information Center

Legg, David E.

2013-01-01

The purpose of this study was to explore the relationship between student performance on Reading Curriculum-based Measures (R-CBM) and student performance on the Alaska's standards based assessment (SBA) administered to students in Studied School District (SSD) Grade 3 through Grade 5 students in the Studied School District as required by…

An integrated environmental modeling framework for performing quantitative microbial risk assessments

USDA-ARS?s Scientific Manuscript database

Standardized methods are often used to assess the likelihood of a human-health effect from exposure to a specified hazard, and inform opinions and decisions about risk management and communication. A Quantitative Microbial Risk Assessment (QMRA) is specifically adapted to detail potential human-heal...

A conceptual framework for evaluation of public health and primary care system performance in iran.

PubMed

Jahanmehr, Nader; Rashidian, Arash; Khosravi, Ardeshir; Farzadfar, Farshad; Shariati, Mohammad; Majdzadeh, Reza; Akbari Sari, Ali; Mesdaghinia, Alireza

2015-01-26

The main objective of this study was to design a conceptual framework, according to the policies and priorities of the ministry of health to evaluate provincial public health and primary care performance and to assess their share in the overall health impacts of the community. We used several tools and techniques, including system thinking, literature review to identify relevant attributes of health system performance framework and interview with the key stakeholders. The PubMed, Scopus, web of science, Google Scholar and two specialized databases of Persian language literature (IranMedex and SID) were searched using main terms and keywords. Following decision-making and collective agreement among the different stakeholders, 51 core indicators were chosen from among 602 obtained indicators in a four stage process, for monitoring and evaluation of Health Deputies. We proposed a conceptual framework by identifying the performance area for Health Deputies between other determinants of health, as well as introducing a chain of results, for performance, consisting of Input, Process, Output and Outcome indicators. We also proposed 5 dimensions for measuring the performance of Health Deputies, consisting of efficiency, effectiveness, equity, access and improvement of health status. The proposed Conceptual Framework illustrates clearly the Health Deputies success in achieving best results and consequences of health in the country. Having the relative commitment of the ministry of health and Health Deputies at the University of Medical Sciences is essential for full implementation of this framework and providing the annual performance report.

Capitalizing on Curriculum-Based Measurement for Reading: Collaboration within a Response to Instruction Framework

ERIC Educational Resources Information Center

Weiss, Stacy L.; Friesen, Amber

2014-01-01

Response to Instruction (RTI) frameworks provide a structure for assessing student progress and evaluating the effectiveness of reading interventions. Schools frequently use RTI to support students who are struggling with learning to read while utilizing curriculum-based measurement (CBM) to monitor performance and guide instructional decisions…

Scientific method, adversarial system, and technology assessment

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1975-01-01

A basic framework is provided for the consideration of the purposes and techniques of scientific method and adversarial systems. Similarities and differences in these two techniques of inquiry are considered with reference to their relevance in the performance of assessments.

Assessment and self-assessment of the pharmacists' competencies using the global competency framework (GbCF) in Serbia.

PubMed

Stojkov, Svetlana; Tadić, Ivana; Crnjanski, Tatjana; Krajnović, Dušanka

2016-09-01

Pharmacists' competence represents a dynamic framework of knowledge, skills and abilities to carry out tasks, and it reflects on improving the quality of life and on patients’ health. One of the documents for the Evaluation and Competency Development of Pharmacists is the Global Competency Framework (GbCF). The aim of this study was to implement the GBCF document into Serbian pharmacies, to perform assessment and self assessment of the competencies. The assessment and self-assessment of pharmacists’ competencies were performed during the period 2012−13 year in eight community pharmacy chains, in seven cities in Serbia. For assessment and self-assessment of pharmacists competencies the GbCF model was applied, which was adjusted to pharmaceutical practice and legislation in Serbia. External assessment was conducted by teams of pharmacists using the structured observation of the work of pharmacists during regular working hours. Evaluated pharmacists filled out the questionnaire about demographic indicators about the pharmacist and the pharmacy where they work. A total of 123 pharmacists were evaluated. Pharmacists’ Professional Competency Cluster (KK1) had the lowest score (average value 2.98), while the cluster Management and Organizational Competency (KK2) had the highest score (average value 3.15). The competence Recognition of the Diagnosis and Patient Counseling (K8), which belonged to the cluster KK1, had the lowest score (average value for assessment and self-assessment were 2.09, and 2.34, respectively) among the all evaluated competencies. GbCF might be considered as an instrument for the competencies' evaluation/selfevaluation and their improvement, accordingly.

A Balanced Scorecard Approach to Public Relations Management Assessment.

ERIC Educational Resources Information Center

Fleisher, Craig S.; Mahaffy, Darren

1997-01-01

Describes a new managerial approach to assessing public relations/communications (PR/C) performance using a "balanced scorecard." Reviews the current state of PR/C management assessment; illustrates the balanced scorecard framework; highlights its strengths and weaknesses; describes the process of applying the scorecard to PR/C units;…

Formative Assessment in Dance Education

ERIC Educational Resources Information Center

Andrade, Heidi; Lui, Angela; Palma, Maria; Hefferen, Joanna

2015-01-01

Feedback is crucial to students' growth as dancers. When used within the framework of formative assessment, or assessment for learning, feedback results in actionable next steps that dancers can use to improve their performances. This article showcases the work of two dance specialists, one elementary and one middle school teacher, who have…

A Systems Framework for Assessing Plumbing Products-Related Water Conservation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Williams, Alison; Dunham Whitehead, Camilla; Lutz, James

2011-12-02

Reducing the water use of plumbing products—toilets, urinals, faucets, and showerheads —has been a popular conservation measure. Improved technologies have created opportunities for additional conservation in this area. However, plumbing products do not operate in a vacuum. This paper reviews the literature related to plumbing products to determine a systems framework for evaluating future conservation measures using these products. The main framework comprises the following categories: water use efficiency, product components, product performance, source water, energy, and plumbing/sewer infrastructure. This framework for analysis provides a starting point for professionals considering future water conservation measures to evaluate the need for additionalmore » research, collaboration with other standards or codes committees, and attachment of additional metrics to water use efficiency (such as performance).« less

Storying Teacher Education Policy: Critical Counternarratives of Curricular, Pedagogical, and Activist Responses to State-Mandated Teacher Performance Assessments

ERIC Educational Resources Information Center

Henning, Nick; Dover, Alison; Dotson, Erica K.; Agarwal-Rangath, Ruchi

2018-01-01

The rise of high-stakes, standardized, teacher performance assessments (TPAs) is central to the industry being created out of the regulation, policing, and evaluation of university-based teacher education In addition to reinforcing a narrow and counter-critical framework, TPAs can shift responsibility for the evaluation of teacher candidates from…

Spatial rule-based assessment of habitat potential to predict impact of land use changes on biodiversity at municipal scale.

PubMed

Scolozzi, Rocco; Geneletti, Davide

2011-03-01

In human dominated landscapes, ecosystems are under increasing pressures caused by urbanization and infrastructure development. In Alpine valleys remnant natural areas are increasingly affected by habitat fragmentation and loss. In these contexts, there is a growing risk of local extinction for wildlife populations; hence assessing the consequences on biodiversity of proposed land use changes is extremely important. The article presents a methodology to assess the impacts of land use changes on target species at a local scale. The approach relies on the application of ecological profiles of target species for habitat potential (HP) assessment, using high resolution GIS-data within a multiple level framework. The HP, in this framework, is based on a species-specific assessment of the suitability of a site, as well of surrounding areas. This assessment is performed through spatial rules, structured as sets of queries on landscape objects. We show that by considering spatial dependencies in habitat assessment it is possible to perform better quantification of impacts of local-level land use changes on habitats.

lazar: a modular predictive toxicology framework

PubMed Central

Maunz, Andreas; Gütlein, Martin; Rautenberg, Micha; Vorgrimmler, David; Gebele, Denis; Helma, Christoph

2013-01-01

lazar (lazy structure–activity relationships) is a modular framework for predictive toxicology. Similar to the read across procedure in toxicological risk assessment, lazar creates local QSAR (quantitative structure–activity relationship) models for each compound to be predicted. Model developers can choose between a large variety of algorithms for descriptor calculation and selection, chemical similarity indices, and model building. This paper presents a high level description of the lazar framework and discusses the performance of example classification and regression models. PMID:23761761

What role does performance information play in securing improvement in healthcare? a conceptual framework for levers of change

PubMed Central

Levesque, Jean-Frederic; Sutherland, Kim

2017-01-01

Objective Across healthcare systems, there is consensus on the need for independent and impartial assessment of performance. There is less agreement about how measurement and reporting performance improves healthcare. This paper draws on academic theories to develop a conceptual framework—one that classifies in an integrated manner the ways in which change can be leveraged by healthcare performance information. Methods A synthesis of published frameworks. Results The framework identifies eight levers for change enabled by performance information, spanning internal and external drivers, and emergent and planned processes: (1) cognitive levers provide awareness and understanding; (2) mimetic levers inform about the performance of others to encourage emulation; (3) supportive levers provide facilitation, implementation tools or models of care to actively support change; (4) formative levers develop capabilities and skills through teaching, mentoring and feedback; (5) normative levers set performance against guidelines, standards, certification and accreditation processes; (6) coercive levers use policies, regulations incentives and disincentives to force change; (7) structural levers modify the physical environment or professional cultures and routines; (8) competitive levers attract patients or funders. Conclusion This framework highlights how performance measurement and reporting can contribute to eight different levers for change. It provides guidance into how to align performance measurement and reporting into quality improvement programme. PMID:28851769

TECHNOLOGY ASSESSMENT IN HOSPITALS: LESSONS LEARNED FROM AN EMPIRICAL EXPERIMENT.

PubMed

Foglia, Emanuela; Lettieri, Emanuele; Ferrario, Lucrezia; Porazzi, Emanuele; Garagiola, Elisabetta; Pagani, Roberta; Bonfanti, Marzia; Lazzarotti, Valentina; Manzini, Raffaella; Masella, Cristina; Croce, Davide

2017-01-01

Hospital Based Health Technology Assessment (HBHTA) practices, to inform decision making at the hospital level, emerged as urgent priority for policy makers, hospital managers, and professionals. The present study crystallized the results achieved by the testing of an original framework for HBHTA, developed within Lombardy Region: the IMPlementation of A Quick hospital-based HTA (IMPAQHTA). The study tested: (i) the HBHTA framework efficiency, (ii) feasibility, (iii) the tool utility and completeness, considering dimensions and sub-dimensions. The IMPAQHTA framework deployed the Regional HTA program, activated in 2008 in Lombardy, at the hospital level. The relevance and feasibility of the framework were tested over a 3-year period through a large-scale empirical experiment, involving seventy-four healthcare professionals organized in different HBHTA teams for assessing thirty-two different technologies within twenty-two different hospitals. Semi-structured interviews and self-reported questionnaires were used to collect data regarding the relevance and feasibility of the IMPAQHTA framework. The proposed HBHTA framework proved to be suitable for application at the hospital level, in the Italian context, permitting a quick assessment (11 working days) and providing hospital decision makers with relevant and quantitative information. Performances in terms of feasibility, utility, completeness, and easiness proved to be satisfactory. The IMPAQHTA was considered to be a complete and feasible HBHTA framework, as well as being replicable to different technologies within any hospital settings, thus demonstrating the capability of a hospital to develop a complete HTA, if supported by adequate and well defined tools and quantitative metrics.

Evaluating the substantive effectiveness of SEA: Towards a better understanding

DOE Office of Scientific and Technical Information (OSTI.GOV)

Doren, D. van; Driessen, P.P.J., E-mail: p.driessen@uu.nl; Schijf, B.

Evaluating the substantive effectiveness of strategic environmental assessment (SEA) is vital in order to know to what extent the tool fulfills its purposes and produces expected results. However, the studies that have evaluated the substantive effectiveness of SEA produce varying outcomes as regards the tool's contribution to decision-making and have used a variety of approaches to appraise its effectiveness. The aim of this article is to discuss the theoretical concept of SEA substantive effectiveness and to present a new approach that can be applied for evaluation studies. The SEA effectiveness evaluation framework that will be presented is composed of conceptsmore » of, and approaches to, SEA effectiveness derived from SEA literature and planning theory. Lessons for evaluation can be learned from planning theory in particular, given its long history of analyzing and understanding how sources of information and decisions affect (subsequent) decision-making. Key concepts of this new approach are 'conformance' and 'performance'. In addition, this article presents a systematic overview of process and context factors that can explain SEA effectiveness, derived from SEA literature. To illustrate the practical value of our framework for the assessment and understanding of substantive effectiveness of SEA, three Dutch SEA case studies are examined. The case studies have confirmed the usefulness of the SEA effectiveness assessment framework. The framework proved helpful in order to describe the cumulative influence of the three SEAs on decision-making and the ultimate plan. - Highlights: Black-Right-Pointing-Pointer A new framework to evaluate the substantive effectiveness of SEA is presented. Black-Right-Pointing-Pointer The framework is based on two key concepts: 'conformance' and 'performance.' Black-Right-Pointing-Pointer The practical applicability of the framework is demonstrated by three Dutch cases. Black-Right-Pointing-Pointer The framework allows for a more systematic understanding of SEA effectiveness. Black-Right-Pointing-Pointer Finally, this paper presents explanations for SEA effectiveness.« less

What role does performance information play in securing improvement in healthcare? a conceptual framework for levers of change.

PubMed

Levesque, Jean-Frederic; Sutherland, Kim

2017-08-28

Across healthcare systems, there is consensus on the need for independent and impartial assessment of performance. There is less agreement about how measurement and reporting performance improves healthcare. This paper draws on academic theories to develop a conceptual framework-one that classifies in an integrated manner the ways in which change can be leveraged by healthcare performance information. A synthesis of published frameworks. The framework identifies eight levers for change enabled by performance information, spanning internal and external drivers, and emergent and planned processes: (1) cognitive levers provide awareness and understanding; (2) mimetic levers inform about the performance of others to encourage emulation; (3) supportive levers provide facilitation, implementation tools or models of care to actively support change; (4) formative levers develop capabilities and skills through teaching, mentoring and feedback; (5) normative levers set performance against guidelines, standards, certification and accreditation processes; (6) coercive levers use policies, regulations incentives and disincentives to force change; (7) structural levers modify the physical environment or professional cultures and routines; (8) competitive levers attract patients or funders. This framework highlights how performance measurement and reporting can contribute to eight different levers for change. It provides guidance into how to align performance measurement and reporting into quality improvement programme. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A knowledge-driven probabilistic framework for the prediction of protein-protein interaction networks.

PubMed

Browne, Fiona; Wang, Haiying; Zheng, Huiru; Azuaje, Francisco

2010-03-01

This study applied a knowledge-driven data integration framework for the inference of protein-protein interactions (PPI). Evidence from diverse genomic features is integrated using a knowledge-driven Bayesian network (KD-BN). Receiver operating characteristic (ROC) curves may not be the optimal assessment method to evaluate a classifier's performance in PPI prediction as the majority of the area under the curve (AUC) may not represent biologically meaningful results. It may be of benefit to interpret the AUC of a partial ROC curve whereby biologically interesting results are represented. Therefore, the novel application of the assessment method referred to as the partial ROC has been employed in this study to assess predictive performance of PPI predictions along with calculating the True positive/false positive rate and true positive/positive rate. By incorporating domain knowledge into the construction of the KD-BN, we demonstrate improvement in predictive performance compared with previous studies based upon the Naive Bayesian approach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

An approach to addressing governance from a health system framework perspective

PubMed Central

2011-01-01

As countries strive to strengthen their health systems in resource constrained contexts, policy makers need to know how best to improve the performance of their health systems. To aid these decisions, health system stewards should have a good understanding of how health systems operate in order to govern them appropriately. While a number of frameworks for assessing governance in the health sector have been proposed, their application is often hindered by unrealistic indicators or they are overly complex resulting in limited empirical work on governance in health systems. This paper reviews contemporary health sector frameworks which have focused on defining and developing indicators to assess governance in the health sector. Based on these, we propose a simplified approach to look at governance within a common health system framework which encourages stewards to take a systematic perspective when assessing governance. Although systems thinking is not unique to health, examples of its application within health systems has been limited. We also provide an example of how this approach could be applied to illuminate areas of governance weaknesses which are potentially addressable by targeted interventions and policies. This approach is built largely on prior literature, but is original in that it is problem-driven and promotes an outward application taking into consideration the major health system building blocks at various levels in order to ensure a more complete assessment of a governance issue rather than a simple input-output approach. Based on an assessment of contemporary literature we propose a practical approach which we believe will facilitate a more comprehensive assessment of governance in health systems leading to the development of governance interventions to strengthen system performance and improve health as a basic human right. PMID:22136318

Reciprocal Relations among Motivational Frameworks, Math Anxiety, and Math Achievement in Early Elementary School

ERIC Educational Resources Information Center

Gunderson, Elizabeth A.; Park, Daeun; Maloney, Erin A.; Beilock, Sian L.; Levine, Susan C.

2018-01-01

School-entry math achievement is a strong predictor of math achievement through high school. We asked whether reciprocal relations among math achievement, math anxiety, and entity motivational frameworks (believing that ability is fixed and a focus on performance) can help explain these persistent individual differences. We assessed 1st and 2nd…

The New NGSS Classroom: A Curriculum Framework for Project-Based Science Learning

ERIC Educational Resources Information Center

Holthuis, Nicole; Deutscher, Rebecca; Schultz, Susan E.; Jamshidi, Arash

2018-01-01

As schools work to implement the Next Generation Science Standards (NGSS), a team at Stanford University found that project-based learning is an effective framework for engaging students. The team used project-based learning, group activities, and performance-based assessments to design an effective, engaging curriculum. Over a three-year period,…

Developing a Framework for the Dissemination of Educational and R&D Products.

ERIC Educational Resources Information Center

Cresap, McCormick, and Paget, Inc., New York, NY.

An indepth study was performed to assess the present status of dissemination in the Education Division of the Department of Health, Education and Welfare, to develop a conceptual framework that would provide a rational base for a dissemination policy, and to recommend an organizational plan for the management of the dissemination activity within…

Building an automated SOAP classifier for emergency department reports.

PubMed

Mowery, Danielle; Wiebe, Janyce; Visweswaran, Shyam; Harkema, Henk; Chapman, Wendy W

2012-02-01

Information extraction applications that extract structured event and entity information from unstructured text can leverage knowledge of clinical report structure to improve performance. The Subjective, Objective, Assessment, Plan (SOAP) framework, used to structure progress notes to facilitate problem-specific, clinical decision making by physicians, is one example of a well-known, canonical structure in the medical domain. Although its applicability to structuring data is understood, its contribution to information extraction tasks has not yet been determined. The first step to evaluating the SOAP framework's usefulness for clinical information extraction is to apply the model to clinical narratives and develop an automated SOAP classifier that classifies sentences from clinical reports. In this quantitative study, we applied the SOAP framework to sentences from emergency department reports, and trained and evaluated SOAP classifiers built with various linguistic features. We found the SOAP framework can be applied manually to emergency department reports with high agreement (Cohen's kappa coefficients over 0.70). Using a variety of features, we found classifiers for each SOAP class can be created with moderate to outstanding performance with F(1) scores of 93.9 (subjective), 94.5 (objective), 75.7 (assessment), and 77.0 (plan). We look forward to expanding the framework and applying the SOAP classification to clinical information extraction tasks. Copyright © 2011. Published by Elsevier Inc.

A national framework for flood forecasting model assessment for use in operations and investment planning over England and Wales

NASA Astrophysics Data System (ADS)

Moore, Robert J.; Wells, Steven C.; Cole, Steven J.

2016-04-01

It has been common for flood forecasting systems to be commissioned at a catchment or regional level in response to local priorities and hydrological conditions, leading to variety in system design and model choice. As systems mature and efficiencies of national management are sought, there can be a drive towards system rationalisation, gaining an overview of model performance and consideration of simplification through model-type convergence. Flood forecasting model assessments, whilst overseen at a national level, may be commissioned and managed at a catchment and regional level, take a variety of forms and be large in number. This presents a challenge when an integrated national assessment is required to guide operational use of flood forecasts and plan future investment in flood forecasting models and supporting hydrometric monitoring. This contribution reports on how a nationally consistent framework for flood forecasting model performance has been developed to embrace many past, ongoing and future assessments for local river systems by engineering consultants across England & Wales. The outcome is a Performance Summary for every site model assessed which, on a single page, contains relevant catchment information for context, a selection of overlain forecast and observed hydrographs and a set of performance statistics with associated displays of novel condensed form. One display provides performance comparison with other models that may exist for the site. The performance statistics include skill scores for forecasting events (flow/level threshold crossings) of differing severity/rarity, indicating their probability and likely timing, which have real value in an operational setting. The local models assessed can be of any type and span rainfall-runoff (conceptual and transfer function) and flow routing (hydrological and hydrodynamic) forms. Also accommodated by the framework is the national G2G (Grid-to-Grid) distributed hydrological model, providing area-wide coverage across the fluvial rivers of England and Wales, which can be assessed at gauged sites. Thus the performance of the national G2G model forecasts can be directly compared with that from the local models. The Performance Summary for each site model is complemented by a national spatial analysis of model performance stratified by model-type, geographical region and forecast lead-time. The map displays provide an extensive evidence-base that can be interrogated, through a Flood Forecasting Model Performance web portal, to reveal fresh insights into comparative performance across locations, lead-times and models. This work was commissioned by the Environment Agency in partnership with Natural Resources Wales and the Flood Forecasting Centre for England and Wales.

A Conceptual Framework for Evaluation of Public Health and Primary Care System Performance in Iran

PubMed Central

Jahanmehr, Nader; Rashidian, Arash; Khosravi, Ardeshir; Farzadfar, Farshad; Shariati, Mohammad; Majdzadeh, Reza; Sari, Ali Akbari; Mesdaghinia, Alireza

2015-01-01

Introduction: The main objective of this study was to design a conceptual framework, according to the policies and priorities of the ministry of health to evaluate provincial public health and primary care performance and to assess their share in the overall health impacts of the community. Methods: We used several tools and techniques, including system thinking, literature review to identify relevant attributes of health system performance framework and interview with the key stakeholders. The PubMed, Scopus, web of science, Google Scholar and two specialized databases of Persian language literature (IranMedex and SID) were searched using main terms and keywords. Following decision-making and collective agreement among the different stakeholders, 51 core indicators were chosen from among 602 obtained indicators in a four stage process, for monitoring and evaluation of Health Deputies. Results: We proposed a conceptual framework by identifying the performance area for Health Deputies between other determinants of health, as well as introducing a chain of results, for performance, consisting of Input, Process, Output and Outcome indicators. We also proposed 5 dimensions for measuring the performance of Health Deputies, consisting of efficiency, effectiveness, equity, access and improvement of health status. Conclusion: The proposed Conceptual Framework illustrates clearly the Health Deputies success in achieving best results and consequences of health in the country. Having the relative commitment of the ministry of health and Health Deputies at the University of Medical Sciences is essential for full implementation of this framework and providing the annual performance report. PMID:25946937

Rater cognition: review and integration of research findings.

PubMed

Gauthier, Geneviève; St-Onge, Christina; Tavares, Walter

2016-05-01

Given the complexity of competency frameworks, associated skills and abilities, and contexts in which they are to be assessed in competency-based education (CBE), there is an increased reliance on rater judgements when considering trainee performance. This increased dependence on rater-based assessment has led to the emergence of rater cognition as a field of research in health professions education. The topic, however, is often conceptualised and ultimately investigated using many different perspectives and theoretical frameworks. Critically analysing how researchers think about, study and discuss rater cognition or the judgement processes in assessment frameworks may provide meaningful and efficient directions in how the field continues to explore the topic. We conducted a critical and integrative review of the literature to explore common conceptualisations and unified terminology associated with rater cognition research. We identified 1045 articles on rater-based assessment in health professions education using Scorpus, Medline and ERIC and 78 articles were included in our review. We propose a three-phase framework of observation, processing and integration. We situate nine specific mechanisms and sub-mechanisms described across the literature within these phases: (i) generating automatic impressions about the person; (ii) formulating high-level inferences; (iii) focusing on different dimensions of competencies; (iv) categorising through well-developed schemata based on (a) personal concept of competence, (b) comparison with various exemplars and (c) task and context specificity; (v) weighting and synthesising information differently, (vi) producing narrative judgements; and (vii) translating narrative judgements into scales. Our review has allowed us to identify common underlying conceptualisations of observed rater mechanisms and subsequently propose a comprehensive, although complex, framework for the dynamic and contextual nature of the rating process. This framework could help bridge the gap between researchers adopting different perspectives when studying rater cognition and enable the interpretation of contradictory findings of raters' performance by determining which mechanism is enabled or disabled in any given context. © 2016 John Wiley & Sons Ltd.

NIST biometric evaluations and developments

NASA Astrophysics Data System (ADS)

Garris, Michael D.; Wilson, Charles L.

2005-05-01

This paper presents an R&D framework used by the National Institute of Standards and Technology (NIST) for biometric technology testing and evaluation. The focus of this paper is on fingerprint-based verification and identification. Since 9-11 the NIST Image Group has been mandated by Congress to run a program for biometric technology assessment and biometric systems certification. Four essential areas of activity are discussed: 1) developing test datasets, 2) conducting performance assessment; 3) technology development; and 4) standards participation. A description of activities and accomplishments are provided for each of these areas. In the process, methods of performance testing are described and results from specific biometric technology evaluations are presented. This framework is anticipated to have broad applicability to other technology and application domains.

Environmental performance policy indicators for the public sector: the case of the defence sector.

PubMed

Ramos, Tomás B; Alves, Inês; Subtil, Rui; Joanaz de Melo, João

2007-03-01

The development of environmental performance policy indicators for public services, and in particular for the defence sector, is an emerging issue. Despite a number of recent initiatives there has been little work done in this area, since the other sectors usually focused on are agriculture, transport, industry, tourism and energy. This type of tool can be an important component for environmental performance evaluation at policy level, when integrated in the general performance assessment system of public missions and activities. The main objective of this research was to develop environmental performance policy indicators for the public sector, specifically applied to the defence sector. Previous research included an assessment of the environmental profile, through the evaluation of how environmental management practices have been adopted in this sector and an assessment of environmental aspects and impacts. This paper builds upon that previous research, developing an indicator framework--SEPI--supported by the selection and construction of environmental performance indicators. Another aim is to discuss how the current environmental indicator framework can be integrated into overall performance management. The Portuguese defence sector is presented and the usefulness of this methodology demonstrated. Feasibility and relevancy criteria are applied to evaluate the set of indicators proposed, allowing indicators to be scored and indicators for the policy level to be obtained.

Establishing a Portfolio Assessment Framework for Pre-Service Teachers: A Multiple Perspectives Approach

ERIC Educational Resources Information Center

Denney, Maria K.; Grier, Jeanne M.; Buchanan, Merilyn

2012-01-01

In the field of initial teacher training, portfolios are widely used to assess pre-service teachers' performance as well as the outcomes of university-based teacher preparation programmes. However, little is known about the explicit design of portfolio assessment mechanisms in teacher preparation programmes. Issues related to the design and…

Using Model-Tracing to Conduct Performance Assessment of Students' Inquiry Skills within a Microworld

ERIC Educational Resources Information Center

Gobert, Janice D.; Koedinger, Kenneth R.

2011-01-01

The National frameworks for science emphasize inquiry skills (NRC, 1996), however, in typical classroom practice, science learning often focuses on rote learning in part because science process skills are difficult to assess (Fadel, Honey, & Pasnick, 2007) and rote knowledge is prioritized on high-stakes tests. Short answer assessments of…

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

State Regulatory Authority (SRA) Coordination of Safety, Security, and Safeguards of Nuclear Facilities: A Framework for Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mladineo, Stephen V.; Frazar, Sarah L.; Kurzrok, Andrew J.

This paper will explore the development of a framework for conducting an assessment of safety-security-safeguards integration within a State. The goal is to examine State regulatory structures to identify conflicts and gaps that hinder management of the three disciplines at nuclear facilities. Such an analysis could be performed by a State Regulatory Authority (SRA) to provide a self-assessment or as part of technical cooperation with either a newcomer State, or to a State with a fully developed SRA.

Integrating the analytic hierarchy process and importance-performance analysis into ISO 14001 framework for assessing campus sustainability

NASA Astrophysics Data System (ADS)

Pramono, Susatyo N. W.; Ulkhaq, M. Mujiya; Trianto, Reza; Setiowati, Priska R.; Rasyida, Dyah R.; Setyorini, Nadia A.; Jauhari, Wakhid A.

2017-11-01

There has been an international emerging issue in the role of higher education in promoting sustainability due to numerous declarations and commitments related to the need of sustainability in higher education. As a result, there is an increasing number of higher educations that have embarked on projects and initiatives to incorporate sustainability into their systems. Higher educations could implement ISO 14001 framework that is recognized as a guide for an organization which aim to implement an environmental management system to pursue the sustainability. This research tried to attempt an extension of the previous work in assessing campus sustainability using ISO 14001 framework by integrating the analytic hierarchy process and importance-performance analysis (IPA). The inclusion of IPA is because many organizations are constrained by limitations on the resources they have so that it has to be decided how those limited resources are best deployed to attain the goals to be achieved. The self-assessment scores of ISO 14001 would the performance and the AHP result is the importance part of the IPA. A case study is conducted at the Diponegoro University, which is located in Semarang, Indonesia. The result indicates that only two main elements of ISO 14001 are located in the second quadrant of IPA, i.e. high performance and high importance. The result also could be a basis for the university to identify, prioritize, and improve the programs related to sustainability and ensure that valuable resources are allocated in the most effective areas.

A high performance data parallel tensor contraction framework: Application to coupled electro-mechanics

NASA Astrophysics Data System (ADS)

Poya, Roman; Gil, Antonio J.; Ortigosa, Rogelio

2017-07-01

The paper presents aspects of implementation of a new high performance tensor contraction framework for the numerical analysis of coupled and multi-physics problems on streaming architectures. In addition to explicit SIMD instructions and smart expression templates, the framework introduces domain specific constructs for the tensor cross product and its associated algebra recently rediscovered by Bonet et al. (2015, 2016) in the context of solid mechanics. The two key ingredients of the presented expression template engine are as follows. First, the capability to mathematically transform complex chains of operations to simpler equivalent expressions, while potentially avoiding routes with higher levels of computational complexity and, second, to perform a compile time depth-first or breadth-first search to find the optimal contraction indices of a large tensor network in order to minimise the number of floating point operations. For optimisations of tensor contraction such as loop transformation, loop fusion and data locality optimisations, the framework relies heavily on compile time technologies rather than source-to-source translation or JIT techniques. Every aspect of the framework is examined through relevant performance benchmarks, including the impact of data parallelism on the performance of isomorphic and nonisomorphic tensor products, the FLOP and memory I/O optimality in the evaluation of tensor networks, the compilation cost and memory footprint of the framework and the performance of tensor cross product kernels. The framework is then applied to finite element analysis of coupled electro-mechanical problems to assess the speed-ups achieved in kernel-based numerical integration of complex electroelastic energy functionals. In this context, domain-aware expression templates combined with SIMD instructions are shown to provide a significant speed-up over the classical low-level style programming techniques.

The Influence of Properties of the Test and Their Interactions with Reader Characteristics on Reading Comprehension: An Explanatory Item Response Study

ERIC Educational Resources Information Center

Kulesz, Paulina A.; Francis, David J.; Barnes, Marcia A.; Fletcher, Jack M.

2016-01-01

Component skills and discourse frameworks of reading have identified characteristics of readers and texts that influence comprehension. However, these 2 frameworks have not previously been integrated in a comprehensive and systematic way to explain performance on any standardized assessment of reading comprehension that is in widespread use across…

Teaching Games for Understanding in American High-School Soccer: A Quantitative Data Analysis Using the Game Performance Assessment Instrument

ERIC Educational Resources Information Center

Harvey, Stephen; Cushion, Christopher J.; Wegis, Heidi M.; Massa-Gonzalez, Ada N.

2010-01-01

Background: Previous research examining the effectiveness of the Teaching Games for Understanding (TGfU) approach has been equivocal. This has been hampered by a dependence on a comparative (i.e., "which method is best?") theoretical framework. An alternative "practice-referenced" framework has the potential to examine the effectiveness of TGfU…

LIFE CYCLE DESIGN OF AMORPHOUS SILICON PHOTOVOLTAIC MODULES

EPA Science Inventory

The life cycle design framework was applied to photovoltaic module design. The primary objective of this project was to develop and evaluate design metrics for assessing and guiding the Improvement of PV product systems. Two metrics were used to assess life cycle energy perform...

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

An application framework of three-dimensional reconstruction and measurement for endodontic research.

PubMed

Gao, Yuan; Peters, Ove A; Wu, Hongkun; Zhou, Xuedong

2009-02-01

The purpose of this study was to customize an application framework by using the MeVisLab image processing and visualization platform for three-dimensional reconstruction and assessment of tooth and root canal morphology. One maxillary first molar was scanned before and after preparation with ProTaper by using micro-computed tomography. With a customized application framework based on MeVisLab, internal and external anatomy was reconstructed. Furthermore, the dimensions of root canal and radicular dentin were quantified, and effects of canal preparation were assessed. Finally, a virtual preparation with risk analysis was performed to simulate the removal of a broken instrument. This application framework provided an economical platform and met current requirements of endodontic research. The broad-based use of high-quality free software and the resulting exchange of experience might help to improve the quality of endodontic research with micro-computed tomography.

Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology.

ERIC Educational Resources Information Center

Brannick, Michael T., Ed.; Salas, Eduardo, Ed.; Prince, Carolyn, Ed.

This volume presents thoughts on measuring team performance written by experts currently working with teams in fields such as training, evaluation, and process consultation. The chapters are: (1) "An Overview of Team Performance Measurement" (Michael T. Brannick and Carolyn Prince); (2) "A Conceptual Framework for Teamwork Measurement" (Terry L.…

Further Education Performance Indicators: A Motivational or a Performative Tool?

ERIC Educational Resources Information Center

Boocock, Andrew

2013-01-01

Ethnographic research in a further education College (Borough College) between 2000 and 2005 assessed the impact of performance indicators (PIs) within a department teaching GCSEs and A-levels. Research focused on PIs integral to the Learning and Skills Council funding formula, the Common Inspection Framework and newspaper league tables, and the…

A multi-scale, multi-disciplinary approach for assessing the technological, economic and environmental performance of bio-based chemicals.

PubMed

Herrgård, Markus; Sukumara, Sumesh; Campodonico, Miguel; Zhuang, Kai

2015-12-01

In recent years, bio-based chemicals have gained interest as a renewable alternative to petrochemicals. However, there is a significant need to assess the technological, biological, economic and environmental feasibility of bio-based chemicals, particularly during the early research phase. Recently, the Multi-scale framework for Sustainable Industrial Chemicals (MuSIC) was introduced to address this issue by integrating modelling approaches at different scales ranging from cellular to ecological scales. This framework can be further extended by incorporating modelling of the petrochemical value chain and the de novo prediction of metabolic pathways connecting existing host metabolism to desirable chemical products. This multi-scale, multi-disciplinary framework for quantitative assessment of bio-based chemicals will play a vital role in supporting engineering, strategy and policy decisions as we progress towards a sustainable chemical industry. © 2015 Authors; published by Portland Press Limited.

Trajectory-Based Performance Assessment for Aviation Weather Information

NASA Technical Reports Server (NTRS)

Vigeant-Langlois, Laurence; Hansman, R. John, Jr.

2003-01-01

Based on an analysis of aviation decision-makers' time-related weather information needs, an abstraction of the aviation weather decision task was developed, that involves 4-D intersection testing between aircraft trajectory hypertubes and hazardous weather hypervolumes. The framework builds on the hypothesis that hazardous meteorological fields can be simplified using discrete boundaries of surrogate threat attributes. The abstractions developed in the framework may be useful in studying how to improve the performance of weather forecasts from the trajectory-centric perspective, as well as for developing useful visualization techniques of weather information.

Framework for continuous assessment and improvement of occupational health and safety issues in construction companies.

PubMed

Mahmoudi, Shahram; Ghasemi, Fakhradin; Mohammadfam, Iraj; Soleimani, Esmaeil

2014-09-01

Construction industry is among the most hazardous industries, and needs a comprehensive and simple-to-administer tool to continuously assess and promote its health and safety performance. Through the study of various standard systems (mainly Health, Safety, and Environment Management System; Occupational Health and Safety Assessment Series 180001; and British Standard, occupational health and safety management systems-Guide 8800), seven main elements were determined for the desired framework, and then, by reviewing literature, factors affecting these main elements were determined. The relative importance of each element and its related factors was calculated at organizational and project levels. The provided framework was then implemented in three construction companies, and results were compared together. THE RESULTS OF THE STUDY SHOW THAT THE RELATIVE IMPORTANCE OF THE MAIN ELEMENTS AND THEIR RELATED FACTORS DIFFER BETWEEN ORGANIZATIONAL AND PROJECT LEVELS: leadership and commitment are the most important elements at the organization level, whereas risk assessment and management are most important at the project level. The present study demonstrated that the framework is easy to administer, and by interpreting the results, the main factors leading to the present condition of companies can be determined.

An Assessment of Adolescent Comprehension of Some Geographical Concepts Using Peel's Theoretical Framework.

ERIC Educational Resources Information Center

Ghuman, Paul A. S.; Davis, R.

1981-01-01

This inquiry had two aims: to assess children's ability to interpret maps in geography; to relate the assessed ability to maturity of thought as proposed by Peel, general intelligence, and age. It was found that performance on four tests depended more on intelligence than on maturity of thought or age. (Author/SJL)

A Knowledge-Structure-Based Adaptive Dynamic Assessment System for Calculus Learning

ERIC Educational Resources Information Center

Ting, M.-Y.; Kuo, B.-C.

2016-01-01

The purpose of this study was to investigate the effect of a calculus system that was designed using an adaptive dynamic assessment (DA) framework on performance in the "finding an area using an integral". In this study, adaptive testing and dynamic assessment were combined to provide different test items depending on students'…

A Framework for General Education Assessment: Assessing Information Literacy and Quantitative Literacy with ePortfolios

ERIC Educational Resources Information Center

Hubert, David A.; Lewis, Kati J.

2014-01-01

This essay presents the findings of an authentic and holistic assessment, using a random sample of one hundred student General Education ePortfolios, of two of Salt Lake Community College's (SLCC) college-wide learning outcomes: quantitative literacy (QL) and information literacy (IL). Performed by four faculty from biology, humanities, and…

School Accountability and Assessment: Should We Put the Roof up First?

ERIC Educational Resources Information Center

Klinger, Don A.; Maggi, Stefania; D'Angiulli, Amedeo

2011-01-01

School accountability and student assessment are closely associated in educational jurisdictions' attempts to monitor student achievement, focus instruction, and improve subsequent student and school performance. The research reported in this article examines the School Effectiveness Framework in Ontario, Canada, exploring the foundations upon…

Small drinking water systems under spatiotemporal water quality variability: a risk-based performance benchmarking framework.

PubMed

Bereskie, Ty; Haider, Husnain; Rodriguez, Manuel J; Sadiq, Rehan

2017-08-23

Traditional approaches for benchmarking drinking water systems are binary, based solely on the compliance and/or non-compliance of one or more water quality performance indicators against defined regulatory guidelines/standards. The consequence of water quality failure is dependent on location within a water supply system as well as time of the year (i.e., season) with varying levels of water consumption. Conventional approaches used for water quality comparison purposes fail to incorporate spatiotemporal variability and degrees of compliance and/or non-compliance. This can lead to misleading or inaccurate performance assessment data used in the performance benchmarking process. In this research, a hierarchical risk-based water quality performance benchmarking framework is proposed to evaluate small drinking water systems (SDWSs) through cross-comparison amongst similar systems. The proposed framework (R WQI framework) is designed to quantify consequence associated with seasonal and location-specific water quality issues in a given drinking water supply system to facilitate more efficient decision-making for SDWSs striving for continuous performance improvement. Fuzzy rule-based modelling is used to address imprecision associated with measuring performance based on singular water quality guidelines/standards and the uncertainties present in SDWS operations and monitoring. This proposed R WQI framework has been demonstrated using data collected from 16 SDWSs in Newfoundland and Labrador and Quebec, Canada, and compared to the Canadian Council of Ministers of the Environment WQI, a traditional, guidelines/standard-based approach. The study found that the R WQI framework provides an in-depth state of water quality and benchmarks SDWSs more rationally based on the frequency of occurrence and consequence of failure events.

A framework for assessing health system resilience in an economic crisis: Ireland as a test case

PubMed Central

2013-01-01

Background The financial crisis that hit the global economy in 2007 was unprecedented in the post war era. In general the crisis has created a difficult environment for health systems globally. The purpose of this paper is to develop a framework for assessing the resilience of health systems in terms of how they have adjusted to economic crisis. Resilience can be understood as the capacity of a system to absorb change but continue to retain essentially the same identity and function. The Irish health system is used as a case study to assess the usefulness of this framework. Methods The authors identify three forms of resilience: financial, adaptive and transformatory. Indicators of performance are presented to allow for testing of the framework and measurement of system performance. Both quantitative and qualitative methods were used to yield data for the Irish case study. Quantitative data were collected from government documents and sources to understand the depth of the recession and the different dimensions of the response. Semi-structured interviews were conducted with key decision makers to understand the reasons for decisions made. Results In the Irish case there is mixed evidence on resilience. Health funding was initially protected but was then followed by deep cuts as the crisis deepened. There is strong evidence for adaptive resilience, with the health system showing efficiency gains from the recession. Nevertheless, easy efficiencies have been made and continued austerity will mean cuts in entitlements and services. The prospects for building and maintaining transformatory resilience are unsure. While the direction of reform is clear, and has been preserved to date, it is not certain whether it will remain manageable given continued austerity, some loss of sovereignty and capacity limitations. Conclusions The three aspects of resilience proved a useful categorisation of performance measurement though there is overlap between them. Transformatory resilience may be more difficult to assess precisely. It would be useful to test out the framework against other country experiences and refine the measures and indicators. Further research on both the comparative resilience of different health systems and building resilience in preparation for crises is encouraged. PMID:24171814

A framework for assessing health system resilience in an economic crisis: Ireland as a test case.

PubMed

Thomas, Steve; Keegan, Conor; Barry, Sarah; Layte, Richard; Jowett, Matt; Normand, Charles

2013-10-30

The financial crisis that hit the global economy in 2007 was unprecedented in the post war era. In general the crisis has created a difficult environment for health systems globally. The purpose of this paper is to develop a framework for assessing the resilience of health systems in terms of how they have adjusted to economic crisis. Resilience can be understood as the capacity of a system to absorb change but continue to retain essentially the same identity and function. The Irish health system is used as a case study to assess the usefulness of this framework. The authors identify three forms of resilience: financial, adaptive and transformatory. Indicators of performance are presented to allow for testing of the framework and measurement of system performance. Both quantitative and qualitative methods were used to yield data for the Irish case study. Quantitative data were collected from government documents and sources to understand the depth of the recession and the different dimensions of the response. Semi-structured interviews were conducted with key decision makers to understand the reasons for decisions made. In the Irish case there is mixed evidence on resilience. Health funding was initially protected but was then followed by deep cuts as the crisis deepened. There is strong evidence for adaptive resilience, with the health system showing efficiency gains from the recession. Nevertheless, easy efficiencies have been made and continued austerity will mean cuts in entitlements and services. The prospects for building and maintaining transformatory resilience are unsure. While the direction of reform is clear, and has been preserved to date, it is not certain whether it will remain manageable given continued austerity, some loss of sovereignty and capacity limitations. The three aspects of resilience proved a useful categorisation of performance measurement though there is overlap between them. Transformatory resilience may be more difficult to assess precisely. It would be useful to test out the framework against other country experiences and refine the measures and indicators. Further research on both the comparative resilience of different health systems and building resilience in preparation for crises is encouraged.

NINJA: a noninvasive framework for internal computer security hardening

NASA Astrophysics Data System (ADS)

Allen, Thomas G.; Thomson, Steve

2004-07-01

Vulnerabilities are a growing problem in both the commercial and government sector. The latest vulnerability information compiled by CERT/CC, for the year ending Dec. 31, 2002 reported 4129 vulnerabilities representing a 100% increase over the 2001 [1] (the 2003 report has not been published at the time of this writing). It doesn"t take long to realize that the growth rate of vulnerabilities greatly exceeds the rate at which the vulnerabilities can be fixed. It also doesn"t take long to realize that our nation"s networks are growing less secure at an accelerating rate. As organizations become aware of vulnerabilities they may initiate efforts to resolve them, but quickly realize that the size of the remediation project is greater than their current resources can handle. In addition, many IT tools that suggest solutions to the problems in reality only address "some" of the vulnerabilities leaving the organization unsecured and back to square one in searching for solutions. This paper proposes an auditing framework called NINJA (acronym for Network Investigation Notification Joint Architecture) for noninvasive daily scanning/auditing based on common security vulnerabilities that repeatedly occur in a network environment. This framework is used for performing regular audits in order to harden an organizations security infrastructure. The framework is based on the results obtained by the Network Security Assessment Team (NSAT) which emulates adversarial computer network operations for US Air Force organizations. Auditing is the most time consuming factor involved in securing an organization's network infrastructure. The framework discussed in this paper uses existing scripting technologies to maintain a security hardened system at a defined level of performance as specified by the computer security audit team. Mobile agents which were under development at the time of this writing are used at a minimum to improve the noninvasiveness of our scans. In general, noninvasive scans with an adequate framework performed on a daily basis reduce the amount of security work load as well as the timeliness in performing remediation, as verified by the NINJA framework. A vulnerability assessment/auditing architecture based on mobile agent technology is proposed and examined at the end of the article as an enhancement to the current NINJA architecture.

Assessing sustainable remediation frameworks using sustainability principles.

PubMed

Ridsdale, D Reanne; Noble, Bram F

2016-12-15

The remediation industry has grown exponentially in recent decades. International organizations of practitioners and remediation experts have developed several frameworks for integrating sustainability into remediation projects; however, there has been limited attention to how sustainability is approached and operationalized in sustainable remediation frameworks and practices - or whether sustainability plays any meaningful role at all in sustainable remediation. This paper examines how sustainability is represented in remediation frameworks and the guidance provided for practical application. Seven broad sustainability principles and review criteria are proposed and applied to a sample of six international remediation frameworks. Not all review criteria were equally satisfied and none of the frameworks fully met all criteria; however, the best performing frameworks were those identified as sustainability remediation frameworks. Intra-generational equity was addressed by all frameworks. Integrating social, economic and biophysical components beyond triple-bottom-line indicators was explicitly addressed only by the sustainable remediation frameworks. No frameworks provided principle- or rule-based guidance for dealing with trade-offs in sustainability decisions. Copyright © 2016 Elsevier Ltd. All rights reserved.

Setting performance standards for medical practice: a theoretical framework.

PubMed

Southgate, L; Hays, R B; Norcini, J; Mulholland, H; Ayers, B; Woolliscroft, J; Cusimano, M; McAvoy, P; Ainsworth, M; Haist, S; Campbell, M

2001-05-01

The assessment of performance in the real world of medical practice is now widely accepted as the goal of assessment at the postgraduate level. This is largely a validity issue, as it is recognised that tests of knowledge and in clinical simulations cannot on their own really measure how medical practitioners function in the broader health care system. However, the development of standards for performance-based assessment is not as well understood as in competency assessment, where simulations can more readily reflect narrower issues of knowledge and skills. This paper proposes a theoretical framework for the development of standards that reflect the more complex world in which experienced medical practitioners work. The paper reflects the combined experiences of a group of education researchers and the results of literature searches that included identifying current health system data sources that might contribute information to the measurement of standards. Standards that reflect the complexity of medical practice may best be developed through an "expert systems" analysis of clinical conditions for which desired health care outcomes reflect the contribution of several health professionals within a complex, three-dimensional, contextual model. Examples of the model are provided, but further work is needed to test validity and measurability.

The Type of Culture at a High Performance Schools and Low Performance School in the State of Kedah

ERIC Educational Resources Information Center

Daud, Yaakob; Raman, Arumugam; Don, Yahya; O. F., Mohd Sofian; Hussin, Fauzi

2015-01-01

This research aims to identify the type of culture at a High Performance School (HPS) and Low Performance School (LPS) in the state of Kedah. The research instrument used to measure the type of organizational culture was adapted from Organizational Culture Assessment Instrument (Cameron & Quinn, 2006) based on Competing Values Framework Quinn…

Design and Development of a Self-Assessment Tool and Investigating its Effectiveness for E-Learning

ERIC Educational Resources Information Center

Domun, Manisha; Bahadur, Goonesh K.

2014-01-01

One of the most effective tools in e-learning is the Self-Assessment Tool (SAT) and research has shown that students need to accurately assess their own performance thus improving their learning. The study involved the design and development of a self-assessment tool based on the Revised Blooms taxonomy Framework. As a second step in investigating…

Do senior management cultures affect performance? Evidence from Italian public healthcare organizations.

PubMed

Prenestini, Anna; Lega, Federico

2013-01-01

Healthcare organizations are often characterized by diffuse power, ambiguous goals, and a plurality of actors. In this complex and pluralistic context, senior healthcare managers are expected to provide strategic direction and lead their organizations toward their goals and performance targets. The present work explores the relationship between senior management team culture and performance by investigating Italian public healthcare organizations in the Tuscany region. Our assessment of senior management culture was accomplished through the use of an established framework and a corresponding tool, the competing values framework, which supports the idea that specific aspects of performance are related to a dominant management culture. Organizational performance was assessed using a wide range of measures collected by a multidimensional performance evaluation system, which was developed in Tuscany to measure the performance of its 12 local health authorities (LHAs) and four teaching hospitals (THs). Usable responses were received from 80 senior managers of 11 different healthcare organizations (two THs and nine LHAs). Our findings show that Tuscan healthcare organizations are characterized by various dominant cultures: developmental, clan, rational, and hierarchical. These variations in dominant culture were associated with performance measures. The implications for management theory, professional practice, and public policy are discussed.

Evaluation Framework and Analyses for Thermal Energy Storage Integrated with Packaged Air Conditioning

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kung, F.; Deru, M.; Bonnema, E.

2013-10-01

Few third-party guidance documents or tools are available for evaluating thermal energy storage (TES) integrated with packaged air conditioning (AC), as this type of TES is relatively new compared to TES integrated with chillers or hot water systems. To address this gap, researchers at the National Renewable Energy Laboratory conducted a project to improve the ability of potential technology adopters to evaluate TES technologies. Major project outcomes included: development of an evaluation framework to describe key metrics, methodologies, and issues to consider when assessing the performance of TES systems integrated with packaged AC; application of multiple concepts from the evaluationmore » framework to analyze performance data from four demonstration sites; and production of a new simulation capability that enables modeling of TES integrated with packaged AC in EnergyPlus. This report includes the evaluation framework and analysis results from the project.« less

KC-135 Simulator Systems Engineering Case Study

DTIC Science & Technology

2010-01-01

performance. The utilization and misutilization of SE principles are highlighted, with special emphasis on the conditions that foster and impede...process, from the identification of the need to the development and utilization of the product, must continuously integrate and optimize system and... utilizing the Friedman-Sage framework to organize the assessment of the application of the SE process. The framework and the derived matrix can

Measuring Up: Are You Looking for a Way to Assess Your Teaching Practice? These Three Frameworks Can Help You Evaluate Your Performance

ERIC Educational Resources Information Center

Carrero, Jacqueline

2015-01-01

The author discusses how teachers can measure their effectiveness and discusses three frameworks they can use to do so: the National Board for Professional Teaching Standards's Core Propositions, Robert J. Marzano's Teacher Evaluation Model, and John Hattie's eight mind frames. She also gives examples from her own experience to show how she…

Assessing NETS.T Performance in Teacher Candidates: Exploring the Wayfind Teacher Assessment

ERIC Educational Resources Information Center

Banister, Savilla; Vannatta Reinhart, Rachel

2013-01-01

To effectively integrate digital technologies in K-12 schools, teachers must be provided with undergraduate experiences that strongly support these integration resources and strategies. The National Educational Technology Standards for Teachers (NETS.T) provide a framework for teacher candidates and inservice teachers to identify their…

A new framework for modeling decentralized low impact developments using Soil and Water Assessment Tool

USDA-ARS?s Scientific Manuscript database

Assessing the performance of Low Impact Development (LID) practices at a catchment scale is important in managing urban watersheds. Few modeling tools exist that are capable of explicitly representing the hydrological mechanisms of LIDs while considering the diverse land uses of urban watersheds. ...

An Ecological Approach to the On-Line Assessment of Problem-Solving Paths: Principles and Applications.

ERIC Educational Resources Information Center

Shaw, Robert E.; And Others

1997-01-01

Proposes a theoretical framework for designing online-situated assessment tools for multimedia instructional systems. Uses a graphic method based on ecological psychology to monitor student performance through a learning activity. Explores the method's feasibility in case studies describing instructional systems teaching critical-thinking and…

Validity: Applying Current Concepts and Standards to Gynecologic Surgery Performance Assessments

ERIC Educational Resources Information Center

LeClaire, Edgar L.; Nihira, Mikio A.; Hardré, Patricia L.

2015-01-01

Validity is critical for meaningful assessment of surgical competency. According to the Standards for Educational and Psychological Testing, validation involves the integration of data from well-defined classifications of evidence. In the authoritative framework, data from all classifications support construct validity claims. The two aims of this…

Excellence in Higher Education Workbook and Scoring Guide

ERIC Educational Resources Information Center

Ruben, Brent D.

2007-01-01

Self-assessment leads to stronger performance in the nation's colleges and universities. That's the premise of "Excellence in Higher Education," a model self-assessment program that has earned accolades from the higher education community. Based on the Malcolm Baldrige National Quality Award framework, the fourth edition of this bestseller is the…

PISA 2009 Assessment Framework: Key Competencies in Reading, Mathematics and Science

ERIC Educational Resources Information Center

Schleicher, Andreas; Zimmer, Karin; Evans, Juliet; Clements, Niccolina

2009-01-01

In response to the need for cross-nationally comparable evidence on student performance, the Organisation for Economic Co-operation and Development (OECD) launched the OECD Programme for International Student Assessment (PISA) in 1997. PISA represents a commitment by governments to monitor the outcomes of education systems through measuring…

Practice Guidelines for Operative Performance Assessments.

PubMed

Williams, Reed G; Kim, Michael J; Dunnington, Gary L

2016-12-01

To provide recommended practice guidelines for assessing single operative performances and for combining results of operative performance assessments into estimates of overall operative performance ability. Operative performance is one defining characteristic of surgeons. Assessment of operative performance is needed to provide feedback with learning benefits to surgical residents in training and to assist in making progress decisions for residents. Operative performance assessment has been a focus of investigation over the past 20 years. This review is designed to integrate findings of this research into a set of recommended operative performance practices. Literature from surgery and from other pertinent research areas (psychology, education, business) was reviewed looking for evidence to inform practice guideline development. Guidelines were created along with a conceptual and scientific foundation for each guideline. Ten guidelines are provided for assessing individual operative performances and 10 are provided for combing data from individual operative performances into overall judgments of operative performance ability. The practice guidelines organize available information to be immediately useful to program directors, to support surgical training, and to provide a conceptual framework upon which to build as the base of pertinent knowledge expands through future research and development efforts.

The development of multi-level critical care competency statements for self-assessment by ICU nurses.

PubMed

Bourgault, Annette M; Smith, Sherry

2004-01-01

Multi-levelled critical care competency statements were developed based on the levels of novice to expert (Benner, 1984). These competency statements provide a framework for the development of knowledge and skills specific to critical care. The purpose of this tool is to guide personal development in critical care, facilitating the assessment of individual learning needs. Competency levels are attained through the completion of performance criteria. Multi-levelled competency statements define clear expectations for the new orientee, in addition to providing a framework for the advancement of the intermediate and experienced nurse.

A case study using the PrOACT-URL and BRAT frameworks for structured benefit risk assessment.

PubMed

Nixon, Richard; Dierig, Christoph; Mt-Isa, Shahrul; Stöckert, Isabelle; Tong, Thaison; Kuhls, Silvia; Hodgson, Gemma; Pears, John; Waddingham, Ed; Hockley, Kimberley; Thomson, Andrew

2016-01-01

While benefit-risk assessment is a key component of the drug development and maintenance process, it is often described in a narrative. In contrast, structured benefit-risk assessment builds on established ideas from decision analysis and comprises a qualitative framework and quantitative methodology. We compare two such frameworks, applying multi-criteria decision-analysis (MCDA) within the PrOACT-URL framework and weighted net clinical benefit (wNCB), within the BRAT framework. These are applied to a case study of natalizumab for the treatment of relapsing remitting multiple sclerosis. We focus on the practical considerations of applying these methods and give recommendations for visual presentation of results. In the case study, we found structured benefit-risk analysis to be a useful tool for structuring, quantifying, and communicating the relative benefit and safety profiles of drugs in a transparent, rational and consistent way. The two frameworks were similar. MCDA is a generic and flexible methodology that can be used to perform a structured benefit-risk in any common context. wNCB is a special case of MCDA and is shown to be equivalent to an extension of the number needed to treat (NNT) principle. It is simpler to apply and understand than MCDA and can be applied when all outcomes are measured on a binary scale. © 2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Sustainability performance evaluation: Literature review and future directions.

PubMed

Büyüközkan, Gülçin; Karabulut, Yağmur

2018-07-01

Current global economic activities are increasingly being perceived as unsustainable. Despite the high number of publications, sustainability science remains highly dispersed over diverse approaches and topics. This article aims to provide a structured overview of sustainability performance evaluation related publications and to document the current state of literature, categorize publications, analyze and link trends, as well as highlight gaps and provide research recommendations. 128 articles between 2007 and 2018 are identified. The results suggest that sustainability performance evaluation models shall be more balanced, suitable criteria and their interrelations shall be well defined and subjectivity of qualitative criteria inherent to sustainability indicators shall be considered. To address this subjectivity, group decision-making techniques and other analytical methods that can deal with uncertainty, conflicting indicators, and linguistic evaluations can be used in future works. By presenting research gaps, this review stimulates researchers to establish practically applicable sustainability performance evaluation frameworks to help assess and compare the degree of sustainability, leading to more sustainable business practices. The review is unique in defining corporate sustainability performance evaluation for the first time, exploring the gap between sustainability accounting and sustainability assessment, and coming up with a structured overview of innovative research recommendations about integrating analytical assessment methods into conceptual sustainability frameworks. Copyright © 2018 Elsevier Ltd. All rights reserved.

A Cognition Analysis of QUASAR's Mathematics Performance Assessment Tasks and Their Sensitivity to Measuring Changes in Middle School Students' Thinking and Reasoning.

ERIC Educational Resources Information Center

Cai, Jinfa, And Others

1996-01-01

Presents a conceptual framework for analyzing students' mathematical understanding, reasoning, problem solving, and communication. Analyses of student responses indicated that the tasks appear to measure the complex thinking and reasoning processes that they were designed to assess. Concludes that the QUASAR assessment tasks can capture changes in…

Excellence in Higher Education Guide: An Integrated Approach to Assessment, Planning, and Improvement in Colleges and Universities

ERIC Educational Resources Information Center

Ruben, Brent D.

2007-01-01

Self-assessment leads to stronger performance in the nation's colleges and universities. That's the premise of "Excellence in Higher Education," a model self-assessment program that has earned accolades from the higher education community. Based on the Malcolm Baldrige National Quality Award framework, the fourth edition of this bestseller is the…

Making the most of data: An information selection and assessment framework to improve water systems operations

NASA Astrophysics Data System (ADS)

Giuliani, M.; Pianosi, F.; Castelletti, A.

2015-11-01

Advances in Environmental monitoring systems are making a wide range of data available at increasingly higher temporal and spatial resolution. This creates an opportunity to enhance real-time understanding of water systems conditions and to improve prediction of their future evolution, ultimately increasing our ability to make better decisions. Yet, many water systems are still operated using very simple information systems, typically based on simple statistical analysis and the operator's experience. In this work, we propose a framework to automatically select the most valuable information to inform water systems operations supported by quantitative metrics to operationally and economically assess the value of this information. The Hoa Binh reservoir in Vietnam is used to demonstrate the proposed framework in a multiobjective context, accounting for hydropower production and flood control. First, we quantify the expected value of perfect information, meaning the potential space for improvement under the assumption of exact knowledge of the future system conditions. Second, we automatically select the most valuable information that could be actually used to improve the Hoa Binh operations. Finally, we assess the economic value of sample information on the basis of the resulting policy performance. Results show that our framework successfully select information to enhance the performance of the operating policies with respect to both the competing objectives, attaining a 40% improvement close to the target trade-off selected as potentially good compromise between hydropower production and flood control.

A conceptual framework for quality assessment and management of biodiversity data.

PubMed

Veiga, Allan Koch; Saraiva, Antonio Mauro; Chapman, Arthur David; Morris, Paul John; Gendreau, Christian; Schigel, Dmitry; Robertson, Tim James

2017-01-01

The increasing availability of digitized biodiversity data worldwide, provided by an increasing number of institutions and researchers, and the growing use of those data for a variety of purposes have raised concerns related to the "fitness for use" of such data and the impact of data quality (DQ) on the outcomes of analyses, reports, and decisions. A consistent approach to assess and manage data quality is currently critical for biodiversity data users. However, achieving this goal has been particularly challenging because of idiosyncrasies inherent in the concept of quality. DQ assessment and management cannot be performed if we have not clearly established the quality needs from a data user's standpoint. This paper defines a formal conceptual framework to support the biodiversity informatics community allowing for the description of the meaning of "fitness for use" from a data user's perspective in a common and standardized manner. This proposed framework defines nine concepts organized into three classes: DQ Needs, DQ Solutions and DQ Report. The framework is intended to formalize human thinking into well-defined components to make it possible to share and reuse concepts of DQ needs, solutions and reports in a common way among user communities. With this framework, we establish a common ground for the collaborative development of solutions for DQ assessment and management based on data fitness for use principles. To validate the framework, we present a proof of concept based on a case study at the Museum of Comparative Zoology of Harvard University. In future work, we will use the framework to engage the biodiversity informatics community to formalize and share DQ profiles related to DQ needs across the community.

A conceptual framework for quality assessment and management of biodiversity data

PubMed Central

Saraiva, Antonio Mauro; Chapman, Arthur David; Morris, Paul John; Gendreau, Christian; Schigel, Dmitry; Robertson, Tim James

2017-01-01

The increasing availability of digitized biodiversity data worldwide, provided by an increasing number of institutions and researchers, and the growing use of those data for a variety of purposes have raised concerns related to the "fitness for use" of such data and the impact of data quality (DQ) on the outcomes of analyses, reports, and decisions. A consistent approach to assess and manage data quality is currently critical for biodiversity data users. However, achieving this goal has been particularly challenging because of idiosyncrasies inherent in the concept of quality. DQ assessment and management cannot be performed if we have not clearly established the quality needs from a data user’s standpoint. This paper defines a formal conceptual framework to support the biodiversity informatics community allowing for the description of the meaning of "fitness for use" from a data user’s perspective in a common and standardized manner. This proposed framework defines nine concepts organized into three classes: DQ Needs, DQ Solutions and DQ Report. The framework is intended to formalize human thinking into well-defined components to make it possible to share and reuse concepts of DQ needs, solutions and reports in a common way among user communities. With this framework, we establish a common ground for the collaborative development of solutions for DQ assessment and management based on data fitness for use principles. To validate the framework, we present a proof of concept based on a case study at the Museum of Comparative Zoology of Harvard University. In future work, we will use the framework to engage the biodiversity informatics community to formalize and share DQ profiles related to DQ needs across the community. PMID:28658288

Assessing Procedural Competence: Validity Considerations.

PubMed

Pugh, Debra M; Wood, Timothy J; Boulet, John R

2015-10-01

Simulation-based medical education (SBME) offers opportunities for trainees to learn how to perform procedures and to be assessed in a safe environment. However, SBME research studies often lack robust evidence to support the validity of the interpretation of the results obtained from tools used to assess trainees' skills. The purpose of this paper is to describe how a validity framework can be applied when reporting and interpreting the results of a simulation-based assessment of skills related to performing procedures. The authors discuss various sources of validity evidence because they relate to SBME. A case study is presented.

PEER Transportation Research Program | PEER Transportation Research Program

Science.gov Websites

methodologies, integrating fundamental knowledge, enabling technologies, and systems. We further expect that the Bayesian Framework for Performance Assessment and Risk Management of Transportation Systems subject to Earthquakes Directivity Modeling for NGA West2 Ground Motion Studies for Transportation Systems Performance

Benchmarking hydrological model predictive capability for UK River flows and flood peaks.

NASA Astrophysics Data System (ADS)

Lane, Rosanna; Coxon, Gemma; Freer, Jim; Wagener, Thorsten

2017-04-01

Data and hydrological models are now available for national hydrological analyses. However, hydrological model performance varies between catchments, and lumped, conceptual models are not able to produce adequate simulations everywhere. This study aims to benchmark hydrological model performance for catchments across the United Kingdom within an uncertainty analysis framework. We have applied four hydrological models from the FUSE framework to 1128 catchments across the UK. These models are all lumped models and run at a daily timestep, but differ in the model structural architecture and process parameterisations, therefore producing different but equally plausible simulations. We apply FUSE over a 20 year period from 1988-2008, within a GLUE Monte Carlo uncertainty analyses framework. Model performance was evaluated for each catchment, model structure and parameter set using standard performance metrics. These were calculated both for the whole time series and to assess seasonal differences in model performance. The GLUE uncertainty analysis framework was then applied to produce simulated 5th and 95th percentile uncertainty bounds for the daily flow time-series and additionally the annual maximum prediction bounds for each catchment. The results show that the model performance varies significantly in space and time depending on catchment characteristics including climate, geology and human impact. We identify regions where models are systematically failing to produce good results, and present reasons why this could be the case. We also identify regions or catchment characteristics where one model performs better than others, and have explored what structural component or parameterisation enables certain models to produce better simulations in these catchments. Model predictive capability was assessed for each catchment, through looking at the ability of the models to produce discharge prediction bounds which successfully bound the observed discharge. These results improve our understanding of the predictive capability of simple conceptual hydrological models across the UK and help us to identify where further effort is needed to develop modelling approaches to better represent different catchment and climate typologies.

Environmental Impacts of Future Urban Deployment of Electric Vehicles: Assessment Framework and Case Study of Copenhagen for 2016-2030.

PubMed

Bohnes, Florence A; Gregg, Jay S; Laurent, Alexis

2017-12-05

To move toward environmentally sustainable transport systems, electric vehicles (EVs) are increasingly seen as viable alternatives to internal combustion vehicles (ICVs). To ensure effectiveness of such deployment, holistic assessments of environmental impacts can help decision-makers determine optimized urban strategies in a long-term perspective. However, explicit guidance and conduct of such assessments are currently missing. Here, we therefore propose a framework using life cycle assessment that enables the quantification of environmental impacts of a transport system at full urban scale from a fleet-based, foresight perspective. The analysis of the passenger car fleet development in the city of Copenhagen for the years 2016-2030 is used as a proof-of-concept. We modeled and compared five powertrain technologies, and we assessed four fleet-based scenarios for the entire city. Our results showed relative environmental benefits from range-extended and fuel-cell EVs over ICVs and standard EVs. These results were found to be sensitive to local settings, like electricity grid mix, which could alter the relative environmental performances across EV technologies. The comprehensive framework developed here can be applied to other geographic areas and contexts to assess the environmental sustainability of transport systems.

Evaluation metrics for bone segmentation in ultrasound

NASA Astrophysics Data System (ADS)

Lougheed, Matthew; Fichtinger, Gabor; Ungi, Tamas

2015-03-01

Tracked ultrasound is a safe alternative to X-ray for imaging bones. The interpretation of bony structures is challenging as ultrasound has no specific intensity characteristic of bones. Several image segmentation algorithms have been devised to identify bony structures. We propose an open-source framework that would aid in the development and comparison of such algorithms by quantitatively measuring segmentation performance in the ultrasound images. True-positive and false-negative metrics used in the framework quantify algorithm performance based on correctly segmented bone and correctly segmented boneless regions. Ground-truth for these metrics are defined manually and along with the corresponding automatically segmented image are used for the performance analysis. Manually created ground truth tests were generated to verify the accuracy of the analysis. Further evaluation metrics for determining average performance per slide and standard deviation are considered. The metrics provide a means of evaluating accuracy of frames along the length of a volume. This would aid in assessing the accuracy of the volume itself and the approach to image acquisition (positioning and frequency of frame). The framework was implemented as an open-source module of the 3D Slicer platform. The ground truth tests verified that the framework correctly calculates the implemented metrics. The developed framework provides a convenient way to evaluate bone segmentation algorithms. The implementation fits in a widely used application for segmentation algorithm prototyping. Future algorithm development will benefit by monitoring the effects of adjustments to an algorithm in a standard evaluation framework.

Performance of community health workers: situating their intermediary position within complex adaptive health systems.

PubMed

Kok, Maryse C; Broerse, Jacqueline E W; Theobald, Sally; Ormel, Hermen; Dieleman, Marjolein; Taegtmeyer, Miriam

2017-09-02

Health systems are social institutions, in which health worker performance is shaped by transactional processes between different actors.This analytical assessment unravels the complex web of factors that influence the performance of community health workers (CHWs) in low- and middle-income countries. It examines their unique intermediary position between the communities they serve and actors in the health sector, and the complexity of the health systems in which they operate. The assessment combines evidence from the international literature on CHW programmes with research outcomes from the 5-year REACHOUT consortium, undertaking implementation research to improve CHW performance in six contexts (two in Asia and four in Africa). A conceptual framework on CHW performance, which explicitly conceptualizes the interface role of CHWs, is presented. Various categories of factors influencing CHW performance are distinguished in the framework: the context, the health system and intervention hardware and the health system and intervention software. Hardware elements of CHW interventions comprise the supervision systems, training, accountability and communication structures, incentives, supplies and logistics. Software elements relate to the ideas, interests, relationships, power, values and norms of the health system actors. They influence CHWs' feelings of connectedness, familiarity, self-fulfilment and serving the same goals and CHWs' perceptions of support received, respect, competence, honesty, fairness and recognition.The framework shines a spotlight on the need for programmes to pay more attention to ideas, interests, relationships, power, values and norms of CHWs, communities, health professionals and other actors in the health system, if CHW performance is to improve.

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Evaluating ecommerce websites cognitive efficiency: an integrative framework based on data envelopment analysis.

PubMed

Lo Storto, Corrado

2013-11-01

This paper presents an integrative framework to evaluate ecommerce website efficiency from the user viewpoint using Data Envelopment Analysis (DEA). This framework is inspired by concepts driven from theories of information processing and cognition and considers the website efficiency as a measure of its quality and performance. When the users interact with the website interfaces to perform a task, they are involved in a cognitive effort, sustaining a cognitive cost to search, interpret and process information, and experiencing either a sense of satisfaction or dissatisfaction for that. The amount of ambiguity and uncertainty, and the search (over-)time during navigation that they perceive determine the effort size - and, as a consequence, the cognitive cost amount - they have to bear to perform their task. On the contrary, task performing and result achievement provide the users with cognitive benefits, making interaction with the website potentially attractive, satisfying, and useful. In total, 9 variables are measured, classified in a set of 3 website macro-dimensions (user experience, site navigability and structure). The framework is implemented to compare 52 ecommerce websites that sell products in the information technology and media market. A stepwise regression is performed to assess the influence of cognitive costs and benefits that mostly affect website efficiency. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Methods, procedures, and contextual characteristics of health technology assessment and health policy decision making: comparison of health technology assessment agencies in Germany, United Kingdom, France, and Sweden.

PubMed

Schwarzer, Ruth; Siebert, Uwe

2009-07-01

The objectives of this study were (i) to develop a systematic framework for describing and comparing different features of health technology assessment (HTA) agencies, (ii) to identify and describe similarities and differences between the agencies, and (iii) to draw conclusions both for producers and users of HTA in research, policy, and practice. We performed a systematic literature search, added information from HTA agencies, and developed a conceptual framework comprising eight main domains: organization, scope, processes, methods, dissemination, decision, implementation, and impact. We grouped relevant items of these domains in an evidence table and chose five HTA agencies to test our framework: DAHTA@DIMDI, HAS, IQWiG, NICE, and SBU. Item and domain similarity was assessed using the percentage of identical characteristics in pairwise comparisons across agencies. RESULTS were interpreted across agencies by demonstrating similarities and differences. Based on 306 included documents, we identified 90 characteristics of eight main domains appropriate for our framework. After applying the framework to the five agencies, we were able to show 40 percent similarities in "dissemination," 38 percent in "scope," 35 percent in "organization," 29 percent in "methods," 26 percent in "processes," 23 percent in "impact," 19 percent in "decision," and 17 percent in "implementation." We found considerably more differences than similarities of HTA features across agencies and countries. Our framework and comparison provides insights and clarification into the need for harmonization. Our findings could serve as descriptive database facilitating communication between producers and users.

Generic framework for vessel detection and tracking based on distributed marine radar image data

NASA Astrophysics Data System (ADS)

Siegert, Gregor; Hoth, Julian; Banyś, Paweł; Heymann, Frank

2018-04-01

Situation awareness is understood as a key requirement for safe and secure shipping at sea. The primary sensor for maritime situation assessment is still the radar, with the AIS being introduced as supplemental service only. In this article, we present a framework to assess the current situation picture based on marine radar image processing. Essentially, the framework comprises a centralized IMM-JPDA multi-target tracker in combination with a fully automated scheme for track management, i.e., target acquisition and track depletion. This tracker is conditioned on measurements extracted from radar images. To gain a more robust and complete situation picture, we are exploiting the aspect angle diversity of multiple marine radars, by fusing them a priori to the tracking process. Due to the generic structure of the proposed framework, different techniques for radar image processing can be implemented and compared, namely the BLOB detector and SExtractor. The overall framework performance in terms of multi-target state estimation will be compared for both methods based on a dedicated measurement campaign in the Baltic Sea with multiple static and mobile targets given.

A deliberative framework to identify the need for real-life evidence building of new cancer drugs after interim funding decision.

PubMed

Leung, Leanne; de Lemos, Mário L; Kovacic, Laurel

2017-01-01

Background With the rising cost of new oncology treatments, it is no longer sustainable to base initial drug funding decisions primarily on prospective clinical trials as their performance in real-life populations are often difficult to determine. In British Columbia, an approach in evidence building is to retrospectively analyse patient outcomes using observational research on an ad hoc basis. Methods The deliberative framework was constructed in three stages: framework design, framework validation and treatment programme characterization, and key informant interview. Framework design was informed through a literature review and analyses of provincial and national decision-making processes. Treatment programmes funded between 2010 and 2013 were used for framework validation. A selection concordance rate of 80% amongst three reviewers was considered to be a validation of the framework. Key informant interviews were conducted to determine the utility of this deliberative framework. Results A multi-domain deliberative framework with 15 assessment parameters was developed. A selection concordance rate of 84.2% was achieved for content validation of the framework. Nine treatment programmes from five different tumour groups were selected for retrospective outcomes analysis. Five contributory factors to funding uncertainties were identified. Key informants agreed that the framework is a comprehensive tool that targets the key areas involved in the funding decision-making process. Conclusions The oncology-based deliberative framework can be routinely used to assess treatment programmes from the major tumour sites for retrospective outcomes analysis. Key informants indicate this is a value-added tool and will provide insight to the current prospective funding model.

An Analytical Framework for Assessing the Efficacy of Small Satellites in Performing Novel Imaging Missions

NASA Astrophysics Data System (ADS)

Weaver, Oesa A.

In the last two decades, small satellites have opened up the use of space to groups other than governments and large corporations, allowing for increased participation and experimentation. This democratization of space was primarily enabled by two factors: improved technology and reduced launch costs. Improved technology allowed the miniaturization of components and reduced overall cost meaning many of the capabilities of larger satellites could be replicated at a fraction of the cost. In addition, new launcher systems that could host many small satellites as ride-shares on manifested vehicles lowered launch costs and simplified the process of getting a satellite into orbit. The potential of these smaller satellites to replace or augment existing systems has led to a flood of potential satellite and mission concepts, often with little rigorous study of whether the proposed satellite or mission is achievable or necessary. This work proposes an analytical framework to aid system designers in evaluating the ability of an existing concept or small satellite to perform a particular imaging mission, either replacing or augmenting existing capabilities. This framework was developed and then refined by application to the problem of using small satellites to perform a wide area search mission -- a mission not possible with existing imaging satellites, but one that would add to current capabilities. Requirements for a wide area search mission were developed, along with a list of factors that would affect image quality and system performance. Two existing small satellite concepts were evaluated for use by examining image quality from the systems, selecting an algorithm to perform the search function automatically, and then assessing mission feasibility by applying the algorithm to simulated imagery. Finally, a notional constellation design was developed to assess the number of satellites required to perform the mission. It was found that a constellation of 480 CubeSats producing 4 m spatial resolution panchromatic imagery and employing an on-board processing algorithm would be sufficient to perform a wide area search mission.

Comparison of Physics Frameworks for WebGL-Based Game Engine

NASA Astrophysics Data System (ADS)

Yogya, Resa; Kosala, Raymond

2014-03-01

Recently, a new technology called WebGL shows a lot of potentials for developing games. However since this technology is still new, there are still many potentials in the game development area that are not explored yet. This paper tries to uncover the potential of integrating physics frameworks with WebGL technology in a game engine for developing 2D or 3D games. Specifically we integrated three open source physics frameworks: Bullet, Cannon, and JigLib into a WebGL-based game engine. Using experiment, we assessed these frameworks in terms of their correctness or accuracy, performance, completeness and compatibility. The results show that it is possible to integrate open source physics frameworks into a WebGLbased game engine, and Bullet is the best physics framework to be integrated into the WebGL-based game engine.

Loss modeling for pricing catastrophic bonds.

DOT National Transportation Integrated Search

2008-12-01

In the research, a loss estimation framework is presented that directly relates seismic : hazard to seismic response to damage and hence to losses. A Performance-Based Earthquake : Engineering (PBEE) approach towards assessing the seismic vulnerabili...

A Multidirectional Model for Assessing Learning Disabled Students' Intelligence: An Information-Processing Framework.

ERIC Educational Resources Information Center

Swanson, H. Lee

1982-01-01

An information processing approach to the assessment of learning disabled students' intellectual performance is presented. The model is based on the assumption that intelligent behavior is comprised of a variety of problem- solving strategies. An account of child problem solving is explained and illustrated with a "thinking aloud" protocol.…

Diagnostic Efficiency of easyCBM[R] Math: Oregon. Technical Report #1009

ERIC Educational Resources Information Center

Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

The easyCBM[R] assessment system is an online benchmark and progress monitoring assessment system designed for use within a response to intervention framework. Educators using easyCBM[R] are often interested in using the results to predict students' state test performance. In the following technical document, we report diagnostic efficiency…

Documenting Student Learning in Music Performance: A Framework

ERIC Educational Resources Information Center

Wesolowski, Brian

2014-01-01

A fundamental aim of the Race to the Top agenda is to assess the effectiveness of teachers based on value-added growth measurement models of student achievement. However, in nontested grades and subject areas, such as music, alternative assessment types are being considered, including district-, school-, or teacher-developed measures. This article…

[The methodological basis of expert assessment of unfavourable outcomes of the stomatological treatment in the framework of civil law proceedings].

PubMed

Pigolkin, Iu I; Murzova, T V; Mirzoev, Kh M

2011-01-01

The authors discuss peculiarities of the performance of forensic medical expertise in the cases of unfavourable outcomes of the stomatological treatment. The methodological basis of expert assessment has been created to be applied in situations related to the unfavourable outcomes of dental care.

Improving L2 Reading Comprehension through Emotionalized Dynamic Assessment Procedures

ERIC Educational Resources Information Center

Abdolrezapour, Parisa

2017-01-01

The paper reports a study on an emotionally-loaded dynamic assessment procedure used with Iranian EFL learners. It focuses on the effect of using emotional intelligence characteristics (based on Goleman's framework) as a tool for motivating learners while performing reading tasks. The study with 50 intermediate learners aged 12-15 used three…

An Integrated Modeling Framework for Performing Environmental Assessments: Application to Ecosystem Services in the Albemarle-Pamlico Basins (NC and VA,USA)

EPA Science Inventory

The U.S. Environmental Protection Agency uses environmental models to inform rulemaking and policy decisions at multiple spatial and temporal scales. As decision-making has moved towards integrated thinking and assessment (e.g. media, site, region, services), the increasing compl...

Task-based image quality assessment in radiation therapy: initial characterization and demonstration with CT simulation images

NASA Astrophysics Data System (ADS)

Dolly, Steven R.; Anastasio, Mark A.; Yu, Lifeng; Li, Hua

2017-03-01

In current radiation therapy practice, image quality is still assessed subjectively or by utilizing physically-based metrics. Recently, a methodology for objective task-based image quality (IQ) assessment in radiation therapy was proposed by Barrett et al.1 In this work, we present a comprehensive implementation and evaluation of this new IQ assessment methodology. A modular simulation framework was designed to perform an automated, computer-simulated end-to-end radiation therapy treatment. A fully simulated framework was created that utilizes new learning-based stochastic object models (SOM) to obtain known organ boundaries, generates a set of images directly from the numerical phantoms created with the SOM, and automates the image segmentation and treatment planning steps of a radiation therapy work ow. By use of this computational framework, therapeutic operating characteristic (TOC) curves can be computed and the area under the TOC curve (AUTOC) can be employed as a figure-of-merit to guide optimization of different components of the treatment planning process. The developed computational framework is employed to optimize X-ray CT pre-treatment imaging. We demonstrate that use of the radiation therapy-based-based IQ measures lead to different imaging parameters than obtained by use of physical-based measures.

Quantitative assessments of municipal waste management systems: using different indicators to compare and rank programs in New York State.

PubMed

Greene, Krista L; Tonjes, David J

2014-04-01

The primary objective of waste management technologies and policies in the United States is to reduce the harmful environmental impacts of waste, particularly those relating to energy consumption and climate change. Performance indicators are frequently used to evaluate the environmental quality of municipal waste systems, as well as to compare and rank programs relative to each other in terms of environmental performance. However, there currently is no consensus on the best indicator for performing these environmental evaluations. The purpose of this study is to examine the common performance indicators used to assess the environmental benefits of municipal waste systems to determine if there is agreement between them regarding which system performs best environmentally. Focus is placed on how indicator selection influences comparisons between municipal waste management programs and subsequent system rankings. The waste systems of ten municipalities in the state of New York, USA, were evaluated using each common performance indicator and Spearman correlations were calculated to see if there was a significant association between system rank orderings. Analyses showed that rank orders of waste systems differ substantially when different indicators are used. Therefore, comparative system assessments based on indicators should be considered carefully, especially those intended to gauge environmental quality. Insight was also gained into specific factors which may lead to one system achieving higher rankings than another. However, despite the insufficiencies of indicators for comparative quality assessments, they do provide important information for waste managers and they can assist in evaluating internal programmatic performance and progress. To enhance these types of assessments, a framework for scoring indicators based on criteria that evaluate their utility and value for system evaluations was developed. This framework was used to construct an improved model for waste system performance assessments. Copyright © 2014 Elsevier Ltd. All rights reserved.

Comparative analysis on the selection of number of clusters in community detection

NASA Astrophysics Data System (ADS)

Kawamoto, Tatsuro; Kabashima, Yoshiyuki

2018-02-01

We conduct a comparative analysis on various estimates of the number of clusters in community detection. An exhaustive comparison requires testing of all possible combinations of frameworks, algorithms, and assessment criteria. In this paper we focus on the framework based on a stochastic block model, and investigate the performance of greedy algorithms, statistical inference, and spectral methods. For the assessment criteria, we consider modularity, map equation, Bethe free energy, prediction errors, and isolated eigenvalues. From the analysis, the tendency of overfit and underfit that the assessment criteria and algorithms have becomes apparent. In addition, we propose that the alluvial diagram is a suitable tool to visualize statistical inference results and can be useful to determine the number of clusters.

A conceptual framework for achieving performance enhancing drug compliance in sport.

PubMed

Donovan, Robert J; Egger, Garry; Kapernick, Vicki; Mendoza, John

2002-01-01

There has been, and continues to be, widespread international concern about athletes' use of banned performance enhancing drugs (PEDs). This concern culminated in the formation of the World Anti-Doping Agency (WADA) in November 1999. To date, the main focus on controlling the use of PEDs has been on testing athletes and the development of tests to detect usage. Although athletes' beliefs and values are known to influence whether or not an athlete will use drugs, little is known about athletes' beliefs and attitudes, and the limited empirical literature shows little use of behavioural science frameworks to guide research methodology, results interpretation, and intervention implications. Mindful of this in preparing its anti-doping strategy for the 2000 Olympics, the Australian Sports Drug Agency (ASDA) in 1997 commissioned a study to assess the extent to which models of attitude-behaviour change in the public health/injury prevention literature had useful implications for compliance campaigns in the sport drug area. A preliminary compliance model was developed from three behavioural science frameworks: social cognition models; threat (or fear) appeals; and instrumental and normative approaches. A subsequent review of the performance enhancing drug literature confirmed that the overall framework was consistent with known empirical data, and therefore had at least face validity if not construct validity. The overall model showed six major inputs to an athlete's attitudes and intentions with respect to performance enhancing drug usage: personality factors, threat appraisal, benefit appraisal, reference group influences, personal morality and legitimacy. The model demonstrated that a comprehensive, fully integrated programme is necessary for maximal effect, and provides anti-doping agencies with a structured framework for strategic planning and implementing interventions. Programmes can be developed in each of the six major areas, with allocation of resources to each area based on needs-assessment research with athletes and other relevant groups.

Damage/fault diagnosis in an operating wind turbine under uncertainty via a vibration response Gaussian mixture random coefficient model based framework

NASA Astrophysics Data System (ADS)

Avendaño-Valencia, Luis David; Fassois, Spilios D.

2017-07-01

The study focuses on vibration response based health monitoring for an operating wind turbine, which features time-dependent dynamics under environmental and operational uncertainty. A Gaussian Mixture Model Random Coefficient (GMM-RC) model based Structural Health Monitoring framework postulated in a companion paper is adopted and assessed. The assessment is based on vibration response signals obtained from a simulated offshore 5 MW wind turbine. The non-stationarity in the vibration signals originates from the continually evolving, due to blade rotation, inertial properties, as well as the wind characteristics, while uncertainty is introduced by random variations of the wind speed within the range of 10-20 m/s. Monte Carlo simulations are performed using six distinct structural states, including the healthy state and five types of damage/fault in the tower, the blades, and the transmission, with each one of them characterized by four distinct levels. Random vibration response modeling and damage diagnosis are illustrated, along with pertinent comparisons with state-of-the-art diagnosis methods. The results demonstrate consistently good performance of the GMM-RC model based framework, offering significant performance improvements over state-of-the-art methods. Most damage types and levels are shown to be properly diagnosed using a single vibration sensor.

A Systematic Approach for Quantitative Analysis of Multidisciplinary Design Optimization Framework

NASA Astrophysics Data System (ADS)

Kim, Sangho; Park, Jungkeun; Lee, Jeong-Oog; Lee, Jae-Woo

An efficient Multidisciplinary Design and Optimization (MDO) framework for an aerospace engineering system should use and integrate distributed resources such as various analysis codes, optimization codes, Computer Aided Design (CAD) tools, Data Base Management Systems (DBMS), etc. in a heterogeneous environment, and need to provide user-friendly graphical user interfaces. In this paper, we propose a systematic approach for determining a reference MDO framework and for evaluating MDO frameworks. The proposed approach incorporates two well-known methods, Analytic Hierarchy Process (AHP) and Quality Function Deployment (QFD), in order to provide a quantitative analysis of the qualitative criteria of MDO frameworks. Identification and hierarchy of the framework requirements and the corresponding solutions for the reference MDO frameworks, the general one and the aircraft oriented one were carefully investigated. The reference frameworks were also quantitatively identified using AHP and QFD. An assessment of three in-house frameworks was then performed. The results produced clear and useful guidelines for improvement of the in-house MDO frameworks and showed the feasibility of the proposed approach for evaluating an MDO framework without a human interference.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

PubMed Central

Knijnenburg, S.L.; Kremer, L.C.; Jaspers, M.W.M.

2015-01-01

Summary Background The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). Objective To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. Methods The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. Results The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Conclusion Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations. PMID:26171083

Self-Reported Pediatric Measures of Physical Activity, Sedentary Behavior and Strength Impact for PROMIS®: Conceptual Framework

PubMed Central

Tucker, Carole A.; Bevans, Katherine B.; Teneralli, Rachel E.; Smith, Ashley Wilder; Bowles, Heather R; Forrest, Christopher B.

2014-01-01

Purpose Children's physical activity (PA) levels are commonly assessed in pediatric clinical research, but rigorous self-report assessment tools for children are scarce, and computer adaptive test implementations are rare. Our objective was to improve pediatric self-report measures of activity using semi-structured interviews with experts and children for conceptualization of a child-informed framework. Methods Semi-structured interviews were conducted to conceptualize physical activity, sedentary behaviors, and strengthening activities. We performed systematic literature reviews to identify item-level concepts used to assess these 3 domains. Results We developed conceptual frameworks for each domain using words and phrases identified by children as relevant. Conclusions Semi-structured interview methods provide valuable information of children's perspectives and the ways children recall previous activities. Conceptualized domains of physical activity are based on the literature and expert views that also reflect children's experiences and understanding providing a basis for pediatric self-report instruments. PMID:25251789

A competency framework for colonoscopy training derived from cognitive task analysis techniques and expert review.

PubMed

Zupanc, Christine M; Burgess-Limerick, Robin; Hill, Andrew; Riek, Stephan; Wallis, Guy M; Plooy, Annaliese M; Horswill, Mark S; Watson, Marcus O; Hewett, David G

2015-12-01

Colonoscopy is a difficult cognitive-perceptual-motor task. Designing an appropriate instructional program for such a task requires an understanding of the knowledge, skills and attitudes underpinning the competency required to perform the task. Cognitive task analysis techniques provide an empirical means of deriving this information. Video recording and a think-aloud protocol were conducted while 20 experienced endoscopists performed colonoscopy procedures. "Cued-recall" interviews were also carried out post-procedure with nine of the endoscopists. Analysis of the resulting transcripts employed the constant comparative coding method within a grounded theory framework. The resulting draft competency framework was modified after review during semi-structured interviews conducted with six expert endoscopists. The proposed colonoscopy competency framework consists of twenty-seven skill, knowledge and attitude components, grouped into six categories (clinical knowledge; colonoscope handling; situation awareness; heuristics and strategies; clinical reasoning; and intra- and inter-personal). The colonoscopy competency framework provides a principled basis for the design of a training program, and for the design of formative assessment to gauge progress towards attaining the knowledge, skills and attitudes underpinning the achievement of colonoscopy competence.

A Security Audit Framework to Manage Information System Security

NASA Astrophysics Data System (ADS)

Pereira, Teresa; Santos, Henrique

The widespread adoption of information and communication technology have promoted an increase dependency of organizations in the performance of their Information Systems. As a result, adequate security procedures to properly manage information security must be established by the organizations, in order to protect their valued or critical resources from accidental or intentional attacks, and ensure their normal activity. A conceptual security framework to manage and audit Information System Security is proposed and discussed. The proposed framework intends to assist organizations firstly to understand what they precisely need to protect assets and what are their weaknesses (vulnerabilities), enabling to perform an adequate security management. Secondly, enabling a security audit framework to support the organization to assess the efficiency of the controls and policy adopted to prevent or mitigate attacks, threats and vulnerabilities, promoted by the advances of new technologies and new Internet-enabled services, that the organizations are subject of. The presented framework is based on a conceptual model approach, which contains the semantic description of the concepts defined in information security domain, based on the ISO/IEC_JCT1 standards.

A critique of the Uganda district league table using a normative health system performance assessment framework.

PubMed

KirungaTashobya, Christine; Ssengooba, Freddie; Nabyonga-Orem, Juliet; Bataringaya, Juliet; Macq, Jean; Marchal, Bruno; Musila, Timothy; Criel, Bart

2018-05-10

In 2003 the Uganda Ministry of Health (MoH) introduced the District League Table (DLT) to track district performance. This review of the DLT is intended to add to the evidence base on Health Systems Performance Assessment (HSPA) globally, with emphasis on Low and Middle Income Countries (LMICs), and provide recommendations for adjustments to the current Ugandan reality. A normative HSPA framework was used to inform the development of a Key Informant Interview (KII) tool. Thirty Key Informants were interviewed, purposively selected from the Ugandan health system on the basis of having developed or used the DLT. KII data and information from published and grey literature on the Uganda health system was analyzed using deductive analysis. Stakeholder involvement in the development of the DLT was limited, including MoH officials and development partners, and a few district technical managers. Uganda policy documents articulate a conceptually broad health system whereas the DLT focuses on a healthcare system. The complexity and dynamism of the Uganda health system was insufficiently acknowledged by the HSPA framework. Though DLT objectives and indicators were articulated, there was no conceptual reference model and lack of clarity on the constitutive dimensions. The DLT mechanisms for change were not explicit. The DLT compared markedly different districts and did not identify factors behind observed performance. Uganda lacks a designated institutional unit for the analysis and presentation of HSPA data, and there are challenges in data quality and range. The critique of the DLT using a normative model supported the development of recommendation for Uganda district HSPA and provides lessons for other LMICs. A similar approach can be used by researchers and policy makers elsewhere for the review and development of other frameworks. Adjustments in Uganda district HSPA should consider: wider stakeholder involvement with more district managers including political, administrative and technical; better anchoring within the national health system framework; integration of the notion of complexity in the design of the framework; and emphasis on facilitating district decision-making and learning. There is need to improve data quality and range and additional approaches for data analysis and presentation.

Comparative SWOT analysis of strategic environmental assessment systems in the Middle East and North Africa region.

PubMed

Rachid, G; El Fadel, M

2013-08-15

This paper presents a SWOT analysis of SEA systems in the Middle East North Africa region through a comparative examination of the status, application and structure of existing systems based on country-specific legal, institutional and procedural frameworks. The analysis is coupled with the multi-attribute decision making method (MADM) within an analytical framework that involves both performance analysis based on predefined evaluation criteria and countries' self-assessment of their SEA system through open-ended surveys. The results show heterogenous status with a general delayed progress characterized by varied levels of weaknesses embedded in the legal and administrative frameworks and poor integration with the decision making process. Capitalizing on available opportunities, the paper highlights measures to enhance the development and enactment of SEA in the region. Copyright © 2013 Elsevier Ltd. All rights reserved.

Building a framework for ergonomic research on laparoscopic instrument handles.

PubMed

Li, Zheng; Wang, Guohui; Tan, Juan; Sun, Xulong; Lin, Hao; Zhu, Shaihong

2016-06-01

Laparoscopic surgery carries the advantage of minimal invasiveness, but ergonomic design of the instruments used has progressed slowly. Previous studies have demonstrated that the handle of laparoscopic instruments is vital for both surgical performance and surgeon's health. This review provides an overview of the sub-discipline of handle ergonomics, including an evaluation framework, objective and subjective assessment systems, data collection and statistical analyses. Furthermore, a framework for ergonomic research on laparoscopic instrument handles is proposed to standardize work on instrument design. Copyright © 2016 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved.

Evaluating the Effects of School Health Interventions on School Performance. Design Report.

ERIC Educational Resources Information Center

Devaney, Barbara; And Others

This evaluation design report presents a general framework for assessing the effects of school health interventions on students' school performance in order to guide efforts to develop strong empirical evidence. The report begins with an overview of eight general types of school health interventions: school health education, health services,…

The Role of Education in Health System Performance

ERIC Educational Resources Information Center

Grignon, Michel

2008-01-01

I investigate the role of education on health, using country-level data and the production frontier framework suggested by the World Health Organization (WHO) to assess performances of health care systems. I find that the impact of human capital on health is much smaller than suggested by the WHO frontier model, and the relationship exhibits…

Enhancing Effective Chemistry Learning through Hypermedia Instructional Mode of Delivery

ERIC Educational Resources Information Center

Abanikannda, Mutahir Oluwafemi

2016-01-01

This study provides a framework for the production of Hypermedia Instructional package. It also assessed the effectiveness of hypermedia instructional mode of delivery on students? performance in Chemistry. This is with a view of improving the learning of Chemistry which may eventually help to improve students? performance. The developmental study…

CMAQ Model Evaluation Framework

EPA Pesticide Factsheets

CMAQ is tested to establish the modeling system’s credibility in predicting pollutants such as ozone and particulate matter. Evaluation of CMAQ has been designed to assess the model’s performance for specific time periods and for specific uses.

Big data and high-performance analytics in structural health monitoring for bridge management

NASA Astrophysics Data System (ADS)

Alampalli, Sharada; Alampalli, Sandeep; Ettouney, Mohammed

2016-04-01

Structural Health Monitoring (SHM) can be a vital tool for effective bridge management. Combining large data sets from multiple sources to create a data-driven decision-making framework is crucial for the success of SHM. This paper presents a big data analytics framework that combines multiple data sets correlated with functional relatedness to convert data into actionable information that empowers risk-based decision-making. The integrated data environment incorporates near real-time streams of semi-structured data from remote sensors, historical visual inspection data, and observations from structural analysis models to monitor, assess, and manage risks associated with the aging bridge inventories. Accelerated processing of dataset is made possible by four technologies: cloud computing, relational database processing, support from NOSQL database, and in-memory analytics. The framework is being validated on a railroad corridor that can be subjected to multiple hazards. The framework enables to compute reliability indices for critical bridge components and individual bridge spans. In addition, framework includes a risk-based decision-making process that enumerate costs and consequences of poor bridge performance at span- and network-levels when rail networks are exposed to natural hazard events such as floods and earthquakes. Big data and high-performance analytics enable insights to assist bridge owners to address problems faster.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yuan, Chris, E-mail: cyuan@uwm.edu; Wang, Endong; Zhai, Qiang

Temporal homogeneity of inventory data is one of the major problems in life cycle assessment (LCA). Addressing temporal homogeneity of life cycle inventory data is important in reducing the uncertainties and improving the reliability of LCA results. This paper attempts to present a critical review and discussion on the fundamental issues of temporal homogeneity in conventional LCA and propose a theoretical framework for temporal discounting in LCA. Theoretical perspectives for temporal discounting in life cycle inventory analysis are discussed first based on the key elements of a scientific mechanism for temporal discounting. Then generic procedures for performing temporal discounting inmore » LCA is derived and proposed based on the nature of the LCA method and the identified key elements of a scientific temporal discounting method. A five-step framework is proposed and reported in details based on the technical methods and procedures needed to perform a temporal discounting in life cycle inventory analysis. Challenges and possible solutions are also identified and discussed for the technical procedure and scientific accomplishment of each step within the framework. - Highlights: • A critical review for temporal homogeneity problem of life cycle inventory data • A theoretical framework for performing temporal discounting on inventory data • Methods provided to accomplish each step of the temporal discounting framework.« less

Measuring coherence of computer-assisted likelihood ratio methods.

PubMed

Haraksim, Rudolf; Ramos, Daniel; Meuwly, Didier; Berger, Charles E H

2015-04-01

Measuring the performance of forensic evaluation methods that compute likelihood ratios (LRs) is relevant for both the development and the validation of such methods. A framework of performance characteristics categorized as primary and secondary is introduced in this study to help achieve such development and validation. Ground-truth labelled fingerprint data is used to assess the performance of an example likelihood ratio method in terms of those performance characteristics. Discrimination, calibration, and especially the coherence of this LR method are assessed as a function of the quantity and quality of the trace fingerprint specimen. Assessment of the coherence revealed a weakness of the comparison algorithm in the computer-assisted likelihood ratio method used. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Development of a new integrated local trajectory planning and tracking control framework for autonomous ground vehicles

NASA Astrophysics Data System (ADS)

Li, Xiaohui; Sun, Zhenping; Cao, Dongpu; Liu, Daxue; He, Hangen

2017-03-01

This study proposes a novel integrated local trajectory planning and tracking control (ILTPTC) framework for autonomous vehicles driving along a reference path with obstacles avoidance. For this ILTPTC framework, an efficient state-space sampling-based trajectory planning scheme is employed to smoothly follow the reference path. A model-based predictive path generation algorithm is applied to produce a set of smooth and kinematically-feasible paths connecting the initial state with the sampling terminal states. A velocity control law is then designed to assign a speed value at each of the points along the generated paths. An objective function considering both safety and comfort performance is carefully formulated for assessing the generated trajectories and selecting the optimal one. For accurately tracking the optimal trajectory while overcoming external disturbances and model uncertainties, a combined feedforward and feedback controller is developed. Both simulation analyses and vehicle testing are performed to verify the effectiveness of the proposed ILTPTC framework, and future research is also briefly discussed.

A comprehensive test of clinical reasoning for medical students: An olympiad experience in Iran.

PubMed

Monajemi, Alireza; Arabshahi, Kamran Soltani; Soltani, Akbar; Arbabi, Farshid; Akbari, Roghieh; Custers, Eugene; Hadadgar, Arash; Hadizadeh, Fatemeh; Changiz, Tahereh; Adibi, Peyman

2012-01-01

Although some tests for clinical reasoning assessment are now available, the theories of medical expertise have not played a major role in this filed. In this paper, illness script theory was chose as a theoretical framework and contemporary clinical reasoning tests were put together based on this theoretical model. This paper is a qualitative study performed with an action research approach. This style of research is performed in a context where authorities focus on promoting their organizations' performance and is carried out in the form of teamwork called participatory research. Results are presented in four parts as basic concepts, clinical reasoning assessment, test framework, and scoring. we concluded that no single test could thoroughly assess clinical reasoning competency, and therefore a battery of clinical reasoning tests is needed. This battery should cover all three parts of clinical reasoning process: script activation, selection and verification. In addition, not only both analytical and non-analytical reasoning, but also both diagnostic and management reasoning should evenly take into consideration in this battery. This paper explains the process of designing and implementing the battery of clinical reasoning in the Olympiad for medical sciences students through an action research.

Applicability Analysis of Validation Evidence for Biomedical Computational Models

DOE PAGES

Pathmanathan, Pras; Gray, Richard A.; Romero, Vicente J.; ...

2017-09-07

Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibilitymore » of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.« less

Applicability Analysis of Validation Evidence for Biomedical Computational Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pathmanathan, Pras; Gray, Richard A.; Romero, Vicente J.

Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibilitymore » of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.« less

A theoretical framework to describe communication processes during medical disability assessment interviews

PubMed Central

van Rijssen, H Jolanda; Schellart, Antonius JM; Anema, Johannes R; van der Beek, Allard J

2009-01-01

Background Research in different fields of medicine suggests that communication is important in physician-patient encounters and influences satisfaction with these encounters. It is argued that this also applies to the non-curative tasks that physicians perform, such as sickness certification and medical disability assessments. However, there is no conceptualised theoretical framework that can be used to describe intentions with regard to communication behaviour, communication behaviour itself, and satisfaction with communication behaviour in a medical disability assessment context. Objective The objective of this paper is to describe the conceptualisation of a model for the communication behaviour of physicians performing medical disability assessments in a social insurance context and of their claimants, in face-to-face encounters during medical disability assessment interviews and the preparation thereof. Conceptualisation The behavioural model, based on the Theory of Planned Behaviour (TPB), is conceptualised for the communication behaviour of social insurance physicians and claimants separately, but also combined during the assessment interview. Other important concepts in the model are the evaluation of communication behaviour (satisfaction), intentions, attitudes, skills, and barriers for communication. Conclusion The conceptualisation of the TPB-based behavioural model will help to provide insight into the communication behaviour of social insurance physicians and claimants during disability assessment interviews. After empirical testing of the relationships in the model, it can be used in other studies to obtain more insight into communication behaviour in non-curative medicine, and it could help social insurance physicians to adapt their communication behaviour to their task when performing disability assessments. PMID:19807905

Data Driven Performance Evaluation of Wireless Sensor Networks

PubMed Central

Frery, Alejandro C.; Ramos, Heitor S.; Alencar-Neto, José; Nakamura, Eduardo; Loureiro, Antonio A. F.

2010-01-01

Wireless Sensor Networks are presented as devices for signal sampling and reconstruction. Within this framework, the qualitative and quantitative influence of (i) signal granularity, (ii) spatial distribution of sensors, (iii) sensors clustering, and (iv) signal reconstruction procedure are assessed. This is done by defining an error metric and performing a Monte Carlo experiment. It is shown that all these factors have significant impact on the quality of the reconstructed signal. The extent of such impact is quantitatively assessed. PMID:22294920

Promoting Formative Assessment in a Connected Classroom Environment: Design and Implementation of Digital Resources

ERIC Educational Resources Information Center

Cusi, Annalisa; Morselli, Francesca; Sabena, Cristina

2017-01-01

This paper is based on a design-based research project investigating how to use digital resources to help activate formative assessment processes in the classroom. Performed as part of FaSMEd, a European Union project, our own project adopts a comprehensive theoretical framework, including the different functionalities of technology, formative…

Large-Scale Investigation of the Role of Trait Activation Theory for Understanding Assessment Center Convergent and Discriminant Validity

ERIC Educational Resources Information Center

Lievens, Filip; Chasteen, Christopher S.; Day, Eric Anthony; Christiansen, Neil D.

2006-01-01

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are…

Using Multigroup Confirmatory Factor Analysis to Test Measurement Invariance in Raters: A Clinical Skills Examination Application

ERIC Educational Resources Information Center

Kahraman, Nilufer; Brown, Crystal B.

2015-01-01

Psychometric models based on structural equation modeling framework are commonly used in many multiple-choice test settings to assess measurement invariance of test items across examinee subpopulations. The premise of the current article is that they may also be useful in the context of performance assessment tests to test measurement invariance…

The impact of contracting-out on health system performance: a conceptual framework.

PubMed

Liu, Xingzhu; Hotchkiss, David R; Bose, Sujata

2007-07-01

Despite the increased popularity of contracting-out of health services in developing countries, its effectiveness on overall health system performance is not yet conclusive. Except for substantial evidence of contracting-out's positive effect on access to health services and some evidence on improved equity in access, there is little evidence of contracting-out's impact on quality and efficiency. Most studies on the subject evaluate specific contracting-out projects against narrowly specified project objectives, not against more broadly defined health system goals. For this reason, conclusions of positive effects pertaining to project level may not hold at system level. This paper presents a conceptual framework that is expected to facilitate comprehensive, rigorous, and standardized evaluation of contracting-out at health system level. Specifically, this framework supports: full and standardized description of contracting-out interventions, study of the determinants of effectiveness, examination of provider and purchaser responses, assessment of the impact of contracting-out on all dimensions of health system performance, and cross-project analyses.

A framework for assessing discretionary corporate performance towards the environment

NASA Astrophysics Data System (ADS)

Labatt, Sonia

1991-03-01

This article reviews the existing models of corporate social responsiveness and develops a theoretical framework with which to examine corporations' discretionary performance with respect to one social issue, that of the environment. Discretionary indicators of corporate response to environmental issues are developed and tested within this framework. Twelve companies from five different sectors were selected for the survey, based on prior knowledge of their commitment to environmental concerns. Primary data was collected from personal interviews, and secondary data was obtained from company documents, annual reports, and other forms of publically disclosed information. Empirical results varied, but certain voluntary indicators, such as composition of the board of directors, the environmental affairs function, community support, and the annual report are considered to provide strong indications of discretionary corporate performance. Philanthropy and company products proved to be less satisfactory indicators of corporate commitment to the environment. The aggregated results revealed a correlation between the final rankings of firms' discretionary environmental performance and whether those companies are process or product oriented. Linkages between discretionary elements and those of economic and legal requirements were not explored.

Developing a Three Processes Framework to Analyze Hydrologic Performance of Urban Stormwater Management in a Watershed Scale

NASA Astrophysics Data System (ADS)

Lyu, H.; Ni, G.; Sun, T.

2016-12-01

Urban stormwater management contributes to recover water cycle to a nearly natural situation. It is a challenge for analyzing the hydrologic performance in a watershed scale, since the measures are various of sorts and scales and work in different processes. A three processes framework is developed to simplify the urban hydrologic process on the surface and evaluate the urban stormwater management. The three processes include source utilization, transfer regulation and terminal detention, by which the stormwater is controlled in order or discharged. Methods for analyzing performance are based on the water controlled proportions by each process, which are calculated using USEPA Stormwater Management Model. A case study form Beijing is used to illustrate how the performance varies under a set of designed events of different return periods. This framework provides a method to assess urban stormwater management as a whole system considering the interaction between measures, and to examine if there is any weak process of an urban watershed to be improved. The results help to make better solutions of urban water crisis.

A Framework For Analysis Of Coastal Infrastructure Vunerabilty To Global Sea Level Rise

NASA Astrophysics Data System (ADS)

Obrien, P. S.; White, K. D.; Veatch, W.; Marzion, R.; Moritz, H.; Moritz, H. R.

2017-12-01

Recorded impacts of global sea rise on coastal water levels have been documented over the past 100 to 150 years. In the recent 40 years the assumption of hydrologic stationarity has been recognized as invalid. New coastal infrastructure designs must recognize the paradigm shift from hydrologic stationarity to non-stationarity in coastal hydrology. A framework for the evaluation of existing coastal infrastructure is proposed to effectively assess design vulnerability. Two data sets developed from existing structures are chosen to test a proposed framework for vunerabilty to global sea level rise, with the proposed name Climate Preparedness and Resilience Register (CPRR). The CPRR framework consists of four major elements; Datum Adjustment, Coastal Water Levels, Scenario Projections and Performance Thresholds.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Coleman, Justin; Slaughter, Andrew; Veeraraghavan, Swetha

Multi-hazard Analysis for STOchastic time-DOmaiN phenomena (MASTODON) is a finite element application that aims at analyzing the response of 3-D soil-structure systems to natural and man-made hazards such as earthquakes, floods and fire. MASTODON currently focuses on the simulation of seismic events and has the capability to perform extensive ‘source-to-site’ simulations including earthquake fault rupture, nonlinear wave propagation and nonlinear soil-structure interaction (NLSSI) analysis. MASTODON is being developed to be a dynamic probabilistic risk assessment framework that enables analysts to not only perform deterministic analyses, but also easily perform probabilistic or stochastic simulations for the purpose of risk assessment.

A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging

NASA Astrophysics Data System (ADS)

Solomon, Justin; Samei, Ehsan

2014-11-01

Realistic three-dimensional (3D) mathematical models of subtle lesions are essential for many computed tomography (CT) studies focused on performance evaluation and optimization. In this paper, we develop a generic mathematical framework that describes the 3D size, shape, contrast, and contrast-profile characteristics of a lesion, as well as a method to create lesion models based on CT data of real lesions. Further, we implemented a technique to insert the lesion models into CT images in order to create hybrid CT datasets. This framework was used to create a library of realistic lesion models and corresponding hybrid CT images. The goodness of fit of the models was assessed using the coefficient of determination (R2) and the visual appearance of the hybrid images was assessed with an observer study using images of both real and simulated lesions and receiver operator characteristic (ROC) analysis. The average R2 of the lesion models was 0.80, implying that the models provide a good fit to real lesion data. The area under the ROC curve was 0.55, implying that the observers could not readily distinguish between real and simulated lesions. Therefore, we conclude that the lesion-modeling framework presented in this paper can be used to create realistic lesion models and hybrid CT images. These models could be instrumental in performance evaluation and optimization of novel CT systems.

The Measurement of Economic, Social and Environmental Performance of Countries: A Novel Approach

ERIC Educational Resources Information Center

Cracolici, Maria Francesca; Cuffaro, Miranda; Nijkamp, Peter

2010-01-01

This paper presents a new analytical framework for assessing spatial disparities among countries. It takes for granted that the analysis of a country's performance cannot be limited solely to either economic or social factors. The aim of the paper is to combine relevant economic and "non-economic" (mainly social) aspects of a country's performance…

Precision and Accuracy of a Digital Impression Scanner in Full-Arch Implant Rehabilitation.

PubMed

Pesce, Paolo; Pera, Francesco; Setti, Paolo; Menini, Maria

To evaluate the accuracy and precision of a digital scanner used to scan four implants positioned according to an immediate loading implant protocol and to assess the accuracy of an aluminum framework fabricated from a digital impression. Five master casts reproducing different edentulous maxillae with four tilted implants were used. Four scan bodies were screwed onto the low-profile abutments, and a digital intraoral scanner was used to perform five digital impressions of each master cast. To assess trueness, a metal framework of the best digital impression was produced with computer-aided design/computer-assisted manufacture (CAD/CAM) technology and passive fit was assessed with the Sheffield test. Gaps between the frameworks and the implant analogs were measured with a stereomicroscope. To assess precision, three-dimensional (3D) point cloud processing software was used to measure the deviations between the five digital impressions of each cast by producing a color map. The deviation values were grouped in three classes, and differences were assessed between class 2 (representing lower discrepancies) and the assembled classes 1 and 3 (representing the higher negative and positive discrepancies, respectively). The frameworks showed a mean gap of < 30 μm (range: 2 to 47 μm). A statistically significant difference was found between the two groups by the 3D point cloud software, with higher frequencies of points in class 2 than in grouped classes 1 and 3 (P < .001). Within the limits of this in vitro study, it appears that a digital impression may represent a reliable method for fabricating full-arch implant frameworks with good passive fit when tilted implants are present.

A Framework to Assess Where and How Children Connect to Nature.

PubMed

Giusti, Matteo; Svane, Ulrika; Raymond, Christopher M; Beery, Thomas H

2017-01-01

The design of the green infrastructure in urban areas largely ignores how people's relation to nature, or human-nature connection (HNC), can be nurtured. One practical reason for this is the lack of a framework to guide the assessment of where people, and more importantly children, experience significant nature situations and establish nature routines. This paper develops such a framework. We employed a mixed-method approach to understand what qualities of nature situations connect children to nature (RQ1), what constitutes children's HNC (RQ2), and how significant nature situations and children's HNC relate to each other over time (RQ3). We first interviewed professionals in the field of connecting children to nature ( N = 26), performed inductive thematic analysis of these interviews, and then further examined the inductive findings by surveying specialists ( N = 275). We identified 16 qualities of significant nature situations (e.g., "awe," "engagement of senses," "involvement of mentors") and 10 abilities that constitute children's HNC (e.g., "feeling comfortable in natural spaces," "feeling attached to natural spaces," "taking care of nature"). We elaborated three principles to answer our research questions: (1) significant nature situations are various and with differing consequences for children's HNC; (2) children's HNC is a complex embodied ability; (3) children's HNC progresses over time through diverse nature routines. Together, these findings form the Assessment framework for Children's Human Nature Situations (ACHUNAS). ACHUNAS is a comprehensive framework that outlines what to quantify or qualify when assessing "child-nature connecting" environments. It guides the assessment of where and how children connect to nature, stimulating both the design of nature-connecting human habitats as well as pedagogical approaches to HNC.

A Framework to Assess Where and How Children Connect to Nature

PubMed Central

Giusti, Matteo; Svane, Ulrika; Raymond, Christopher M.; Beery, Thomas H.

2018-01-01

The design of the green infrastructure in urban areas largely ignores how people's relation to nature, or human-nature connection (HNC), can be nurtured. One practical reason for this is the lack of a framework to guide the assessment of where people, and more importantly children, experience significant nature situations and establish nature routines. This paper develops such a framework. We employed a mixed-method approach to understand what qualities of nature situations connect children to nature (RQ1), what constitutes children's HNC (RQ2), and how significant nature situations and children's HNC relate to each other over time (RQ3). We first interviewed professionals in the field of connecting children to nature (N = 26), performed inductive thematic analysis of these interviews, and then further examined the inductive findings by surveying specialists (N = 275). We identified 16 qualities of significant nature situations (e.g., “awe,” “engagement of senses,” “involvement of mentors”) and 10 abilities that constitute children's HNC (e.g., “feeling comfortable in natural spaces,” “feeling attached to natural spaces,” “taking care of nature”). We elaborated three principles to answer our research questions: (1) significant nature situations are various and with differing consequences for children's HNC; (2) children's HNC is a complex embodied ability; (3) children's HNC progresses over time through diverse nature routines. Together, these findings form the Assessment framework for Children's Human Nature Situations (ACHUNAS). ACHUNAS is a comprehensive framework that outlines what to quantify or qualify when assessing “child-nature connecting” environments. It guides the assessment of where and how children connect to nature, stimulating both the design of nature-connecting human habitats as well as pedagogical approaches to HNC. PMID:29354088

A design automation framework for computational bioenergetics in biological networks.

PubMed

Angione, Claudio; Costanza, Jole; Carapezza, Giovanni; Lió, Pietro; Nicosia, Giuseppe

2013-10-01

The bioenergetic activity of mitochondria can be thoroughly investigated by using computational methods. In particular, in our work we focus on ATP and NADH, namely the metabolites representing the production of energy in the cell. We develop a computational framework to perform an exhaustive investigation at the level of species, reactions, genes and metabolic pathways. The framework integrates several methods implementing the state-of-the-art algorithms for many-objective optimization, sensitivity, and identifiability analysis applied to biological systems. We use this computational framework to analyze three case studies related to the human mitochondria and the algal metabolism of Chlamydomonas reinhardtii, formally described with algebraic differential equations or flux balance analysis. Integrating the results of our framework applied to interacting organelles would provide a general-purpose method for assessing the production of energy in a biological network.

Individual performance review in hospital practice: the development of a framework and evaluation of doctors' attitudes to its value and implementation.

PubMed

Trebble, T M; Cruickshank, L; Hockey, P M; Heyworth, N; Powell, T; Clarke, N

2013-11-01

Appraisal, or independent performance review (IPR) is used in human resources management in the commercial and public sectors to evaluate the performance of an employee against agreed local organisational expectations and objectives, and to identify their requirements for development and effective management. IPR for NHS consultants may provide essential information for job planning, contribute towards medical appraisal for revalidation, and facilitate productivity and quality improvement. To develop a framework for IPR for consultants, and to determine attitudes on its value, process and content. Information from commercial, public and voluntary sector models and published and other literature sources were used to develop an IPR framework. This was assessed through a three-cycle action research methodology involving qualitative interviews with 22 consultants (predominantly with medical management roles). The domains of the IPR framework included: (1) performance against objectives; (2) behaviour and leadership; (3) talent management; (4) agreed future objectives. A number of themes were identified from the consultant interviews including: ineffective current appraisal systems reflecting a lack of valid performance data and allotted time; a lack of empowerment of medical managers to address performance issues; IPR as a more explicit system, offering value in evaluating doctors performance; and the dependence of successful implementation on the engagement of the Trust executive. IPR may have value for performance evaluation of consultants, contributing toward job planning and complementing medical appraisal. Support by their employing organisation and engagement with medical managers in design and implementation is likely to be essential.

A Framework for Dimensioning VDL-2 Air-Ground Networks

NASA Technical Reports Server (NTRS)

Ribeiro, Leila Z.; Monticone, Leone C.; Snow, Richard E.; Box, Frank; Apaza, Rafel; Bretmersky, Steven

2014-01-01

This paper describes a framework developed at MITRE for dimensioning a Very High Frequency (VHF) Digital Link Mode 2 (VDL-2) Air-to-Ground network. This framework was developed to support the FAA's Data Communications (Data Comm) program by providing estimates of expected capacity required for the air-ground network services that will support Controller-Pilot-Data-Link Communications (CPDLC), as well as the spectrum needed to operate the system at required levels of performance. The Data Comm program is part of the FAA's NextGen initiative to implement advanced communication capabilities in the National Airspace System (NAS). The first component of the framework is the radio-frequency (RF) coverage design for the network ground stations. Then we proceed to describe the approach used to assess the aircraft geographical distribution and the data traffic demand expected in the network. The next step is the resource allocation utilizing optimization algorithms developed in MITRE's Spectrum ProspectorTM tool to propose frequency assignment solutions, and a NASA-developed VDL-2 tool to perform simulations and determine whether a proposed plan meets the desired performance requirements. The framework presented is capable of providing quantitative estimates of multiple variables related to the air-ground network, in order to satisfy established coverage, capacity and latency performance requirements. Outputs include: coverage provided at different altitudes; data capacity required in the network, aggregated or on a per ground station basis; spectrum (pool of frequencies) needed for the system to meet a target performance; optimized frequency plan for a given scenario; expected performance given spectrum available; and, estimates of throughput distributions for a given scenario. We conclude with a discussion aimed at providing insight into the tradeoffs and challenges identified with respect to radio resource management for VDL-2 air-ground networks.

Evidence based post graduate training. A systematic review of reviews based on the WFME quality framework

PubMed Central

2011-01-01

Background A framework for high quality in post graduate training has been defined by the World Federation of Medical Education (WFME). The objective of this paper is to perform a systematic review of reviews to find current evidence regarding aspects of quality of post graduate training and to organise the results following the 9 areas of the WFME framework. Methods The systematic literature review was conducted in 2009 in Medline Ovid, EMBASE, ERIC and RDRB databases from 1995 onward. The reviews were selected by two independent researchers and a quality appraisal was based on the SIGN tool. Results 31 reviews met inclusion criteria. The majority of the reviews provided information about the training process (WFME area 2), the assessment of trainees (WFME area 3) and the trainees (WFME area 4). One review covered the area 8 'governance and administration'. No review was found in relation to the mission and outcomes, the evaluation of the training process and the continuous renewal (respectively areas 1, 7 and 9 of the WFME framework). Conclusions The majority of the reviews provided information about the training process, the assessment of trainees and the trainees. Indicators used for quality assessment purposes of post graduate training should be based on this evidence but further research is needed for some areas in particular to assess the quality of the training process. PMID:21977898

The need for a systematic approach to disaster psychosocial response: a suggested competency framework.

PubMed

Cox, Robin S; Danford, Taryn

2014-04-01

Competency models attempt to define what makes expert performers "experts." Successful disaster psychosocial planning and the institutionalizing of psychosocial response within emergency management require clearly-defined skill sets. This necessitates anticipating both the short- and long-term psychosocial implications of a disaster or health emergency (ie, pandemic) by developing effective and sustained working relationships among psychosocial providers, programs, and other planning partners. The following article outlines recommended competencies for psychosocial responders to enable communities and organizations to prepare for and effectively manage a disaster response. Competency-based models are founded on observable performance or behavioral indicators, attitudes, traits, or personalities related to effective performance in a specific role or job. After analyzing the literature regarding competency-based frameworks, a proposed competency framework that details 13 competency domains is suggested. Each domain describes a series of competencies and suggests behavioral indicators for each competency and, where relevant, associated training expectations. These domains have been organized under three distinct categories or types of competencies: general competency domains; disaster psychosocial intervention competency domains; and disaster psychosocial program leadership and coordination competency domains. Competencies do not replace job descriptions nor should they be confused with performance assessments. What they can do is update and revise job descriptions; orient existing and new employees to their disaster/emergency roles and responsibilities; target training needs; provide the basis for ongoing self-assessment by agencies and individuals as they evaluate their readiness to respond; and provide a job- or role-relevant basis for performance appraisal dimensions or standards and review discussions. Using a modular approach to psychosocial planning, service providers can improve their response capacity by utilizing differences in levels of expertise and training. The competencies outlined in this paper can thus be used to standardize expectations about levels of psychosocial support interventions. In addition this approach provides an adaptable framework that can be adjusted for various contexts.

A strategy for monitoring and evaluating massive open online courses.

PubMed

Chapman, S A; Goodman, S; Jawitz, J; Deacon, A

2016-08-01

We argue that the complex, innovative and adaptive nature of Massive Open Online Course (MOOC) initiatives poses particular challenges to monitoring and evaluation, in that any evaluation strategy will need to follow a systems approach. This article aims to guide organizations implementing MOOCs through a series of steps to assist them in developing a strategy to monitor, improve, and judge the merit of their initiatives. We describe how we operationalise our strategy by first defining the different layers of interacting agents in a given MOOC system. We then tailor our approach to these different layers. Specifically, a two-pronged approach was developed, where we suggest that individual projects be assessed through performance monitoring; assessment criteria for which would be defined at the outset to include coverage, participation, quality and student achievement. In contrast, the success of an overall initiative should be considered within a more adaptive, emergent evaluation inquiry framework. We present the inquiry framework we developed for MOOC initiatives, and show how this framework might be used to develop evaluation questions and an assessment methodology. We also define the more fixed indicators and measures for project performance monitoring. Our strategy is described as it was developed to inform the evaluation of a MOOC initiative at the University of Cape Town (UCT), South Africa. Copyright © 2016 Elsevier Ltd. All rights reserved.

Recommendations to Improve the Accuracy of Estimates of Physical Activity Derived from Self Report

PubMed Central

Ainsworth, Barbara E; Caspersen, Carl J; Matthews, Charles E; Mâsse, Louise C; Baranowski, Tom; Zhu, Weimo

2013-01-01

Context Assessment of physical activity using self-report has the potential for measurement error that can lead to incorrect inferences about physical activity behaviors and bias study results. Objective To provide recommendations to improve the accuracy of physical activity derived from self report. Process We provide an overview of presentations and a compilation of perspectives shared by the authors of this paper and workgroup members. Findings We identified a conceptual framework for reducing errors using physical activity self-report questionnaires. The framework identifies six steps to reduce error: (1) identifying the need to measure physical activity, (2) selecting an instrument, (3) collecting data, (4) analyzing data, (5) developing a summary score, and (6) interpreting data. Underlying the first four steps are behavioral parameters of type, intensity, frequency, and duration of physical activities performed, activity domains, and the location where activities are performed. We identified ways to reduce measurement error at each step and made recommendations for practitioners, researchers, and organizational units to reduce error in questionnaire assessment of physical activity. Conclusions Self-report measures of physical activity have a prominent role in research and practice settings. Measurement error can be reduced by applying the framework discussed in this paper. PMID:22287451

Use of cognitive task analysis to guide the development of performance-based assessments for intraoperative decision making.

PubMed

Pugh, Carla M; DaRosa, Debra A

2013-10-01

There is a paucity of performance-based assessments that focus on intraoperative decision making. The purpose of this article is to review the performance outcomes and usefulness of two performance-based assessments that were developed using cognitive task analysis (CTA) frameworks. Assessment-A used CTA to create a "think aloud" oral examination that was administered while junior residents (PGY 1-2's, N = 69) performed a porcine-based laparoscopic cholecystectomy. Assessment-B used CTA to create a simulation-based, formative assessment of senior residents' (PGY 4-5's, N = 29) decision making during a laparoscopic ventral hernia repair. In addition to survey-based assessments of usefulness, a multiconstruct evaluation was performed using eight variables. When comparing performance outcomes, both approaches revealed major deficiencies in residents' intraoperative decision-making skills. Multiconstruct evaluation of the two CTA approaches revealed assessment method advantages for five of the eight evaluation areas: (1) Cognitive Complexity, (2) Content Quality, (3) Content Coverage, (4) Meaningfulness, and (5) Transfer and Generalizability. The two CTA performance assessments were useful in identifying significant training needs. While there are pros and cons to each approach, the results serve as a useful blueprint for program directors seeking to develop performance-based assessments for intraoperative decision making. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Applying the Balanced Scorecard approach in teaching hospitals: a literature review and conceptual framework.

PubMed

Trotta, Annarita; Cardamone, Emma; Cavallaro, Giusy; Mauro, Marianna

2013-01-01

Teaching hospitals (THs) simultaneously serve three different roles: offering medical treatment, teaching future doctors and promoting research. The international literature recognises such organisations as 'peaks of excellence' and highlights their economic function in the health system. In addition, the literature describes the urgent need to manage the complex dynamics and inefficiency issues that threaten the survival of teaching hospitals worldwide. In this context, traditional performance measurement systems that focus only on accounting and financial measures appear to be inadequate. Given that THs are highly specific and complex, a multidimensional system of performance measurement, such as the Balanced Scorecard (BSC), may be more appropriate because of the multitude of stakeholders, each of whom seek a specific type of accountability. The aim of the paper was twofold: (i) to review the literature on the BSC and its applications in teaching hospitals and (ii) to propose a scorecard framework that is suitable for assessing the performance of THs and serving as a guide for scholars and practitioners. In addition, this research will contribute to the ongoing debate on performance evaluation systems by suggesting a revised BSC framework and proposing specific performance indicators for THs. Copyright © 2012 John Wiley & Sons, Ltd.

Geologic framework for the national assessment of carbon dioxide storage resources: Alaska North Slope and Kandik Basin, Alaska: Chapter I in Geologic framework for the national assessment of carbon dioxide storage resources

USGS Publications Warehouse

Craddock, William H.; Buursink, Marc L.; Covault, Jacob A.; Brennan, Sean T.; Doolan, Colin A.; Drake II, Ronald M.; Merrill, Matthew D.; Roberts-Ashby, Tina L.; Slucher, Ernie R.; Warwick, Peter D.; Blondes, Madalyn S.; Freeman, P.A.; Cahan, Steven N.; DeVera, Christina A.; Lohr, Celeste D.; Warwick, Peter D.; Corum, Margo D.

2014-01-01

For each SAU in both of the basins, we discuss the areal distribution of suitable CO2 sequestration reservoir rock. We also characterize the overlying sealing unit and describe the geologic characteristics that influence the potential CO2 storage volume and reservoir performance. These characteristics include reservoir depth, gross thickness, net thickness, porosity, permeability, and groundwater salinity. Case-by-case strategies for estimating the pore volume existing within structurally and (or) stratigraphically closed traps are presented. Although assessment results are not contained in this report, the geologic information included herein was employed to calculate the potential storage volume in the various SAUs. Lastly, in this report, we present the rationale for not conducting assessment work in fifteen sedimentary basins distributed across the Alaskan interior and within Alaskan State waters.

Abiotic raw-materials in life cycle impact assessments: An emerging consensus across disciplines

USGS Publications Warehouse

Drielsma, Johannes; Allington, Ruth; Brady, Thomas; Guinée, Jeroen; Hammarstrom, Jane M.; Hummen, Torsten; Russell-Vaccari, Andrea; Schneider, Laura; Sonnemann, Guido; Weihed, Pär

2016-01-01

This paper captures some of the emerging consensus points that came out of the workshop “Mineral Resources in Life Cycle Impact Assessment: Mapping the path forward”, held at the Natural History Museum London on 14 October 2015: that current practices rely in many instances on obsolete data, often confuse resource depletion with impacts on resource availability, which can therefore provide inconsistent decision support and lead to misguided claims about environmental performance. Participants agreed it would be helpful to clarify which models estimate depletion and which estimate availability, so that results can be correctly reported in the most appropriate framework. Most participants suggested that resource availability will be more meaningfully addressed within a comprehensive Life Cycle Sustainability Assessment framework rather than limited to an environmental Life Cycle Assessment or Footprint. Presentations from each of the authors are available for download.

Using key performance indicators as knowledge-management tools at a regional health-care authority level.

PubMed

Berler, Alexander; Pavlopoulos, Sotiris; Koutsouris, Dimitris

2005-06-01

The advantages of the introduction of information and communication technologies in the complex health-care sector are already well-known and well-stated in the past. It is, nevertheless, paradoxical that although the medical community has embraced with satisfaction most of the technological discoveries allowing the improvement in patient care, this has not happened when talking about health-care informatics. Taking the above issue of concern, our work proposes an information model for knowledge management (KM) based upon the use of key performance indicators (KPIs) in health-care systems. Based upon the use of the balanced scorecard (BSC) framework (Kaplan/Norton) and quality assurance techniques in health care (Donabedian), this paper is proposing a patient journey centered approach that drives information flow at all levels of the day-to-day process of delivering effective and managed care, toward information assessment and knowledge discovery. In order to persuade health-care decision-makers to assess the added value of KM tools, those should be used to propose new performance measurement and performance management techniques at all levels of a health-care system. The proposed KPIs are forming a complete set of metrics that enable the performance management of a regional health-care system. In addition, the performance framework established is technically applied by the use of state-of-the-art KM tools such as data warehouses and business intelligence information systems. In that sense, the proposed infrastructure is, technologically speaking, an important KM tool that enables knowledge sharing amongst various health-care stakeholders and between different health-care groups. The use of BSC is an enabling framework toward a KM strategy in health care.

Fit of screw-retained fixed implant frameworks fabricated by different methods: a systematic review.

PubMed

Abduo, Jaafar; Lyons, Karl; Bennani, Vincent; Waddell, Neil; Swain, Michael

2011-01-01

The aim of this study was to review the published literature investigating the accuracy of fit of fixed implant frameworks fabricated using different materials and methods. A comprehensive electronic search was performed through PubMed (MEDLINE) using Boolean operators to combine key words. The search was limited to articles written in English and published through May 2010. In addition, a manual search through articles and reference lists retrieved from the electronic search and peer-reviewed journals was also conducted. A total of 248 articles were retrieved, and 26 met the specified inclusion criteria for the review. The selected articles assessed the fit of fixed implant frameworks fabricated by different techniques. The investigated fabrication approaches were one-piece casting, sectioning and reconnection, spark erosion with an electric discharge machine, computer-aided design/computer-assisted manufacturing (CAD/CAM), and framework bonding to prefabricated abutment cylinders. Cast noble metal frameworks have a predictable fit, and additional fit refinement treatment is not indicated in well-controlled conditions. Base metal castings do not provide a satisfactory level of fit unless additional refinement treatment is performed, such as sectioning and laser welding or spark erosion. Spark erosion, framework bonding to prefabricated abutment cylinders, and CAD/CAM have the potential to provide implant frameworks with an excellent fit; CAD/CAM is the most consistent and least technique-sensitive of these methods.

Ergonomics Climate Assessment: A measure of operational performance and employee well-being.

PubMed

Hoffmeister, Krista; Gibbons, Alyssa; Schwatka, Natalie; Rosecrance, John

2015-09-01

Ergonomics interventions have the potential to improve operational performance and employee well-being. We introduce a framework for ergonomics climate, the extent to which an organization emphasizes and supports the design and modification of work to maximize both performance and well-being outcomes. We assessed ergonomics climate at a large manufacturing facility twice during a two-year period. When the organization used ergonomics to promote performance and well-being equally, and at a high level, employees reported less work-related pain. A larger discrepancy between measures of operational performance and employee well-being was associated with increased reports of work-related pain. The direction of this discrepancy was not significantly related to work-related pain, such that it didn't matter which facet was valued more. The Ergonomics Climate Assessment can provide companies with a baseline assessment of the overall value placed on ergonomics and help prioritize areas for improving operational performance and employee well-being. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Near Real-Time Monitoring of Forest Disturbance: A Multi-Sensor Remote Sensing Approach and Assessment Framework

NASA Astrophysics Data System (ADS)

Tang, Xiaojing

Fast and accurate monitoring of tropical forest disturbance is essential for understanding current patterns of deforestation as well as helping eliminate illegal logging. This dissertation explores the use of data from different satellites for near real-time monitoring of forest disturbance in tropical forests, including: development of new monitoring methods; development of new assessment methods; and assessment of the performance and operational readiness of existing methods. Current methods for accuracy assessment of remote sensing products do not address the priority of near real-time monitoring of detecting disturbance events as early as possible. I introduce a new assessment framework for near real-time products that focuses on the timing and the minimum detectable size of disturbance events. The new framework reveals the relationship between change detection accuracy and the time needed to identify events. In regions that are frequently cloudy, near real-time monitoring using data from a single sensor is difficult. This study extends the work by Xin et al. (2013) and develops a new time series method (Fusion2) based on fusion of Landsat and MODIS (Moderate Resolution Imaging Spectroradiometer) data. Results of three test sites in the Amazon Basin show that Fusion2 can detect 44.4% of the forest disturbance within 13 clear observations (82 days) after the initial disturbance. The smallest event detected by Fusion2 is 6.5 ha. Also, Fusion2 detects disturbance faster and has less commission error than more conventional methods. In a comparison of coarse resolution sensors, MODIS Terra and Aqua combined provides faster and more accurate detection of disturbance events than VIIRS (Visible Infrared Imaging Radiometer Suite) and MODIS single sensor data. The performance of near real-time monitoring using VIIRS is slightly worse than MODIS Terra but significantly better than MODIS Aqua. New monitoring methods developed in this dissertation provide forest protection organizations the capacity to monitor illegal logging events promptly. In the future, combining two Landsat and two Sentinel-2 satellites will provide global coverage at 30 m resolution every 4 days, and routine monitoring may be possible at high resolution. The methods and assessment framework developed in this dissertation are adaptable to newly available datasets.

Ecological Risk Assessment Framework for Low-Altitude Overflights by Fixed-Wing and Rotary-Wing Military Aircraft

DOE Office of Scientific and Technical Information (OSTI.GOV)

Efroymson, R.A.

2001-01-12

This is a companion report to the risk assessment framework proposed by Suter et al. (1998): ''A Framework for Assessment of Risks of Military Training and Testing to Natural Resources,'' hereafter referred to as the ''generic framework.'' The generic framework is an ecological risk assessment methodology for use in environmental assessments on Department of Defense (DoD) installations. In the generic framework, the ecological risk assessment framework of the US Environmental Protection Agency (EPA 1998) is modified for use in the context of (1) multiple and diverse stressors and activities at a military installation and (2) risks resulting from causal chains,more » e.g., effects on habitat that indirectly impact wildlife. Both modifications are important if the EPA framework is to be used on military installations. In order for the generic risk assessment framework to be useful to DoD environmental staff and contractors, the framework must be applied to specific training and testing activities. Three activity-specific ecological risk assessment frameworks have been written (1) to aid environmental staff in conducting risk assessments that involve these activities and (2) to guide staff in the development of analogous frameworks for other DoD activities. The three activities are: (1) low-altitude overflights by fixed-wing and rotary-wing aircraft (this volume), (2) firing at targets on land, and (3) ocean explosions. The activities were selected as priority training and testing activities by the advisory committee for this project.« less

Integrated Technology Assessment Center (ITAC) Update

NASA Technical Reports Server (NTRS)

Taylor, J. L.; Neely, M. A.; Curran, F. M.; Christensen, E. R.; Escher, D.; Lovell, N.; Morris, Charles (Technical Monitor)

2002-01-01

The Integrated Technology Assessment Center (ITAC) has developed a flexible systems analysis framework to identify long-term technology needs, quantify payoffs for technology investments, and assess the progress of ASTP-sponsored technology programs in the hypersonics area. For this, ITAC has assembled an experienced team representing a broad sector of the aerospace community and developed a systematic assessment process complete with supporting tools. Concepts for transportation systems are selected based on relevance to the ASTP and integrated concept models (ICM) of these concepts are developed. Key technologies of interest are identified and projections are made of their characteristics with respect to their impacts on key aspects of the specific concepts of interest. Both the models and technology projections are then fed into the ITAC's probabilistic systems analysis framework in ModelCenter. This framework permits rapid sensitivity analysis, single point design assessment, and a full probabilistic assessment of each concept with respect to both embedded and enhancing technologies. Probabilistic outputs are weighed against metrics of interest to ASTP using a multivariate decision making process to provide inputs for technology prioritization within the ASTP. ITAC program is currently finishing the assessment of a two-stage-to-orbit (TSTO), rocket-based combined cycle (RBCC) concept and a TSTO turbine-based combined cycle (TBCC) concept developed by the team with inputs from NASA. A baseline all rocket TSTO concept is also being developed for comparison. Boeing has recently submitted a performance model for their Flexible Aerospace System Solution for Tomorrow (FASST) concept and the ISAT program will provide inputs for a single-stage-to-orbit (SSTO) TBCC based concept in the near-term. Both of these latter concepts will be analyzed within the ITAC framework over the summer. This paper provides a status update of the ITAC program.

A Review of Auditing Methods Applied to the Content of Controlled Biomedical Terminologies

PubMed Central

Zhu, Xinxin; Fan, Jung-Wei; Baorto, David M.; Weng, Chunhua; Cimino, James J.

2012-01-01

Although controlled biomedical terminologies have been with us for centuries, it is only in the last couple of decades that close attention has been paid to the quality of these terminologies. The result of this attention has been the development of auditing methods that apply formal methods to assessing whether terminologies are complete and accurate. We have performed an extensive literature review to identify published descriptions of these methods and have created a framework for characterizing them. The framework considers manual, systematic and heuristic methods that use knowledge (within or external to the terminology) to measure quality factors of different aspects of the terminology content (terms, semantic classification, and semantic relationships). The quality factors examined included concept orientation, consistency, non-redundancy, soundness and comprehensive coverage. We reviewed 130 studies that were retrieved based on keyword search on publications in PubMed, and present our assessment of how they fit into our framework. We also identify which terminologies have been audited with the methods and provide examples to illustrate each part of the framework. PMID:19285571

Towards a balanced performance measurement system in a public health care organization.

PubMed

Yuen, Peter P; Ng, Artie W

2012-01-01

This article attempts to devise an integrated performance measurement framework to assess the Hong Kong Hospital Authority (HA) management system by harnessing previous performance measurement systems. An integrated evaluative framework based on the balanced score card (BSC) was developed and applied using the case study method and longitudinal data to evaluate the HA's performance management system. The authors unveil evolving HA performance indicators (P1). Despite the HA staffs explicit quality emphasis, cost control remains the primary focus in their performance measurements. RESEARCH LHNITATIONS/IMPLICATIONS: Data used in this study are from secondary sources, disclosed mostly by HA staff. This study shows public sector staff often attach too much importance to cost control and easily measurable activities at the expense of quality and other less easily measurable attributes'. A balanced performance measurement system, linked to health targets, with a complementary budgeting process that supports pertinent resource allocation is yet to be implemented in Hong Kong's public hospitals.

The Power of the Frame: Systems Transformation Framework for Health Care Leaders.

PubMed

Scott, Kathy A; Pringle, Janice

Health care leaders are responsible for oversight of multiple and competing change interventions. These interventions regularly fail to achieve the desired outcomes and/or sustainable results. This often occurs because of the mental models and approaches that are used to plan, design, implement, and evaluate the system. These do not account for inherent characteristics that determine the system's likely ability to innovate while maintaining operational effectiveness. Theories exist on how to assess a system's readiness to change, but the definitions, constructs, and assessments are diverse and often look at facets of systems in isolation. The Systems Transformation Framework prescriptively defines and characterizes system domains on the basis of complex adaptive systems theory so that domains can be assessed in tandem. As a result, strengths and challenges to implementation are recognized before implementation begins. The Systems Transformation Framework defines 8 major domains: vision, leadership, organizational culture, organizational behavior, organizational structure, performance measurements, internal learning, and external learning. Each domain has principles that are critical for creating the conditions that lead to successful organizational adaptation and change. The Systems Transformation Framework can serve as a guide for health care leaders at all levels of the organization to (1) create environments that are change ready and (2) plan, design, implement, and evaluate change within complex adaptive systems.

Real-Time Data Capture and Management Evaluation and Performance Measures : Evaluation Framework

DOT National Transportation Integrated Search

2011-09-01

Through connected vehicle research, the U.S. DOT Intelligent Transportation Systems Joint Program Office (ITS JPO) is leading an effort to assess the potential for systematic and dynamic data capture from vehicles, travelers and the transportation sy...

A framework for characterizing eHealth literacy demands and barriers.

PubMed

Chan, Connie V; Kaufman, David R

2011-11-17

Consumer eHealth interventions are of a growing importance in the individual management of health and health behaviors. However, a range of access, resources, and skills barriers prevent health care consumers from fully engaging in and benefiting from the spectrum of eHealth interventions. Consumers may engage in a range of eHealth tasks, such as participating in health discussion forums and entering information into a personal health record. eHealth literacy names a set of skills and knowledge that are essential for productive interactions with technology-based health tools, such as proficiency in information retrieval strategies, and communicating health concepts effectively. We propose a theoretical and methodological framework for characterizing complexity of eHealth tasks, which can be used to diagnose and describe literacy barriers and inform the development of solution strategies. We adapted and integrated two existing theoretical models relevant to the analysis of eHealth literacy into a single framework to systematically categorize and describe task demands and user performance on tasks needed by health care consumers in the information age. The method derived from the framework is applied to (1) code task demands using a cognitive task analysis, and (2) code user performance on tasks. The framework and method are applied to the analysis of a Web-based consumer eHealth task with information-seeking and decision-making demands. We present the results from the in-depth analysis of the task performance of a single user as well as of 20 users on the same task to illustrate both the detailed analysis and the aggregate measures obtained and potential analyses that can be performed using this method. The analysis shows that the framework can be used to classify task demands as well as the barriers encountered in user performance of the tasks. Our approach can be used to (1) characterize the challenges confronted by participants in performing the tasks, (2) determine the extent to which application of the framework to the cognitive task analysis can predict and explain the problems encountered by participants, and (3) inform revisions to the framework to increase accuracy of predictions. The results of this illustrative application suggest that the framework is useful for characterizing task complexity and for diagnosing and explaining barriers encountered in task completion. The framework and analytic approach can be a potentially powerful generative research platform to inform development of rigorous eHealth examination and design instruments, such as to assess eHealth competence, to design and evaluate consumer eHealth tools, and to develop an eHealth curriculum.

A Framework for Characterizing eHealth Literacy Demands and Barriers

PubMed Central

Chan, Connie V

2011-01-01

Background Consumer eHealth interventions are of a growing importance in the individual management of health and health behaviors. However, a range of access, resources, and skills barriers prevent health care consumers from fully engaging in and benefiting from the spectrum of eHealth interventions. Consumers may engage in a range of eHealth tasks, such as participating in health discussion forums and entering information into a personal health record. eHealth literacy names a set of skills and knowledge that are essential for productive interactions with technology-based health tools, such as proficiency in information retrieval strategies, and communicating health concepts effectively. Objective We propose a theoretical and methodological framework for characterizing complexity of eHealth tasks, which can be used to diagnose and describe literacy barriers and inform the development of solution strategies. Methods We adapted and integrated two existing theoretical models relevant to the analysis of eHealth literacy into a single framework to systematically categorize and describe task demands and user performance on tasks needed by health care consumers in the information age. The method derived from the framework is applied to (1) code task demands using a cognitive task analysis, and (2) code user performance on tasks. The framework and method are applied to the analysis of a Web-based consumer eHealth task with information-seeking and decision-making demands. We present the results from the in-depth analysis of the task performance of a single user as well as of 20 users on the same task to illustrate both the detailed analysis and the aggregate measures obtained and potential analyses that can be performed using this method. Results The analysis shows that the framework can be used to classify task demands as well as the barriers encountered in user performance of the tasks. Our approach can be used to (1) characterize the challenges confronted by participants in performing the tasks, (2) determine the extent to which application of the framework to the cognitive task analysis can predict and explain the problems encountered by participants, and (3) inform revisions to the framework to increase accuracy of predictions. Conclusions The results of this illustrative application suggest that the framework is useful for characterizing task complexity and for diagnosing and explaining barriers encountered in task completion. The framework and analytic approach can be a potentially powerful generative research platform to inform development of rigorous eHealth examination and design instruments, such as to assess eHealth competence, to design and evaluate consumer eHealth tools, and to develop an eHealth curriculum. PMID:22094891

Framework of Sustainability Assessment (FSA) method for manufacturing industry in Malaysia

NASA Astrophysics Data System (ADS)

Soliha Sahimi, Nur; Turan, Faiz Mohd; Johan, Kartina

2018-04-01

In recent years, our planet faced massive social, environmental and economic challenges. Moreover, Environmental Democracy Index (EDI) published that Malaysia has been ranked as the second worst environmental democracy among 70 countries in May 2015. This is due to lack of participation in sustainability compliance and less awareness on sustainability by Malaysia’s business partners. By combating and achieving these, the Sustainable Development Goals (SDGs) defines global priorities and inspirations through Agenda 2030 that recognize by United Nation. This paper attempts to propose Framework Sustainability Assessment (FSA) to assess sustainability for the various sector in Malaysia. This framework will give an overview to reduce the noise from wide data collection to a single element. Lastly, it will integrate the current performance with the linkage of the SDGs and the sustainability elements by dividing into three phase which is baselining, clustering and correlation. Now it is time for business to take action especially every sector or industry in Malaysia and it will improve the awareness and enhance Environmental Democracy Index to a better rank in future.

. Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability

USGS Publications Warehouse

Gentile, J.H.; Harwell, M.A.; Cropper, W.; Harwell, C. C.; DeAngelis, Donald L.; Davis, S.; Ogden, J.C.; Lirman, D.

2001-01-01

The Everglades and South Florida ecosystems are the focus of national and international attention because of their current degraded and threatened state. Ecological risk assessment, sustainability and ecosystem and adaptive management principles and processes are being used nationally as a decision and policy framework for a variety of types of ecological assessments. The intent of this study is to demonstrate the application of these paradigms and principles at a regional scale. The effects-directed assessment approach used in this study consists of a retrospective, eco-epidemiological phase to determine the causes for the current conditions and a prospective predictive risk-based assessment using scenario analysis to evaluate future options. Embedded in these assessment phases is a process that begins with the identification of goals and societal preferences which are used to develop an integrated suite of risk-based and policy relevant conceptual models. Conceptual models are used to illustrate the linkages among management (societal) actions, environmental stressors, and societal/ecological effects, and provide the basis for developing and testing causal hypotheses. These models, developed for a variety of landscape units and their drivers, stressors, and endpoints, are used to formulate hypotheses to explain the current conditions. They are also used as the basis for structuring management scenarios and analyses to project the temporal and spatial magnitude of risk reduction and system recovery. Within the context of recovery, the conceptual models are used in the initial development of performance criteria for those stressors that are determined to be most important in shaping the landscape, and to guide the use of numerical models used to develop quantitative performance criteria in the scenario analysis. The results will be discussed within an ecosystem and adaptive management framework that provides the foundation for decision making.

Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability.

PubMed

Gentile, J H; Harwell, M A; Cropper, W; Harwell, C C; DeAngelis, D; Davis, S; Ogden, J C; Lirman, D

2001-07-02

The Everglades and South Florida ecosystems are the focus of national and international attention because of their current degraded and threatened state. Ecological risk assessment, sustainability, and ecosystem and adaptive management principles and processes are being used nationally as a decision and policy framework for a variety of types of ecological assessments. The intent of this study is to demonstrate the application of these paradigms and principles at a regional scale. The effects-directed assessment approach used in this study consists of a retrospective, eco-epidemiological phase to determine the causes for the current conditions and a prospective predictive risk-based assessment using scenario analysis to evaluate future options. Embedded in these assessment phases is a process that begins with the identification of goals and societal preferences which are used to develop an integrated suite of risk-based and policy relevant conceptual models. Conceptual models are used to illustrate the linkages among management (societal) actions, environmental stressors, and societal/ecological effects, and provide the basis for developing and testing causal hypotheses. These models, developed for a variety of landscape units and their drivers, stressors, and endpoints, are used to formulate hypotheses to explain the current conditions. They are also used as the basis for structuring management scenarios and analyses to project the temporal and spatial magnitude of risk reduction and system recovery. Within the context of recovery, the conceptual models are used in the initial development of performance criteria for those stressors that are determined to be most important in shaping the landscape, and to guide the use of numerical models used to develop quantitative performance criteria in the scenario analysis. The results will be discussed within an ecosystem and adaptive management framework that provides the foundation for decision making.

Using Instructional Technology to Integrate CEFR "Can Do" Performance Objectives into an Advanced-Level Language Course

ERIC Educational Resources Information Center

Burston, Jack; Athanasiou, Androulla; Neophytou-Yiokari, Maro

2016-01-01

The purpose of this presentation is to show how instructional technology can be exploited to effectively integrate Common European Framework of Reference (CEFR) "Can Do" performance objectives (Council of Europe, 2001) into the syllabus and assessment of an advanced (B2) level course. The particular course that will be used for purposes…

Non-technical skills evaluation in the critical care air ambulance environment: introduction of an adapted rating instrument--an observational study.

PubMed

Myers, Julia A; Powell, David M C; Psirides, Alex; Hathaway, Karyn; Aldington, Sarah; Haney, Michael F

2016-03-08

In the isolated and dynamic health-care setting of critical care air ambulance transport, the quality of clinical care is strongly influenced by non-technical skills such as anticipating, recognising and understanding, decision making, and teamwork. However there are no published reports identifying or applying a non-technical skills framework specific to an intensive care air ambulance setting. The objective of this study was to adapt and evaluate a non-technical skills rating framework for the air ambulance clinical environment. In the first phase of the project the anaesthetists' non-technical skills (ANTS) framework was adapted to the air ambulance setting, using data collected directly from clinician groups, published literature, and field observation. In the second phase experienced and inexperienced inter-hospital transport clinicians completed a simulated critical care air transport scenario, and their non-technical skills performance was independently rated by two blinded assessors. Observed and self-rated general clinical performance ratings were also collected. Rank-based statistical tests were used to examine differences in the performance of experienced and inexperienced clinicians, and relationships between different assessment approaches and assessors. The framework developed during phase one was referred to as an aeromedical non-technical skills framework, or AeroNOTS. During phase two 16 physicians from speciality training programmes in intensive care, emergency medicine and anaesthesia took part in the clinical simulation study. Clinicians with inter-hospital transport experience performed more highly than those without experience, according to both AeroNOTS non-technical skills ratings (p = 0.001) and general performance ratings (p = 0.003). Self-ratings did not distinguish experienced from inexperienced transport clinicians (p = 0.32) and were not strongly associated with either observed general performance (r(s) = 0.4, p = 0.11) or observed non-technical skills performance (r(s) = 0.4, p = 0.1). This study describes a framework which characterises the non-technical skills required by critical care air ambulance clinicians, and distinguishes higher and lower levels of performance. The AeroNOTS framework could be used to facilitate education and training in non-technical skills for air ambulance clinicians, and further evaluation of this rating system is merited.

Taiwan industrial cooperation program technology transfer for low-level radioactive waste final disposal - phase I.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Knowlton, Robert G.; Cochran, John Russell; Arnold, Bill Walter

2007-01-01

Sandia National Laboratories and the Institute of Nuclear Energy Research, Taiwan have collaborated in a technology transfer program related to low-level radioactive waste (LLW) disposal in Taiwan. Phase I of this program included regulatory analysis of LLW final disposal, development of LLW disposal performance assessment capabilities, and preliminary performance assessments of two potential disposal sites. Performance objectives were based on regulations in Taiwan and comparisons to those in the United States. Probabilistic performance assessment models were constructed based on limited site data using software including GoldSim, BLT-MS, FEHM, and HELP. These software codes provided the probabilistic framework, container degradation, waste-formmore » leaching, groundwater flow, radionuclide transport, and cover infiltration simulation capabilities in the performance assessment. Preliminary performance assessment analyses were conducted for a near-surface disposal system and a mined cavern disposal system at two representative sites in Taiwan. Results of example calculations indicate peak simulated concentrations to a receptor within a few hundred years of LLW disposal, primarily from highly soluble, non-sorbing radionuclides.« less

Fuzzy entropy thresholding and multi-scale morphological approach for microscopic image enhancement

NASA Astrophysics Data System (ADS)

Zhou, Jiancan; Li, Yuexiang; Shen, Linlin

2017-07-01

Microscopic images provide lots of useful information for modern diagnosis and biological research. However, due to the unstable lighting condition during image capturing, two main problems, i.e., high-level noises and low image contrast, occurred in the generated cell images. In this paper, a simple but efficient enhancement framework is proposed to address the problems. The framework removes image noises using a hybrid method based on wavelet transform and fuzzy-entropy, and enhances the image contrast with an adaptive morphological approach. Experiments on real cell dataset were made to assess the performance of proposed framework. The experimental results demonstrate that our proposed enhancement framework increases the cell tracking accuracy to an average of 74.49%, which outperforms the benchmark algorithm, i.e., 46.18%.

A comprehensive test of clinical reasoning for medical students: An olympiad experience in Iran

PubMed Central

Monajemi, Alireza; Arabshahi, Kamran Soltani; Soltani, Akbar; Arbabi, Farshid; Akbari, Roghieh; Custers, Eugene; Hadadgar, Arash; Hadizadeh, Fatemeh; Changiz, Tahereh; Adibi, Peyman

2012-01-01

Background: Although some tests for clinical reasoning assessment are now available, the theories of medical expertise have not played a major role in this filed. In this paper, illness script theory was chose as a theoretical framework and contemporary clinical reasoning tests were put together based on this theoretical model. Materials and Methods: This paper is a qualitative study performed with an action research approach. This style of research is performed in a context where authorities focus on promoting their organizations’ performance and is carried out in the form of teamwork called participatory research. Results: Results are presented in four parts as basic concepts, clinical reasoning assessment, test framework, and scoring. Conclusion: we concluded that no single test could thoroughly assess clinical reasoning competency, and therefore a battery of clinical reasoning tests is needed. This battery should cover all three parts of clinical reasoning process: script activation, selection and verification. In addition, not only both analytical and non-analytical reasoning, but also both diagnostic and management reasoning should evenly take into consideration in this battery. This paper explains the process of designing and implementing the battery of clinical reasoning in the Olympiad for medical sciences students through an action research. PMID:23555113

VALUE - A Framework to Validate Downscaling Approaches for Climate Change Studies

NASA Astrophysics Data System (ADS)

Maraun, Douglas; Widmann, Martin; Gutiérrez, José M.; Kotlarski, Sven; Chandler, Richard E.; Hertig, Elke; Wibig, Joanna; Huth, Radan; Wilke, Renate A. I.

2015-04-01

VALUE is an open European network to validate and compare downscaling methods for climate change research. VALUE aims to foster collaboration and knowledge exchange between climatologists, impact modellers, statisticians, and stakeholders to establish an interdisciplinary downscaling community. A key deliverable of VALUE is the development of a systematic validation framework to enable the assessment and comparison of both dynamical and statistical downscaling methods. Here, we present the key ingredients of this framework. VALUE's main approach to validation is user-focused: starting from a specific user problem, a validation tree guides the selection of relevant validation indices and performance measures. Several experiments have been designed to isolate specific points in the downscaling procedure where problems may occur: what is the isolated downscaling skill? How do statistical and dynamical methods compare? How do methods perform at different spatial scales? Do methods fail in representing regional climate change? How is the overall representation of regional climate, including errors inherited from global climate models? The framework will be the basis for a comprehensive community-open downscaling intercomparison study, but is intended also to provide general guidance for other validation studies.

VALUE: A framework to validate downscaling approaches for climate change studies

NASA Astrophysics Data System (ADS)

Maraun, Douglas; Widmann, Martin; Gutiérrez, José M.; Kotlarski, Sven; Chandler, Richard E.; Hertig, Elke; Wibig, Joanna; Huth, Radan; Wilcke, Renate A. I.

2015-01-01

VALUE is an open European network to validate and compare downscaling methods for climate change research. VALUE aims to foster collaboration and knowledge exchange between climatologists, impact modellers, statisticians, and stakeholders to establish an interdisciplinary downscaling community. A key deliverable of VALUE is the development of a systematic validation framework to enable the assessment and comparison of both dynamical and statistical downscaling methods. In this paper, we present the key ingredients of this framework. VALUE's main approach to validation is user- focused: starting from a specific user problem, a validation tree guides the selection of relevant validation indices and performance measures. Several experiments have been designed to isolate specific points in the downscaling procedure where problems may occur: what is the isolated downscaling skill? How do statistical and dynamical methods compare? How do methods perform at different spatial scales? Do methods fail in representing regional climate change? How is the overall representation of regional climate, including errors inherited from global climate models? The framework will be the basis for a comprehensive community-open downscaling intercomparison study, but is intended also to provide general guidance for other validation studies.

Green and sustainable remediation (GSR) evaluation: framework, standards, and tool. A case study in Taiwan.

PubMed

Huang, Wen-Yen; Hung, Weiteng; Vu, Chi Thanh; Chen, Wei-Ting; Lai, Jhih-Wei; Lin, Chitsan

2016-11-01

Taiwan has a large number of poorly managed contaminated sites in need of remediation. This study proposes a framework, a set of standards, and a spreadsheet-based evaluation tool for implementing green and sustainable principles into remediation projects and evaluating the projects from this perspective. We performed a case study to understand how the framework would be applied. For the case study, we used a spreadsheet-based evaluation tool (SEFA) and performed field scale cultivation tests on a site contaminated with total petroleum hydrocarbons (TPHs). The site was divided into two lots: one treated by chemical oxidation and the other by bioremediation. We evaluated five core elements of green and sustainable remediation (GSR): energy, air, water resources, materials and wastes, and land and ecosystem. The proposed evaluation tool and field scale cultivation test were found to efficiently assess the effectiveness of the two remediation alternatives. The framework and related tools proposed herein can potentially be used to support decisions about the remediation of contaminated sites taking into account engineering management, cost effectiveness, and social reconciliation.

Identifying Cross-Disciplinary Interactions to Assess and Promote Functional Resilience in Flight Crews During Exploration Missions

NASA Technical Reports Server (NTRS)

Shelhamer, M.; Mindock, J.; Lumpkins, S.

2015-01-01

NASA supports research to mitigate risks to health and performance on extended missions. Typically these risks are investigated independently. In reality, physiological systems are tightly coupled, and related to psychological and inter-individual factors (team cohesion, conflict). We draw on ideas from network theory to assess these interactions and better design a research framework to address them.

Classification Accuracy of Oral Reading Fluency and Maze in Predicting Performance on Large-Scale Reading Assessments

ERIC Educational Resources Information Center

Decker, Dawn M.; Hixson, Michael D.; Shaw, Amber; Johnson, Gloria

2014-01-01

The purpose of this study was to examine whether using a multiple-measure framework yielded better classification accuracy than oral reading fluency (ORF) or maze alone in predicting pass/fail rates for middle-school students on a large-scale reading assessment. Participants were 178 students in Grades 7 and 8 from a Midwestern school district.…

Probabilistic Approaches for Multi-Hazard Risk Assessment of Structures and Systems

NASA Astrophysics Data System (ADS)

Kwag, Shinyoung

Performance assessment of structures, systems, and components for multi-hazard scenarios has received significant attention in recent years. However, the concept of multi-hazard analysis is quite broad in nature and the focus of existing literature varies across a wide range of problems. In some cases, such studies focus on hazards that either occur simultaneously or are closely correlated with each other. For example, seismically induced flooding or seismically induced fires. In other cases, multi-hazard studies relate to hazards that are not dependent or correlated but have strong likelihood of occurrence at different times during the lifetime of a structure. The current approaches for risk assessment need enhancement to account for multi-hazard risks. It must be able to account for uncertainty propagation in a systems-level analysis, consider correlation among events or failure modes, and allow integration of newly available information from continually evolving simulation models, experimental observations, and field measurements. This dissertation presents a detailed study that proposes enhancements by incorporating Bayesian networks and Bayesian updating within a performance-based probabilistic framework. The performance-based framework allows propagation of risk as well as uncertainties in the risk estimates within a systems analysis. Unlike conventional risk assessment techniques such as a fault-tree analysis, a Bayesian network can account for statistical dependencies and correlations among events/hazards. The proposed approach is extended to develop a risk-informed framework for quantitative validation and verification of high fidelity system-level simulation tools. Validation of such simulations can be quite formidable within the context of a multi-hazard risk assessment in nuclear power plants. The efficiency of this approach lies in identification of critical events, components, and systems that contribute to the overall risk. Validation of any event or component on the critical path is relatively more important in a risk-informed environment. Significance of multi-hazard risk is also illustrated for uncorrelated hazards of earthquakes and high winds which may result in competing design objectives. It is also illustrated that the number of computationally intensive nonlinear simulations needed in performance-based risk assessment for external hazards can be significantly reduced by using the power of Bayesian updating in conjunction with the concept of equivalent limit-state.

Towards a European Framework to Monitor Infectious Diseases among Migrant Populations: Design and Applicability

PubMed Central

Riccardo, Flavia; Dente, Maria Grazia; Kärki, Tommi; Fabiani, Massimo; Napoli, Christian; Chiarenza, Antonio; Giorgi Rossi, Paolo; Velasco Munoz, Cesar; Noori, Teymur; Declich, Silvia

2015-01-01

There are limitations in our capacity to interpret point estimates and trends of infectious diseases occurring among diverse migrant populations living in the European Union/European Economic Area (EU/EEA). The aim of this study was to design a data collection framework that could capture information on factors associated with increased risk to infectious diseases in migrant populations in the EU/EEA. The authors defined factors associated with increased risk according to a multi-dimensional framework and performed a systematic literature review in order to identify whether those factors well reflected the reported risk factors for infectious disease in these populations. Following this, the feasibility of applying this framework to relevant available EU/EEA data sources was assessed. The proposed multidimensional framework is well suited to capture the complexity and concurrence of these risk factors and in principle applicable in the EU/EEA. The authors conclude that adopting a multi-dimensional framework to monitor infectious diseases could favor the disaggregated collection and analysis of migrant health data. PMID:26393623

Towards a European Framework to Monitor Infectious Diseases among Migrant Populations: Design and Applicability.

PubMed

Riccardo, Flavia; Dente, Maria Grazia; Kärki, Tommi; Fabiani, Massimo; Napoli, Christian; Chiarenza, Antonio; Giorgi Rossi, Paolo; Munoz, Cesar Velasco; Noori, Teymur; Declich, Silvia

2015-09-17

There are limitations in our capacity to interpret point estimates and trends of infectious diseases occurring among diverse migrant populations living in the European Union/European Economic Area (EU/EEA). The aim of this study was to design a data collection framework that could capture information on factors associated with increased risk to infectious diseases in migrant populations in the EU/EEA. The authors defined factors associated with increased risk according to a multi-dimensional framework and performed a systematic literature review in order to identify whether those factors well reflected the reported risk factors for infectious disease in these populations. Following this, the feasibility of applying this framework to relevant available EU/EEA data sources was assessed. The proposed multidimensional framework is well suited to capture the complexity and concurrence of these risk factors and in principle applicable in the EU/EEA. The authors conclude that adopting a multi-dimensional framework to monitor infectious diseases could favor the disaggregated collection and analysis of migrant health data.

Sensor fusion display evaluation using information integration models in enhanced/synthetic vision applications

NASA Technical Reports Server (NTRS)

Foyle, David C.

1993-01-01

Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.

A review and preliminary evaluation of methodological factors in performance assessments of time-varying aircraft noise effects

NASA Technical Reports Server (NTRS)

Coates, G. D.; Alluisi, E. A.

1975-01-01

The effects of aircraft noise on human performance is considered. Progress is reported in the following areas: (1) review of the literature to identify the methodological and stimulus parameters involved in the study of noise effects on human performance; (2) development of a theoretical framework to provide working hypotheses as to the effects of noise on complex human performance; and (3) data collection on the first of several experimental investigations designed to provide tests of the hypotheses.

Development and application of a framework to assess community nutritionists' use of environmental strategies to prevent obesity.

PubMed

Lu, Angela H; Dickin, Katherine; Dollahite, Jamie

2014-01-01

To develop and apply a framework exploring the extent of involvement in promoting environmental changes to prevent obesity by a group of nutrition educators (NE). Cross-sectional, mixed methods: qualitative interviews informed framework development; survey applied framework to describe NE's involvement in environmental changes. Cooperative Extension in New York State. Interviewees (n = 7) selected to vary in environmental change activities and rural/urban location. Survey response rate was 100% (n = 58). Dimensions and degree of NE's involvement in promoting environmental change. Thematic analysis of qualitative data, triangulated with descriptive analyses of NE's performance of tasks in various settings. NE's promotion of environmental changes was characterized using framework based on settings and tasks, dimensions that emerged from qualitative analysis. NE's actions varied across these dimensions and ranged from low to high intensity of collaboration and leadership for environmental change. Most NE surveyed reported actions limited to providing information and recommendations on healthy eating and physical activity. Few reported intensive engagement in developing, implementing, and evaluating plans to change environments for obesity prevention. Framework identifies the levels of engagement in promoting environmental changes and supports future research and practice of community nutrition professionals by providing a roadmap for assessing their involvement on multiple levels to prevent obesity. Copyright © 2014 Society for Nutrition Education and Behavior. All rights reserved.

Global Conservation Priorities for Marine Turtles

PubMed Central

Wallace, Bryan P.; DiMatteo, Andrew D.; Bolten, Alan B.; Chaloupka, Milani Y.; Hutchinson, Brian J.; Abreu-Grobois, F. Alberto; Mortimer, Jeanne A.; Seminoff, Jeffrey A.; Amorocho, Diego; Bjorndal, Karen A.; Bourjea, Jérôme; Bowen, Brian W.; Briseño Dueñas, Raquel; Casale, Paolo; Choudhury, B. C.; Costa, Alice; Dutton, Peter H.; Fallabrino, Alejandro; Finkbeiner, Elena M.; Girard, Alexandre; Girondot, Marc; Hamann, Mark; Hurley, Brendan J.; López-Mendilaharsu, Milagros; Marcovaldi, Maria Angela; Musick, John A.; Nel, Ronel; Pilcher, Nicolas J.; Troëng, Sebastian; Witherington, Blair; Mast, Roderic B.

2011-01-01

Where conservation resources are limited and conservation targets are diverse, robust yet flexible priority-setting frameworks are vital. Priority-setting is especially important for geographically widespread species with distinct populations subject to multiple threats that operate on different spatial and temporal scales. Marine turtles are widely distributed and exhibit intra-specific variations in population sizes and trends, as well as reproduction and morphology. However, current global extinction risk assessment frameworks do not assess conservation status of spatially and biologically distinct marine turtle Regional Management Units (RMUs), and thus do not capture variations in population trends, impacts of threats, or necessary conservation actions across individual populations. To address this issue, we developed a new assessment framework that allowed us to evaluate, compare and organize marine turtle RMUs according to status and threats criteria. Because conservation priorities can vary widely (i.e. from avoiding imminent extinction to maintaining long-term monitoring efforts) we developed a “conservation priorities portfolio” system using categories of paired risk and threats scores for all RMUs (n = 58). We performed these assessments and rankings globally, by species, by ocean basin, and by recognized geopolitical bodies to identify patterns in risk, threats, and data gaps at different scales. This process resulted in characterization of risk and threats to all marine turtle RMUs, including identification of the world's 11 most endangered marine turtle RMUs based on highest risk and threats scores. This system also highlighted important gaps in available information that is crucial for accurate conservation assessments. Overall, this priority-setting framework can provide guidance for research and conservation priorities at multiple relevant scales, and should serve as a model for conservation status assessments and priority-setting for widespread, long-lived taxa. PMID:21969858

Using a Malcolm Baldrige framework to understand high-performing clinical microsystems.

PubMed

Foster, Tina C; Johnson, Julie K; Nelson, Eugene C; Batalden, Paul B

2007-10-01

BACKGROUND, OBJECTIVES AND METHOD: The Malcolm Baldrige National Quality Award (MBNQA) provides a set of criteria for organisational quality assessment and improvement that has been used by thousands of business, healthcare and educational organisations for more than a decade. The criteria can be used as a tool for self-evaluation, and are widely recognised as a robust framework for design and evaluation of healthcare systems. The clinical microsystem, as an organisational construct, is a systems approach for providing clinical care based on theories from organisational development, leadership and improvement. This study compared the MBNQA criteria for healthcare and the success factors of high-performing clinical microsystems to (1) determine whether microsystem success characteristics cover the same range of issues addressed by the Baldrige criteria and (2) examine whether this comparison might better inform our understanding of either framework. Both Baldrige criteria and microsystem success characteristics cover a wide range of areas crucial to high performance. Those particularly called out by this analysis are organisational leadership, work systems and service processes from a Baldrige standpoint, and leadership, performance results, process improvement, and information and information technology from the microsystem success characteristics view. Although in many cases the relationship between Baldrige criteria and microsystem success characteristics are obvious, in others the analysis points to ways in which the Baldrige criteria might be better understood and worked with by a microsystem through the design of work systems and a deep understanding of processes. Several tools are available for those who wish to engage in self-assessment based on MBNQA criteria and microsystem characteristics.

Using a Malcolm Baldrige framework to understand high‐performing clinical microsystems

PubMed Central

Foster, Tina C; Johnson, Julie K; Nelson, Eugene C; Batalden, Paul B

2007-01-01

Background, objectives and method The Malcolm Baldrige National Quality Award (MBNQA) provides a set of criteria for organisational quality assessment and improvement that has been used by thousands of business, healthcare and educational organisations for more than a decade. The criteria can be used as a tool for self‐evaluation, and are widely recognised as a robust framework for design and evaluation of healthcare systems. The clinical microsystem, as an organisational construct, is a systems approach for providing clinical care based on theories from organisational development, leadership and improvement. This study compared the MBNQA criteria for healthcare and the success factors of high‐performing clinical microsystems to (1) determine whether microsystem success characteristics cover the same range of issues addressed by the Baldrige criteria and (2) examine whether this comparison might better inform our understanding of either framework. Results and conclusions Both Baldrige criteria and microsystem success characteristics cover a wide range of areas crucial to high performance. Those particularly called out by this analysis are organisational leadership, work systems and service processes from a Baldrige standpoint, and leadership, performance results, process improvement, and information and information technology from the microsystem success characteristics view. Although in many cases the relationship between Baldrige criteria and microsystem success characteristics are obvious, in others the analysis points to ways in which the Baldrige criteria might be better understood and worked with by a microsystem through the design of work systems and a deep understanding of processes. Several tools are available for those who wish to engage in self‐assessment based on MBNQA criteria and microsystem characteristics. PMID:17913773

77 FR 44613 - Notice of Availability of the External Review Draft of Framework for Human Health Risk Assessment...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-07-30

... External Review Draft of Framework for Human Health Risk Assessment To Inform Decision Making AGENCY: U.S... external review draft of ``A Framework for Human Health Risk Assessment to Inform Decision Making.'' This... a framework for conducting human health risk assessments that are responsive to the needs of...

State Public Health Enabling Authorities: Results of a Fundamental Activities Assessment Examining Core and Essential Services

PubMed Central

Hoss, Aila; Menon, Akshara; Corso, Liza

2016-01-01

Context Public health enabling authorities establish the legal foundation for financing, organizing, and delivering public health services. State laws vary in terms of the content, depth, and breadth of these fundamental public health activities. Given this variance, the Institute of Medicine has identified state public health laws as an area that requires further examination. To respond to this call for further examination, the Centers for Disease Control and Prevention’s Public Health Law Program conducted a fundamental activities legal assessment on state public health laws. Objective The goal of the legal assessment was to examine state laws referencing frameworks representing public health department fundamental activities (ie, core and essential services) in an effort to identify, catalog, and describe enabling authorities of state governmental public health systems. Design In 2013, Public Health Law Program staff compiled a list of state statutes and regulations referencing different commonly-recognized public health frameworks of fundamental activities. The legal assessment included state fundamental activities laws available on WestlawNext as of July 2013. The results related to the 10 essential public health services and the 3 core public health functions were confirmed and updated in June 2016. Results Eighteen states reference commonly-recognized frameworks of fundamental activities in their laws. Thirteen states have listed the 10 essential public health services in their laws. Eight of these states have also referenced the 3 core public health functions in their laws. Five states reference only the core public health functions. Conclusions Several states reference fundamental activities in their state laws, particularly through use of the essential services framework. Further work is needed to capture the public health laws and practices of states that may be performing fundamental activities but without reference to a common framework. PMID:27682724

State Public Health Enabling Authorities: Results of a Fundamental Activities Assessment Examining Core and Essential Services.

PubMed

Hoss, Aila; Menon, Akshara; Corso, Liza

2016-01-01

Public health enabling authorities establish the legal foundation for financing, organizing, and delivering public health services. State laws vary in terms of the content, depth, and breadth of these fundamental public health activities. Given this variance, the Institute of Medicine has identified state public health laws as an area that requires further examination. To respond to this call for further examination, the Centers for Disease Control and Prevention's Public Health Law Program conducted a fundamental activities legal assessment on state public health laws. The goal of the legal assessment was to examine state laws referencing frameworks representing public health department fundamental activities (ie, core and essential services) in an effort to identify, catalog, and describe enabling authorities of state governmental public health systems. In 2013, Public Health Law Program staff compiled a list of state statutes and regulations referencing different commonly-recognized public health frameworks of fundamental activities. The legal assessment included state fundamental activities laws available on WestlawNext as of July 2013. The results related to the 10 essential public health services and the 3 core public health functions were confirmed and updated in June 2016. Eighteen states reference commonly-recognized frameworks of fundamental activities in their laws. Thirteen states have listed the 10 essential public health services in their laws. Eight of these states have also referenced the 3 core public health functions in their laws. Five states reference only the core public health functions. Several states reference fundamental activities in their state laws, particularly through use of the essential services framework. Further work is needed to capture the public health laws and practices of states that may be performing fundamental activities but without reference to a common framework.

A New Framework for Quantifying Lidar Uncertainty

DOE Office of Scientific and Technical Information (OSTI.GOV)

Newman, Jennifer, F.; Clifton, Andrew; Bonin, Timothy A.

2017-03-24

As wind turbine sizes increase and wind energy expands to more complex and remote sites, remote sensing devices such as lidars are expected to play a key role in wind resource assessment and power performance testing. The switch to remote sensing devices represents a paradigm shift in the way the wind industry typically obtains and interprets measurement data for wind energy. For example, the measurement techniques and sources of uncertainty for a remote sensing device are vastly different from those associated with a cup anemometer on a meteorological tower. Current IEC standards discuss uncertainty due to mounting, calibration, and classificationmore » of the remote sensing device, among other parameters. Values of the uncertainty are typically given as a function of the mean wind speed measured by a reference device. However, real-world experience has shown that lidar performance is highly dependent on atmospheric conditions, such as wind shear, turbulence, and aerosol content. At present, these conditions are not directly incorporated into the estimated uncertainty of a lidar device. In this presentation, we propose the development of a new lidar uncertainty framework that adapts to current flow conditions and more accurately represents the actual uncertainty inherent in lidar measurements under different conditions. In this new framework, sources of uncertainty are identified for estimation of the line-of-sight wind speed and reconstruction of the three-dimensional wind field. These sources are then related to physical processes caused by the atmosphere and lidar operating conditions. The framework is applied to lidar data from an operational wind farm to assess the ability of the framework to predict errors in lidar-measured wind speed.« less

Interagency Modeling Atmospheric Assessment Center Local Jurisdiction: IMAAC Operations Framework

DTIC Science & Technology

2010-03-01

Richard Bergin Robert Josefek i REPORT DOCUMENTATION PAGE Form Approved OMB No. 0704-0188 Public reporting burden for this collection of information...Edward J. Dadosky 5. FUNDING NUMBERS 7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) Naval Postgraduate School Monterey, CA 93943-5000 8...PERFORMING ORGANIZATION REPORT NUMBER 9. SPONSORING /MONITORING AGENCY NAME(S) AND ADDRESS(ES) N/A 10. SPONSORING/MONITORING AGENCY REPORT

An open framework for automated chemical hazard assessment based on GreenScreen for Safer Chemicals: A proof of concept.

PubMed

Wehage, Kristopher; Chenhansa, Panan; Schoenung, Julie M

2017-01-01

GreenScreen® for Safer Chemicals is a framework for comparative chemical hazard assessment. It is the first transparent, open and publicly accessible framework of its kind, allowing manufacturers and governmental agencies to make informed decisions about the chemicals and substances used in consumer products and buildings. In the GreenScreen® benchmarking process, chemical hazards are assessed and classified based on 18 hazard endpoints from up to 30 different sources. The result is a simple numerical benchmark score and accompanying assessment report that allows users to flag chemicals of concern and identify safer alternatives. Although the screening process is straightforward, aggregating and sorting hazard data is tedious, time-consuming, and prone to human error. In light of these challenges, the present work demonstrates the usage of automation to cull chemical hazard data from publicly available internet resources, assign metadata, and perform a GreenScreen® hazard assessment using the GreenScreen® "List Translator." The automated technique, written as a module in the Python programming language, generates GreenScreen® List Translation data for over 3000 chemicals in approximately 30 s. Discussion of the potential benefits and limitations of automated techniques is provided. By embedding the library into a web-based graphical user interface, the extensibility of the library is demonstrated. The accompanying source code is made available to the hazard assessment community. Integr Environ Assess Manag 2017;13:167-176. © 2016 SETAC. © 2016 SETAC.

A computational framework to characterize and compare the geometry of coronary networks.

PubMed

Bulant, C A; Blanco, P J; Lima, T P; Assunção, A N; Liberato, G; Parga, J R; Ávila, L F R; Pereira, A C; Feijóo, R A; Lemos, P A

2017-03-01

This work presents a computational framework to perform a systematic and comprehensive assessment of the morphometry of coronary arteries from in vivo medical images. The methodology embraces image segmentation, arterial vessel representation, characterization and comparison, data storage, and finally analysis. Validation is performed using a sample of 48 patients. Data mining of morphometric information of several coronary arteries is presented. Results agree to medical reports in terms of basic geometric and anatomical variables. Concerning geometric descriptors, inter-artery and intra-artery correlations are studied. Data reported here can be useful for the construction and setup of blood flow models of the coronary circulation. Finally, as an application example, similarity criterion to assess vasculature likelihood based on geometric features is presented and used to test geometric similarity among sibling patients. Results indicate that likelihood, measured through geometric descriptors, is stronger between siblings compared with non-relative patients. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Conceptual frameworks of individual work performance: a systematic review.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; Schaufeli, Wilmar B; de Vet Henrica, C W; van der Beek, Allard J

2011-08-01

Individual work performance is differently conceptualized and operationalized in different disciplines. The aim of the current review was twofold: (1) identifying conceptual frameworks of individual work performance and (2) integrating these to reach a heuristic conceptual framework. A systematic review was conducted in medical, psychological, and management databases. Studies were selected independently by two researchers and included when they presented a conceptual framework of individual work performance. A total of 17 generic frameworks (applying across occupations) and 18 job-specific frameworks (applying to specific occupations) were identified. Dimensions frequently used to describe individual work performance were task performance, contextual performance, counterproductive work behavior, and adaptive performance. On the basis of the literature, a heuristic conceptual framework of individual work performance was proposed. This framework can serve as a theoretical basis for future research and practice.

ECTA/DaSy Framework Self-Assessment Comparison Tool

ERIC Educational Resources Information Center

Center for IDEA Early Childhood Data Systems (DaSy), 2016

2016-01-01

The Self-Assessment Comparison (SAC) Tool is for state Part C and Section 619/Preschool programs to use to assess changes in the implementation of one or more components of the ECTA System Framework and/or subcomponenets of the DaSy Data System Framework. It is a companion to the ECTA/DaSy Framework Self-Assessment. Key features of the SAC are…

A quantitative evaluation of a qualitative risk assessment framework: Examining the assumptions and predictions of the Productivity Susceptibility Analysis (PSA)

PubMed Central

2018-01-01

Qualitative risk assessment frameworks, such as the Productivity Susceptibility Analysis (PSA), have been developed to rapidly evaluate the risks of fishing to marine populations and prioritize management and research among species. Despite being applied to over 1,000 fish populations, and an ongoing debate about the most appropriate method to convert biological and fishery characteristics into an overall measure of risk, the assumptions and predictive capacity of these approaches have not been evaluated. Several interpretations of the PSA were mapped to a conventional age-structured fisheries dynamics model to evaluate the performance of the approach under a range of assumptions regarding exploitation rates and measures of biological risk. The results demonstrate that the underlying assumptions of these qualitative risk-based approaches are inappropriate, and the expected performance is poor for a wide range of conditions. The information required to score a fishery using a PSA-type approach is comparable to that required to populate an operating model and evaluating the population dynamics within a simulation framework. In addition to providing a more credible characterization of complex system dynamics, the operating model approach is transparent, reproducible and can evaluate alternative management strategies over a range of plausible hypotheses for the system. PMID:29856869

Performance evaluation of DNA copy number segmentation methods.

PubMed

Pierre-Jean, Morgane; Rigaill, Guillem; Neuvial, Pierre

2015-07-01

A number of bioinformatic or biostatistical methods are available for analyzing DNA copy number profiles measured from microarray or sequencing technologies. In the absence of rich enough gold standard data sets, the performance of these methods is generally assessed using unrealistic simulation studies, or based on small real data analyses. To make an objective and reproducible performance assessment, we have designed and implemented a framework to generate realistic DNA copy number profiles of cancer samples with known truth. These profiles are generated by resampling publicly available SNP microarray data from genomic regions with known copy-number state. The original data have been extracted from dilutions series of tumor cell lines with matched blood samples at several concentrations. Therefore, the signal-to-noise ratio of the generated profiles can be controlled through the (known) percentage of tumor cells in the sample. This article describes this framework and its application to a comparison study between methods for segmenting DNA copy number profiles from SNP microarrays. This study indicates that no single method is uniformly better than all others. It also helps identifying pros and cons of the compared methods as a function of biologically informative parameters, such as the fraction of tumor cells in the sample and the proportion of heterozygous markers. This comparison study may be reproduced using the open source and cross-platform R package jointseg, which implements the proposed data generation and evaluation framework: http://r-forge.r-project.org/R/?group_id=1562. © The Author 2014. Published by Oxford University Press.

Cage Occupation of Light Hydrocarbons in Gas Hydrate Crystals

NASA Astrophysics Data System (ADS)

Kida, M.; Watanabe, M.; Konno, Y.; Yoneda, J.; Jin, Y.; Nagao, J.

2016-12-01

Naturally occurring gas hydrates in marine or permafrost environments can trap methane and heavier hydrocarbons within its host lattice structure built up with hydrogen-bonded water molecules. Naturally occurring gas hydrates have been expected as new natural gas resources. It is important to reveal the distribution of guest hydrocarbons in host hydrate framework from viewpoint of assessment of gas capacity. In this study, we assessed cage occupancies of guest hydrocarbons in host hydrate framework of synthetic and natural gas hydrates using solid-state 13C NMR technique. As synthetic samples, gas hydrates formed from gas mixtures including C1 to C5 were investigated. As a natural sample, the pore-space gas hydrate sample recovered from the eastern Nankai Trough area during the 2012 JOGMEC/JAPEX Pressure coring operation was studied. As a result, it revealed that all heavier hydrocarbons than ethane are preferentially incorporated into the larger cage cavities in hydrate frameworks. We performed this study as a part of a Japanese National hydrate research program (MH21, funded by METI).

Towards a common oil spill risk assessment framework – Adapting ISO 31000 and addressing uncertainties.

PubMed

Sepp Neves, Antonio Augusto; Pinardi, Nadia; Martins, Flavio; Janeiro, Joao; Samaras, Achilleas; Zodiatis, George; De Dominicis, Michela

2015-08-15

Oil spills are a transnational problem, and establishing a common standard methodology for Oil Spill Risk Assessments (OSRAs) is thus paramount in order to protect marine environments and coastal communities. In this study we firstly identified the strengths and weaknesses of the OSRAs carried out in various parts of the globe. We then searched for a generic and recognized standard, i.e. ISO 31000, in order to design a method to perform OSRAs in a scientific and standard way. The new framework was tested for the Lebanon oil spill that occurred in 2006 employing ensemble oil spill modeling to quantify the risks and uncertainties due to unknown spill characteristics. The application of the framework generated valuable visual instruments for the transparent communication of the risks, replacing the use of risk tolerance levels, and thus highlighting the priority areas to protect in case of an oil spill. Copyright © 2015 Elsevier Ltd. All rights reserved.

Automated robot-assisted surgical skill evaluation: Predictive analytics approach.

PubMed

Fard, Mahtab J; Ameri, Sattar; Darin Ellis, R; Chinnam, Ratna B; Pandya, Abhilash K; Klein, Michael D

2018-02-01

Surgical skill assessment has predominantly been a subjective task. Recently, technological advances such as robot-assisted surgery have created great opportunities for objective surgical evaluation. In this paper, we introduce a predictive framework for objective skill assessment based on movement trajectory data. Our aim is to build a classification framework to automatically evaluate the performance of surgeons with different levels of expertise. Eight global movement features are extracted from movement trajectory data captured by a da Vinci robot for surgeons with two levels of expertise - novice and expert. Three classification methods - k-nearest neighbours, logistic regression and support vector machines - are applied. The result shows that the proposed framework can classify surgeons' expertise as novice or expert with an accuracy of 82.3% for knot tying and 89.9% for a suturing task. This study demonstrates and evaluates the ability of machine learning methods to automatically classify expert and novice surgeons using global movement features. Copyright © 2017 John Wiley & Sons, Ltd.

Vulnerability Assessment and Adaptation Framework, Third Edition

DOT National Transportation Integrated Search

2017-11-01

The Federal Highway Administrations (FHWAs) Vulnerability Assessment and Adaptation Framework (the Framework), third edition, is a manual to help transportation agencies and their partners assess the vulnerability of transportation infrastructu...

Final Report for the ZERT Project: Basic Science of Retention Issues, Risk Assessment & Measurement, Monitoring and Verification for Geologic Sequestration

DOE Office of Scientific and Technical Information (OSTI.GOV)

Spangler, Lee; Cunningham, Alfred; Lageson, David

2011-03-31

ZERT has made major contributions to five main areas of sequestration science: improvement of computational tools; measurement and monitoring techniques to verify storage and track migration of CO{sub 2}; development of a comprehensive performance and risk assessment framework; fundamental geophysical, geochemical and hydrological investigations of CO{sub 2} storage; and investigate innovative, bio-based mitigation strategies.

Discussion of skill improvement in marine ecosystem dynamic models based on parameter optimization and skill assessment

NASA Astrophysics Data System (ADS)

Shen, Chengcheng; Shi, Honghua; Liu, Yongzhi; Li, Fen; Ding, Dewen

2016-07-01

Marine ecosystem dynamic models (MEDMs) are important tools for the simulation and prediction of marine ecosystems. This article summarizes the methods and strategies used for the improvement and assessment of MEDM skill, and it attempts to establish a technical framework to inspire further ideas concerning MEDM skill improvement. The skill of MEDMs can be improved by parameter optimization (PO), which is an important step in model calibration. An efficient approach to solve the problem of PO constrained by MEDMs is the global treatment of both sensitivity analysis and PO. Model validation is an essential step following PO, which validates the efficiency of model calibration by analyzing and estimating the goodness-of-fit of the optimized model. Additionally, by focusing on the degree of impact of various factors on model skill, model uncertainty analysis can supply model users with a quantitative assessment of model confidence. Research on MEDMs is ongoing; however, improvement in model skill still lacks global treatments and its assessment is not integrated. Thus, the predictive performance of MEDMs is not strong and model uncertainties lack quantitative descriptions, limiting their application. Therefore, a large number of case studies concerning model skill should be performed to promote the development of a scientific and normative technical framework for the improvement of MEDM skill.

Measuring research impact in medical research institutes: a qualitative study of the attitudes and opinions of Australian medical research institutes towards research impact assessment frameworks.

PubMed

Deeming, Simon; Reeves, Penny; Ramanathan, Shanthi; Attia, John; Nilsson, Michael; Searles, Andrew

2018-03-16

The question of how to measure, assess and optimise the returns from investment in health and medical research (HMR) is a highly policy-relevant issue. Research Impact Assessment Frameworks (RIAFs) provide a conceptual measurement framework to assess the impact from HMR. The aims of this study were (1) to elicit the views of Medical Research Institutes (MRIs) regarding objectives, definitions, methods, barriers, potential scope and attitudes towards RIAFs, and (2) to investigate whether an assessment framework should represent a retrospective reflection of research impact or a prospective approach integrated into the research process. The wider objective was to inform the development of a draft RIAF for Australia's MRIs. Purposive sampling to derive a heterogeneous sample of Australian MRIs was used alongside semi-structured interviews with senior executives responsible for research translation or senior researchers affected by research impact initiatives. Thematic analysis of the interview transcriptions using the framework approach was then performed. Interviews were conducted with senior representatives from 15 MRIs. Participants understood the need for greater research translation/impact, but varied in their comprehension and implementation of RIAFs. Common concerns included the time lag to the generation of societal impacts from basic or discovery science, and whether impact reflected a narrow commercialisation agenda. Broad support emerged for the use of metrics, case study and economic methods. Support was also provided for the rationale of both standardised and customised metrics. Engendering cultural change in the approach to research translation was acknowledged as both a barrier to greater impact and a critical objective for the assessment process. Participants perceived that the existing research environment incentivised the generation of academic publications and track records, and often conflicted with the generation of wider impacts. The potential to improve the speed of translation through prospective implementation of impact assessment was supported, albeit that the mechanism required development. The study found that the issues raised regarding research impact assessment are less about methods and metrics, and more about the research activities that the measurement of research translation and impact may or may not incentivise. Consequently, if impact assessment is to contribute to optimisation of the health gains from the public, corporate and philanthropic investment entrusted to the institutes, then further inquiry into how the assessment process may re-align research behaviour must be prioritised.

The influence of stress responses on surgical performance and outcomes: Literature review and the development of the surgical stress effects (SSE) framework.

PubMed

Chrouser, Kristin L; Xu, Jie; Hallbeck, Susan; Weinger, Matthew B; Partin, Melissa R

2018-02-22

Surgical adverse events persist despite several decades of system-based quality improvement efforts, suggesting the need for alternative strategies. Qualitative studies suggest stress-induced negative intraoperative interpersonal dynamics might contribute to performance errors and undesirable patient outcomes. Understanding the impact of intraoperative stressors may be critical to reducing adverse events and improving outcomes. We searched MEDLINE, psycINFO, EMBASE, Business Source Premier, and CINAHL databases (1996-2016) to assess the relationship between negative (emotional and behavioral) responses to acute intraoperative stressors and provider performance or patient surgical outcomes. Drawing on theory and evidence from reviewed studies, we present the Surgical Stress Effects (SSE) framework. This illustrates how emotional and behavioral responses to stressors can influence individual surgical provider (e.g. surgeon, nurse) performance, team performance, and patient outcomes. It also demonstrates how uncompensated intraoperative threats and errors can lead to adverse events, highlighting evidence gaps for future research efforts. Published by Elsevier Inc.

Conceptual framework of public health surveillance and action and its application in health sector reform.

PubMed

McNabb, Scott J N; Chungong, Stella; Ryan, Mike; Wuhib, Tadesse; Nsubuga, Peter; Alemu, Wondi; Carande-Kulis, Vilma; Rodier, Guenael

2002-01-01

Because both public health surveillance and action are crucial, the authors initiated meetings at regional and national levels to assess and reform surveillance and action systems. These meetings emphasized improved epidemic preparedness, epidemic response, and highlighted standardized assessment and reform. To standardize assessments, the authors designed a conceptual framework for surveillance and action that categorized the framework into eight core and four support activities, measured with indicators. In application, country-level reformers measure both the presence and performance of the six core activities comprising public health surveillance (detection, registration, reporting, confirmation, analyses, and feedback) and acute (epidemic-type) and planned (management-type) responses composing the two core activities of public health action. Four support activities - communications, supervision, training, and resource provision - enable these eight core processes. National, multiple systems can then be concurrently assessed at each level for effectiveness, technical efficiency, and cost. This approach permits a cost analysis, highlights areas amenable to integration, and provides focused intervention. The final public health model becomes a district-focused, action-oriented integration of core and support activities with enhanced effectiveness, technical efficiency, and cost savings. This reform approach leads to sustained capacity development by an empowerment strategy defined as facilitated, process-oriented action steps transforming staff and the system.

The development of an evaluation framework for injury surveillance systems

PubMed Central

Mitchell, Rebecca J; Williamson, Ann M; O'Connor, Rod

2009-01-01

Background Access to good quality information from injury surveillance is essential to develop and monitor injury prevention activities. To determine if information obtained from surveillance is of high quality, the limitations and strengths of a surveillance system are often examined. Guidelines have been developed to assist in evaluating certain types of surveillance systems. However, to date, no standard guidelines have been developed to specifically evaluate an injury surveillance system. The aim of this research is to develop a framework to guide the evaluation of injury surveillance systems. Methods The development of an Evaluation Framework for Injury Surveillance Systems (EFISS) involved a four stage process. First, a literature review was conducted to identify an initial set of characteristics that were recognised as important and/or had been recommended to be assessed in an evaluation of a surveillance system. Second, this set of characteristics was assessed using SMART criteria. Third, those surviving were presented to an expert panel using a two round modified-Delphi study to gain an alternative perspective on characteristic definitions, practicality of assessment, and characteristic importance. Finally, a rating system was created for the EFISS characteristics. Results The resulting EFISS consisted of 18 characteristics that assess three areas of an injury surveillance system – five characteristics assess data quality, nine characteristics assess the system's operation, and four characteristics assess the practical capability of an injury surveillance system. A rating system assesses the performance of each characteristic. Conclusion The development of the EFISS builds upon existing evaluation guidelines for surveillance systems and provides a framework tailored to evaluate an injury surveillance system. Ultimately, information obtained through an evaluation of an injury data collection using the EFISS would be useful for agencies to recommend how a collection could be improved to increase its usefulness for injury surveillance and in the long-term injury prevention. PMID:19627617

Evaluating the effectiveness of risk minimisation measures: the application of a conceptual framework to Danish real-world dabigatran data.

PubMed

Nyeland, Martin Erik; Laursen, Mona Vestergaard; Callréus, Torbjörn

2017-06-01

For both marketing authorization holders and regulatory authorities, evaluating the effectiveness of risk minimization measures is now an integral part of pharmacovigilance in the European Union. The overall aim of activities in this area is to assess the performance of risk minimization measures implemented in order to ensure a positive benefit-risk balance in patients treated with a medicinal product. Following a review of the relevant literature, we developed a conceptual framework consisting of four domains (data, knowledge, behaviour and outcomes) intended for the evaluation of risk minimization measures put into practice in the Danish health-care system. For the implementation of the framework, four classes of monitoring variables can be named and defined: patient descriptors, performance-related indicators of knowledge, behaviour and outcomes. We reviewed the features of the framework when applied to historical, real-world data following the introduction of dabigatran in Denmark for the prophylactic treatment of patients with non-valvular atrial fibrillation. The application of the framework provided useful graphical displays and an opportunity for a statistical evaluation (interrupted time series analysis) of a regulatory intervention. © 2017 Commonwealth of Australia. Pharmacoepidemiology & Drug Safety © 2017 John Wiley & Sons, Ltd. © 2017 Commonwealth of Australia. Pharmacoepidemiology & Drug Safety © 2017 John Wiley & Sons, Ltd.

A flexible framework for process-based hydraulic and water ...

EPA Pesticide Factsheets

Background Models that allow for design considerations of green infrastructure (GI) practices to control stormwater runoff and associated contaminants have received considerable attention in recent years. While popular, generally, the GI models are relatively simplistic. However, GI model predictions are being relied upon by many municipalities and State/Local agencies to make decisions about grey vs. green infrastructure improvement planning. Adding complexity to GI modeling frameworks may preclude their use in simpler urban planning situations. Therefore, the goal here was to develop a sophisticated, yet flexible tool that could be used by design engineers and researchers to capture and explore the effect of design factors and properties of the media used in the performance of GI systems at a relatively small scale. We deemed it essential to have a flexible GI modeling tool that is capable of simulating GI system components and specific biophysical processes affecting contaminants such as reactions, and particle-associated transport accurately while maintaining a high degree of flexibly to account for the myriad of GI alternatives. The mathematical framework for a stand-alone GI performance assessment tool has been developed and will be demonstrated.Framework Features The process-based model framework developed here can be used to model a diverse range of GI practices such as green roof, retention pond, bioretention, infiltration trench, permeable pavement and

Video scrambling for privacy protection in video surveillance: recent results and validation framework

NASA Astrophysics Data System (ADS)

Dufaux, Frederic

2011-06-01

The issue of privacy in video surveillance has drawn a lot of interest lately. However, thorough performance analysis and validation is still lacking, especially regarding the fulfillment of privacy-related requirements. In this paper, we first review recent Privacy Enabling Technologies (PET). Next, we discuss pertinent evaluation criteria for effective privacy protection. We then put forward a framework to assess the capacity of PET solutions to hide distinguishing facial information and to conceal identity. We conduct comprehensive and rigorous experiments to evaluate the performance of face recognition algorithms applied to images altered by PET. Results show the ineffectiveness of naïve PET such as pixelization and blur. Conversely, they demonstrate the effectiveness of more sophisticated scrambling techniques to foil face recognition.

The Dutch Health Care Performance Report: seven years of health care performance assessment in the Netherlands.

PubMed

van den Berg, Michael J; Kringos, Dionne S; Marks, Lisanne K; Klazinga, Niek S

2014-01-09

In 2006, the first edition of a monitoring tool for the performance of the Dutch health care system was released: the Dutch Health Care Performance Report (DHCPR). The Netherlands was among the first countries in the world developing such a comprehensive tool for reporting performance on quality, access, and affordability of health care. The tool contains 125 performance indicators; the choice for specific indicators resulted from a dialogue between researchers and policy makers. In the 'policy cycle', the DHCPR can rationally be placed between evaluation (accountability) and agenda-setting (for strategic decision making). In this paper, we reflect on important lessons learned after seven years of health care system performance assessment. These lessons entail the importance of a good conceptual framework for health system performance assessment, the importance of repeated measurement, the strength of combining multiple perspectives (e.g., patient, professional, objective, subjective) on the same issue, the importance of a central role for the patients' perspective in performance assessment, how to deal with the absence of data in relevant domains, the value of international benchmarking and the continuous exchange between researchers and policy makers.

77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-14

... interface design guidelines for EHRs. Manufacturers interested in participating in this research will be... the usability of health information technology (HIT) systems. NIST research is designed to: (1... develop performance-oriented user interface design guidelines for EHRs, and a framework for assessing the...

Mississippi Curriculum Framework for Family Dynamics. Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for family dynamics. The course uses skills in critical thinking, decision…

State Civic Education Policy Framework

ERIC Educational Resources Information Center

Baumann, Paul; Millard, Maria; Hamdorf, Leslie

2014-01-01

While many Americans might agree on the importance of preparing young people for democratic life, civic education receives relatively less attention than other school subjects. Student performance on civic assessments reflects the limited focus of schools on civic learning. While many individuals and organizations have sought to address the poor…

Assisting allied health in performance evaluation: a systematic review.

PubMed

Lizarondo, Lucylynn; Grimmer, Karen; Kumar, Saravana

2014-11-14

Performance evaluation raises several challenges to allied health practitioners and there is no agreed approach to measuring or monitoring allied health service performance. The aim of this review was to examine the literature on performance evaluation in healthcare to assist in the establishment of a framework that can guide the measurement and evaluation of allied health clinical service performance. This review determined the core elements of a performance evaluation system, tools for evaluating performance, and barriers to the implementation of performance evaluation. A systematic review of the literature was undertaken. Five electronic databases were used to search for relevant articles: MEDLINE, Embase, CINAHL, PsychInfo, and Academic Search Premier. Articles which focussed on any allied health performance evaluation or those which examined performance in health care in general were considered in the review. Content analysis was used to synthesise the findings from individual articles. A total of 37 articles were included in the review. The literature suggests there are core elements involved in performance evaluation which include prioritising clinical areas for measurement, setting goals, selecting performance measures, identifying sources of feedback, undertaking performance measurement, and reporting the results to relevant stakeholders. The literature describes performance evaluation as multi-dimensional, requiring information or data from more than one perspective to provide a rich assessment of performance. A range of tools or instruments are available to capture various perspectives and gather a comprehensive picture of health care quality. Every allied health care delivery system has different performance needs and will therefore require different approaches. However, there are core processes that can be used as a framework to evaluate allied health performance. A careful examination of barriers to performance evaluation and subsequent tailoring of strategies to overcome these barriers should be undertaken to achieve the aims of performance evaluation. The findings of this review should inform the development of a standardised framework that can be used to measure and evaluate allied health performance. Future research should explore the utility and overall impact of such framework in allied health service delivery.

A framework for outcome-level evaluation of in-service training of health care workers.

PubMed

O'Malley, Gabrielle; Perdue, Thomas; Petracca, Frances

2013-10-01

In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and results of that project. A general inductive methodology was used for the conceptualization and development of the framework. Fifteen key informant interviews were conducted to explore contextual factors, perceived needs, barriers and facilitators affecting the evaluation of training outcomes. In addition, a thematic analysis of 70 published articles reporting health care worker training outcomes identified key themes and categories. These were integrated, synthesized and compared to several existing training evaluation models. This formed an overall typology which was used to draft a new framework. Finally, the framework was refined and validated through an iterative process of feedback, pilot testing and revision. The inductive process resulted in identification of themes and categories, as well as relationships among several levels and types of outcomes. The resulting framework includes nine distinct types of outcomes that can be evaluated, which are organized within three nested levels: individual, organizational and health system/population. The outcome types are: (1) individual knowledge, attitudes and skills; (2) individual performance; (3) individual patient health; (4) organizational systems; (5) organizational performance; (6) organizational-level patient health; (7) health systems; (8) population-level performance; and (9) population-level health. The framework also addresses contextual factors which may influence the outcomes of training, as well as the ability of evaluators to determine training outcomes. In addition, a group of user-friendly resources, the Training Evaluation Framework and Tools (TEFT) were created to help evaluators and stakeholders understand and apply the framework. Feedback from pilot users suggests that using the framework and accompanying tools may support outcome evaluation planning. Further assessment will assist in strengthening guidelines and tools for operationalization.

A framework for outcome-level evaluation of in-service training of health care workers

PubMed Central

2013-01-01

Background In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President’s Emergency Plan for AIDS Relief’s Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and results of that project. Methods A general inductive methodology was used for the conceptualization and development of the framework. Fifteen key informant interviews were conducted to explore contextual factors, perceived needs, barriers and facilitators affecting the evaluation of training outcomes. In addition, a thematic analysis of 70 published articles reporting health care worker training outcomes identified key themes and categories. These were integrated, synthesized and compared to several existing training evaluation models. This formed an overall typology which was used to draft a new framework. Finally, the framework was refined and validated through an iterative process of feedback, pilot testing and revision. Results The inductive process resulted in identification of themes and categories, as well as relationships among several levels and types of outcomes. The resulting framework includes nine distinct types of outcomes that can be evaluated, which are organized within three nested levels: individual, organizational and health system/population. The outcome types are: (1) individual knowledge, attitudes and skills; (2) individual performance; (3) individual patient health; (4) organizational systems; (5) organizational performance; (6) organizational-level patient health; (7) health systems; (8) population-level performance; and (9) population-level health. The framework also addresses contextual factors which may influence the outcomes of training, as well as the ability of evaluators to determine training outcomes. In addition, a group of user-friendly resources, the Training Evaluation Framework and Tools (TEFT) were created to help evaluators and stakeholders understand and apply the framework. Conclusions Feedback from pilot users suggests that using the framework and accompanying tools may support outcome evaluation planning. Further assessment will assist in strengthening guidelines and tools for operationalization. PMID:24083635

Developing Urban Environment Indicators for Neighborhood Sustainability Assessment in Tripoli-Libya

NASA Astrophysics Data System (ADS)

Elgadi, Ahmed. A.; Hakim Ismail, Lokman; Abass, Fatma; Ali, Abdelmuniem

2016-11-01

Sustainability assessment frameworks are becoming increasingly important to assist in the transition towards a sustainable urban environment. The urban environment is an effective system and requires regular monitoring and evaluation through a set of relevant indicators. The indicator provides information about the state of the environment through the production value of quantity. The indicator creates sustainability assessment requests to be considered on all spatial scales to specify efficient information of urban environment sustainability in Tripoli-Libya. Detailed data is necessary to assess environmental modification in the urban environment on a local scale and ease the transfer of this information to national and global stages. This paper proposes a set of key indicators to monitor urban environmental sustainability developments of Libyan residential neighborhoods. The proposed environmental indicator framework measures the sustainability performance of an urban environment through 13 sub-categories consisting of 21 indicators. This paper also explains the theoretical foundations for the selection of all indicators with reference to previous studies.

OPPE, FPPE, QPS, and why the alphabet soup of physician assessment is essential for safer patient care.

PubMed

Loftus, Michael L

Creating a successful quality and patient safety program requires a multifaceted approach that systematically reviews overall systems and processes, but also creates a standardized framework for evaluating individual practitioner performance on a routine basis. There are two required elements of competency assessment that are typically tied to the hospital credentialing process: ongoing professional practice evaluation (OPPE) and focused professional practice evaluation (FPPE). Each of these processes are mandated by the Joint Commission, and form an important cornerstone for ensuring adequate physician performance and knowledge base. Copyright © 2017. Published by Elsevier Inc.

A framework for global river flood risk assessment

NASA Astrophysics Data System (ADS)

Winsemius, H. C.; Van Beek, L. P. H.; Bouwman, A.; Ward, P. J.; Jongman, B.

2012-04-01

There is an increasing need for strategic global assessments of flood risks. Such assessments may be required by: (a) International Financing Institutes and Disaster Management Agencies to evaluate where, when, and which investments in flood risk mitigation are most required; (b) (re-)insurers, who need to determine their required coverage capital; and (c) large companies to account for risks of regional investments. In this contribution, we propose a framework for global river flood risk assessment. The framework combines coarse scale resolution hazard probability distributions, derived from global hydrological model runs (typical scale about 0.5 degree resolution) with high resolution estimates of exposure indicators. The high resolution is required because floods typically occur at a much smaller scale than the typical resolution of global hydrological models, and exposure indicators such as population, land use and economic value generally are strongly variable in space and time. The framework therefore estimates hazard at a high resolution ( 1 km2) by using a) global forcing data sets of the current (or in scenario mode, future) climate; b) a global hydrological model; c) a global flood routing model, and d) importantly, a flood spatial downscaling routine. This results in probability distributions of annual flood extremes as an indicator of flood hazard, at the appropriate resolution. A second component of the framework combines the hazard probability distribution with classical flood impact models (e.g. damage, affected GDP, affected population) to establish indicators for flood risk. The framework can be applied with a large number of datasets and models and sensitivities of such choices can be evaluated by the user. The framework is applied using the global hydrological model PCR-GLOBWB, combined with a global flood routing model. Downscaling of the hazard probability distributions to 1 km2 resolution is performed with a new downscaling algorithm, applied on a number of target regions. We demonstrate the use of impact models in these regions based on global GDP, population, and land use maps. In this application, we show sensitivities of the estimated risks with regard to the use of different climate input datasets, decisions made in the downscaling algorithm, and different approaches to establish distributed estimates of GDP and asset exposure to flooding.

Experience with low-cost telemedicine in three different settings. Recommendations based on a proposed framework for network performance evaluation.

PubMed

Wootton, Richard; Vladzymyrskyy, Anton; Zolfo, Maria; Bonnardot, Laurent

2011-01-01

Telemedicine has been used for many years to support doctors in the developing world. Several networks provide services in different settings and in different ways. However, to draw conclusions about which telemedicine networks are successful requires a method of evaluating them. No general consensus or validated framework exists for this purpose. To define a basic method of performance measurement that can be used to improve and compare teleconsultation networks; to employ the proposed framework in an evaluation of three existing networks; to make recommendations about the future implementation and follow-up of such networks. Analysis based on the experience of three telemedicine networks (in operation for 7-10 years) that provide services to doctors in low-resource settings and which employ the same basic design. Although there are many possible indicators and metrics that might be relevant, five measures for each of the three user groups appear to be sufficient for the proposed framework. In addition, from the societal perspective, information about clinical- and cost-effectiveness is also required. The proposed performance measurement framework was applied to three mature telemedicine networks. Despite their differences in terms of activity, size and objectives, their performance in certain respects is very similar. For example, the time to first reply from an expert is about 24 hours for each network. Although all three networks had systems in place to collect data from the user perspective, none of them collected information about the coordinator's time required or about ease of system usage. They had only limited information about quality and cost. Measuring the performance of a telemedicine network is essential in understanding whether the network is working as intended and what effect it is having. Based on long-term field experience, the suggested framework is a practical tool that will permit organisations to assess the performance of their own networks and to improve them by comparison with others. All telemedicine systems should provide information about setup and running costs because cost-effectiveness is crucial for sustainability.

Experience with low-cost telemedicine in three different settings. Recommendations based on a proposed framework for network performance evaluation

PubMed Central

Wootton, Richard; Vladzymyrskyy, Anton; Zolfo, Maria; Bonnardot, Laurent

2011-01-01

Background Telemedicine has been used for many years to support doctors in the developing world. Several networks provide services in different settings and in different ways. However, to draw conclusions about which telemedicine networks are successful requires a method of evaluating them. No general consensus or validated framework exists for this purpose. Objective To define a basic method of performance measurement that can be used to improve and compare teleconsultation networks; to employ the proposed framework in an evaluation of three existing networks; to make recommendations about the future implementation and follow-up of such networks. Methods Analysis based on the experience of three telemedicine networks (in operation for 7–10 years) that provide services to doctors in low-resource settings and which employ the same basic design. Findings Although there are many possible indicators and metrics that might be relevant, five measures for each of the three user groups appear to be sufficient for the proposed framework. In addition, from the societal perspective, information about clinical- and cost-effectiveness is also required. The proposed performance measurement framework was applied to three mature telemedicine networks. Despite their differences in terms of activity, size and objectives, their performance in certain respects is very similar. For example, the time to first reply from an expert is about 24 hours for each network. Although all three networks had systems in place to collect data from the user perspective, none of them collected information about the coordinator's time required or about ease of system usage. They had only limited information about quality and cost. Conclusion Measuring the performance of a telemedicine network is essential in understanding whether the network is working as intended and what effect it is having. Based on long-term field experience, the suggested framework is a practical tool that will permit organisations to assess the performance of their own networks and to improve them by comparison with others. All telemedicine systems should provide information about setup and running costs because cost-effectiveness is crucial for sustainability. PMID:22162965

towards a theory-based multi-dimensional framework for assessment in mathematics: The "SEA" framework

NASA Astrophysics Data System (ADS)

Anku, Sitsofe E.

1997-09-01

Using the reform documents of the National Council of Teachers of Mathematics (NCTM) (NCTM, 1989, 1991, 1995), a theory-based multi-dimensional assessment framework (the "SEA" framework) which should help expand the scope of assessment in mathematics is proposed. This framework uses a context based on mathematical reasoning and has components that comprise mathematical concepts, mathematical procedures, mathematical communication, mathematical problem solving, and mathematical disposition.

Networks to Strengthen Health Systems for Chronic Disease Prevention

PubMed Central

Riley, Barbara L.; Herbert, Carol P.; Best, Allan

2013-01-01

Interorganizational networks that harness the priorities, capacities, and skills of various agencies and individuals have emerged as useful approaches for strengthening preventive services in public health systems. We use examples from the Canadian Heart Health Initiative and Alberta’s Primary Care Networks to illustrate characteristics of networks, describe the limitations of existing frameworks for assessing the performance of prevention-oriented networks, and propose a research agenda for guiding future efforts to improve the performance of these initiatives. Prevention-specific assessment strategies that capture relevant aspects of network performance need to be identified, and feedback mechanisms are needed that make better use of these data to drive change in network activities. PMID:24028225

DOE Office of Scientific and Technical Information (OSTI.GOV)

Newman, Jennifer; Clifton, Andrew; Bonin, Timothy

As wind turbine sizes increase and wind energy expands to more complex and remote sites, remote-sensing devices such as lidars are expected to play a key role in wind resource assessment and power performance testing. The switch to remote-sensing devices represents a paradigm shift in the way the wind industry typically obtains and interprets measurement data for wind energy. For example, the measurement techniques and sources of uncertainty for a remote-sensing device are vastly different from those associated with a cup anemometer on a meteorological tower. Current IEC standards for quantifying remote sensing device uncertainty for power performance testing considermore » uncertainty due to mounting, calibration, and classification of the remote sensing device, among other parameters. Values of the uncertainty are typically given as a function of the mean wind speed measured by a reference device and are generally fixed, leading to climatic uncertainty values that apply to the entire measurement campaign. However, real-world experience and a consideration of the fundamentals of the measurement process have shown that lidar performance is highly dependent on atmospheric conditions, such as wind shear, turbulence, and aerosol content. At present, these conditions are not directly incorporated into the estimated uncertainty of a lidar device. In this presentation, we describe the development of a new dynamic lidar uncertainty framework that adapts to current flow conditions and more accurately represents the actual uncertainty inherent in lidar measurements under different conditions. In this new framework, sources of uncertainty are identified for estimation of the line-of-sight wind speed and reconstruction of the three-dimensional wind field. These sources are then related to physical processes caused by the atmosphere and lidar operating conditions. The framework is applied to lidar data from a field measurement site to assess the ability of the framework to predict errors in lidar-measured wind speed. The results show how uncertainty varies over time and can be used to help select data with different levels of uncertainty for different applications, for example, low uncertainty data for power performance testing versus all data for plant performance monitoring.« less

Medical school benchmarking - from tools to programmes.

PubMed

Wilkinson, Tim J; Hudson, Judith N; Mccoll, Geoffrey J; Hu, Wendy C Y; Jolly, Brian C; Schuwirth, Lambert W T

2015-02-01

Benchmarking among medical schools is essential, but may result in unwanted effects. To apply a conceptual framework to selected benchmarking activities of medical schools. We present an analogy between the effects of assessment on student learning and the effects of benchmarking on medical school educational activities. A framework by which benchmarking can be evaluated was developed and applied to key current benchmarking activities in Australia and New Zealand. The analogy generated a conceptual framework that tested five questions to be considered in relation to benchmarking: what is the purpose? what are the attributes of value? what are the best tools to assess the attributes of value? what happens to the results? and, what is the likely "institutional impact" of the results? If the activities were compared against a blueprint of desirable medical graduate outcomes, notable omissions would emerge. Medical schools should benchmark their performance on a range of educational activities to ensure quality improvement and to assure stakeholders that standards are being met. Although benchmarking potentially has positive benefits, it could also result in perverse incentives with unforeseen and detrimental effects on learning if it is undertaken using only a few selected assessment tools.

A review of methodological factors in performance assessments of time-varying aircraft noise effects. [with annotated bibliography

NASA Technical Reports Server (NTRS)

Coates, G. D.; Alluisi, E. A.; Adkins, C. J., Jr.

1977-01-01

Literature on the effects of general noise on human performance is reviewed in an attempt to identify (1) those characteristics of noise that have been found to affect human performance; (2) those characteristics of performance most likely to be affected by the presence of noise, and (3) those characteristics of the performance situation typically associated with noise effects. Based on the characteristics identified, a theoretical framework is proposed that will permit predictions of possible effects of time-varying aircraft-type noise on complex human performance. An annotated bibliography of 50 articles is included.

Assessment of Aberdeen Proving Ground - Army Contracting Command, Contract Management Processes

DTIC Science & Technology

2014-12-01

order to enact improvement to public procurement systems (2008). The Balance Scorecard approach is presented by Niven as “a carefully selected set of...organizational performance. The framework analyzes four areas of emphasis: the customer, internal processes, learning and growth and financial (Niven, 2003...performance management (Cavanagh et al., 1999). The contract score card developed by Cullen looks further past the balance scorecard approach by

A framework for quantifying the impact of occupant behavior on energy savings of energy conservation measures

DOE PAGES

Sun, K; Hong, T

2017-07-01

© 2017 Elsevier B.V. To improve energy efficiency—during new buildings design or during a building retrofit—evaluating the energy savings potential of energy conservation measures (ECMs) is a critical task. In building retrofits, occupant behavior significantly impacts building energy use and is a leading factor in uncertainty when determining the effectiveness of retrofit ECMs. Current simulation-based assessment methods simplify the representation of occupant behavior by using a standard or representative set of static and homogeneous assumptions ignoring the dynamics, stochastics, and diversity of occupant's energy-related behavior in buildings. The simplification contributes to significant gaps between the simulated and measured actual energymore » performance of buildings. This study presents a framework for quantifying the impact of occupant behaviors on ECM energy savings using building performance simulation. During the first step of the study, three occupant behavior styles (austerity, normal, and wasteful) were defined to represent different levels of energy consciousness of occupants regarding their interactions with building energy systems (HVAC, windows, lights and plug-in equipment). Next, a simulation workflow was introduced to determine a range of the ECM energy savings. Then, guidance was provided to interpret the range of ECM savings to support ECM decision making. Finally, a pilot study was performed in a real building to demonstrate the application of the framework. Simulation results show that the impact of occupant behaviors on ECM savings vary with the type of ECM. Occupant behavior minimally affects energy savings for ECMs that are technology-driven (the relative savings differ by less than 2%) and have little interaction with the occupants; for ECMs with strong occupant interaction, such as the use of zonal control variable refrigerant flow system and natural ventilation, energy savings are significantly affected by occupant behavior (the relative savings differ by up to 20%). The study framework provides a novel, holistic approach to assessing the uncertainty of ECM energy savings related to occupant behavior, enabling stakeholders to understand and assess the risk of adopting energy efficiency technologies for new and existing buildings.« less

A framework for quantifying the impact of occupant behavior on energy savings of energy conservation measures

DOE PAGES

Sun, Kaiyu; Hong, Tianzhen

2017-04-27

To improve energy efficiency—during new buildings design or during a building retrofit—evaluating the energy savings potential of energy conservation measures (ECMs) is a critical task. In building retrofits, occupant behavior significantly impacts building energy use and is a leading factor in uncertainty when determining the effectiveness of retrofit ECMs. Current simulation-based assessment methods simplify the representation of occupant behavior by using a standard or representative set of static and homogeneous assumptions ignoring the dynamics, stochastics, and diversity of occupant's energy-related behavior in buildings. The simplification contributes to significant gaps between the simulated and measured actual energy performance of buildings. Thismore » paper presents a framework for quantifying the impact of occupant behaviors on ECM energy savings using building performance simulation. During the first step of the study, three occupant behavior styles (austerity, normal, and wasteful) were defined to represent different levels of energy consciousness of occupants regarding their interactions with building energy systems (HVAC, windows, lights and plug-in equipment). Next, a simulation workflow was introduced to determine a range of the ECM energy savings. Then, guidance was provided to interpret the range of ECM savings to support ECM decision making. Finally, a pilot study was performed in a real building to demonstrate the application of the framework. Simulation results show that the impact of occupant behaviors on ECM savings vary with the type of ECM. Occupant behavior minimally affects energy savings for ECMs that are technology-driven (the relative savings differ by less than 2%) and have little interaction with the occupants; for ECMs with strong occupant interaction, such as the use of zonal control variable refrigerant flow system and natural ventilation, energy savings are significantly affected by occupant behavior (the relative savings differ by up to 20%). Finally, the study framework provides a novel, holistic approach to assessing the uncertainty of ECM energy savings related to occupant behavior, enabling stakeholders to understand and assess the risk of adopting energy efficiency technologies for new and existing buildings.« less

A framework for quantifying the impact of occupant behavior on energy savings of energy conservation measures

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sun, Kaiyu; Hong, Tianzhen

To improve energy efficiency—during new buildings design or during a building retrofit—evaluating the energy savings potential of energy conservation measures (ECMs) is a critical task. In building retrofits, occupant behavior significantly impacts building energy use and is a leading factor in uncertainty when determining the effectiveness of retrofit ECMs. Current simulation-based assessment methods simplify the representation of occupant behavior by using a standard or representative set of static and homogeneous assumptions ignoring the dynamics, stochastics, and diversity of occupant's energy-related behavior in buildings. The simplification contributes to significant gaps between the simulated and measured actual energy performance of buildings. Thismore » paper presents a framework for quantifying the impact of occupant behaviors on ECM energy savings using building performance simulation. During the first step of the study, three occupant behavior styles (austerity, normal, and wasteful) were defined to represent different levels of energy consciousness of occupants regarding their interactions with building energy systems (HVAC, windows, lights and plug-in equipment). Next, a simulation workflow was introduced to determine a range of the ECM energy savings. Then, guidance was provided to interpret the range of ECM savings to support ECM decision making. Finally, a pilot study was performed in a real building to demonstrate the application of the framework. Simulation results show that the impact of occupant behaviors on ECM savings vary with the type of ECM. Occupant behavior minimally affects energy savings for ECMs that are technology-driven (the relative savings differ by less than 2%) and have little interaction with the occupants; for ECMs with strong occupant interaction, such as the use of zonal control variable refrigerant flow system and natural ventilation, energy savings are significantly affected by occupant behavior (the relative savings differ by up to 20%). Finally, the study framework provides a novel, holistic approach to assessing the uncertainty of ECM energy savings related to occupant behavior, enabling stakeholders to understand and assess the risk of adopting energy efficiency technologies for new and existing buildings.« less

A Framework and Improvements of the Korea Cloud Services Certification System.

PubMed

Jeon, Hangoo; Seo, Kwang-Kyu

2015-01-01

Cloud computing service is an evolving paradigm that affects a large part of the ICT industry and provides new opportunities for ICT service providers such as the deployment of new business models and the realization of economies of scale by increasing efficiency of resource utilization. However, despite benefits of cloud services, there are some obstacles to adopt such as lack of assessing and comparing the service quality of cloud services regarding availability, security, and reliability. In order to adopt the successful cloud service and activate it, it is necessary to establish the cloud service certification system to ensure service quality and performance of cloud services. This paper proposes a framework and improvements of the Korea certification system of cloud service. In order to develop it, the critical issues related to service quality, performance, and certification of cloud service are identified and the systematic framework for the certification system of cloud services and service provider domains are developed. Improvements of the developed Korea certification system of cloud services are also proposed.

Atomic layer deposition in a metal–organic framework: Synthesis, characterization, and performance of a solid acid

DOE PAGES

Rimoldi, Martino; Bernales, Varinia; Borycz, Joshua; ...

2017-01-05

NU-1000, a zirconium-based metal-organic framework featuring mesoporous channels, has been post-synthetically metalated via atomic layer deposition in MOF (AIM) employing dimethylaluminum iso-propoxide ([AlMe 2 iOPr] 2 – DMAI), a milder precursor than widely used trimethylaluminum (AlMe 3 - TMA). The aluminum-modified NU-1000 (Al-NU-1000) has been characterized with a comprehensive suite of techniques that points to the formation of aluminum oxide clusters well dispersed through the framework and stabilized by confinement within small pores intrinsic to the NU-1000 structure. Experimental evidence allows for identification of spectroscopic similarities between Al-NU-1000 and γ-Al 2O 3. Density functional theory modeling provides structures and simulatedmore » spectra the relevance of which can be assessed via comparison to experimental IR and EXAFS data. As a result, the catalytic performance of Al-NU-1000 has been benchmarked against γ-Al 2O 3, with promising results in terms of selectivity.« less

A Framework and Improvements of the Korea Cloud Services Certification System

PubMed Central

Jeon, Hangoo

2015-01-01

Cloud computing service is an evolving paradigm that affects a large part of the ICT industry and provides new opportunities for ICT service providers such as the deployment of new business models and the realization of economies of scale by increasing efficiency of resource utilization. However, despite benefits of cloud services, there are some obstacles to adopt such as lack of assessing and comparing the service quality of cloud services regarding availability, security, and reliability. In order to adopt the successful cloud service and activate it, it is necessary to establish the cloud service certification system to ensure service quality and performance of cloud services. This paper proposes a framework and improvements of the Korea certification system of cloud service. In order to develop it, the critical issues related to service quality, performance, and certification of cloud service are identified and the systematic framework for the certification system of cloud services and service provider domains are developed. Improvements of the developed Korea certification system of cloud services are also proposed. PMID:26125049

Using frameworks to diagram value in complex policy and environmental interventions to prevent childhood obesity.

PubMed

Swank, Melissa Farrell; Brennan, Laura K; Gentry, Daniel; Kemner, Allison L

2015-01-01

To date, few tools assist policy makers and practitioners in understanding and conveying the implementation costs, potential impacts, and value of policy and environmental changes to address healthy eating, active living, and childhood obesity. For the Evaluation of Healthy Kids, Healthy Communities (HKHC), evaluators considered inputs (resources and investments) that generate costs and savings as well as benefits and harms related to social, economic, environmental, and health-related outcomes in their assessment of 49 HKHC community partnerships funded from 2009 to 2014. Using data collected through individual and group interviews and an online performance monitoring system, evaluators created a socioecological framework to assess investments, resources, costs, savings, benefits, and harms at the individual, organizational, community, and societal levels. Evaluators customized frameworks for 6 focal strategies: active transportation, parks and play spaces, child care physical activity standards, corner stores, farmers' markets, and child care nutrition standards. To illustrate the Value Frameworks, this brief highlights the 38 HKHC communities implementing at least 1 active transportation strategy. Evaluators populated this conceptual Value Framework with themes from the strategy-specific inputs and outputs. The range of factors corresponding to the implementation and impact of the HKHC community partnerships are highlighted along with the inputs and outputs. The Value Frameworks helped evaluators identify gaps in current analysis models (ie, benefit-cost analysis, cost-effectiveness analysis) as well as paint a more complete picture of value for potential obesity prevention strategies. These frameworks provide a comprehensive understanding of investments needed, proposed costs and savings, and potential benefits and harms associated with economic, social, environmental, and health outcomes. This framing also allowed evaluators to demonstrate the interdependence of each socioecological level on the others in these multicomponent interventions. This model can be used by practitioners and community leaders to assess realistic and sustainable strategies to combat childhood obesity.

A multidimensional framework for assessing patient room configurations.

PubMed

Pati, Debajyoti; Harvey, Thomas E; Reyers, Evelyn; Evans, Jennie; Waggener, Laurie; Serrano, Marjorie; Saucier, Rachel; Nagle, Tina

2009-01-01

A framework for multidimensional assessment of patient room configurations is presented. Twenty-three issues are considered and categorized under six domains of assessment: (1) patient safety, (2) staff efficiency, (3) circulation, (4) infection control, (5) patient considerations, and (6) family amenities. Use of the framework to rank issues by importance and assess six alternative patient room configurations by a diverse group of experts in a symposium is described. One of the key questions posed during inpatient room design is the location of the bathroom. What issues are affected by the variations in room configuration that arise from bathroom location? A complete articulation of the issues that potentially are affected by room configuration is not available in the literature. The list of issues was developed by the authors in preparation for a symposium. The symposium was organized in May 2007 and attended by 14 experts from four institutions. Six alternative room configurations were used. Variations in the configurations included: (1) three same-handed and three mirror-image rooms; (2) three outboard, two inboard, and one nested bathroom; and (3) three rooms with footwall bathrooms and three with headwall bathrooms. In a four-step process, the attendees ranked the issues, discussed them in detail, rated each room configuration against each issue on a seven-point suitability scale, and conducted an overall assessment of the six configurations. Based on the ratings and rankings provided by the symposium participants, outboard bathroom locations were found to be most suitable, followed by nested and inboard configurations. Furthermore, configurations with patient bathrooms located on the footwall were rated as more suitable than headwall locations. The authors recommend, however, that the framework be used to determine a suitable room configuration in a specific context, rather than to identify configurations that will perform well universally.

High performance in healthcare priority setting and resource allocation: A literature- and case study-based framework in the Canadian context.

PubMed

Smith, Neale; Mitton, Craig; Hall, William; Bryan, Stirling; Donaldson, Cam; Peacock, Stuart; Gibson, Jennifer L; Urquhart, Bonnie

2016-08-01

Priority setting and resource allocation, or PSRA, are key functions of executive teams in healthcare organizations. Yet decision-makers often base their choices on historical patterns of resource distribution or political pressures. Our aim was to provide leaders with guidance on how to improve PSRA practice, by creating organizational contexts which enable high performance. We carried out in-depth case studies of six Canadian healthcare organizations to obtain from healthcare leaders their understanding of the concept of high performance in PSRA and the factors which contribute to its achievement. Individual and group interviews were carried out (n = 62) with senior managers, middle managers and Board members. Site observations and document review were used to assist researchers in interpreting the interview data. Qualitative data were analyzed iteratively with the literature on empirical examples of PSRA practice, in order to develop a framework of high performance in PSRA. The framework consists of four domains - structures, processes, attitudes and behaviours, and outcomes - within which are 19 specific elements. The emergent themes derive from case studies in different kinds of health organizations (urban/rural, small/large) across Canada. The elements can serve as a checklist for 'high performance' in PSRA. This framework provides a means by which decision-makers in healthcare might assess their practice and identify key areas for improvement. The findings are likely generalizable, certainly within Canada but also across countries. This work constitutes, to our knowledge, the first attempt to present a full package of elements comprising high performance in health care PSRA. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Framework for Assessing High School Students' Statistical Reasoning.

PubMed

Chan, Shiau Wei; Ismail, Zaleha; Sumintono, Bambang

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students' statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students' statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework's cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments.

A Framework for Quality Assurance in Child Welfare.

ERIC Educational Resources Information Center

O'Brien, Mary; Watson, Peter

In their search for new ways to assess their agencies' success in working with children and families, child welfare administrators and senior managers are increasingly seeking regular and reliable sources of information that help them evaluate agency performance, make ongoing decisions, and provide an accurate picture for agency staff and external…

A Comparative Assessment of Greek Universities' Efficiency Using Quantitative Analysis

ERIC Educational Resources Information Center

Katharaki, Maria; Katharakis, George

2010-01-01

In part due to the increased demand for higher education, typical evaluation frameworks for universities often address the key issue of available resource utilisation. This study seeks to estimate the efficiency of 20 public universities in Greece through quantitative analysis (including performance indicators, data envelopment analysis (DEA) and…

SWAT ungauged: Hydrological budget and crop yield predictions in the Upper Mississippi River Basin

USDA-ARS?s Scientific Manuscript database

Physically based, distributed hydrologic models are increasingly used in assessments of water resources, best management practices, and climate and land use changes. Model performance evaluation in ungauged basins is an important research topic. In this study, we propose a framework for developing S...

Mississippi Curriculum Framework for Electrician (Program CIP: 46.0302--Electrician). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for secondary-level courses to prepare Mississippi vocational students for…

A Profile of Advanced Writing Performance: Putting Some Flesh on the Bones

ERIC Educational Resources Information Center

Morgan, Siân

2012-01-01

The "Common European Framework of Reference for Languages" (CEFR) has prompted much reflection on language testing and raised awareness of the importance of standardisation in assessing English for academic and professional purposes in an increasingly globalised world. Criticism has nevertheless been levelled at CEFR profiles for being…

Effective Management Techniques in Tertiary Administration: A Risk Management Framework.

ERIC Educational Resources Information Center

McNamara, R. P.; Booth, P.

1984-01-01

A management strategy that is potentially more fruitful for the nonprofit sector than traditional management toward a primary objective is a risk management approach to organizational effectiveness. The organization's effectiveness, its survival, can be analyzed by categorizing the risks facing it and assessing its performance in managing these…

Renewing focus on family planning service quality globally.

PubMed

Hancock, Nancy L; Stuart, Gretchen S; Tang, Jennifer H; Chibwesha, Carla J; Stringer, Jeffrey S A; Chi, Benjamin H

2016-01-01

Reducing the global unmet need for contraception is currently a priority for many governments, multi-lateral initiatives, non-governmental organizations, and donors. Evidence strongly suggests that the provision of quality family planning services can increase uptake, prevalence, and continuation of contraception. While an accepted framework to define the components of family planning service quality exists, translating this framework into assessment tools that are accessible, easily utilized, and valid for service providers has remained a challenge. We propose new approaches to improve the standardization and accessibility of family planning service quality assessment tools to simplify family planning service quality evaluation. With easier approaches to program evaluation, quality improvements can be performed more swiftly to help increase uptake and continuation of contraception to improve the health of women and their families.

CEOS SEO and GISS Meeting

NASA Technical Reports Server (NTRS)

Killough, Brian; Stover, Shelley

2008-01-01

The Committee on Earth Observation Satellites (CEOS) provides a brief to the Goddard Institute for Space Studies (GISS) regarding the CEOS Systems Engineering Office (SEO) and current work on climate requirements and analysis. A "system framework" is provided for the Global Earth Observation System of Systems (GEOSS). SEO climate-related tasks are outlined including the assessment of essential climate variable (ECV) parameters, use of the "systems framework" to determine relevant informational products and science models and the performance of assessments and gap analyses of measurements and missions for each ECV. Climate requirements, including instruments and missions, measurements, knowledge and models, and decision makers, are also outlined. These requirements would establish traceability from instruments to products and services allowing for benefit evaluation of instruments and measurements. Additionally, traceable climate requirements would provide a better understanding of global climate models.

The City Blueprint Approach: Urban Water Management and Governance in Cities in the U.S.

NASA Astrophysics Data System (ADS)

Feingold, Daniel; Koop, Stef; van Leeuwen, Kees

2018-01-01

In this paper, we assess the challenges of water, waste and climate change in six cities across the U.S.: New York City, Boston, Milwaukee, Phoenix, Portland and Los Angeles. We apply the City Blueprint® Approach which consists of three indicator assessments: (1) the Trends and Pressures Framework (TPF), (2) the City Blueprint Framework (CBF) and (3) the water Governance Capacity Framework (GCF). The TPF summarizes the main social, environmental and financial pressures that may impede water management. The CBF provides an integrated overview of the management performances within the urban watercycle. Finally, the GCF provides a framework to identify key barriers and opportunities to develop governance capacity. The GCF has only been applied in NYC. Results show that all cities face pressures from heat risk. The management performances regarding resource efficiency and resource recovery from wastewater and solid waste show considerable room for improvement. Moreover, stormwater separation, infrastructure maintenance and green space require improvement in order to achieve a resilient urban watercycle. Finally, in New York City, the GCF results show that learning through smart monitoring, evaluation and cross-stakeholder learning is a limiting condition that needs to be addressed. We conclude that the City Blueprint Approach has large potential to assist cities in their strategic planning and exchange of knowledge, experiences and lessons. Because the methodology is well-structured, easy to understand, and concise, it may bridge the gap between science, policy and practice. It could therefore enable other cities to address their challenges of water, waste and climate change.

The City Blueprint Approach: Urban Water Management and Governance in Cities in the U.S.

PubMed

Feingold, Daniel; Koop, Stef; van Leeuwen, Kees

2018-01-01

In this paper, we assess the challenges of water, waste and climate change in six cities across the U.S.: New York City, Boston, Milwaukee, Phoenix, Portland and Los Angeles. We apply the City Blueprint ® Approach which consists of three indicator assessments: (1) the Trends and Pressures Framework (TPF), (2) the City Blueprint Framework (CBF) and (3) the water Governance Capacity Framework (GCF). The TPF summarizes the main social, environmental and financial pressures that may impede water management. The CBF provides an integrated overview of the management performances within the urban watercycle. Finally, the GCF provides a framework to identify key barriers and opportunities to develop governance capacity. The GCF has only been applied in NYC. Results show that all cities face pressures from heat risk. The management performances regarding resource efficiency and resource recovery from wastewater and solid waste show considerable room for improvement. Moreover, stormwater separation, infrastructure maintenance and green space require improvement in order to achieve a resilient urban watercycle. Finally, in New York City, the GCF results show that learning through smart monitoring, evaluation and cross-stakeholder learning is a limiting condition that needs to be addressed. We conclude that the City Blueprint Approach has large potential to assist cities in their strategic planning and exchange of knowledge, experiences and lessons. Because the methodology is well-structured, easy to understand, and concise, it may bridge the gap between science, policy and practice. It could therefore enable other cities to address their challenges of water, waste and climate change.

Geologic framework for the national assessment of carbon dioxide storage resources─South Florida Basin: Chapter L in Geologic framework for the national assessment of carbon dioxide storage resources

USGS Publications Warehouse

Roberts-Ashby, Tina L.; Brennan, Sean T.; Merrill, Matthew D.; Blondes, Madalyn S.; Freeman, P.A.; Cahan, Steven M.; DeVera, Christina A.; Lohr, Celeste D.; Warwick, Peter D.; Corum, Margo D.

2015-08-26

This report presents five storage assessment units (SAUs) that have been identified as potentially suitable for geologic carbon dioxide sequestration within a 35,075-square-mile area that includes the entire onshore and State-water portions of the South Florida Basin. Platform-wide, thick successions of laterally extensive carbonates and evaporites deposited in highly cyclic depositional environments in the South Florida Basin provide several massive, porous carbonate reservoirs that are separated by evaporite seals. For each storage assessment unit identified within the basin, the areal distribution of the reservoir-seal couplet identified as suitable for geologic Carbon dioxide sequestration is presented, along with a description of the geologic characteristics that influence the potential carbon dioxide storage volume and reservoir performance. On a case-by-case basis, strategies for estimating the pore volume existing within structurally and (or) stratigraphically closed traps are also discussed. Geologic information presented in this report has been employed to calculate potential storage capacities for carbon dioxide sequestration in the storage assessment units assessed herein, although complete assessment results are not contained in this report.

A Machine Learning Framework for Plan Payment Risk Adjustment.

PubMed

Rose, Sherri

2016-12-01

To introduce cross-validation and a nonparametric machine learning framework for plan payment risk adjustment and then assess whether they have the potential to improve risk adjustment. 2011-2012 Truven MarketScan database. We compare the performance of multiple statistical approaches within a broad machine learning framework for estimation of risk adjustment formulas. Total annual expenditure was predicted using age, sex, geography, inpatient diagnoses, and hierarchical condition category variables. The methods included regression, penalized regression, decision trees, neural networks, and an ensemble super learner, all in concert with screening algorithms that reduce the set of variables considered. The performance of these methods was compared based on cross-validated R 2 . Our results indicate that a simplified risk adjustment formula selected via this nonparametric framework maintains much of the efficiency of a traditional larger formula. The ensemble approach also outperformed classical regression and all other algorithms studied. The implementation of cross-validated machine learning techniques provides novel insight into risk adjustment estimation, possibly allowing for a simplified formula, thereby reducing incentives for increased coding intensity as well as the ability of insurers to "game" the system with aggressive diagnostic upcoding. © Health Research and Educational Trust.

ATR evaluation through the synthesis of multiple performance measures

NASA Astrophysics Data System (ADS)

Bassham, Christopher B.; Klimack, William K.; Bauer, Kenneth W., Jr.

2002-07-01

This research demonstrates the application of decision analysis (DA) techniques to decisions made within Automatic Target Recognition (ATR) technology development. This work is accomplished to improve the means by which ATR technologies are evaluated. The first step in this research was to create a flexible decision analysis framework that could be applied to several decisions across different ATR programs evaluated by the Comprehensive ATR Scientific Evaluation (COMPASE) Center of the Air Force Research Laboratory (AFRL). For the purposes of this research, a single COMPASE Center representative provided the value, utility, and preference functions for the DA framework. The DA framework employs performance measures collected during ATR classification system (CS) testing to calculate value and utility scores. The authors gathered data from the Moving and Stationary Target Acquisition and Recognition (MSTAR) program to demonstrate how the decision framework could be used to evaluate three different ATR CSs. A decision-maker may use the resultant scores to gain insight into any of the decisions that occur throughout the lifecycle of ATR technologies. Additionally, a means of evaluating ATR CS self-assessment ability is presented. This represents a new criterion that emerged from this study, and no present evaluation metric is known.

Depth of Teachers' Knowledge: Frameworks for Teachers' Knowledge of Mathematics

ERIC Educational Resources Information Center

Holmes, Vicki-Lynn

2012-01-01

This article describes seven teacher knowledge frameworks and relates these frameworks to the teaching and assessment of elementary teacher's mathematics knowledge. The frameworks classify teachers' knowledge and provide a vocabulary and common language through which knowledge can be discussed and assessed. These frameworks are categorized into…

A generic framework for individual-based modelling and physical-biological interaction

PubMed Central

2018-01-01

The increased availability of high-resolution ocean data globally has enabled more detailed analyses of physical-biological interactions and their consequences to the ecosystem. We present IBMlib, which is a versatile, portable and computationally effective framework for conducting Lagrangian simulations in the marine environment. The purpose of the framework is to handle complex individual-level biological models of organisms, combined with realistic 3D oceanographic model of physics and biogeochemistry describing the environment of the organisms without assumptions about spatial or temporal scales. The open-source framework features a minimal robust interface to facilitate the coupling between individual-level biological models and oceanographic models, and we provide application examples including forward/backward simulations, habitat connectivity calculations, assessing ocean conditions, comparison of physical circulation models, model ensemble runs and recently posterior Eulerian simulations using the IBMlib framework. We present the code design ideas behind the longevity of the code, our implementation experiences, as well as code performance benchmarking. The framework may contribute substantially to progresses in representing, understanding, predicting and eventually managing marine ecosystems. PMID:29351280

Measuring the effectiveness and impact of an open innovation platform.

PubMed

Carroll, Glenn P; Srivastava, Sanjay; Volini, Adam S; Piñeiro-Núñez, Marta M; Vetman, Tatiana

2017-05-01

Today, most pharmaceutical companies complement their traditional R&D models with some variation on the Open Innovation (OI) approach in an effort to better access global scientific talent, ideas and hypotheses. Traditional performance indicators that measure economic returns from R&D through commercialization are often not applicable to the practical assessment of these OI approaches, particularly within the context of early drug discovery. This leaves OI programs focused on early R&D without a standard assessment framework from which to evaluate overall performance. This paper proposes a practical dashboard for such assessment, encompassing quantitative and qualitative elements, to enable decision-making and improvement of future performance. The use of this dashboard is illustrated using real-time data from the Lilly Open Innovation Drug Discovery (OIDD) program. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Model performance evaluation (validation and calibration) in model-based studies of therapeutic interventions for cardiovascular diseases : a review and suggested reporting framework.

PubMed

Haji Ali Afzali, Hossein; Gray, Jodi; Karnon, Jonathan

2013-04-01

Decision analytic models play an increasingly important role in the economic evaluation of health technologies. Given uncertainties around the assumptions used to develop such models, several guidelines have been published to identify and assess 'best practice' in the model development process, including general modelling approach (e.g., time horizon), model structure, input data and model performance evaluation. This paper focuses on model performance evaluation. In the absence of a sufficient level of detail around model performance evaluation, concerns regarding the accuracy of model outputs, and hence the credibility of such models, are frequently raised. Following presentation of its components, a review of the application and reporting of model performance evaluation is presented. Taking cardiovascular disease as an illustrative example, the review investigates the use of face validity, internal validity, external validity, and cross model validity. As a part of the performance evaluation process, model calibration is also discussed and its use in applied studies investigated. The review found that the application and reporting of model performance evaluation across 81 studies of treatment for cardiovascular disease was variable. Cross-model validation was reported in 55 % of the reviewed studies, though the level of detail provided varied considerably. We found that very few studies documented other types of validity, and only 6 % of the reviewed articles reported a calibration process. Considering the above findings, we propose a comprehensive model performance evaluation framework (checklist), informed by a review of best-practice guidelines. This framework provides a basis for more accurate and consistent documentation of model performance evaluation. This will improve the peer review process and the comparability of modelling studies. Recognising the fundamental role of decision analytic models in informing public funding decisions, the proposed framework should usefully inform guidelines for preparing submissions to reimbursement bodies.

Integrated wildfire risk assessment: framework development and application on the Lewis and Clark National Forest in Montana, USA.

PubMed

Thompson, Matthew P; Scott, Joe; Helmbrecht, Don; Calkin, Dave E

2013-04-01

The financial, socioeconomic, and ecological impacts of wildfire continue to challenge federal land management agencies in the United States. In recent years, policymakers and managers have increasingly turned to the field of risk analysis to better manage wildfires and to mitigate losses to highly valued resources and assets (HVRAs). Assessing wildfire risk entails the interaction of multiple components, including integrating wildfire simulation outputs with geospatial identification of HVRAs and the characterization of fire effects to HVRAs. We present an integrated and systematic risk assessment framework that entails 3 primary analytical components: 1) stochastic wildfire simulation and burn probability modeling to characterize wildfire hazard, 2) expert-based modeling to characterize fire effects, and 3) multicriteria decision analysis to characterize preference structures across at-risk HVRAs. We demonstrate application of this framework for a wildfire risk assessment performed on the Little Belts Assessment Area within the Lewis and Clark National Forest in Montana, United States. We devote particular attention to our approach to eliciting and encapsulating expert judgment, in which we: 1) adhered to a structured process for using expert judgment in ecological risk assessment, 2) used as our expert base local resource scientists and fire/fuels specialists who have a direct connection to the specific landscape and HVRAs in question, and 3) introduced multivariate response functions to characterize fire effects to HVRAs that consider biophysical variables beyond fire behavior. We anticipate that this work will further the state of wildfire risk science and will lead to additional application of risk assessment to inform land management planning. Copyright © 2012 SETAC.

Environmental risk assessment of pesticides: state of the art and prospective improvement from science.

PubMed

Boivin, Arnaud; Poulsen, Véronique

2017-03-01

Pesticide risk assessment in the European regulatory framework is mandatory performed for active substances (pesticides) and the plant protection products they are constituents of. The aim is to guarantee that safe use can be achieved for the intended use of the product. This paper provides a feedback on the regulatory environmental risk assessment performed for pesticide registration at the EU and member state levels. The different steps of pesticide registration are addressed considering both exposure and hazard. In this paper, we focus on the environmental fate and behaviour in surface water together with the aquatic ecotoxicity of the substances to illustrate pesticide regulatory risk assessment performed for aquatic organisms. Current methodologies are presented along with highlights on potential improvements. For instance, as regards exposure aspects, moving from field based to landscape risk assessments is promising. Regarding ecotoxicology, ecological models may be valuable tools when applied to chemical risk assessment. In addition, interest and further developments to better take into account mitigation measures in risk assessment and management are also presented.

GPs’ opinions of health assessment instruments for people with intellectual disabilities: a qualitative study

PubMed Central

Bakker-van Gijssel, Esther J; Hartman, Tim C olde; Lucassen, Peter LBJ; van den Driessen Mareeuw, Francine; Dees, Marianne K; Assendelft, Willem JJ; van Schrojenstein Lantman-de Valk, Henny MJ

2017-01-01

Background GPs provide health care to people with intellectual disabilities (ID). People with ID find it difficult to express themselves concerning health-related matters. Applying health assessments is an effective method to reveal health needs, and can play a role in prevention and health promotion. Aim The aim of this qualitative study was to explore GPs’ considerations about applying a health assessment for people with ID. Design and setting This focus group study was conducted among a selection of Dutch GPs. Method An interview guide was developed. All discussions were audiorecorded and transcribed. Analysis was performed using the framework analysis approach. Two researchers independently applied open coding and identified a thematic framework. This framework and the summaries of views per theme were discussed in the research team. Results After four focus groups, with 23 GPs, saturation was reached. Three main themes evolved: health assessments in relation to GPs’ responsibility; the usefulness and necessity of health assessments; and barriers to using health assessments on people with ID. A health assessment instrument for people with ID can help GPs to focus on certain issues that are not so common in the general population. GPs are motivated to use such a tool if it is scientifically tested, and results in significant health gains. However, GPs identify barriers at the level of GP, patient, and organisation. Conclusion Most GPs in the focus groups consider providing medical care to people with ID their responsibility and indicate that a health assessment instrument could be a valuable tool. In order to deliver good care, they need education and support. Many barriers need to be overcome before a health assessment instrument can be implemented. PMID:27993898

Software framework for the upcoming MMT Observatory primary mirror re-aluminization

NASA Astrophysics Data System (ADS)

Gibson, J. Duane; Clark, Dusty; Porter, Dallan

2014-07-01

Details of the software framework for the upcoming in-situ re-aluminization of the 6.5m MMT Observatory (MMTO) primary mirror are presented. This framework includes: 1) a centralized key-value store and data structure server for data exchange between software modules, 2) a newly developed hardware-software interface for faster data sampling and better hardware control, 3) automated control algorithms that are based upon empirical testing, modeling, and simulation of the aluminization process, 4) re-engineered graphical user interfaces (GUI's) that use state-of-the-art web technologies, and 5) redundant relational databases for data logging. Redesign of the software framework has several objectives: 1) automated process control to provide more consistent and uniform mirror coatings, 2) optional manual control of the aluminization process, 3) modular design to allow flexibility in process control and software implementation, 4) faster data sampling and logging rates to better characterize the approximately 100-second aluminization event, and 5) synchronized "real-time" web application GUI's to provide all users with exactly the same data. The framework has been implemented as four modules interconnected by a data store/server. The four modules are integrated into two Linux system services that start automatically at boot-time and remain running at all times. Performance of the software framework is assessed through extensive testing within 2.0 meter and smaller coating chambers at the Sunnyside Test Facility. The redesigned software framework helps ensure that a better performing and longer lasting coating will be achieved during the re-aluminization of the MMTO primary mirror.

Integrated performance and reliability specification for digital avionics systems

NASA Technical Reports Server (NTRS)

Brehm, Eric W.; Goettge, Robert T.

1995-01-01

This paper describes an automated tool for performance and reliability assessment of digital avionics systems, called the Automated Design Tool Set (ADTS). ADTS is based on an integrated approach to design assessment that unifies traditional performance and reliability views of system designs, and that addresses interdependencies between performance and reliability behavior via exchange of parameters and result between mathematical models of each type. A multi-layer tool set architecture has been developed for ADTS that separates the concerns of system specification, model generation, and model solution. Performance and reliability models are generated automatically as a function of candidate system designs, and model results are expressed within the system specification. The layered approach helps deal with the inherent complexity of the design assessment process, and preserves long-term flexibility to accommodate a wide range of models and solution techniques within the tool set structure. ADTS research and development to date has focused on development of a language for specification of system designs as a basis for performance and reliability evaluation. A model generation and solution framework has also been developed for ADTS, that will ultimately encompass an integrated set of analytic and simulated based techniques for performance, reliability, and combined design assessment.

The Motivation-Cognition Interface in Learning and Decision-Making.

PubMed

Maddox, W Todd; Markman, Arthur B

2010-04-01

In this article we discuss how incentive motivations and task demands affect performance. We present a three-factor framework that suggests that performance is determined from the interaction of global incentives, local incentives, and the psychological processes needed to achieve optimal task performance. We review work that examines the implications of the motivation-cognition interface in classification, choice and on phenomena such as stereotype threat and performance pressure. We show that under some conditions stereotype threat and pressure accentuate performance. We discuss the implications of this work for neuropsychological assessment, and outline a number of challenges for future research.

Goal orientation and self-efficacy in relation to memory in adulthood

PubMed Central

Hastings, Erin C.; West, Robin L.

2011-01-01

The achievement goal framework (Dweck, 1986) has been well-established in children and college-students, but has rarely been examined empirically with older adults. The current study, including younger and older adults, examined the effects of memory self-efficacy, learning goals (focusing on skill mastery over time) and performance goals (focusing on performance outcome evaluations) on memory performance. Questionnaires measured memory self-efficacy and general orientation toward learning and performance goals; free and cued recall was assessed in a subsequent telephone interview. As expected, age was negatively related and education was positively related to memory self-efficacy, and memory self-efficacy was positively related to memory, in a structural equation model. Age was also negatively related to memory performance. Results supported the positive impact of learning goals and the negative impact of performance goals on memory self-efficacy. There was no significant direct effect of learning or performance goals on memory performance; their impact occurred via their effect on memory self-efficacy. The present study supports past research suggesting that learning goals are beneficial, and performance goals are maladaptive, for self-efficacy and learning, and validates the achievement goal framework in a sample including older adults. PMID:21728891

Developing biodiversity indicators on a stakeholders' opinions basis: the gypsum industry Key Performance Indicators framework.

PubMed

Pitz, Carline; Mahy, Grégory; Vermeulen, Cédric; Marlet, Christine; Séleck, Maxime

2016-07-01

This study aims to establish a common Key Performance Indicators (KPIs) framework for reporting about the gypsum industry biodiversity at the European level. In order to integrate different opinions and to reach a consensus framework, an original participatory process approach has been developed among different stakeholder groups: Eurogypsum, European and regional authorities, university scientists, consulting offices, European and regional associations for the conservation of nature, and the extractive industry. The strategy is developed around four main steps: (1) building of a maximum set of indicators to be submitted to stakeholders based on the literature (Focus Group method); (2) evaluating the consensus about indicators through a policy Delphi survey aiming at the prioritization of indicator classes using the Analytic Hierarchy Process method (AHP) and of individual indicators; (3) testing acceptability and feasibility through analysis of Environmental Impact Assessments (EIAs) and visits to three European quarries; (4) Eurogypsum final decision and communication. The resulting framework contains a set of 11 indicators considered the most suitable for all the stakeholders. Our KPIs respond to European legislation and strategies for biodiversity. The framework aims at improving sustainability in quarries and at helping to manage biodiversity as well as to allow the creation of coherent reporting systems. The final goal is to allow for the definition of the actual biodiversity status of gypsum quarries and allow for enhancing it. The framework is adaptable to the local context of each gypsum quarry.

Comparative Analysis of Two Industries for Validating Green Manufacturing (GM) Framework: An Indian Scenario

NASA Astrophysics Data System (ADS)

Rehman, Minhaj Ahemad Abdul; Shrivastava, Rakesh Lakshmikumar; Shrivastava, Rashmi Rakesh

2017-04-01

Green Manufacturing (GM) deals with manufacturing practices that reduces or eliminates the adverse environmental impact during any of its phases. It emphasizes the use of processes that do not contaminate the environment or hurt consumers, employees, or other stakeholders. This paper presents the comparative analysis of two Indian industries representing different sectors for validating GM framework. It also highlights the road map of the companies for achieving performance improvement through GM implementation and its impact on organisational performance. The case studies helps in evaluating the companies GM implementation and overall business performance. For this, a developed diagnostic instrument in the form of questionnaire was administered amongst employees in the companies respectively and their responses were analysed. In order to have a better understanding of the impact of GM implementation, the information about overall business performance was obtained over the last 3 years. The diagnostic instrument developed here may be used by manufacturing organisations to prioritise their management efforts to assess and implement GM.

Perspectives to performance of environment and health assessments and models--from outputs to outcomes?

PubMed

Pohjola, Mikko V; Pohjola, Pasi; Tainio, Marko; Tuomisto, Jouni T

2013-06-26

The calls for knowledge-based policy and policy-relevant research invoke a need to evaluate and manage environment and health assessments and models according to their societal outcomes. This review explores how well the existing approaches to assessment and model performance serve this need. The perspectives to assessment and model performance in the scientific literature can be called: (1) quality assurance/control, (2) uncertainty analysis, (3) technical assessment of models, (4) effectiveness and (5) other perspectives, according to what is primarily seen to constitute the goodness of assessments and models. The categorization is not strict and methods, tools and frameworks in different perspectives may overlap. However, altogether it seems that most approaches to assessment and model performance are relatively narrow in their scope. The focus in most approaches is on the outputs and making of assessments and models. Practical application of the outputs and the consequential outcomes are often left unaddressed. It appears that more comprehensive approaches that combine the essential characteristics of different perspectives are needed. This necessitates a better account of the mechanisms of collective knowledge creation and the relations between knowledge and practical action. Some new approaches to assessment, modeling and their evaluation and management span the chain from knowledge creation to societal outcomes, but the complexity of evaluating societal outcomes remains a challenge.

Toward an Ecological Risk Assessment Framework for Special Education

ERIC Educational Resources Information Center

Trepanier, Nathalie S.

2005-01-01

We suggest a new framework for conducting research in the field of special education. This framework is inspired by the ecological risk assessment frameworks of the U.S. Environmental Protection Agency (1995) and G.W. Suter (1993), which are primarily used in ecotoxicology and environmental toxicology. The framework includes three phases by which…

Occlusion handling framework for tracking in smart camera networks by per-target assistance task assignment

NASA Astrophysics Data System (ADS)

Bo, Nyan Bo; Deboeverie, Francis; Veelaert, Peter; Philips, Wilfried

2017-09-01

Occlusion is one of the most difficult challenges in the area of visual tracking. We propose an occlusion handling framework to improve the performance of local tracking in a smart camera view in a multicamera network. We formulate an extensible energy function to quantify the quality of a camera's observation of a particular target by taking into account both person-person and object-person occlusion. Using this energy function, a smart camera assesses the quality of observations over all targets being tracked. When it cannot adequately observe of a target, a smart camera estimates the quality of observation of the target from view points of other assisting cameras. If a camera with better observation of the target is found, the tracking task of the target is carried out with the assistance of that camera. In our framework, only positions of persons being tracked are exchanged between smart cameras. Thus, communication bandwidth requirement is very low. Performance evaluation of our method on challenging video sequences with frequent and severe occlusions shows that the accuracy of a baseline tracker is considerably improved. We also report the performance comparison to the state-of-the-art trackers in which our method outperforms.

An efficient framework for Java data processing systems in HPC environments

NASA Astrophysics Data System (ADS)

Fries, Aidan; Castañeda, Javier; Isasi, Yago; Taboada, Guillermo L.; Portell de Mora, Jordi; Sirvent, Raül

2011-11-01

Java is a commonly used programming language, although its use in High Performance Computing (HPC) remains relatively low. One of the reasons is a lack of libraries offering specific HPC functions to Java applications. In this paper we present a Java-based framework, called DpcbTools, designed to provide a set of functions that fill this gap. It includes a set of efficient data communication functions based on message-passing, thus providing, when a low latency network such as Myrinet is available, higher throughputs and lower latencies than standard solutions used by Java. DpcbTools also includes routines for the launching, monitoring and management of Java applications on several computing nodes by making use of JMX to communicate with remote Java VMs. The Gaia Data Processing and Analysis Consortium (DPAC) is a real case where scientific data from the ESA Gaia astrometric satellite will be entirely processed using Java. In this paper we describe the main elements of DPAC and its usage of the DpcbTools framework. We also assess the usefulness and performance of DpcbTools through its performance evaluation and the analysis of its impact on some DPAC systems deployed in the MareNostrum supercomputer (Barcelona Supercomputing Center).

Levels of Autonomy and Autonomous System Performance Assessment for Intelligent Unmanned Systems

DTIC Science & Technology

2014-04-01

LIDAR and camera sensors that is driven entirely by teleoperation would be AL 0. If that same robot used its LIDAR and camera data to generate a...obstacle detection, mapping, path planning 3 CMMAD semi- autonomous counter- mine system (Few 2010) Talon UGV, camera, LIDAR , metal detector...NCAP framework are performed on individual UMS components and do not require mission level evaluations. For example, bench testing of camera, LIDAR

A Framework for Assessing High School Students' Statistical Reasoning

PubMed Central

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students’ statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students’ statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework’s cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments. PMID:27812091

TIMSS 2007 Assessment Frameworks

ERIC Educational Resources Information Center

Mullis, Ina V. S.; Martin, Michael O.; Ruddock, Graham J.; O'Sullivan, Christine Y.; Arora, Alka; Erberber, Ebru

2005-01-01

Developing the Trends in International Mathematics and Science Study (TIMSS) 2007 Assessment Frameworks represents an extensive collaborative effort involving individuals and expert groups from more than 60 countries around the world. The document contains three frameworks for implementing TIMSS 2007--the Mathematics Framework, the Science…

Best practices for assessing ocean health in multiple contexts using tailorable frameworks

PubMed Central

Pacheco, Erich J.; Best, Benjamin D.; Scarborough, Courtney; Longo, Catherine; Katona, Steven K.; Halpern, Benjamin S.

2015-01-01

Marine policy is increasingly calling for maintaining or restoring healthy oceans while human activities continue to intensify. Thus, successful prioritization and management of competing objectives requires a comprehensive assessment of the current state of the ocean. Unfortunately, assessment frameworks to define and quantify current ocean state are often site-specific, limited to a few ocean components, and difficult to reproduce in different geographies or even through time, limiting spatial or temporal comparisons as well as the potential for shared learning. Ideally, frameworks should be tailorable to accommodate use in disparate locations and contexts, removing the need to develop frameworks de novo and allowing efforts to focus on the assessments themselves to advise action. Here, we present some of our experiences using the Ocean Health Index (OHI) framework, a tailorable and repeatable approach that measures health of coupled human-ocean ecosystems in different contexts by accommodating differences in local environmental characteristics, cultural priorities, and information availability and quality. Since its development in 2012, eleven assessments using the OHI framework have been completed at global, national, and regional scales, four of which have been led by independent academic or government groups. We have found the following to be best practices for conducting assessments: Incorporate key characteristics and priorities into the assessment framework design before gathering information; Strategically define spatial boundaries to balance information availability and decision-making scales; Maintain the key characteristics and priorities of the assessment framework regardless of information limitations; and Document and share the assessment process, methods, and tools. These best practices are relevant to most ecosystem assessment processes, but also provide tangible guidance for assessments using the OHI framework. These recommendations also promote transparency around which decisions were made and why, reproducibility through access to detailed methods and computational code, repeatability via the ability to modify methods and computational code, and ease of communication to wide audiences, all of which are critical for any robust assessment process. PMID:26713251

Best practices for assessing ocean health in multiple contexts using tailorable frameworks.

PubMed

Lowndes, Julia S Stewart; Pacheco, Erich J; Best, Benjamin D; Scarborough, Courtney; Longo, Catherine; Katona, Steven K; Halpern, Benjamin S

2015-01-01

Marine policy is increasingly calling for maintaining or restoring healthy oceans while human activities continue to intensify. Thus, successful prioritization and management of competing objectives requires a comprehensive assessment of the current state of the ocean. Unfortunately, assessment frameworks to define and quantify current ocean state are often site-specific, limited to a few ocean components, and difficult to reproduce in different geographies or even through time, limiting spatial or temporal comparisons as well as the potential for shared learning. Ideally, frameworks should be tailorable to accommodate use in disparate locations and contexts, removing the need to develop frameworks de novo and allowing efforts to focus on the assessments themselves to advise action. Here, we present some of our experiences using the Ocean Health Index (OHI) framework, a tailorable and repeatable approach that measures health of coupled human-ocean ecosystems in different contexts by accommodating differences in local environmental characteristics, cultural priorities, and information availability and quality. Since its development in 2012, eleven assessments using the OHI framework have been completed at global, national, and regional scales, four of which have been led by independent academic or government groups. We have found the following to be best practices for conducting assessments: Incorporate key characteristics and priorities into the assessment framework design before gathering information; Strategically define spatial boundaries to balance information availability and decision-making scales; Maintain the key characteristics and priorities of the assessment framework regardless of information limitations; and Document and share the assessment process, methods, and tools. These best practices are relevant to most ecosystem assessment processes, but also provide tangible guidance for assessments using the OHI framework. These recommendations also promote transparency around which decisions were made and why, reproducibility through access to detailed methods and computational code, repeatability via the ability to modify methods and computational code, and ease of communication to wide audiences, all of which are critical for any robust assessment process.

Simulation training: a systematic review of simulation in arthroscopy and proposal of a new competency-based training framework.

PubMed

Tay, Charison; Khajuria, Ankur; Gupte, Chinmay

2014-01-01

Traditional orthopaedic training has followed an apprenticeship model whereby trainees enhance their skills by operating under guidance. However the introduction of limitations on training hours and shorter training programmes mean that alternative training strategies are required. To perform a literature review on simulation training in arthroscopy and devise a framework that structures different simulation techniques that could be used in arthroscopic training. A systematic search of Medline, Embase, Google Scholar and the Cochrane Databases were performed. Search terms included "virtual reality OR simulator OR simulation" and "arthroscopy OR arthroscopic". 14 studies evaluating simulators in knee, shoulder and hip arthroplasty were included. The majority of the studies demonstrated construct and transference validity but only one showed concurrent validity. More studies are required to assess its potential as a training and assessment tool, skills transference between simulators and to determine the extent of skills decay from prolonged delays in training. We also devised a "ladder of arthroscopic simulation" that provides a competency-based framework to implement different simulation strategies. The incorporation of simulation into an orthopaedic curriculum will depend on a coordinated approach between many bodies. But the successful integration of simulators in other areas of surgery supports a possible role for simulation in advancing orthopaedic education. Copyright © 2014 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

Towards the Implementation of an Assessment-Centred Blended Learning Framework at the Course Level: A Case Study in a Vietnamese National University

ERIC Educational Resources Information Center

Nguyen, Viet Anh

2017-01-01

Purpose: The purpose of this paper is to build an assessment-centred blended learning (BL) framework to assess learners, to analyse and to evaluate the impact of the technology support in the form of formative assessment in students' positive learning. Design/methodology/approach: This research proposed an assessment-centred BL framework at the…

An official American thoracic society workshop report: developing performance measures from clinical practice guidelines.

PubMed

Kahn, Jeremy M; Gould, Michael K; Krishnan, Jerry A; Wilson, Kevin C; Au, David H; Cooke, Colin R; Douglas, Ivor S; Feemster, Laura C; Mularski, Richard A; Slatore, Christopher G; Wiener, Renda Soylemez

2014-05-01

Many health care performance measures are either not based on high-quality clinical evidence or not tightly linked to patient-centered outcomes, limiting their usefulness in quality improvement. In this report we summarize the proceedings of an American Thoracic Society workshop convened to address this problem by reviewing current approaches to performance measure development and creating a framework for developing high-quality performance measures by basing them directly on recommendations from well-constructed clinical practice guidelines. Workshop participants concluded that ideally performance measures addressing care processes should be linked to clinical practice guidelines that explicitly rate the quality of evidence and the strength of recommendations, such as the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) process. Under this framework, process-based performance measures would only be developed from strong recommendations based on high- or moderate-quality evidence. This approach would help ensure that clinical processes specified in performance measures are both of clear benefit to patients and supported by strong evidence. Although this approach may result in fewer performance measures, it would substantially increase the likelihood that quality-improvement programs based on these measures actually improve patient care.

Assessment for Systems Learning: A Holistic Assessment Framework to Support Decision Making Across the Medical Education Continuum.

PubMed

Bowe, Constance M; Armstrong, Elizabeth

2017-05-01

Viewing health care from a systems perspective-that is, "a collection of different things which, working together, produce a result not achievable by the things alone"-raises awareness of the complex interrelationships involved in meeting society's goals for accessible, cost-effective, high-quality health care. This perspective also emphasizes the far-reaching consequences of changes in one sector of a system on other components' performance. Medical education promotes this holistic view of health care in its curricula and competency requirements for graduation at the undergraduate and graduate training levels. But how completely does medical education apply a systems lens to itself?The continuum of medical training has undergone a series of changes that have moved it more closely to a systems organizational model. Competency assessment criteria have been expanded and more explicitly defined for learners at all levels of training. Outcomes data, in multiple domains, are monitored by external reviewers for program accreditation. However, translating increasing amounts of individual outcomes into actionable intelligence for decision making poses a formidable information management challenge.Assessment in systems is designed to impart a "big picture" of overall system performance through the synthesis, analysis, and interpretation of outcomes data to provide actionable information for continuous systems improvement, innovation, and long-term planning. A systems-based framework is presented for use across the medical education continuum to facilitate timely improvements in individual curriculum components, continuous improvement in overall program performance, and program decision making on changes required to better address society's health care needs.

Outcome-based ventilation: A framework for assessing performance, health, and energy impacts to inform office building ventilation decisions.

PubMed

Rackes, A; Ben-David, T; Waring, M S

2018-07-01

This article presents an outcome-based ventilation (OBV) framework, which combines competing ventilation impacts into a monetized loss function ($/occ/h) used to inform ventilation rate decisions. The OBV framework, developed for U.S. offices, considers six outcomes of increasing ventilation: profitable outcomes realized from improvements in occupant work performance and sick leave absenteeism; health outcomes from occupant exposure to outdoor fine particles and ozone; and energy outcomes from electricity and natural gas usage. We used the literature to set low, medium, and high reference values for OBV loss function parameters, and evaluated the framework and outcome-based ventilation rates using a simulated U.S. office stock dataset and a case study in New York City. With parameters for all outcomes set at medium values derived from literature-based central estimates, higher ventilation rates' profitable benefits dominated negative health and energy impacts, and the OBV framework suggested ventilation should be ≥45 L/s/occ, much higher than the baseline ~8.5 L/s/occ rate prescribed by ASHRAE 62.1. Only when combining very low parameter estimates for profitable impacts with very high ones for health and energy impacts were all outcomes on the same order. Even then, however, outcome-based ventilation rates were often twice the baseline rate or more. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Hierarchical kernel mixture models for the prediction of AIDS disease progression using HIV structural gp120 profiles

PubMed Central

2010-01-01

Changes to the glycosylation profile on HIV gp120 can influence viral pathogenesis and alter AIDS disease progression. The characterization of glycosylation differences at the sequence level is inadequate as the placement of carbohydrates is structurally complex. However, no structural framework is available to date for the study of HIV disease progression. In this study, we propose a novel machine-learning based framework for the prediction of AIDS disease progression in three stages (RP, SP, and LTNP) using the HIV structural gp120 profile. This new intelligent framework proves to be accurate and provides an important benchmark for predicting AIDS disease progression computationally. The model is trained using a novel HIV gp120 glycosylation structural profile to detect possible stages of AIDS disease progression for the target sequences of HIV+ individuals. The performance of the proposed model was compared to seven existing different machine-learning models on newly proposed gp120-Benchmark_1 dataset in terms of error-rate (MSE), accuracy (CCI), stability (STD), and complexity (TBM). The novel framework showed better predictive performance with 67.82% CCI, 30.21 MSE, 0.8 STD, and 2.62 TBM on the three stages of AIDS disease progression of 50 HIV+ individuals. This framework is an invaluable bioinformatics tool that will be useful to the clinical assessment of viral pathogenesis. PMID:21143806

Prioritization of disasters and their management in Rwanda.

PubMed

Rugigana, E; Nyirazinyoye, L; Umubyeyi, A; Nsengiyumva, J B; Kanyandekwe, C; Ntahobakulira, I

2013-06-01

Rwanda has been experiencing quite a significant number of disastrous events of both natural and man-made origin in the last 2 decades. Many cases of disasters are particularly linked to the geographic, historical and socio-cultural aspects of the country. The overall objective of the present article is to perform a situation analysis of disasters in Rwanda and to highlight the institutional and legal framework of disaster management. An assessment questionnaire focused on the current capacity, institutional frameworks and on-going initiatives for disaster management at country level and operational level was administered. The assessment was descriptive and used mainly qualitative methods. These included review of records (country policies and policy briefs, programme documents), interviews with key informants from line ministries, and interviews with key informants from stakeholder agencies. The Rwandan hazard profile, its vulnerability and capacity assessment shows top seven disasters which are related to epidemics, hails storms/floods; roads accidents; environmental degradation and earthquakes/volcanic eruption. Currently, the Institutional framework for disaster management and response is coordinated by Ministry of Disaster Management and Refugee Affairs through the Rwanda National Disasters Operation Center. Although disaster risk reduction has been integrated into sustainable policies and plans, most districts do not have adequate capacity to plan for disasters and the majority of districts disaster committees have not yet been trained. Rwanda has established a legal and institutional framework for disasters management. There is a need to build capacity in disaster management at operational level (District).

Performance assessment of HIFU lesion detection by Harmonic Motion Imaging for Focused Ultrasound (HMIFU): A 3D finite-element-based framework with experimental validation

PubMed Central

Hou, Gary Y.; Luo, Jianwen; Marquet, Fabrice; Maleke, Caroline; Vappou, Jonathan; Konofagou, Elisa E.

2014-01-01

Harmonic Motion Imaging for Focused Ultrasound (HMIFU) is a novel high-intensity focused ultrasound (HIFU) therapy monitoring method with feasibilities demonstrated in vitro, ex vivo and in vivo. Its principle is based on Amplitude-modulated (AM) - Harmonic Motion Imaging (HMI), an oscillatory radiation force used for imaging the tissue mechanical response during thermal ablation. In this study, a theoretical framework of HMIFU is presented, comprising a customized nonlinear wave propagation model, a finite-element (FE) analysis module, and an image-formation model. The objective of this study is to develop such a framework in order to 1) assess the fundamental performance of HMIFU in detecting HIFU lesions based on the change in tissue apparent elasticity, i.e., the increasing Young's modulus, and the HIFU lesion size with respect to the HIFU exposure time and 2) validate the simulation findings ex vivo. The same HMI and HMIFU parameters as in the experimental studies were used, i.e., 4.5-MHz HIFU frequency and 25 Hz AM frequency. For a lesion-to-background Young's modulus ratio of 3, 6, and 9, the FE and estimated HMI displacement ratios were equal to 1.83, 3.69, 5.39 and 1.65, 3.19, 4.59, respectively. In experiments, the HMI displacement followed a similar increasing trend of 1.19, 1.28, and 1.78 at 10-s, 20-s, and 30-s HIFU exposure, respectively. In addition, moderate agreement in lesion size growth was also found in both simulations (16.2, 73.1 and 334.7 mm2) and experiments (26.2, 94.2 and 206.2 mm2). Therefore, the feasibility of HMIFU for HIFU lesion detection based on the underlying tissue elasticity changes was verified through the developed theoretical framework, i.e., validation of the fundamental performance of the HMIFU system for lesion detection, localization and quantification, was demonstrated both theoretically and ex vivo. PMID:22036637

Mississippi Curriculum Framework for Metal Trades (Program CIP: 48.0590--Metal Trades). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for metal trades I, IIA (advanced welding), and IIB (advanced machine shop).…

Mississippi Curriculum Framework for Horticulture (Program CIP: 01.0601--Horticulture Serv. Op. & Mgmt., Gen.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for horticulture I and II. Presented first are a program description and…

The Profiles in Practice School Reporting Software.

ERIC Educational Resources Information Center

Griffin, Patrick

"The Profiles in Practice: School Reporting Software" provides a framework for reports on different aspects of performance in an assessment program. This booklet is the installation guide and user manual for the Profiles in Practice software, which is included as a CD-ROM. The chapters of the guide are: (1) "Installation"; (2) "Starting the…

The Use of Techniques of Sensory Evaluation as a Framework for Teaching Experimental Methods.

ERIC Educational Resources Information Center

Bennett, R.; Hamilton, M.

1981-01-01

Describes sensory assessment techniques and conditions for their satisfactory performance, including how they can provide open-ended exercises and advantages as relatively inexpensive and simple methods of teaching experimentation. Experiments described focus on diffusion of salt into potatoes after being cooked in boiled salted water. (Author/JN)

Mississippi Curriculum Framework for Agriculture Production (Program CIP: 01.0301--Agricultural Prod. Workers & Mgrs.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriculture production I and II. Presented first are a program…

Mississippi Curriculum Framework for Building Trades (Program CIP: 46.0490--Building Trades, General). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in the building trades: building trades I and…

What States Should Know about International Standards in Science: Highlights from Achieve's Analysis

ERIC Educational Resources Information Center

Achieve, Inc., 2010

2010-01-01

Achieve, through support from the Noyce Foundation, examined ten sets of international standards with the intent of informing the development of both the conceptual framework and Next Generation Science Standards. Achieve selected countries based on their strong performance on international assessments and/or their economic, political, or cultural…

Mississippi Curriculum Framework for Welding (Program CIP: 48.0508--Welder/Welding Technologist). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for welding I and II. Presented first are a program description and course…

Mississippi Curriculum Framework for General Drafting (Program CIP: 48.0101--Drafting, General). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in drafting: drafting I and II. Presented…

Causal Mediation in Educational Research: An Illustration Using International Assessment Data

ERIC Educational Resources Information Center

Caro, Daniel H.

2015-01-01

This paper applies the causal mediation framework proposed by Kosuke Imai and colleagues (Imai, Keele, & Tingley, 2010) to educational research by examining the causal mediating role of early literacy activities in parental education influences on reading performance. The paper argues that the study of causal mediation is particularly relevant…

Correlates of Quality Sleep and Academic Performance

ERIC Educational Resources Information Center

Becker, Craig M.; Adams, Troy; Orr, Caroline; Quilter, Lyndsay

2008-01-01

Sleep problems have become epidemic and traditional research has discovered many causes of poor sleep. The purpose of this study was to complement existing research by using a salutogenic or health origins framework to investigate the correlates of good sleep. The analysis for this study used the National College Health Assessment data that…

Impact in the REF: Issues and Obstacles

ERIC Educational Resources Information Center

Watermeyer, Richard

2016-01-01

This article focuses on "impact" as a new condition of research assessment for UK academics. It explores a history of resistance to an "impact agenda" and how impact as a component of the Research Excellence Framework (REF)--a system of performance based funding--is viewed by academics as an infringement to a scholarly way of…

Mississippi Curriculum Framework for Agriscience (Program CIP: 02.0101--Agriculture Science). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriscience I and II. Presented first are a program description and…

Mississippi Curriculum Framework for Automotive Mechanics (Program CIP: 47.0604--Auto/Automotive Mechanic/Tech). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for automotive mechanics I and II. Presented first are a program description…

Mississippi Curriculum Framework for Allied Health (Program CIP: 51.1699--Nursing, Other). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for allied health I and II. Presented first are a program description and…

Mississippi Curriculum Framework for Introduction to Agriscience (Program CIP: 02.9990--Introduction to Agriculture Science). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for the introduction to agriscience program. Presented first are a program…

Intelligence Assessment: Gardner Multiple Intelligence Theory as an Alternative

ERIC Educational Resources Information Center

Almeida, Leandro S.; Prieto, Maria Dolores; Ferreira, Aristides I.; Bermejo, Maria Rosario; Ferrando, Mercedes; Ferrandiz, Carmen

2010-01-01

In the multiple intelligence framework, newer and more contextualized cognitive tasks are suggested as alternative to more traditional psychometric tests. The purpose of this article is to examine whether or not these two types of instruments converge into a general factor of cognitive performance. Thus, the Battery of General and Differential…

Mississippi Curriculum Framework for Electronics (Program CIP: 47.0190--Electronics (Secondary)). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in electronics: electronics I and II.…

Mississippi Curriculum Framework for Residential Carpentry (Program CIP: 46.0201--Carpenter). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in carpentry: carpentry I and II. Presented…

Evaluation Criterion for Quality Assessment of E-Learning Content

ERIC Educational Resources Information Center

Al-Alwani, Abdulkareem

2014-01-01

Research trends related to e-learning systems are oriented towards increasing the efficiency and capacity of the systems, thus they reflect a large variance in performance when considering content conformity and quality standards. The Framework related to standardisation of digital content for e-learning systems is likely to play a significant…

Multi-Scenario Use Case based Demonstration of Buildings Cybersecurity Framework Webtool

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gourisetti, Sri Nikhil G.; Mylrea, Michael E.; Gervais, Easton L.

The purpose of this paper is to demonstrate the cybersecurity and software capabilities of Buildings Cybersecurity Framework (BCF) webtool. The webtool is designed based on BCF document and existing NIST standards. It’s capabilities and features are depicted through a building usecase with four different investment scenarios geared towards improving the cybersecurity posture of the building. BCF webtool also facilitates implementation of the goals outlined in Presidential Executive Order (EO) on Strengthening the Cybersecurity of Federal Networks and Critical Infrastructure (May 2017. In realization of the EO goals, BCF includes five core elements: Identify, Protect, Detect, Respond, and Recover, to helpmore » determine various policy and process level vulnerabilities and provide mitigation strategies. With the BCF webtool, an organization can perform a cybersecurity self-assessment; determine the current cybersecurity posture; define investment based goals to achieve a target state; connect the cybersecurity posture with business processes, functions, and continuity; and finally, develop plans to answer critical organizational cybersecurity questions. In this paper, the webtool and its core capabilities are depicted by performing an extensive comparative assessment over four different scenarios.« less

Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool.

PubMed

Krause, Lyndon; Farrow, Damian; Reid, Machar; Buszard, Tim; Pinder, Ross

2018-06-01

Representative Learning Design (RLD) is a framework for assessing the degree to which experimental or practice tasks simulate key aspects of specific performance environments (i.e. competition). The key premise being that when practice replicates the performance environment, skills are more likely to transfer. In applied situations, however, there is currently no simple or quick method for coaches to assess the key concepts of RLD (e.g. during on-court tasks). The aim of this study was to develop a tool for coaches to efficiently assess practice task design in tennis. A consensus-based tool was developed using a 4-round Delphi process with 10 academic and 13 tennis-coaching experts. Expert consensus was reached for the inclusion of seven items, each consisting of two sub-questions related to (i) the task goal and (ii) the relevance of the task to competition performance. The Representative Practice Assessment Tool (RPAT) is proposed for use in assessing and enhancing practice task designs in tennis to increase the functional coupling between information and movement, and to maximise the potential for skill transfer to competition contexts.

Water-saving interventions assessment framework: an application for the Urmia Lake Restoration Program

NASA Astrophysics Data System (ADS)

Shadkam, Somayeh; Oel, Pieter; Kabat, Pavel; Ludwig, Fulco

2017-04-01

Increasing water demand often results in unsustainable water use leaving insufficient amounts of water for sustaining natural environments. Therefore, to save natural resources water-saving interventions have been introduced to the environmental policy agenda in many (semi)-arid regions. Many policies, however, have failed reaching their objectives to increase water availability for the environment. This calls for a comprehensive tool to assess water-saving policies. Therefore, this study introduces a constructive framework to assess the policies by estimating five components: 1) Total water demand under socio-economic scenarios, 2) Water supply under climate change scenarios, 3) Water withdrawal for different sectors, 4) Water depletion and 5) Environmental flow. The framework, was applied to assess Urmia Lake Restoration Program (ULRP), which aims to restore the drying Urmia Lake in north-western Iran by increasing the lake inflow by 3.1×106m3yr-1. Results suggest that although the ULRP helps to increase inflow by up to 57% it is unlikely to fully reach its target. The analysis shows that there are three main reasons for the potential poor performance. The first reason is decreasing return flows due to increasing irrigation efficiency. This means that the expected increase in lake inflow volume is smaller than the volume saved by increasing irrigation efficiency. The second reason is increased depletion which is due to neglecting the fact that agricultural water demand is currently higher than available water for agriculture. As a result, increasing water use efficiency may result in increased water depletion. The third reason is ignoring the potential impact of climate change, which might decrease future water availability by 3% to 15%. Our analysis suggests that to reach the intervention target, measures need to focus on reducing Water demand and Water depletion rather than on reducing Water withdrawals. The assessment framework can be used to comprehensively assess water-saving intervention plans, particularly in water-stressed basins.

Development of an Interdisciplinary Team Communication Framework and Quality Metrics for Home-Based Medical Care Practices.

PubMed

Fathi, Roya; Sheehan, Orla C; Garrigues, Sarah K; Saliba, Debra; Leff, Bruce; Ritchie, Christine S

2016-08-01

The unique needs of homebound adults receiving home-based medical care (HBMC) (ie, home-based primary care and home-based palliative care services) are ideally provided by interdisciplinary care teams (IDTs) that provide coordinated care. The composition of team members from an array of organizations and the unique dimension of providing care in the home present specific challenges to timely access and communication of patient care information. The objective of this work was to develop a conceptual framework and corresponding quality indicators (QIs) that assess how IDT members for HBMC practices access and communicate key patient information with each other. A systematic review of peer-reviewed and gray literature was performed to inform a framework for care coordination in the home and the development of candidate QIs to assess processes by which all IDT members optimally access and use patient information. A technical expert panel (TEP) participated in a modified Delphi process to assess the validity and feasibility of each QI and to identify which would be most suitable for testing in the field. Thematic analysis of literature revealed 4 process themes for how HBMC practices might engage in high-quality care coordination: using electronic medical records, conducting interdisciplinary team meetings, sharing standardized patient assessments, and communicating via secure e-messaging. Based on these themes, 9 candidate QIs were developed to reflect these processes. Three candidate QIs were assessed by the TEP as valid and feasible to measure in an HBMC practice setting. These indicators focused on use of IDT meetings, standardized patient assessments, and secure e-messaging. Translating the complex issue of care coordination into QIs will improve care delivered to vulnerable home-limited adults who receive HBMC. Guided by the literature, we developed a framework to reflect optimal care coordination in the home setting and identified 3 candidate QIs to field-test in HBMC practices. Published by Elsevier Inc.

Going DEEP: guidelines for building simulation-based team assessments.

PubMed

Grand, James A; Pearce, Marina; Rench, Tara A; Chao, Georgia T; Fernandez, Rosemarie; Kozlowski, Steve W J

2013-05-01

Whether for team training, research or evaluation, making effective use of simulation-based technologies requires robust, reliable and accurate assessment tools. Extant literature on simulation-based assessment practices has primarily focused on scenario and instructional design; however, relatively little direct guidance has been provided regarding the challenging decisions and fundamental principles related to assessment development and implementation. The objective of this manuscript is to introduce a generalisable assessment framework supplemented by specific guidance on how to construct and ensure valid and reliable simulation-based team assessment tools. The recommendations reflect best practices in assessment and are designed to empower healthcare educators, professionals and researchers with the knowledge to design and employ valid and reliable simulation-based team assessments. Information and actionable recommendations associated with creating assessments of team processes (non-technical 'teamwork' activities) and performance (demonstration of technical proficiency) are presented which provide direct guidance on how to Distinguish the underlying competencies one aims to assess, Elaborate the measures used to capture team member behaviours during simulation activities, Establish the content validity of these measures and Proceduralise the measurement tools in a way that is systematically aligned with the goals of the simulation activity while maintaining methodological rigour (DEEP). The DEEP framework targets fundamental principles and critical activities that are important for effective assessment, and should benefit healthcare educators, professionals and researchers seeking to design or enhance any simulation-based assessment effort.

Evaluation of hazard and integrity monitor functions for integrated alerting and notification using a sensor simulation framework

NASA Astrophysics Data System (ADS)

Bezawada, Rajesh; Uijt de Haag, Maarten

2010-04-01

This paper discusses the results of an initial evaluation study of hazard and integrity monitor functions for use with integrated alerting and notification. The Hazard and Integrity Monitor (HIM) (i) allocates information sources within the Integrated Intelligent Flight Deck (IIFD) to required functionality (like conflict detection and avoidance) and determines required performance of these information sources as part of that function; (ii) monitors or evaluates the required performance of the individual information sources and performs consistency checks among various information sources; (iii) integrates the information to establish tracks of potential hazards that can be used for the conflict probes or conflict prediction for various time horizons including the 10, 5, 3, and <3 minutes used in our scenario; (iv) detects and assesses the class of the hazard and provide possible resolutions. The HIM monitors the operation-dependent performance parameters related to the potential hazards in a manner similar to the Required Navigation Performance (RNP). Various HIM concepts have been implemented and evaluated using a previously developed sensor simulator/synthesizer. Within the simulation framework, various inputs to the IIFD and its subsystems are simulated, synthesized from actual collected data, or played back from actual flight test sensor data. The framework and HIM functions are implemented in SimulinkR, a modeling language developed by The MathworksTM. This modeling language allows for test and evaluation of various sensor and communication link configurations as well as the inclusion of feedback from the pilot on the performance of the aircraft.

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

A Computational Framework for Automation of Point Defect Calculations

NASA Astrophysics Data System (ADS)

Goyal, Anuj; Gorai, Prashun; Peng, Haowei; Lany, Stephan; Stevanovic, Vladan; National Renewable Energy Laboratory, Golden, Colorado 80401 Collaboration

A complete and rigorously validated open-source Python framework to automate point defect calculations using density functional theory has been developed. The framework provides an effective and efficient method for defect structure generation, and creation of simple yet customizable workflows to analyze defect calculations. The package provides the capability to compute widely accepted correction schemes to overcome finite-size effects, including (1) potential alignment, (2) image-charge correction, and (3) band filling correction to shallow defects. Using Si, ZnO and In2O3as test examples, we demonstrate the package capabilities and validate the methodology. We believe that a robust automated tool like this will enable the materials by design community to assess the impact of point defects on materials performance. National Renewable Energy Laboratory, Golden, Colorado 80401.

Effects of age on navigation strategy.

PubMed

Rodgers, M Kirk; Sindone, Joseph A; Moffat, Scott D

2012-01-01

Age differences in navigation strategies have been demonstrated in animals, with aged animals more likely to prefer an egocentric (route) strategy and younger animals more likely to prefer an allocentric (place) strategy. Using a novel virtual Y-maze strategy assessment (vYSA), the present study demonstrated substantial age differences in strategy preference in humans. Older adults overwhelmingly preferred an egocentric strategy, while younger adults were equally distributed between egocentric and allocentric preference. A preference for allocentric strategy on the Y-maze strategy assessment was found to benefit performance on an independent assessment (virtual Morris water task) only in younger adults. These results establish baseline age differences in spatial strategies and suggest this may impact performance on other spatial navigation assessments. The results are interpreted within the framework of age differences in hippocampal structure and function. Copyright © 2012 Elsevier Inc. All rights reserved.

Framework for Sustainability Performance Assessment for Manufacturing Processes- A Review

NASA Astrophysics Data System (ADS)

Singh, K.; Sultan, I.

2017-07-01

Manufacturing industries are facing tough competition due to increasing raw material cost and depleting natural resources. There is great pressure on the industry to produce environmental friendly products using environmental friendly processes. To address these issues modern manufacturing industries are focusing on sustainable manufacturing. To develop more sustainable societies, industries need to better understand how to respond to environmental, economic and social challenges. This paper proposed some framework and tools that accelerate the transition towards a sustainable system. The developed framework will be beneficial for sustainability assessment comparing different plans alongside material properties, ultimately helping the manufacturing industries to reduce the carbon emissions and material waste, besides improving energy efficiency. It is expected that this would be highly beneficial for determination of environmental impact of a process at early design stages. Therefore, it would greatly help the manufacturing industries for selection of process plan based on sustainable indices. Overall objective of this paper would have good impact on reducing air emissions and protecting environment. We expect this work to contribute to the development of a standard reference methodology to help further sustainability in the manufacturing sector.

Evacuation performance evaluation tool.

PubMed

Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

2016-01-01

Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Development of indicators for measuring outcomes of water safety plans

PubMed Central

Lockhart, Gabriella; Oswald, William E.; Hubbard, Brian; Medlin, Elizabeth; Gelting, Richard J.

2015-01-01

Water safety plans (WSPs) are endorsed by the World Health Organization as the most effective method of protecting a water supply. With the increase in WSPs worldwide, several valuable resources have been developed to assist practitioners in the implementation of WSPs, yet there is still a need for a practical and standardized method of evaluating WSP effectiveness. In 2012, the Centers for Disease Control and Prevention (CDC) published a conceptual framework for the evaluation of WSPs, presenting four key outcomes of the WSP process: institutional, operational, financial and policy change. In this paper, we seek to operationalize this conceptual framework by providing a set of simple and practical indicators for assessing WSP outcomes. Using CDC’s WSP framework as a foundation and incorporating various existing performance monitoring indicators for water utilities, we developed a set of approximately 25 indicators of institutional, operational, financial and policy change within the WSP context. These outcome indicators hold great potential for the continued implementation and expansion of WSPs worldwide. Having a defined framework for evaluating a WSP’s effectiveness, along with a set of measurable indicators by which to carry out that evaluation, will help implementers assess key WSP outcomes internally, as well as benchmark their progress against other WSPs in their region and globally. PMID:26361540

Managing for efficiency in health care: the case of Greek public hospitals.

PubMed

Mitropoulos, Panagiotis; Mitropoulos, Ioannis; Sissouras, Aris

2013-12-01

This paper evaluates the efficiency of public hospitals with two alternative conceptual models. One model targets resource usage directly to assess production efficiency, while the other model incorporates financial results to assess economic efficiency. Performance analysis of these models was conducted in two stages. In stage one, we utilized data envelopment analysis to obtain the efficiency score of each hospital, while in stage two we took into account the influence of the operational environment on efficiency by regressing those scores on explanatory variables that concern the performance of hospital services. We applied these methods to evaluate 96 general hospitals in the Greek national health system. The results indicate that, although the average efficiency scores in both models have remained relatively stable compared to past assessments, internal changes in hospital performances do exist. This study provides a clear framework for policy implications to increase the overall efficiency of general hospitals.

The development of a competency framework for pharmacists providing cancer services.

PubMed

Carrington, Christine; Weir, Janet; Smith, Peter

2011-09-01

Health practitioners should possess relevant, up to date skills and be able to perform within their required scope of practice to ensure that they are competent. Maintaining the competency of health care professionals is a key principle of clinical governance and risk management. The aim of this project was to develop a competency framework for pharmacists providing pharmaceutical care to cancer patients. An initial draft framework was developed based on existing documentation and adapted to the needs of Queensland Health (QH) facilities. Pharmacists in QH and interstate were asked to review the framework for content and applicability. Cancer care pharmacists in QH were invited to evaluate and score the usefulness and relevance of the final framework. The framework consists of competency clusters, which describe core activities within three areas: patient care competencies, knowledge competencies, and advanced level competencies. The characteristics of the levels of practice at foundation, advanced, and consultant are defined. Twelve pharmacists evaluated the framework by self-assessing their own practice. Respondents reported that the framework was very to somewhat reflective of what they usually do and gave overall support for the content and applicability to practice. The framework has been developed using national and international documents and the input of experienced practitioners across Australia. It represents a set of key competencies for the pharmaceutical delivery of cancer care. The next essential step of the competency framework is to implement and integrate the framework into practice and to develop accompanying training tools.

Sustainability assessment framework for scenarios – SAFS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Arushanyan, Yevgeniya, E-mail: yevgeniya.arushanyan@abe.kth.se; KTH Royal Institute of Technology, Centre for Sustainable Communications; Ekener, Elisabeth

To address current challenges regarding sustainable development and support planning for this form of development, new learning about different possible futures and their potential sustainability implications is needed. One way of facilitating this learning is by combining the futures studies and sustainability assessment (SA) research fields. This paper presents the sustainability assessment framework for scenarios (SAFS), a method developed for assessing the environmental and social risks and opportunities of future scenarios, provides guidelines for its application and demonstrates how the framework can be applied. SAFS suggests assessing environmental and social aspects using a consumption perspective and a life cycle approach,more » and provides qualitative results. SAFS does not suggest any modelling using precise data, but instead offers guidelines on how to carry out a qualitative assessment, where both the process of assessing and the outcome of the assessment are valuable and can be used as a basis for discussion. The benefits, drawbacks and potential challenges of applying SAFS are also discussed in the paper. SAFS uses systems thinking looking at future societies as a whole, considering both environmental and social consequences. This encourages researchers and decision-makers to consider the whole picture, and not just individual elements, when considering different futures. - Highlights: • The paper presents a new methodological framework for qualitative sustainability assessment of future scenarios with transformative changes. • The framework suggests qualitative assessment with consumption perspective and a life cycle approach. • The paper presents the framework and provides guidelines for its application. • The paper demonstrates on an example how the framework can be applied. • The benefits, drawbacks and challenges of the framework application and the need for further development are discussed.« less

Towards more sustainable management of European food waste: Methodological approach and numerical application.

PubMed

Manfredi, Simone; Cristobal, Jorge

2016-09-01

Trying to respond to the latest policy needs, the work presented in this article aims at developing a life-cycle based framework methodology to quantitatively evaluate the environmental and economic sustainability of European food waste management options. The methodology is structured into six steps aimed at defining boundaries and scope of the evaluation, evaluating environmental and economic impacts and identifying best performing options. The methodology is able to accommodate additional assessment criteria, for example the social dimension of sustainability, thus moving towards a comprehensive sustainability assessment framework. A numerical case study is also developed to provide an example of application of the proposed methodology to an average European context. Different options for food waste treatment are compared, including landfilling, composting, anaerobic digestion and incineration. The environmental dimension is evaluated with the software EASETECH, while the economic assessment is conducted based on different indicators expressing the costs associated with food waste management. Results show that the proposed methodology allows for a straightforward identification of the most sustainable options for food waste, thus can provide factual support to decision/policy making. However, it was also observed that results markedly depend on a number of user-defined assumptions, for example on the choice of the indicators to express the environmental and economic performance. © The Author(s) 2016.

New Perspectives on Assessing Amplification Effects

PubMed Central

Souza, Pamela E.; Tremblay, Kelly L.

2006-01-01

Clinicians have long been aware of the range of performance variability with hearing aids. Despite improvements in technology, there remain many instances of well-selected and appropriately fitted hearing aids whereby the user reports minimal improvement in speech understanding. This review presents a multistage framework for understanding how a hearing aid affects performance. Six stages are considered: (1) acoustic content of the signal, (2) modification of the signal by the hearing aid, (3) interaction between sound at the output of the hearing aid and the listener's ear, (4) integrity of the auditory system, (5) coding of available acoustic cues by the listener's auditory system, and (6) correct identification of the speech sound. Within this framework, this review describes methodology and research on 2 new assessment techniques: acoustic analysis of speech measured at the output of the hearing aid and auditory evoked potentials recorded while the listener wears hearing aids. Acoustic analysis topics include the relationship between conventional probe microphone tests and probe microphone measurements using speech, appropriate procedures for such tests, and assessment of signal-processing effects on speech acoustics and recognition. Auditory evoked potential topics include an overview of physiologic measures of speech processing and the effect of hearing loss and hearing aids on cortical auditory evoked potential measurements in response to speech. Finally, the clinical utility of these procedures is discussed. PMID:16959734

Development and testing of a new framework for rapidly assessing legal and managerial protection afforded by marine protected areas: Mediterranean Sea case study.

PubMed

Rodríguez-Rodríguez, D; Rodríguez, J; Abdul Malak, D

2016-02-01

The Convention on Biological Diversity (CBD) states the need to effectively conserve at least 10% of coastal and marine areas of particular importance for biodiversity by 2020. Here, a new indicator-based methodological framework to assess biodiversity protection afforded by marine protected areas' (MPA) was developed as a quick surrogate for MPAs' potential conservation effectiveness: the Marine Protected Area Protection Assessment Framework (MaPAF). The MaPAF consists of a limited number of headline indicators that are integrated in two indexes: Legal protection and Management effort, which eventually integrate in the overall MPA Protection super-index. The MaPAF was then tested in the Mediterranean MPA network as a case study. Spatial analyses were performed at three meaningful scales: the whole Mediterranean Sea, Mediterranean ecoregions and countries. The results of this study suggest that: 1) The MaPAF can serve as a useful tool for consistent, adaptive, quick and cost-effective MPA effectiveness assessments of MPAs and MPA networks in virtually any marine region, as the headline indicators used are commonly compiled and easy to retrieve; 2) The MaPAF proved usable and potentially relevant in the Mediterranean Sea where most indicators in the framework can be publicly accessed through the MAPAMED database and are planned to be regularly updated; 3) Protection afforded by MPAs is low across the whole Mediterranean, with only few MPAs having relatively high legal and managerial protection; and 4) Most Mediterranean countries need to devote substantially more work to improve MPA effectiveness mainly through increased management effort. Copyright © 2015 Elsevier Ltd. All rights reserved.

[Assessing program sustainability in public health organizations: a tool-kit application in Haiti].

PubMed

Ridde, V; Pluye, P; Queuille, L

2006-10-01

Public health stakeholders are concerned about program sustainability. However, they usually conceive sustainability in accordance with financial criteria for at least one reason. No simple frameworks are operationally and theoretically sound enough to globally evaluate program sustainability. The present paper aims to describe an application of one framework assessment tool used to evaluate the sustainability level and process of a Nutritional Care Unit managed by a Swiss humanitarian agency to fight against severe child malnutrition in a Haitian area. The managing agency is committed to put this Unit back into the structure of a local public hospital. The evaluation was performed within the sustainability framework proposed in a former article. Data were collected with a combination of tools, semi-structured interviews (n=33, medical and support staff from the agency and the hospital), participatory observation and document review. Data concerned the four characteristics of organizational routines (memory, adaptation, values and rules) enabling assess to the level of sustainability. In addition, data were related to three types of events distinguishing routinization processes from implementation processes: specific events of routinization, routinization-implementation joint events, and specific events of implementation. Data analysis was thematic and results were validated by actors through a feed-back session and written comments. The current level of sustainability of the Nutritional Care Unit within the Hospital is weak: weak memory, high adaptation, weak sharing of values and rules. This may be explained by the sustainability process, and the absence of specific routinization events. The relevance of such processes is reasonable, while it has been strongly challenged in the troublesome Haitian context. Riots have been widespread over the last years, creating difficulties for the Hospital. This experience suggests the proposed framework and sustainability assessment tools are useful when the context permits scrutinization of program sustainability.

Framework for Assessing Health Risk of Environmental Exposure to Children (External Review Draft)

EPA Science Inventory

The draft document, Framework For Assessing Health Risks of Environmental Exposure to Children, can serve as a resource on children's health risk assessment and it addresses the need to provide a comprehensive and consistent framework for considering children in risk asses...

Monitoring alert and drowsy states by modeling EEG source nonstationarity

NASA Astrophysics Data System (ADS)

Hsu, Sheng-Hsiou; Jung, Tzyy-Ping

2017-10-01

Objective. As a human brain performs various cognitive functions within ever-changing environments, states of the brain characterized by recorded brain activities such as electroencephalogram (EEG) are inevitably nonstationary. The challenges of analyzing the nonstationary EEG signals include finding neurocognitive sources that underlie different brain states and using EEG data to quantitatively assess the state changes. Approach. This study hypothesizes that brain activities under different states, e.g. levels of alertness, can be modeled as distinct compositions of statistically independent sources using independent component analysis (ICA). This study presents a framework to quantitatively assess the EEG source nonstationarity and estimate levels of alertness. The framework was tested against EEG data collected from 10 subjects performing a sustained-attention task in a driving simulator. Main results. Empirical results illustrate that EEG signals under alert versus drowsy states, indexed by reaction speeds to driving challenges, can be characterized by distinct ICA models. By quantifying the goodness-of-fit of each ICA model to the EEG data using the model deviation index (MDI), we found that MDIs were significantly correlated with the reaction speeds (r  =  -0.390 with alertness models and r  =  0.449 with drowsiness models) and the opposite correlations indicated that the two models accounted for sources in the alert and drowsy states, respectively. Based on the observed source nonstationarity, this study also proposes an online framework using a subject-specific ICA model trained with an initial (alert) state to track the level of alertness. For classification of alert against drowsy states, the proposed online framework achieved an averaged area-under-curve of 0.745 and compared favorably with a classic power-based approach. Significance. This ICA-based framework provides a new way to study changes of brain states and can be applied to monitoring cognitive or mental states of human operators in attention-critical settings or in passive brain-computer interfaces.

Defining resilience within a risk-informed assessment framework

DOE Office of Scientific and Technical Information (OSTI.GOV)

Coles, Garill A.; Unwin, Stephen D.; Holter, Gregory M.

2011-08-01

The concept of resilience is the subject of considerable discussion in academic, business, and governmental circles. The United States Department of Homeland Security for one has emphasised the need to consider resilience in safeguarding critical infrastructure and key resources. The concept of resilience is complex, multidimensional, and defined differently by different stakeholders. The authors contend that there is a benefit in moving from discussing resilience as an abstraction to defining resilience as a measurable characteristic of a system. This paper proposes defining resilience measures using elements of a traditional risk assessment framework to help clarify the concept of resilience andmore » as a way to provide non-traditional risk information. The authors show various, diverse dimensions of resilience can be quantitatively defined in a common risk assessment framework based on the concept of loss of service. This allows the comparison of options for improving the resilience of infrastructure and presents a means to perform cost-benefit analysis. This paper discusses definitions and key aspects of resilience, presents equations for the risk of loss of infrastructure function that incorporate four key aspects of resilience that could prevent or mitigate that loss, describes proposed resilience factor definitions based on those risk impacts, and provides an example that illustrates how resilience factors would be calculated using a hypothetical scenario.« less

Modeling and Advanced Control for Sustainable Process ...

EPA Pesticide Factsheets

This book chapter introduces a novel process systems engineering framework that integrates process control with sustainability assessment tools for the simultaneous evaluation and optimization of process operations. The implemented control strategy consists of a biologically-inspired, multi-agent-based method. The sustainability and performance assessment of process operating points is carried out using the U.S. E.P.A.’s GREENSCOPE assessment tool that provides scores for the selected economic, material management, environmental and energy indicators. The indicator results supply information on whether the implementation of the controller is moving the process towards a more sustainable operation. The effectiveness of the proposed framework is illustrated through a case study of a continuous bioethanol fermentation process whose dynamics are characterized by steady-state multiplicity and oscillatory behavior. This book chapter contribution demonstrates the application of novel process control strategies for sustainability by increasing material management, energy efficiency, and pollution prevention, as needed for SHC Sustainable Uses of Wastes and Materials Management.

A comprehensive framework for data quality assessment in CER.

PubMed

Holve, Erin; Kahn, Michael; Nahm, Meredith; Ryan, Patrick; Weiskopf, Nicole

2013-01-01

The panel addresses the urgent need to ensure that comparative effectiveness research (CER) findings derived from diverse and distributed data sources are based on credible, high-quality data; and that the methods used to assess and report data quality are consistent, comprehensive, and available to data consumers. The panel consists of representatives from four teams leveraging electronic clinical data for CER, patient centered outcomes research (PCOR), and quality improvement (QI) and seeks to change the current paradigm where data quality assessment (DQA) is performed "behind the scenes" using one-off project specific methods. The panelists will present their process of harmonizing existing models for describing and measuring clinical data quality and will describe a comprehensive integrated framework for assessing and reporting DQA findings. The collaborative project is supported by the Electronic Data Methods (EDM) Forum, a three-year grant from the Agency for Healthcare Research and Quality (AHRQ) to facilitate learning and foster collaboration across a set of CER, PCOR, and QI projects designed to build infrastructure and methods for collecting and analyzing prospective data from electronic clinical data .

Performance metrics for the assessment of satellite data products: an ocean color case study

PubMed Central

Seegers, Bridget N.; Stumpf, Richard P.; Schaeffer, Blake A.; Loftin, Keith A.; Werdell, P. Jeremy

2018-01-01

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multi-metric and user-dependent approach that can be applied within science, modeling, and resource management communities. PMID:29609296

Improving Conceptual Design for Launch Vehicles

NASA Technical Reports Server (NTRS)

Olds, John R.

1998-01-01

This report summarizes activities performed during the second year of a three year cooperative agreement between NASA - Langley Research Center and Georgia Tech. Year 1 of the project resulted in the creation of a new Cost and Business Assessment Model (CABAM) for estimating the economic performance of advanced reusable launch vehicles including non-recurring costs, recurring costs, and revenue. The current year (second year) activities were focused on the evaluation of automated, collaborative design frameworks (computation architectures or computational frameworks) for automating the design process in advanced space vehicle design. Consistent with NASA's new thrust area in developing and understanding Intelligent Synthesis Environments (ISE), the goals of this year's research efforts were to develop and apply computer integration techniques and near-term computational frameworks for conducting advanced space vehicle design. NASA - Langley (VAB) has taken a lead role in developing a web-based computing architectures within which the designer can interact with disciplinary analysis tools through a flexible web interface. The advantages of this approach are, 1) flexible access to the designer interface through a simple web browser (e.g. Netscape Navigator), 2) ability to include existing 'legacy' codes, and 3) ability to include distributed analysis tools running on remote computers. To date, VAB's internal emphasis has been on developing this test system for the planetary entry mission under the joint Integrated Design System (IDS) program with NASA - Ames and JPL. Georgia Tech's complementary goals this year were to: 1) Examine an alternate 'custom' computational architecture for the three-discipline IDS planetary entry problem to assess the advantages and disadvantages relative to the web-based approach.and 2) Develop and examine a web-based interface and framework for a typical launch vehicle design problem.

Assessment of collection schemes for packaging and other recyclable waste in European Union-28 Member States and capital cities.

PubMed

Seyring, Nicole; Dollhofer, Marie; Weißenbacher, Jakob; Bakas, Ioannis; McKinnon, David

2016-09-01

The Waste Framework Directive obliged European Union Member States to set up separate collection systems to promote high quality recycling for at least paper, metal, plastic and glass by 2015. As implementation of the requirement varies across European Union Member States, the European Commission contracted BiPRO GmbH/Copenhagen Resource Institute to assess the separate collection schemes in the 28 European Union Member States, focusing on capital cities and on metal, plastic, glass (with packaging as the main source), paper/cardboard and bio-waste. The study includes an assessment of the legal framework for, and the practical implementation of, collection systems in the European Union-28 Member States and an in depth-analysis of systems applied in all capital cities. It covers collection systems that collect one or more of the five waste streams separately from residual waste/mixed municipal waste at source (including strict separation, co-mingled systems, door-to-door, bring-point collection and civic amenity sites). A scoreboard including 13 indicators is elaborated in order to measure the performance of the systems with the capture rates as key indicators to identify best performers. Best performance are by the cities of Ljubljana, Helsinki and Tallinn, leading to the key conclusion that door-to-door collection, at least for paper and bio-waste, and the implementation of pay-as-you-throw schemes results in high capture and thus high recycling rates of packaging and other municipal waste. © The Author(s) 2016.

LiDAR based prediction of forest biomass using hierarchical models with spatially varying coefficients

USGS Publications Warehouse

Babcock, Chad; Finley, Andrew O.; Bradford, John B.; Kolka, Randall K.; Birdsey, Richard A.; Ryan, Michael G.

2015-01-01

Many studies and production inventory systems have shown the utility of coupling covariates derived from Light Detection and Ranging (LiDAR) data with forest variables measured on georeferenced inventory plots through regression models. The objective of this study was to propose and assess the use of a Bayesian hierarchical modeling framework that accommodates both residual spatial dependence and non-stationarity of model covariates through the introduction of spatial random effects. We explored this objective using four forest inventory datasets that are part of the North American Carbon Program, each comprising point-referenced measures of above-ground forest biomass and discrete LiDAR. For each dataset, we considered at least five regression model specifications of varying complexity. Models were assessed based on goodness of fit criteria and predictive performance using a 10-fold cross-validation procedure. Results showed that the addition of spatial random effects to the regression model intercept improved fit and predictive performance in the presence of substantial residual spatial dependence. Additionally, in some cases, allowing either some or all regression slope parameters to vary spatially, via the addition of spatial random effects, further improved model fit and predictive performance. In other instances, models showed improved fit but decreased predictive performance—indicating over-fitting and underscoring the need for cross-validation to assess predictive ability. The proposed Bayesian modeling framework provided access to pixel-level posterior predictive distributions that were useful for uncertainty mapping, diagnosing spatial extrapolation issues, revealing missing model covariates, and discovering locally significant parameters.

CSHM: Web-based safety and health monitoring system for construction management.

PubMed

Cheung, Sai On; Cheung, Kevin K W; Suen, Henry C H

2004-01-01

This paper describes a web-based system for monitoring and assessing construction safety and health performance, entitled the Construction Safety and Health Monitoring (CSHM) system. The design and development of CSHM is an integration of internet and database systems, with the intent to create a total automated safety and health management tool. A list of safety and health performance parameters was devised for the management of safety and health in construction. A conceptual framework of the four key components of CSHM is presented: (a) Web-based Interface (templates); (b) Knowledge Base; (c) Output Data; and (d) Benchmark Group. The combined effect of these components results in a system that enables speedy performance assessment of safety and health activities on construction sites. With the CSHM's built-in functions, important management decisions can theoretically be made and corrective actions can be taken before potential hazards turn into fatal or injurious occupational accidents. As such, the CSHM system will accelerate the monitoring and assessing of performance safety and health management tasks.

Performance needs assessment of maternal and newborn health service delivery in urban and rural areas of Osun State, South-West, Nigeria.

PubMed

Esan, Oluwaseun T; Fatusi, Adesegun O

2014-06-01

The study aimed to determine performance and compare gaps in maternal and newborn health (MNH) services in urban and rural areas of Osun State, Nigeria, to inform decisions for improved services. This study involved 14 urban and 10 rural-based randomly selected PHC facilities. Using a Performance Needs Assessment framework, desired performances were determined by key stakeholders and actual performances measured by conducting facility survey. Questionnaire interview of 143 health workers and 153 antenatal clients were done. Performance gaps were determined for the urban and rural areas and compared using Chi-square tests with SPSS version 17. PHC facilities and health workers in Osun State, Nigeria, were found to have significant gaps in MNH service performance and this was worse in the rural areas. Root cause of most of the performance gaps was poor political will of local government authorities. Improved government commitment to MNH is needful to address most of the gaps.

A flexible tool for hydraulic and water quality performance analysis of green infrastructure

NASA Astrophysics Data System (ADS)

Massoudieh, A.; Alikhani, J.

2017-12-01

Models that allow for design considerations of green infrastructure (GI) practices to control stormwater runoff and associated contaminants have received considerable attention in recent years. To be used to evaluate the effect design configurations on the long-term performance of GIs, models should be able to consider processes within GIs with good fidelity. In this presentation, a sophisticated, yet flexible tool for hydraulic and water quality assessment of GIs will be introduced. The tool can be used by design engineers and researchers to capture and explore the effect of design factors and properties of the media employed in the performance of GI systems at a relatively small scale. We deemed it essential to have a flexible GI modeling tool that is capable of simulating GI system components and specific biogeochemical processes affecting contaminants such as evapotranspiration, plant uptake, reactions, and particle-associated transport accurately while maintaining a high degree of flexibility to account for the myriad of GI alternatives. The mathematical framework for a stand-alone GI performance assessment tool has been developed and will be demonstrated. The process-based model framework developed here can be used to model a diverse range of GI practices such as stormwater ponds, green roofs, retention ponds, bioretention systems, infiltration trench, permeable pavement and other custom-designed combinatory systems. An example of the application of the system to evaluate the performance of a rain-garden system will be demonstrated.

Impact Assessment and Forecasts of Information and Telecommunications Technologies Applied to Education and Training: Volume III--Annex & Glossary. Analysis of Key Issues for the Orientation of the Work of Sector Actors in the Framework of DELTA.

ERIC Educational Resources Information Center

Commission of the European Communities, Brussels (Belgium).

This annex to the main report, the third volume in a three volume set, is based on a study performed by the DELTA (Developing European Learning through Technological Advance) unit in parallel with the projects underway in the research and development Exploratory Action. It provides an assessment of the world situation in flexible and distance…

The influence of creative process engagement on employee creative performance and overall job performance: a curvilinear assessment.

PubMed

Zhang, Xiaomeng; Bartol, Kathryn M

2010-09-01

Integrating theories addressing attention and activation with creativity literature, we found an inverted U-shaped relationship between creative process engagement and overall job performance among professionals in complex jobs in an information technology firm. Work experience moderated the curvilinear relationship, with low-experience employees generally exhibiting higher levels of overall job performance at low to moderate levels of creative process engagement and high-experience employees demonstrating higher overall performance at moderate to high levels of creative process engagement. Creative performance partially mediated the relationship between creative process engagement and job performance. These relationships were tested within a moderated mediation framework. Copyright 2010 APA, all rights reserved

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

PubMed

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

PubMed Central

2012-01-01

Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test. PMID:22894708

An Analytical Model for the Performance Analysis of Concurrent Transmission in IEEE 802.15.4

PubMed Central

Gezer, Cengiz; Zanella, Alberto; Verdone, Roberto

2014-01-01

Interference is a serious cause of performance degradation for IEEE802.15.4 devices. The effect of concurrent transmissions in IEEE 802.15.4 has been generally investigated by means of simulation or experimental activities. In this paper, a mathematical framework for the derivation of chip, symbol and packet error probability of a typical IEEE 802.15.4 receiver in the presence of interference is proposed. Both non-coherent and coherent demodulation schemes are considered by our model under the assumption of the absence of thermal noise. Simulation results are also added to assess the validity of the mathematical framework when the effect of thermal noise cannot be neglected. Numerical results show that the proposed analysis is in agreement with the measurement results on the literature under realistic working conditions. PMID:24658624

An analytical model for the performance analysis of concurrent transmission in IEEE 802.15.4.

PubMed

Gezer, Cengiz; Zanella, Alberto; Verdone, Roberto

2014-03-20

Interference is a serious cause of performance degradation for IEEE802.15.4 devices. The effect of concurrent transmissions in IEEE 802.15.4 has been generally investigated by means of simulation or experimental activities. In this paper, a mathematical framework for the derivation of chip, symbol and packet error probability of a typical IEEE 802.15.4 receiver in the presence of interference is proposed. Both non-coherent and coherent demodulation schemes are considered by our model under the assumption of the absence of thermal noise. Simulation results are also added to assess the validity of the mathematical framework when the effect of thermal noise cannot be neglected. Numerical results show that the proposed analysis is in agreement with the measurement results on the literature under realistic working conditions.

What can we learn from international comparisons of health systems and health system reform?

PubMed Central

McPake, B.; Mills, A.

2000-01-01

Most commonly, lessons derived from comparisons of international health sector reform can only be generalized in a limited way to similar countries. However, there is little guidance as to what constitutes "similarity" in this respect. We propose that a framework for assessing similarity could be derived from the performance of individual policies in different contexts, and from the cause and effect processes related to the policies. We demonstrate this process by considering research evidence in the "public-private mix", and propose variables for an initial framework that we believe determine private involvement in the public health sector. The most influential model of public leadership places the private role in a contracting framework. Research in countries that have adopted this model suggests an additional list of variables to add to the framework. The variables can be grouped under the headings "demand factors", "supply factors", and "strength of the public sector". These illustrate the nature of a framework that could emerge, and which would help countries aiming to learn from international experience. PMID:10916918

Ensemble framework based real-time respiratory motion prediction for adaptive radiotherapy applications.

PubMed

Tatinati, Sivanagaraja; Nazarpour, Kianoush; Tech Ang, Wei; Veluvolu, Kalyana C

2016-08-01

Successful treatment of tumors with motion-adaptive radiotherapy requires accurate prediction of respiratory motion, ideally with a prediction horizon larger than the latency in radiotherapy system. Accurate prediction of respiratory motion is however a non-trivial task due to the presence of irregularities and intra-trace variabilities, such as baseline drift and temporal changes in fundamental frequency pattern. In this paper, to enhance the accuracy of the respiratory motion prediction, we propose a stacked regression ensemble framework that integrates heterogeneous respiratory motion prediction algorithms. We further address two crucial issues for developing a successful ensemble framework: (1) selection of appropriate prediction methods to ensemble (level-0 methods) among the best existing prediction methods; and (2) finding a suitable generalization approach that can successfully exploit the relative advantages of the chosen level-0 methods. The efficacy of the developed ensemble framework is assessed with real respiratory motion traces acquired from 31 patients undergoing treatment. Results show that the developed ensemble framework improves the prediction performance significantly compared to the best existing methods. Copyright © 2016 IPEM. Published by Elsevier Ltd. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thompson, B.G.J.; Grindrod, P.

Her Majesty`s Inspectorate of Polution (HMIP) of the United Kingdom has developed a procedure for the post closure assessment of the underground disposal of radioactive waste. In this paper the method of using theory and ideas from the mathematical sciences for assessment is described. The system simulation methodology seeks to discover key combinations of processes or effects which may yield behaviour of interest by sampling across functional and parametric uncertainties, and treating the systems within a probabilistic framework. This paper also discusses how HMIP assessment methodology has been presented, independent of any current application, for review by leading scientists whomore » are independent of the performance assessment field.« less

Applying a multi-criteria genetic algorithm framework for brownfield reuse optimization: improving redevelopment options based on stakeholder preferences.

PubMed

Morio, Maximilian; Schädler, Sebastian; Finkel, Michael

2013-11-30

The reuse of underused or abandoned contaminated land, so-called brownfields, is increasingly seen as an important means for reducing the consumption of land and natural resources. Many existing decision support systems are not appropriate because they focus mainly on economic aspects, while neglecting sustainability issues. To fill this gap, we present a framework for spatially explicit, integrated planning and assessment of brownfield redevelopment options. A multi-criteria genetic algorithm allows us to determine optimal land use configurations with respect to assessment criteria and given constraints on the composition of land use classes, according to, e.g., stakeholder preferences. Assessment criteria include sustainability indicators as well as economic aspects, including remediation costs and land value. The framework is applied to a case study of a former military site near Potsdam, Germany. Emphasis is placed on the trade-off between possibly conflicting objectives (e.g., economic goals versus the need for sustainable development in the regional context of the brownfield site), which may represent different perspectives of involved stakeholders. The economic analysis reveals the trade-off between the increase in land value due to reuse and the costs for remediation required to make reuse possible. We identify various reuse options, which perform similarly well although they exhibit different land use patterns. High-cost high-value options dominated by residential land use and low-cost low-value options with less sensitive land use types may perform equally well economically. The results of the integrated analysis show that the quantitative integration of sustainability may change optimal land use patterns considerably. Copyright © 2013 Elsevier Ltd. All rights reserved.

Testing the Hydrological Coherence of High-Resolution Gridded Precipitation and Temperature Data Sets

NASA Astrophysics Data System (ADS)

Laiti, L.; Mallucci, S.; Piccolroaz, S.; Bellin, A.; Zardi, D.; Fiori, A.; Nikulin, G.; Majone, B.

2018-03-01

Assessing the accuracy of gridded climate data sets is highly relevant to climate change impact studies, since evaluation, bias correction, and statistical downscaling of climate models commonly use these products as reference. Among all impact studies those addressing hydrological fluxes are the most affected by errors and biases plaguing these data. This paper introduces a framework, coined Hydrological Coherence Test (HyCoT), for assessing the hydrological coherence of gridded data sets with hydrological observations. HyCoT provides a framework for excluding meteorological forcing data sets not complying with observations, as function of the particular goal at hand. The proposed methodology allows falsifying the hypothesis that a given data set is coherent with hydrological observations on the basis of the performance of hydrological modeling measured by a metric selected by the modeler. HyCoT is demonstrated in the Adige catchment (southeastern Alps, Italy) for streamflow analysis, using a distributed hydrological model. The comparison covers the period 1989-2008 and includes five gridded daily meteorological data sets: E-OBS, MSWEP, MESAN, APGD, and ADIGE. The analysis highlights that APGD and ADIGE, the data sets with highest effective resolution, display similar spatiotemporal precipitation patterns and produce the largest hydrological efficiency indices. Lower performances are observed for E-OBS, MESAN, and MSWEP, especially in small catchments. HyCoT reveals deficiencies in the representation of spatiotemporal patterns of gridded climate data sets, which cannot be corrected by simply rescaling the meteorological forcing fields, as often done in bias correction of climate model outputs. We recommend this framework to assess the hydrological coherence of gridded data sets to be used in large-scale hydroclimatic studies.

The comparative risk assessment framework and tools (CRAFT)

Treesearch

Southern Research Station USDA Forest Service

2010-01-01

To help address these challenges, the USDA Forest Service’s Eastern Forest Environmental Threat Assessment Center (EFETAC) and the University of North Carolina Asheville’s National Environmental Modeling and Analysis Center (NEMAC) designed a planning framework, called the Comparative Risk Assessment Framework and Tools (CRAFT). CRAFT is...

Assessing Higher-Order Cognitive Constructs by Using an Information-Processing Framework

ERIC Educational Resources Information Center

Dickison, Philip; Luo, Xiao; Kim, Doyoung; Woo, Ada; Muntean, William; Bergstrom, Betty

2016-01-01

Designing a theory-based assessment with sound psychometric qualities to measure a higher-order cognitive construct is a highly desired yet challenging task for many practitioners. This paper proposes a framework for designing a theory-based assessment to measure a higher-order cognitive construct. This framework results in a modularized yet…

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized DINA Model Framework

ERIC Educational Resources Information Center

Chen, Huilin; Chen, Jinsong

2016-01-01

Cognitive diagnosis models (CDMs) are psychometric models developed mainly to assess examinees' specific strengths and weaknesses in a set of skills or attributes within a domain. By adopting the Generalized-DINA model framework, the recently developed general modeling framework, we attempted to retrofit the PISA reading assessments, a…

Radioactive waste isolation in salt: special advisory report on the status of the Office of Nuclear Waste Isolation's plans for repository performance assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ditmars, J.D.; Walbridge, E.W.; Rote, D.M.

1983-10-01

Repository performance assessment is analysis that identifies events and processes that might affect a repository system for isolation of radioactive waste, examines their effects on barriers to waste migration, and estimates the probabilities of their occurrence and their consequences. In 1983 Battelle Memorial Institute's Office of Nuclear Waste Isolation (ONWI) prepared two plans - one for performance assessment for a waste repository in salt and one for verification and validation of performance assessment technology. At the request of the US Department of Energy's Salt Repository Project Office (SRPO), Argonne National Laboratory reviewed those plans and prepared this report to advisemore » SRPO of specific areas where ONWI's plans for performance assessment might be improved. This report presents a framework for repository performance assessment that clearly identifies the relationships among the disposal problems, the processes underlying the problems, the tools for assessment (computer codes), and the data. In particular, the relationships among important processes and 26 model codes available to ONWI are indicated. A common suggestion for computer code verification and validation is the need for specific and unambiguous documentation of the results of performance assessment activities. A major portion of this report consists of status summaries of 27 model codes indicated as potentially useful by ONWI. The code summaries focus on three main areas: (1) the code's purpose, capabilities, and limitations; (2) status of the elements of documentation and review essential for code verification and validation; and (3) proposed application of the code for performance assessment of salt repository systems. 15 references, 6 figures, 4 tables.« less

Periodic benefit-risk assessment using Bayesian stochastic multi-criteria acceptability analysis

PubMed Central

Li, Kan; Yuan, Shuai Sammy; Wang, William; Wan, Shuyan Sabrina; Ceesay, Paulette; Heyse, Joseph F.; Mt-Isa, Shahrul; Luo, Sheng

2018-01-01

Benefit-risk (BR) assessment is essential to ensure the best decisions are made for a medical product in the clinical development process, regulatory marketing authorization, post-market surveillance, and coverage and reimbursement decisions. One challenge of BR assessment in practice is that the benefit and risk profile may keep evolving while new evidence is accumulating. Regulators and the International Conference on Harmonization (ICH) recommend performing periodic benefit-risk evaluation report (PBRER) through the product's lifecycle. In this paper, we propose a general statistical framework for periodic benefit-risk assessment, in which Bayesian meta-analysis and stochastic multi-criteria acceptability analysis (SMAA) will be combined to synthesize the accumulating evidence. The proposed approach allows us to compare the acceptability of different drugs dynamically and effectively and accounts for the uncertainty of clinical measurements and imprecise or incomplete preference information of decision makers. We apply our approaches to two real examples in a post-hoc way for illustration purpose. The proposed method may easily be modified for other pre and post market settings, and thus be an important complement to the current structured benefit-risk assessment (sBRA) framework to improve the transparent and consistency of the decision-making process. PMID:29505866

Mississippi Curriculum Framework for Automotive Body Repair (Program CIP: 47.0603--Auto/Automotive Body Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for automotive body repair I and II. Presented first are a program…

A Framework for Understanding Cross-National and Cross-Ethnic Gaps in Math and Science Achievement: The Case of the United States

ERIC Educational Resources Information Center

Guglielmi, R. Sergio; Brekke, Nancy

2017-01-01

Comparative international assessments of academic achievement consistently indicate that US students trail behind many peers, particularly those from east Asia, in math and science. Traditional efforts to explain this finding have focused on identifying characteristics that might differentiate the United States from top-performing countries.…

Mississippi Curriculum Framework for Small Engine Repair (Program CIP: 47.0606--Small Engine Mechanic and Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for small engine repair I and II. Presented first are a program description…

Diagnostic Efficiency of easyCBM[R] Math: Washington State. Technical Report #1008

ERIC Educational Resources Information Center

Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

easyCBM[R] is an online benchmark and progress monitoring assessment system designed for use within a response to intervention framework. Educators using easyCBM[R] are often interested in using the results to predict students' state test performance. In the following technical document, we report diagnostic efficiency statistics using a sample…

Five Critical Practices for Middle Grades Leadership: A Framework for School Improvement

ERIC Educational Resources Information Center

Nash, Ruth C.; Richardson, Yvette M.; Hodge, Patricia H.; Connell, Peggy H.; Green, Zebbra P.

2014-01-01

Based on current research, many students in the middle grades (6-8) have not performed at their highest academic levels. In 2011, more than one-half of eighth graders in 16 Southern states scored basic or below basic on the National Assessment of Educational Progress (NAEP). Alternatively, effective principal-leaders strategically demonstrated…

Can the Principles of Cognitive Acceleration Be Used to Improve Numerical Reasoning in Science?

ERIC Educational Resources Information Center

Clowser, Anthony; Jones, Susan Wyn; Lewis, John

2018-01-01

This study investigates whether the Cognitive Acceleration through Science Education (CASE) scheme could be used to meet the demands of the Literacy and Numeracy Framework (LNF). The LNF is part of the Welsh Government's improvement strategy in response to perceived poor performance in the Programme for International Student Assessment (PISA)…

Mississippi Curriculum Framework for Business and Computer Technology (Program CIP: 52.0408--Gen. Office/Clerical & Typing Service). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for secondary-level courses in business and computer technology I-II.…

Mississippi Curriculum Framework for Marketing and Fashion Merchandising (Program CIP: 08.0705--General Retailing Operations). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for marketing I-II and fashion merchandising. Presented first are a program…

Understanding the Nature of Performance: The Influence of Learner Background on School-Age Learner Achievement in Chinese

ERIC Educational Resources Information Center

Scrimgeour, Andrew

2012-01-01

While Chinese language learning in Australian schools is characterised by predominantly second language programs for learners who have had no prior exposure to the target language, there is increasing participation by Australian-born children who speak Putonghua (Mandarin) or another dialect at home. Curriculum and assessment frameworks and…

Taiwanese Sixth Graders' Achievement Goals and Their Motivation, Strategy Use, and Grades: An Examination of the Multiple Goal Perspective

ERIC Educational Resources Information Center

Shih, Shu-Shen

2005-01-01

Using the trichotomous framework of achievement goals, in the present study I investigated the effects of different combinations of achievement goals on Taiwanese sixth graders' motivation, strategy use, and performance. 242 students completed a self-report survey assessing their achievement goal orientations and a range of outcomes including…

Mississippi Curriculum Framework for Agriculture Business and Management (Program CIP: 01.0101--Agriculture Business & Mgmt., Gen.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriculture business and management (ABM) I and II. Presented first are a…

The University Supervisor, edTPA, and the New Making of the Teacher

ERIC Educational Resources Information Center

Donovan, Martha K.; Cannon, Susan O.

2018-01-01

As university supervisors at a large, urban university in the southern US, we examined the ways that the Education Teacher Performance Assessment (edTPA) shaped the pedagogic relationships and decision-making processes of our students and ourselves during the spring of 2016. We situated this study of edTPA within the framework of critical policy…

Mississippi Curriculum Framework for Brick, Block, and Stonemasonry (Program CIP: 46.0101--Mason and Tile Setter). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in brick, block, and stonemasonry: brick,…

The Effect of Accelerated Reader on Reading Scores in a Rural School District

ERIC Educational Resources Information Center

Hunter, Teresa A.

2013-01-01

In this study, the implementation of Accelerated Reader (AR), a computer-assisted supplemental reading program, was investigated as a research-based instructional strategy to assess whether it aided a high-performing, rural school district in meeting adequate yearly progress goals. The theoretical framework was based on Vygotsky's zone of…

Using Generalizability Theory as a Framework for Informing Measurement Issues in Middle School Settings

ERIC Educational Resources Information Center

Ing, Marsha; Shih, Jeffrey C.

2013-01-01

There are situations within middle school settings where measurements of students and teachers are used for high-stakes decisions. For example, student performance is used as an indicator of teacher quality or determines student eligibility for particular types of support services. Given the high-stakes nature of these types of assessments,…

Understanding How Resources and Capabilities Affect Performance: Actively Applying the Resource-Based View in the Classroom

ERIC Educational Resources Information Center

Sheehan, Norman T.

2006-01-01

The resource-based view is a strategic framework for understanding why some firms outperform others. Its importance is reflected in its wide inclusion in strategy texts as a tool for assessing a firm's internal strengths and weaknesses. This article outlines an experiential exercise that demonstrates how different bundles of resources and…

Mississippi Curriculum Framework for Diesel Equipment Repair & Service (Program CIP: 47.0605--Diesel Engine Mechanic & Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for diesel engine mechanics I and II. Presented first are a program…

Mississippi Curriculum Framework for Forestry (Program CIP: 03.0401--Forest Harvesting and Production Technology). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for forestry I and II. Presented first are a program description and course…

Mississippi Curriculum Framework for Family and Consumer Sciences and Related Technology (Enrichment) (CIP: 20.0101--Comprehensive Consumer & Homemkg. Ed.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for family and consumer sciences and related technology (enrichment).…

Detecting Different Types of Reading Difficulties: A Comparison of Tests

ERIC Educational Resources Information Center

Moore, Danielle M.; Porter, Melanie A.; Kohnen, Saskia; Castles, Anne

2012-01-01

The focus of this paper is on the assessment of the two main processes that children must acquire at the single word reading level: word recognition (lexical) and decoding (nonlexical) skills. Guided by the framework of the dual route model, this study aimed to (1) investigate the impact of item characteristics on test performance, and (2)…

Mississippi Curriculum Framework for Machine Tool Operation/Machine Shop (Program CIP: 48.0503--Machine Shop Assistant). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for machine tool operation/machine shop I and II. Presented first are a…

Using Data to Measure Performance of Home Visiting: A New Framework for Assessing Effectiveness

ERIC Educational Resources Information Center

Martens, Katye

2015-01-01

Across the country, state legislatures are turning to evidence-based policymaking to ensure that taxpayer dollars are spent efficiently and effectively. One example is family support and coaching. In response to research confirming that the early years of childhood affect learning, behavior, and health for a lifetime, many states have invested in…

Perspectives to Performance of Environment and Health Assessments and Models—From Outputs to Outcomes?

PubMed Central

Pohjola, Mikko V.; Pohjola, Pasi; Tainio, Marko; Tuomisto, Jouni T.

2013-01-01

The calls for knowledge-based policy and policy-relevant research invoke a need to evaluate and manage environment and health assessments and models according to their societal outcomes. This review explores how well the existing approaches to assessment and model performance serve this need. The perspectives to assessment and model performance in the scientific literature can be called: (1) quality assurance/control, (2) uncertainty analysis, (3) technical assessment of models, (4) effectiveness and (5) other perspectives, according to what is primarily seen to constitute the goodness of assessments and models. The categorization is not strict and methods, tools and frameworks in different perspectives may overlap. However, altogether it seems that most approaches to assessment and model performance are relatively narrow in their scope. The focus in most approaches is on the outputs and making of assessments and models. Practical application of the outputs and the consequential outcomes are often left unaddressed. It appears that more comprehensive approaches that combine the essential characteristics of different perspectives are needed. This necessitates a better account of the mechanisms of collective knowledge creation and the relations between knowledge and practical action. Some new approaches to assessment, modeling and their evaluation and management span the chain from knowledge creation to societal outcomes, but the complexity of evaluating societal outcomes remains a challenge. PMID:23803642

The Framework for the National Assessment of Educational Progress in Civics. ERIC Digest.

ERIC Educational Resources Information Center

Patrick, John J.

This digest briefly summarizes the contents of the "Civics Framework for the 1998 National Assessment of Educational Progress" in terms of the Framework's development and components including civic knowledge, civic skills, and civic dispositions. The framework may be used to inform and guide curriculum development projects in civics and…

Toward an Ecological Risk Assessment Framework for Special Education

ERIC Educational Resources Information Center

Trepanier, Nathalie Sonia

2005-01-01

This paper suggests a new framework for conducting research in the field of special education. This framework is inspired by the ecological risk assessment frameworks of the U.S. Environmental Protection Agency (1995) and G.W. Suter (1993), which are primarily used in ecotoxicology and environmental toxicology. The methodology used to develop the…

Ex-ante assessment of the safety effects of intelligent transport systems.

PubMed

Kulmala, Risto

2010-07-01

There is a need to develop a comprehensive framework for the safety assessment of Intelligent Transport Systems (ITS). This framework should: (1) cover all three dimensions of road safety-exposure, crash risk and consequence, (2) cover, in addition to the engineering effect, also the effects due to behavioural adaptation and (3) be compatible with the other aspects of state of the art road safety theories. A framework based on nine ITS safety mechanisms is proposed and discussed with regard to the requirements set to the framework. In order to illustrate the application of the framework in practice, the paper presents a method based on the framework and the results from applying that method for twelve intelligent vehicle systems in Europe. The framework is also compared to two recent frameworks applied in the safety assessment of intelligent vehicle safety systems. Copyright 2010 Elsevier Ltd. All rights reserved.

How to assess driver's interaction with partially automated driving systems - A framework for early concept assessment.

PubMed

van den Beukel, Arie P; van der Voort, Mascha C

2017-03-01

The introduction of partially automated driving systems changes the driving task into supervising the automation with an occasional need to intervene. To develop interface solutions that adequately support drivers in this new role, this study proposes and evaluates an assessment framework that allows designers to evaluate driver-support within relevant real-world scenarios. Aspects identified as requiring assessment in terms of driver-support within the proposed framework are Accident Avoidance, gained Situation Awareness (SA) and Concept Acceptance. Measurement techniques selected to operationalise these aspects and the associated framework are pilot-tested with twenty-four participants in a driving simulator experiment. The objective of the test is to determine the reliability of the applied measurements for the assessment of the framework and whether the proposed framework is effective in predicting the level of support offered by the concepts. Based on the congruency between measurement scores produced in the test and scores with predefined differences in concept-support, this study demonstrates the framework's reliability. A remaining concern is the framework's weak sensitivity to small differences in offered support. The article concludes that applying the framework is especially advantageous for evaluating early design phases and can successfully contribute to the efficient development of driver's in-control and safe means of operating partially automated vehicles. Copyright © 2016 Elsevier Ltd. All rights reserved.

The UK Quality and Outcomes Framework pay-for-performance scheme and spirometry: rewarding quality or just quantity? A cross-sectional study in Rotherham, UK

PubMed Central

Strong, Mark; South, Gail; Carlisle, Robin

2009-01-01

Background Accurate spirometry is important in the management of COPD. The UK Quality and Outcomes Framework pay-for-performance scheme for general practitioners includes spirometry related indicators within its COPD domain. It is not known whether high achievement against QOF spirometry indicators is associated with spirometry to BTS standards. Methods Data were obtained from the records of 3,217 patients randomly sampled from 5,649 patients with COPD in 38 general practices in Rotherham, UK. Severity of airflow obstruction was categorised by FEV1 (% predicted) according to NICE guidelines. This was compared with clinician recorded COPD severity. The proportion of patients whose spirometry met BTS standards was calculated in each practice using a random sub-sample of 761 patients. The Spearman rank correlation between practice level QOF spirometry achievement and performance against BTS spirometry standards was calculated. Results Spirometry as assessed by clinical records was to BTS standards in 31% of cases (range at practice level 0% to 74%). The categorisation of airflow obstruction according to the most recent spirometry results did not agree well with the clinical categorisation of COPD recorded in the notes (Cohen's kappa = 0.34, 0.30 – 0.38). 12% of patients on COPD registers had FEV1 (% predicted) results recorded that did not support the diagnosis of COPD. There was no association between quality, as measured by adherence to BTS spirometry standards, and either QOF COPD9 achievement (Spearman's rho = -0.11), or QOF COPD10 achievement (rho = 0.01). Conclusion The UK Quality and Outcomes Framework currently assesses the quantity, but not the quality of spirometry. PMID:19558719

The UK Quality and Outcomes Framework pay-for-performance scheme and spirometry: rewarding quality or just quantity? A cross-sectional study in Rotherham, UK.

PubMed

Strong, Mark; South, Gail; Carlisle, Robin

2009-06-28

Accurate spirometry is important in the management of COPD. The UK Quality and Outcomes Framework pay-for-performance scheme for general practitioners includes spirometry related indicators within its COPD domain. It is not known whether high achievement against QOF spirometry indicators is associated with spirometry to BTS standards. Data were obtained from the records of 3,217 patients randomly sampled from 5,649 patients with COPD in 38 general practices in Rotherham, UK. Severity of airflow obstruction was categorised by FEV1 (% predicted) according to NICE guidelines. This was compared with clinician recorded COPD severity. The proportion of patients whose spirometry met BTS standards was calculated in each practice using a random sub-sample of 761 patients. The Spearman rank correlation between practice level QOF spirometry achievement and performance against BTS spirometry standards was calculated. Spirometry as assessed by clinical records was to BTS standards in 31% of cases (range at practice level 0% to 74%). The categorisation of airflow obstruction according to the most recent spirometry results did not agree well with the clinical categorisation of COPD recorded in the notes (Cohen's kappa = 0.34, 0.30 - 0.38). 12% of patients on COPD registers had FEV1 (% predicted) results recorded that did not support the diagnosis of COPD. There was no association between quality, as measured by adherence to BTS spirometry standards, and either QOF COPD9 achievement (Spearman's rho = -0.11), or QOF COPD10 achievement (rho = 0.01). The UK Quality and Outcomes Framework currently assesses the quantity, but not the quality of spirometry.

A Framework for Preliminary Design of Aircraft Structures Based on Process Information. Part 1

NASA Technical Reports Server (NTRS)

Rais-Rohani, Masoud

1998-01-01

This report discusses the general framework and development of a computational tool for preliminary design of aircraft structures based on process information. The described methodology is suitable for multidisciplinary design optimization (MDO) activities associated with integrated product and process development (IPPD). The framework consists of three parts: (1) product and process definitions; (2) engineering synthesis, and (3) optimization. The product and process definitions are part of input information provided by the design team. The backbone of the system is its ability to analyze a given structural design for performance as well as manufacturability and cost assessment. The system uses a database on material systems and manufacturing processes. Based on the identified set of design variables and an objective function, the system is capable of performing optimization subject to manufacturability, cost, and performance constraints. The accuracy of the manufacturability measures and cost models discussed here depend largely on the available data on specific methods of manufacture and assembly and associated labor requirements. As such, our focus in this research has been on the methodology itself and not so much on its accurate implementation in an industrial setting. A three-tier approach is presented for an IPPD-MDO based design of aircraft structures. The variable-complexity cost estimation methodology and an approach for integrating manufacturing cost assessment into design process are also discussed. This report is presented in two parts. In the first part, the design methodology is presented, and the computational design tool is described. In the second part, a prototype model of the preliminary design Tool for Aircraft Structures based on Process Information (TASPI) is described. Part two also contains an example problem that applies the methodology described here for evaluation of six different design concepts for a wing spar.

Parametric modelling of cardiac system multiple measurement signals: an open-source computer framework for performance evaluation of ECG, PCG and ABP event detectors.

PubMed

Homaeinezhad, M R; Sabetian, P; Feizollahi, A; Ghaffari, A; Rahmani, R

2012-02-01

The major focus of this study is to present a performance accuracy assessment framework based on mathematical modelling of cardiac system multiple measurement signals. Three mathematical algebraic subroutines with simple structural functions for synthetic generation of the synchronously triggered electrocardiogram (ECG), phonocardiogram (PCG) and arterial blood pressure (ABP) signals are described. In the case of ECG signals, normal and abnormal PQRST cycles in complicated conditions such as fascicular ventricular tachycardia, rate dependent conduction block and acute Q-wave infarctions of inferior and anterolateral walls can be simulated. Also, continuous ABP waveform with corresponding individual events such as systolic, diastolic and dicrotic pressures with normal or abnormal morphologies can be generated by another part of the model. In addition, the mathematical synthetic PCG framework is able to generate the S4-S1-S2-S3 cycles in normal and in cardiac disorder conditions such as stenosis, insufficiency, regurgitation and gallop. In the PCG model, the amplitude and frequency content (5-700 Hz) of each sound and variation patterns can be specified. The three proposed models were implemented to generate artificial signals with varies abnormality types and signal-to-noise ratios (SNR), for quantitative detection-delineation performance assessment of several ECG, PCG and ABP individual event detectors designed based on the Hilbert transform, discrete wavelet transform, geometric features such as area curve length (ACLM), the multiple higher order moments (MHOM) metric, and the principal components analysed geometric index (PCAGI). For each method the detection-delineation operating characteristics were obtained automatically in terms of sensitivity, positive predictivity and delineation (segmentation) error rms and checked by the cardiologist. The Matlab m-file script of the synthetic ECG, ABP and PCG signal generators are available in the Appendix.

Harmonised framework for ecological risk assessment of sediments from ports and estuarine zones of North and South Atlantic.

PubMed

Choueri, R B; Cesar, A; Abessa, D M S; Torres, R J; Riba, I; Pereira, C D S; Nascimento, M R L; Morais, R D; Mozeto, A A; DelValls, T A

2010-04-01

This paper presents a harmonised framework of sediment quality assessment and dredging material characterisation for estuaries and port zones of North and South Atlantic. This framework, based on the weight-of-evidence approach, provides a structure and a process for conducting sediment/dredging material assessment that leads to a decision. The main structure consists of "step 1" (examination of available data); "step 2" (chemical characterisation and toxicity assessment); "decision 1" (any chemical level higher than reference values? are sediments toxic?); "step 3" (assessment of benthic community structure); "step 4" (integration of the results); "decision 2" (are sediments toxic or benthic community impaired?); "step 5" (construction of the decision matrix) and "decision 3" (is there environmental risk?). The sequence of assessments may be interrupted when the information obtained is judged to be sufficient for a correct characterisation of the risk posed by the sediments/dredging material. This framework brought novel features compared to other sediment/dredging material risk assessment frameworks: data integration through multivariate analysis allows the identification of which samples are toxic and/or related to impaired benthic communities; it also discriminates the chemicals responsible for negative biological effects; and the framework dispenses the use of a reference area. We demonstrated the successful application of this framework in different port and estuarine zones of the North (Gulf of Cádiz) and South Atlantic (Santos and Paranaguá Estuarine Systems).

Beyond the plot: technology extrapolation domains for scaling out agronomic science

NASA Astrophysics Data System (ADS)

Rattalino Edreira, Juan I.; Cassman, Kenneth G.; Hochman, Zvi; van Ittersum, Martin K.; van Bussel, Lenny; Claessens, Lieven; Grassini, Patricio

2018-05-01

Ensuring an adequate food supply in systems that protect environmental quality and conserve natural resources requires productive and resource-efficient cropping systems on existing farmland. Meeting this challenge will be difficult without a robust spatial framework that facilitates rapid evaluation and scaling-out of currently available and emerging technologies. Here we develop a global spatial framework to delineate ‘technology extrapolation domains’ based on key climate and soil factors that govern crop yields and yield stability in rainfed crop production. The proposed framework adequately represents the spatial pattern of crop yields and stability when evaluated over the data-rich US Corn Belt. It also facilitates evaluation of cropping system performance across continents, which can improve efficiency of agricultural research that seeks to intensify production on existing farmland. Populating this biophysical spatial framework with appropriate socio-economic attributes provides the potential to amplify the return on investments in agricultural research and development by improving the effectiveness of research prioritization and impact assessment.

Managing risk in healthcare: understanding your safety culture using the Manchester Patient Safety Framework (MaPSaF).

PubMed

Parker, Dianne

2009-03-01

To provide sufficient information about the Manchester Patient Safety Framework (MaPSaF) to allow healthcare professionals to assess its potential usefulness. The assessment of safety culture is an important aspect of risk management, and one in which there is increasing interest among healthcare organizations. Manchester Patient Safety Framework offers a theory-based framework for assessing safety culture, designed specifically for use in the NHS. The framework covers multiple dimensions of safety culture, and five levels of safety culture development. This allows the generation of a profile of an organization's safety culture in terms of areas of relative strength and challenge, which can be used to identify focus issues for change and improvement. Manchester Patient Safety Framework provides a useful method for engaging healthcare professionals in assessing and improving the safety culture in their organization, as part of a programme of risk management.

Structural Analysis in a Conceptual Design Framework

NASA Technical Reports Server (NTRS)

Padula, Sharon L.; Robinson, Jay H.; Eldred, Lloyd B.

2012-01-01

Supersonic aircraft designers must shape the outer mold line of the aircraft to improve multiple objectives, such as mission performance, cruise efficiency, and sonic-boom signatures. Conceptual designers have demonstrated an ability to assess these objectives for a large number of candidate designs. Other critical objectives and constraints, such as weight, fuel volume, aeroelastic effects, and structural soundness, are more difficult to address during the conceptual design process. The present research adds both static structural analysis and sizing to an existing conceptual design framework. The ultimate goal is to include structural analysis in the multidisciplinary optimization of a supersonic aircraft. Progress towards that goal is discussed and demonstrated.

A cognitive framework to inform the design of professional development supporting teachers' classroom assessment of inquiry-based science

NASA Astrophysics Data System (ADS)

Matese, Gabrielle

Inquiry-based science places new demands on teachers for assessing students' growth, both of deep conceptual understanding as well as developing inquiry skills. In addition, new ideas about classroom assessment, such as the importance of formative assessment, are gaining currency. While we have ideas about what classroom assessment consistent with inquiry-based pedagogy might look like, and why it is necessary, we have little understanding of what it takes to implement it. That teachers face a challenge in doing so is well-documented. Researchers have noted that teachers attempting changes in classroom assessment often bring with them incompatible beliefs, knowledge, and practices. However, noting general incompatibility is insufficient to support addressing these issues through professional development. In response to this need, I initiated a research project to identify and describe in more detail the categories of beliefs, knowledge and skills that play an important role in inquiry-based science assessment practices. I created an assessment framework outlining specific categories of beliefs, knowledge, and skills affecting particular classroom assessment practices. I then used the framework to examine teachers' classroom assessment practices and to create comparative cases between three middle-school science teachers, highlighting how the different cognitive factors affect four particular assessment practices. The comparative cases demonstrate the framework's utility for analyzing and explicating teacher assessment practices. As a tool for analyzing and understanding teacher practice, the framework supports the design of professional development. To demonstrate the value of the framework, I draw on the comparative cases to identify implications for the design of professional development to support teachers' classroom assessment of inquiry-based science. In this dissertation I provide a brief overview of the framework and its rationale, present an example of the comparative case studies demonstrating the application of the framework and what it reveals about the cognitive influences on teacher practice, and outline the resulting design implications for professional development. This research allows us to better understand the cognitive factors underlying classroom assessment in inquiry-based science, and to design professional development to support teachers engaging in these practices.

The combination of an Environmental Management System and Life Cycle Assessment at the territorial level

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mazzi, Anna; Toniolo, Sara; Catto, Stella

A framework to include a Life Cycle Assessment in the significance evaluation of the environmental aspects of an Environmental Management System has been studied for some industrial sectors, but there is a literature gap at the territorial level, where the indirect impact assessment is crucial. To overcome this criticality, our research proposes the Life Cycle Assessment as a framework to assess environmental aspects of public administration within an Environmental Management System applied at the territorial level. This research is structured in two parts: the design of a new methodological framework and the pilot application for an Italian municipality. The methodologicalmore » framework designed supports Initial Environmental Analysis at the territorial level thanks to the results derived from the impact assessment phase. The pilot application in an Italian municipality EMAS registered demonstrates the applicability of the framework and its effectiveness in evaluating the environmental impact assessment for direct and indirect aspects. Through the discussion of the results, we underline the growing knowledge derived by this research in terms of the reproducibility and consistency of the criteria to define the significance of the direct and indirect environmental aspects for a local public administration. - Highlights: • The combination between Environmental Management System and LCA is studied. • A methodological framework is elaborated and tested at the territorial level. • Life Cycle Impact Assessment supports the evaluation of aspects significance. • The framework assures consistency of evaluation criteria on the studied territory.« less

Adapting the balanced scorecard for mental health and addictions: an inpatient example.

PubMed

Lin, Elizabeth; Durbin, Janet

2008-05-01

The Balanced Scorecard (BSC) is a performance-monitoring framework that originated in the business sector but has more recently been applied to health services. The province of Ontario is using the BSC approach to monitor quality of inpatient care in five service areas. Feasibility of the scorecard framework for each area has been assessed using a standard approach. This paper reports results of the feasibility study for the mental health sector, focusing on three issues: framework relevance, underlying strategic goals and indicator selection. Based on a literature review and extensive stakeholder input, the BSC quadrant structure was recommended with some modifications, and indicators were selected that aligned with provincial mental health reform policy goals. The mental health report has completed two cycles of reporting, and has received good support from the field. Copyright © 2008 Longwoods Publishing.

[The GIPSY-RECPAM model: a versatile approach for integrated evaluation in cardiologic care].

PubMed

Carinci, F

2009-01-01

Tree-structured methodology applied for the GISSI-PSICOLOGIA project, although performed in the framework of earliest GISSI studies, represents a powerful tool to analyze different aspects of cardiologic care. The GISSI-PSICOLOGIA project has delivered a novel methodology based on the joint application of psychometric tools and sophisticated statistical techniques. Its prospective use could allow building effective epidemiological models relevant to the prognosis of the cardiologic patient. The various features of the RECPAM method allow a versatile use in the framework of modern e-health projects. The study used the Cognitive Behavioral Assessment H Form (CBA-H) psychometrics scales. The potential for its future application in the framework of Italian cardiology is relevant and particularly indicated to assist planning of systems for integrated care and routine evaluation of the cardiologic patient.

Initial Multidisciplinary Design and Analysis Framework

NASA Technical Reports Server (NTRS)

Ozoroski, L. P.; Geiselhart, K. A.; Padula, S. L.; Li, W.; Olson, E. D.; Campbell, R. L.; Shields, E. W.; Berton, J. J.; Gray, J. S.; Jones, S. M.;

Power Spectral Density Error Analysis of Spectral Subtraction Type of Speech Enhancement Methods

NASA Astrophysics Data System (ADS)

Händel, Peter

2006-12-01

A theoretical framework for analysis of speech enhancement algorithms is introduced for performance assessment of spectral subtraction type of methods. The quality of the enhanced speech is related to physical quantities of the speech and noise (such as stationarity time and spectral flatness), as well as to design variables of the noise suppressor. The derived theoretical results are compared with the outcome of subjective listening tests as well as successful design strategies, performed by independent research groups.

Using the Analytic Hierarchy Process (AHP) to understand the most important factors to design and evaluate a telehealth system for Parkinson's disease.

PubMed

Cancela, Jorge; Fico, Giuseppe; Arredondo Waldmeyer, Maria T

2015-01-01

The assessment of a new health technology is a multidisciplinary and multidimensional process, which requires a complex analysis and the convergence of different stakeholders into a common decision. This task is even more delicate when the assessment is carried out in early stage of development processes, when the maturity of the technology prevents conducting a large scale trials to evaluate the cost effectiveness through classic health economics methods. This lack of information may limit the future development and deployment in the clinical practice. This work aims to 1) identify the most relevant user needs of a new medical technology for managing and monitoring Parkinson's Disease (PD) patients and to 2) use these user needs for a preliminary assessment of a specific system called PERFORM, as a case study. Analytic Hierarchy Process (AHP) was used to design a hierarchy of 17 needs, grouped into 5 categories. A total of 16 experts, 6 of them with a clinical background and the remaining 10 with a technical background, were asked to rank these needs and categories. On/Off fluctuations detection, Increase wearability acceptance, and Increase self-management support have been identified as the most relevant user needs. No significant differences were found between the clinician and technical groups. These results have been used to evaluate the PERFORM system and to identify future areas of improvement. First of all, the AHP contributed to the elaboration of a unified hierarchy, integrating the needs of a variety of stakeholders, promoting the discussion and the agreement into a common framework of evaluation. Moreover, the AHP effectively supported the user need elicitation as well as the assignment of different weights and priorities to each need and, consequently, it helped to define a framework for the assessment of telehealth systems for PD management and monitoring. This framework can be used to support the decision-making process for the adoption of new technologies in PD.

Using the Analytic Hierarchy Process (AHP) to understand the most important factors to design and evaluate a telehealth system for Parkinson's disease

PubMed Central

2015-01-01

Background The assessment of a new health technology is a multidisciplinary and multidimensional process, which requires a complex analysis and the convergence of different stakeholders into a common decision. This task is even more delicate when the assessment is carried out in early stage of development processes, when the maturity of the technology prevents conducting a large scale trials to evaluate the cost effectiveness through classic health economics methods. This lack of information may limit the future development and deployment in the clinical practice. This work aims to 1) identify the most relevant user needs of a new medical technology for managing and monitoring Parkinson's Disease (PD) patients and to 2) use these user needs for a preliminary assessment of a specific system called PERFORM, as a case study. Methods Analytic Hierarchy Process (AHP) was used to design a hierarchy of 17 needs, grouped into 5 categories. A total of 16 experts, 6 of them with a clinical background and the remaining 10 with a technical background, were asked to rank these needs and categories. Results On/Off fluctuations detection, Increase wearability acceptance, and Increase self-management support have been identified as the most relevant user needs. No significant differences were found between the clinician and technical groups. These results have been used to evaluate the PERFORM system and to identify future areas of improvement. Conclusions First of all, the AHP contributed to the elaboration of a unified hierarchy, integrating the needs of a variety of stakeholders, promoting the discussion and the agreement into a common framework of evaluation. Moreover, the AHP effectively supported the user need elicitation as well as the assignment of different weights and priorities to each need and, consequently, it helped to define a framework for the assessment of telehealth systems for PD management and monitoring. This framework can be used to support the decision-making process for the adoption of new technologies in PD. PMID:26391847

Analysis of airframe/engine interactions in integrated flight and propulsion control

NASA Technical Reports Server (NTRS)

Schierman, John D.; Schmidt, David K.

1991-01-01

An analysis framework for the assessment of dynamic cross-coupling between airframe and engine systems from the perspective of integrated flight/propulsion control is presented. This analysis involves to determining the significance of the interactions with respect to deterioration in stability robustness and performance, as well as critical frequency ranges where problems may occur due to these interactions. The analysis illustrated here investigates both the airframe's effects on the engine control loops and the engine's effects on the airframe control loops in two case studies. The second case study involves a multi-input/multi-output analysis of the airframe. Sensitivity studies are performed on critical interactions to examine the degradations in the system's stability robustness and performance. Magnitudes of the interactions required to cause instabilities, as well as the frequencies at which the instabilities occur are recorded. Finally, the analysis framework is expanded to include control laws which contain cross-feeds between the airframe and engine systems.

A Simulation Environment for Benchmarking Sensor Fusion-Based Pose Estimators.

PubMed

Ligorio, Gabriele; Sabatini, Angelo Maria

2015-12-19

In-depth analysis and performance evaluation of sensor fusion-based estimators may be critical when performed using real-world sensor data. For this reason, simulation is widely recognized as one of the most powerful tools for algorithm benchmarking. In this paper, we present a simulation framework suitable for assessing the performance of sensor fusion-based pose estimators. The systems used for implementing the framework were magnetic/inertial measurement units (MIMUs) and a camera, although the addition of further sensing modalities is straightforward. Typical nuisance factors were also included for each sensor. The proposed simulation environment was validated using real-life sensor data employed for motion tracking. The higher mismatch between real and simulated sensors was about 5% of the measured quantity (for the camera simulation), whereas a lower correlation was found for an axis of the gyroscope (0.90). In addition, a real benchmarking example of an extended Kalman filter for pose estimation from MIMU and camera data is presented.

Fine grained recognition of masonry walls for built heritage assessment

NASA Astrophysics Data System (ADS)

Oses, N.; Dornaika, F.; Moujahid, A.

2015-01-01

This paper presents the ground work carried out to achieve automatic fine grained recognition of stone masonry. This is a necessary first step in the development of the analysis tool. The built heritage that will be assessed consists of stone masonry constructions and many of the features analysed can be characterized according to the geometry and arrangement of the stones. Much of the assessment is carried out through visual inspection. Thus, we apply image processing on digital images of the elements under inspection. The main contribution of the paper is the performance evaluation of the automatic categorization of masonry walls from a set of extracted straight line segments. The element chosen to perform this evaluation is the stone arrangement of masonry walls. The validity of the proposed framework is assessed on real images of masonry walls using machine learning paradigms. These include classifiers as well as automatic feature selection.

Framework for an Effective Assessment and Accountability Program: The Philadelphia Example

ERIC Educational Resources Information Center

Porter, Andrew C.; Chester, Mitchell D.; Schlesinger, Michael D.

2004-01-01

The purpose of this article is to put in the hands of researchers, practitioners, and policy makers a powerful framework for building and studying the effects of high-quality assessment and accountability programs. The framework is illustrated through a description and analysis of the assessment and accountability program in the School District of…

Science Framework for the 2009 National Assessment of Educational Progress

ERIC Educational Resources Information Center

National Assessment Governing Board, 2008

2008-01-01

This document sets forth recommendations for the design of a new science assessment. The assessment resulting from this framework will start a new NAEP science trend (i.e., measure of student progress in science) beginning in 2009. This framework represents a unique opportunity to build on previous NAEP science work as well as key developments in…

Assessing Team Leadership in Emergency Medicine: The Milestones and Beyond

PubMed Central

Rosenman, Elizabeth D.; Branzetti, Jeremy B.; Fernandez, Rosemarie

2016-01-01

Background Team leadership is a critical skill for emergency medicine physicians that directly affects team performance and the quality of patient care. There exists a robust body of team science research supporting team leadership conceptual models and behavioral skill sets. However, to date, this work has not been widely incorporated into health care team leadership education. Objective This narrative review has 3 aims: (1) to synthesize the team science literature and to translate important concepts and models to health care team leadership; (2) to describe how team leadership is currently represented in the health care literature and in the Accreditation Council for Graduate Medical Education Milestones for emergency medicine; and (3) to propose a novel, evidence-based framework for the assessment of team leadership in emergency medicine. Methods We conducted a narrative review of the team science and health care literature. We summarized our findings and identified a list of team leadership behaviors that were then used to create a framework for team leadership assessment. Results Current health care team leadership measurement tools do not incorporate evidence-based models of leadership concepts from other established domains. The emergency medicine milestones include several team leadership behaviors as part of a larger resident evaluation program. However, they do not offer a comprehensive or cohesive representation of the team leadership construct. Conclusions Despite the importance of team leadership to patient care, there is no standardized approach to team leadership assessment in emergency medicine. Based on the results of our review, we propose a novel team leadership assessment framework that is supported by the team science literature. PMID:27413434

Assessing Team Leadership in Emergency Medicine: The Milestones and Beyond.

PubMed

Rosenman, Elizabeth D; Branzetti, Jeremy B; Fernandez, Rosemarie

2016-07-01

Team leadership is a critical skill for emergency medicine physicians that directly affects team performance and the quality of patient care. There exists a robust body of team science research supporting team leadership conceptual models and behavioral skill sets. However, to date, this work has not been widely incorporated into health care team leadership education. This narrative review has 3 aims: (1) to synthesize the team science literature and to translate important concepts and models to health care team leadership; (2) to describe how team leadership is currently represented in the health care literature and in the Accreditation Council for Graduate Medical Education Milestones for emergency medicine; and (3) to propose a novel, evidence-based framework for the assessment of team leadership in emergency medicine. We conducted a narrative review of the team science and health care literature. We summarized our findings and identified a list of team leadership behaviors that were then used to create a framework for team leadership assessment. Current health care team leadership measurement tools do not incorporate evidence-based models of leadership concepts from other established domains. The emergency medicine milestones include several team leadership behaviors as part of a larger resident evaluation program. However, they do not offer a comprehensive or cohesive representation of the team leadership construct. Despite the importance of team leadership to patient care, there is no standardized approach to team leadership assessment in emergency medicine. Based on the results of our review, we propose a novel team leadership assessment framework that is supported by the team science literature.

Ecological speciation in the tropics: insights from comparative genetic studies in Amazonia

PubMed Central

Beheregaray, Luciano B.; Cooke, Georgina M.; Chao, Ning L.; Landguth, Erin L.

2015-01-01

Evolution creates and sustains biodiversity via adaptive changes in ecologically relevant traits. Ecologically mediated selection contributes to genetic divergence both in the presence or absence of geographic isolation between populations, and is considered an important driver of speciation. Indeed, the genetics of ecological speciation is becoming increasingly studied across a variety of taxa and environments. In this paper we review the literature of ecological speciation in the tropics. We report on low research productivity in tropical ecosystems and discuss reasons accounting for the rarity of studies. We argue for research programs that simultaneously address biogeographical and taxonomic questions in the tropics, while effectively assessing relationships between reproductive isolation and ecological divergence. To contribute toward this goal, we propose a new framework for ecological speciation that integrates information from phylogenetics, phylogeography, population genomics, and simulations in evolutionary landscape genetics (ELG). We introduce components of the framework, describe ELG simulations (a largely unexplored approach in ecological speciation), and discuss design and experimental feasibility within the context of tropical research. We then use published genetic datasets from populations of five codistributed Amazonian fish species to assess the performance of the framework in studies of tropical speciation. We suggest that these approaches can assist in distinguishing the relative contribution of natural selection from biogeographic history in the origin of biodiversity, even in complex ecosystems such as Amazonia. We also discuss on how to assess ecological speciation using ELG simulations that include selection. These integrative frameworks have considerable potential to enhance conservation management in biodiversity rich ecosystems and to complement historical biogeographic and evolutionary studies of tropical biotas. PMID:25653668

The application of data mining and cloud computing techniques in data-driven models for structural health monitoring

NASA Astrophysics Data System (ADS)

Khazaeli, S.; Ravandi, A. G.; Banerji, S.; Bagchi, A.

2016-04-01

Recently, data-driven models for Structural Health Monitoring (SHM) have been of great interest among many researchers. In data-driven models, the sensed data are processed to determine the structural performance and evaluate the damages of an instrumented structure without necessitating the mathematical modeling of the structure. A framework of data-driven models for online assessment of the condition of a structure has been developed here. The developed framework is intended for automated evaluation of the monitoring data and structural performance by the Internet technology and resources. The main challenges in developing such framework include: (a) utilizing the sensor measurements to estimate and localize the induced damage in a structure by means of signal processing and data mining techniques, and (b) optimizing the computing and storage resources with the aid of cloud services. The main focus in this paper is to demonstrate the efficiency of the proposed framework for real-time damage detection of a multi-story shear-building structure in two damage scenarios (change in mass and stiffness) in various locations. Several features are extracted from the sensed data by signal processing techniques and statistical methods. Machine learning algorithms are deployed to select damage-sensitive features as well as classifying the data to trace the anomaly in the response of the structure. Here, the cloud computing resources from Amazon Web Services (AWS) have been used to implement the proposed framework.

A Source-Term Based Boundary Layer Bleed/Effusion Model for Passive Shock Control

NASA Technical Reports Server (NTRS)

Baurle, Robert A.; Norris, Andrew T.

2011-01-01

A modeling framework for boundary layer effusion has been developed based on the use of source (or sink) terms instead of the usual practice of specifying bleed directly as a boundary condition. This framework allows the surface boundary condition (i.e. isothermal wall, adiabatic wall, slip wall, etc.) to remain unaltered in the presence of bleed. This approach also lends itself to easily permit the addition of empirical models for second order effects that are not easily accounted for by simply defining effective transpiration values. Two effusion models formulated for supersonic flows have been implemented into this framework; the Doerffer/Bohning law and the Slater formulation. These models were applied to unit problems that contain key aspects of the flow physics applicable to bleed systems designed for hypersonic air-breathing propulsion systems. The ability of each model to predict bulk bleed properties was assessed, as well as the response of the boundary layer as it passes through and downstream of a porous bleed system. The model assessment was performed with and without the presence of shock waves. Three-dimensional CFD simulations that included the geometric details of the porous plate bleed systems were also carried out to supplement the experimental data, and provide additional insights into the bleed flow physics. Overall, both bleed formulations fared well for the tests performed in this study. However, the sample of test problems considered in this effort was not large enough to permit a comprehensive validation of the models.